2023-11-24T07:51:51.305 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-24T07:51:51.305 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} --name rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584 -- /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584/orig.config.yaml 2023-11-24T07:51:51.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T07:51:51.430 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} email: null first_in_suite: false job_id: '7465584' kernel: client: sha1: distro flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-tests sha1: 73843baf45f8a92d8e3fcbea3f024c97e73036da owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9764 sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-tests suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 73843baf45f8a92d8e3fcbea3f024c97e73036da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-24_07:31:48 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-24T07:51:51.431 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa; will attempt to use it 2023-11-24T07:51:51.431 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks 2023-11-24T07:51:51.432 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-24T07:51:51.433 INFO:teuthology.task.internal:Checking packages... 2023-11-24T07:51:51.458 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a13ea5ff00cb4df7a9cc941166ddeb358881144c' 2023-11-24T07:51:51.458 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-24T07:51:51.458 INFO:teuthology.packaging:ref: None 2023-11-24T07:51:51.458 INFO:teuthology.packaging:tag: None 2023-11-24T07:51:51.458 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-24T07:51:51.458 INFO:teuthology.packaging:sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:51:51.458 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-24T07:51:51.605 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484.ga13ea5ff 2023-11-24T07:51:51.605 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-24T07:51:51.611 INFO:teuthology.task.internal:no buildpackages task found 2023-11-24T07:51:51.613 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-24T07:51:51.629 INFO:teuthology.task.internal:Saving configuration 2023-11-24T07:51:51.647 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-24T07:51:51.653 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T07:51:51.678 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:46:28.729235', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-24T07:51:51.703 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:46:28.727264', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-24T07:51:51.703 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-24T07:51:51.711 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-24T07:51:51.712 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-24T07:51:51.712 INFO:teuthology.run_tasks:Running task console_log... 2023-11-24T07:51:51.785 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f99a57a9b80>, signals=[15]) 2023-11-24T07:51:51.786 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-24T07:51:51.793 INFO:teuthology.task.internal:Opening connections... 2023-11-24T07:51:51.794 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T07:51:51.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:51:51.863 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T07:51:51.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:51:51.934 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-24T07:51:51.941 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-11-24T07:51:51.962 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-11-24T07:51:51.962 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-11-24T07:51:52.021 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux" 2023-11-24T07:51:52.021 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)" 2023-11-24T07:51:52.021 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel" 2023-11-24T07:51:52.022 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora" 2023-11-24T07:51:52.022 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6" 2023-11-24T07:51:52.022 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-11-24T07:51:52.022 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-24T07:51:52.023 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-11-24T07:51:52.023 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-24T07:51:52.023 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/" 2023-11-24T07:51:52.023 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-24T07:51:52.023 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T07:51:52.023 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T07:51:52.024 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-24T07:51:52.024 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-24T07:51:52.024 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-24T07:51:52.024 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-24T07:51:52.025 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-11-24T07:51:52.053 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2023-11-24T07:51:52.072 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2023-11-24T07:51:52.073 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-11-24T07:51:52.135 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2023-11-24T07:51:52.135 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)" 2023-11-24T07:51:52.135 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2023-11-24T07:51:52.135 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2023-11-24T07:51:52.135 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6" 2023-11-24T07:51:52.135 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-11-24T07:51:52.135 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-24T07:51:52.135 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-11-24T07:51:52.136 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-24T07:51:52.136 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2023-11-24T07:51:52.136 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-24T07:51:52.136 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T07:51:52.136 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T07:51:52.136 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-24T07:51:52.136 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-24T07:51:52.136 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-24T07:51:52.137 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-24T07:51:52.137 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-11-24T07:51:52.161 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-24T07:51:52.170 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-24T07:51:52.271 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-24T07:51:52.271 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2023-11-24T07:51:52.273 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2023-11-24T07:51:52.292 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-24T07:51:52.298 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-24T07:51:52.298 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2023-11-24T07:51:52.332 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2023-11-24T07:51:52.383 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-24T07:51:52.436 INFO:teuthology.run_tasks:Running task kernel... 2023-11-24T07:51:52.454 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-24T07:51:52.454 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-11-24T07:51:52.455 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-11-24T07:51:52.455 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T07:51:52.456 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T07:51:52.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:51:52.475 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-11-24T07:51:52.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:51:52.477 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2023-11-24T07:51:52.534 INFO:teuthology.orchestra.run.smithi153.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-24T07:51:52.534 INFO:teuthology.task.kernel:Running kernel on smithi153: 4.18.0-372.9.1.el8.x86_64 2023-11-24T07:51:52.534 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum install -y kernel 2023-11-24T07:51:52.540 INFO:teuthology.orchestra.run.smithi164.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-24T07:51:52.540 INFO:teuthology.task.kernel:Running kernel on smithi164: 4.18.0-372.9.1.el8.x86_64 2023-11-24T07:51:52.540 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum install -y kernel 2023-11-24T07:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2023-11-24T07:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:Unable to read consumer identity 2023-11-24T07:51:53.823 INFO:teuthology.orchestra.run.smithi164.stdout:Updating Subscription Management repositories. 2023-11-24T07:51:53.823 INFO:teuthology.orchestra.run.smithi164.stdout:Unable to read consumer identity 2023-11-24T07:51:55.386 INFO:teuthology.orchestra.run.smithi164.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-11-24T07:51:55.429 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-11-24T07:51:56.761 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-11-24T07:51:57.371 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 16 MB 00:01 2023-11-24T07:52:00.681 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 340 kB/s | 24 kB 00:00 2023-11-24T07:52:00.846 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 450 kB/s | 24 kB 00:00 2023-11-24T07:52:01.397 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-24T07:52:01.452 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2023-11-24T07:52:01.453 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2023-11-24T07:52:01.453 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2023-11-24T07:52:01.573 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-24T07:52:01.587 DEBUG:teuthology.orchestra.run.smithi164:> echo no | sudo yum reinstall kernel || true 2023-11-24T07:52:01.637 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-24T07:52:01.638 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-11-24T07:52:01.639 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-24T07:52:01.757 DEBUG:teuthology.orchestra.run.smithi153:> echo no | sudo yum reinstall kernel || true 2023-11-24T07:52:01.917 INFO:teuthology.orchestra.run.smithi164.stdout:Updating Subscription Management repositories. 2023-11-24T07:52:01.917 INFO:teuthology.orchestra.run.smithi164.stdout:Unable to read consumer identity 2023-11-24T07:52:02.091 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2023-11-24T07:52:02.091 INFO:teuthology.orchestra.run.smithi153.stdout:Unable to read consumer identity 2023-11-24T07:52:02.184 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:02 ago on Fri 24 Nov 2023 07:52:00 AM UTC. 2023-11-24T07:52:02.236 INFO:teuthology.orchestra.run.smithi164.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-24T07:52:02.262 INFO:teuthology.orchestra.run.smithi164.stderr:Error: No packages marked for reinstall. 2023-11-24T07:52:02.310 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum reinstall -y kernel || true 2023-11-24T07:52:02.364 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:02 ago on Fri 24 Nov 2023 07:52:00 AM UTC. 2023-11-24T07:52:02.404 INFO:teuthology.orchestra.run.smithi153.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-24T07:52:02.437 INFO:teuthology.orchestra.run.smithi153.stderr:Error: No packages marked for reinstall. 2023-11-24T07:52:02.484 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum reinstall -y kernel || true 2023-11-24T07:52:02.639 INFO:teuthology.orchestra.run.smithi164.stdout:Updating Subscription Management repositories. 2023-11-24T07:52:02.640 INFO:teuthology.orchestra.run.smithi164.stdout:Unable to read consumer identity 2023-11-24T07:52:02.816 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2023-11-24T07:52:02.816 INFO:teuthology.orchestra.run.smithi153.stdout:Unable to read consumer identity 2023-11-24T07:52:02.901 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:02 ago on Fri 24 Nov 2023 07:52:00 AM UTC. 2023-11-24T07:52:02.941 INFO:teuthology.orchestra.run.smithi164.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-24T07:52:02.978 INFO:teuthology.orchestra.run.smithi164.stderr:Error: No packages marked for reinstall. 2023-11-24T07:52:03.024 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2023-11-24T07:52:03.076 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:03 ago on Fri 24 Nov 2023 07:52:00 AM UTC. 2023-11-24T07:52:03.104 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-24T07:52:03.104 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-24T07:52:03.105 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-24T07:52:03.105 DEBUG:teuthology.parallel:result is None 2023-11-24T07:52:03.116 INFO:teuthology.orchestra.run.smithi153.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-24T07:52:03.137 INFO:teuthology.orchestra.run.smithi153.stderr:Error: No packages marked for reinstall. 2023-11-24T07:52:03.188 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2023-11-24T07:52:03.268 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-24T07:52:03.269 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-24T07:52:03.269 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-24T07:52:03.269 DEBUG:teuthology.parallel:result is None 2023-11-24T07:52:03.269 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-24T07:52:03.276 INFO:teuthology.task.internal:Creating test directory... 2023-11-24T07:52:03.276 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T07:52:03.278 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T07:52:03.295 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-24T07:52:03.302 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-24T07:52:03.308 INFO:teuthology.task.internal:Creating archive directory... 2023-11-24T07:52:03.308 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T07:52:03.336 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T07:52:03.364 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-24T07:52:03.371 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-24T07:52:03.371 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T07:52:03.393 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T07:52:03.419 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:52:03.438 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:52:03.440 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:52:03.457 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:52:03.458 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-24T07:52:03.466 INFO:teuthology.task.internal:Configuring sudo... 2023-11-24T07:52:03.466 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T07:52:03.481 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T07:52:03.525 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-24T07:52:03.534 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-24T07:52:03.534 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T07:52:03.548 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T07:52:03.582 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:52:03.641 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:52:03.697 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:52:03.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:52:03.822 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T07:52:03.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T07:52:03.890 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:52:03.932 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:52:03.983 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:52:04.067 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:52:04.109 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T07:52:04.109 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T07:52:04.175 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2023-11-24T07:52:04.178 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2023-11-24T07:52:04.232 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T07:52:04.282 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T07:52:04.626 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-24T07:52:04.634 INFO:teuthology.task.internal:Starting timer... 2023-11-24T07:52:04.634 INFO:teuthology.run_tasks:Running task pcp... 2023-11-24T07:52:04.644 INFO:teuthology.run_tasks:Running task selinux... 2023-11-24T07:52:04.653 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-11-24T07:52:04.653 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2023-11-24T07:52:04.713 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2023-11-24T07:52:04.715 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2023-11-24T07:52:04.776 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2023-11-24T07:52:04.778 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-24T07:52:04.778 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2023-11-24T07:52:04.804 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2023-11-24T07:52:04.804 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2023-11-24T07:52:04.828 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2023-11-24T07:52:04.829 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi153.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2023-11-24T07:52:04.829 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T07:52:04.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:52:04.872 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T07:52:04.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:52:04.899 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-24T07:52:04.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2023-11-24T07:52:04.938 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2023-11-24T07:52:04.967 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-24T07:52:04.977 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-24T07:52:04.982 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-24T07:52:05.109 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-24T07:52:05.126 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-24T07:52:05.127 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi153.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-24T08:00:59.836 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi153.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2023-11-24T08:00:59.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-11-24T08:00:59.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T08:00:59.910 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-11-24T08:00:59.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-11-24T08:00:59.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-11-24T08:00:59.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T08:01:00.044 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-11-24T08:01:00.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-11-24T08:01:00.114 INFO:teuthology.run_tasks:Running task clock... 2023-11-24T08:01:00.128 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-24T08:01:00.128 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T08:01:00.129 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T08:01:00.132 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:01:00.161 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T08:01:00.176 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T08:01:00.188 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T08:01:00.203 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T08:01:00.249 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2023-11-24T08:01:00.261 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2023-11-24T08:01:00.275 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2023-11-24T08:01:00.275 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T08:01:00.287 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2023-11-24T08:01:00.289 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T08:01:00.302 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T08:01:00.317 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T08:01:00.378 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2023-11-24T08:01:00.382 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T08:01:00.382 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-11-24T08:01:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:01:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:01:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:01:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:01:00.398 INFO:teuthology.orchestra.run.smithi164.stderr:bash: ntpq: command not found 2023-11-24T08:01:00.402 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T08:01:00.402 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2023-11-24T08:01:00.402 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:01:00.402 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:01:00.402 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:01:00.403 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:01:00.403 INFO:teuthology.run_tasks:Running task install... 2023-11-24T08:01:00.412 DEBUG:teuthology.task.install:project ceph 2023-11-24T08:01:00.412 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}} 2023-11-24T08:01:00.412 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'} 2023-11-24T08:01:00.412 INFO:teuthology.task.install:Using flavor: default 2023-11-24T08:01:00.417 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-24T08:01:00.418 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-24T08:01:00.418 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T08:01:00.418 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:01:00.420 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T08:01:00.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:01:00.574 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/ 2023-11-24T08:01:00.574 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T08:01:00.644 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/ 2023-11-24T08:01:00.644 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T08:01:00.700 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T08:01:00.700 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:01:00.701 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T08:01:00.729 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T08:01:00.730 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T08:01:00.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T08:01:00.811 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T08:01:00.812 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:01:00.812 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T08:01:00.840 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T08:01:00.841 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T08:01:00.875 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T08:01:00.909 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T08:01:00.941 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2023-11-24T08:01:00.942 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2023-11-24T08:01:00.986 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T08:01:01.052 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2023-11-24T08:01:01.053 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2023-11-24T08:01:01.319 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2023-11-24T08:01:01.425 INFO:teuthology.orchestra.run.smithi164.stdout:Updating Subscription Management repositories. 2023-11-24T08:01:01.580 INFO:teuthology.orchestra.run.smithi153.stdout:44 files removed 2023-11-24T08:01:01.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T08:01:01.681 INFO:teuthology.orchestra.run.smithi164.stdout:44 files removed 2023-11-24T08:01:01.727 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T08:01:01.961 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2023-11-24T08:01:02.067 INFO:teuthology.orchestra.run.smithi164.stdout:Updating Subscription Management repositories. 2023-11-24T08:01:02.600 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 271 kB/s | 81 kB 00:00 2023-11-24T08:01:02.664 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 317 kB/s | 81 kB 00:00 2023-11-24T08:01:02.880 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 38 kB/s | 9.5 kB 00:00 2023-11-24T08:01:03.016 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 30 kB/s | 9.5 kB 00:00 2023-11-24T08:01:03.226 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2023-11-24T08:01:03.358 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2023-11-24T08:01:03.544 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-11-24T08:01:03.575 INFO:teuthology.orchestra.run.smithi164.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-11-24T08:01:04.604 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-11-24T08:01:08.118 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 486 kB/s | 24 kB 00:00 2023-11-24T08:01:09.045 INFO:teuthology.orchestra.run.smithi164.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-11-24T08:01:11.438 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 2.0 MB/s | 16 MB 00:07 2023-11-24T08:01:14.977 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 369 kB/s | 24 kB 00:00 2023-11-24T08:01:15.879 INFO:teuthology.orchestra.run.smithi153.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-11-24T08:01:17.021 INFO:teuthology.orchestra.run.smithi164.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 57 MB/s | 53 MB 00:00 2023-11-24T08:01:23.838 INFO:teuthology.orchestra.run.smithi153.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-11-24T08:01:28.118 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-24T08:01:28.119 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-24T08:01:28.134 INFO:teuthology.orchestra.run.smithi164.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-24T08:01:28.135 INFO:teuthology.orchestra.run.smithi164.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-24T08:01:28.136 INFO:teuthology.orchestra.run.smithi164.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-24T08:01:28.137 INFO:teuthology.orchestra.run.smithi164.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-24T08:01:28.139 INFO:teuthology.orchestra.run.smithi164.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-24T08:01:28.142 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-24T08:01:28.144 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-24T08:01:28.278 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2023-11-24T08:01:28.291 INFO:teuthology.orchestra.run.smithi164.stdout:=========================================================================================================================== 2023-11-24T08:01:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2023-11-24T08:01:28.291 INFO:teuthology.orchestra.run.smithi164.stdout:=========================================================================================================================== 2023-11-24T08:01:28.291 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2023-11-24T08:01:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-24T08:01:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-24T08:01:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 6.4 k 2023-11-24T08:01:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 5.4 M 2023-11-24T08:01:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 920 k 2023-11-24T08:01:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 171 k 2023-11-24T08:01:28.291 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 1.6 M 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 133 k 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 1.8 M 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 7.4 M 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 50 k 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 14 M 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 49 M 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 262 k 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 407 k 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 262 k 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 18 k 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-24T08:01:28.292 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 31 k 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 839 k 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 139 k 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 197 k 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 371 k 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 364 k 2023-11-24T08:01:28.293 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 107 k 2023-11-24T08:01:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 94 k 2023-11-24T08:01:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.6 M 2023-11-24T08:01:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 181 k 2023-11-24T08:01:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-24T08:01:28.294 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2023-11-24T08:01:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-24T08:01:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.8 M 2023-11-24T08:01:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.7 M 2023-11-24T08:01:28.294 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2023-11-24T08:01:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-24T08:01:28.294 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 23 M 2023-11-24T08:01:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 28 k 2023-11-24T08:01:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 2.3 M 2023-11-24T08:01:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 243 k 2023-11-24T08:01:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 4.6 M 2023-11-24T08:01:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 18 M 2023-11-24T08:01:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 15 k 2023-11-24T08:01:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 24 k 2023-11-24T08:01:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-24T08:01:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-24T08:01:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-24T08:01:28.295 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 183 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 517 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 6.9 M 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-24T08:01:28.296 INFO:teuthology.orchestra.run.smithi164.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-24T08:01:28.297 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-24T08:01:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-24T08:01:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-24T08:01:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 45 k 2023-11-24T08:01:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 128 k 2023-11-24T08:01:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-24T08:01:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-24T08:01:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-24T08:01:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-24T08:01:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-24T08:01:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-24T08:01:28.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-24T08:01:28.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-24T08:01:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-24T08:01:28.301 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout:Enabling module streams: 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql 10 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout:=========================================================================================================================== 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout:Install 128 Packages 2023-11-24T08:01:28.302 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 3 Packages 2023-11-24T08:01:28.303 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:01:28.303 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 209 M 2023-11-24T08:01:28.303 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2023-11-24T08:01:28.463 INFO:teuthology.orchestra.run.smithi164.stdout:(1/131): ceph-18.0.0-7484.ga13ea5ff.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2023-11-24T08:01:28.680 INFO:teuthology.orchestra.run.smithi164.stdout:(2/131): ceph-fuse-18.0.0-7484.ga13ea5ff.el8.x8 4.1 MB/s | 920 kB 00:00 2023-11-24T08:01:28.746 INFO:teuthology.orchestra.run.smithi164.stdout:(3/131): ceph-immutable-object-cache-18.0.0-748 2.5 MB/s | 171 kB 00:00 2023-11-24T08:01:29.030 INFO:teuthology.orchestra.run.smithi164.stdout:(4/131): ceph-mds-18.0.0-7484.ga13ea5ff.el8.x86 8.2 MB/s | 2.3 MB 00:00 2023-11-24T08:01:29.205 INFO:teuthology.orchestra.run.smithi164.stdout:(5/131): ceph-mgr-18.0.0-7484.ga13ea5ff.el8.x86 9.3 MB/s | 1.6 MB 00:00 2023-11-24T08:01:29.633 INFO:teuthology.orchestra.run.smithi164.stdout:(6/131): ceph-mon-18.0.0-7484.ga13ea5ff.el8.x86 11 MB/s | 4.6 MB 00:00 2023-11-24T08:01:29.706 INFO:teuthology.orchestra.run.smithi164.stdout:(7/131): ceph-base-18.0.0-7484.ga13ea5ff.el8.x8 3.9 MB/s | 5.4 MB 00:01 2023-11-24T08:01:31.090 INFO:teuthology.orchestra.run.smithi164.stdout:(8/131): ceph-osd-18.0.0-7484.ga13ea5ff.el8.x86 12 MB/s | 18 MB 00:01 2023-11-24T08:01:31.123 INFO:teuthology.orchestra.run.smithi164.stdout:(9/131): ceph-selinux-18.0.0-7484.ga13ea5ff.el8 738 kB/s | 24 kB 00:00 2023-11-24T08:01:32.398 INFO:teuthology.orchestra.run.smithi164.stdout:(10/131): ceph-common-18.0.0-7484.ga13ea5ff.el8 5.6 MB/s | 23 MB 00:04 2023-11-24T08:01:32.574 INFO:teuthology.orchestra.run.smithi164.stdout:(11/131): ceph-radosgw-18.0.0-7484.ga13ea5ff.el 4.8 MB/s | 14 MB 00:02 2023-11-24T08:01:32.599 INFO:teuthology.orchestra.run.smithi164.stdout:(12/131): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 1.3 MB/s | 262 kB 00:00 2023-11-24T08:01:32.632 INFO:teuthology.orchestra.run.smithi164.stdout:(13/131): libcephfs-devel-18.0.0-7484.ga13ea5ff 532 kB/s | 31 kB 00:00 2023-11-24T08:01:32.709 INFO:teuthology.orchestra.run.smithi164.stdout:(14/131): libcephsqlite-18.0.0-7484.ga13ea5ff.e 2.4 MB/s | 183 kB 00:00 2023-11-24T08:01:32.791 INFO:teuthology.orchestra.run.smithi164.stdout:(15/131): libcephfs2-18.0.0-7484.ga13ea5ff.el8. 4.3 MB/s | 839 kB 00:00 2023-11-24T08:01:32.841 INFO:teuthology.orchestra.run.smithi164.stdout:(16/131): librados-devel-18.0.0-7484.ga13ea5ff. 1.0 MB/s | 139 kB 00:00 2023-11-24T08:01:32.950 INFO:teuthology.orchestra.run.smithi164.stdout:(17/131): libradosstriper1-18.0.0-7484.ga13ea5f 3.2 MB/s | 517 kB 00:00 2023-11-24T08:01:33.034 INFO:teuthology.orchestra.run.smithi164.stdout:(18/131): python3-ceph-argparse-18.0.0-7484.ga1 538 kB/s | 45 kB 00:00 2023-11-24T08:01:33.134 INFO:teuthology.orchestra.run.smithi164.stdout:(19/131): python3-ceph-common-18.0.0-7484.ga13e 1.3 MB/s | 128 kB 00:00 2023-11-24T08:01:33.226 INFO:teuthology.orchestra.run.smithi164.stdout:(20/131): python3-cephfs-18.0.0-7484.ga13ea5ff. 2.1 MB/s | 197 kB 00:00 2023-11-24T08:01:33.326 INFO:teuthology.orchestra.run.smithi164.stdout:(21/131): python3-rados-18.0.0-7484.ga13ea5ff.e 3.6 MB/s | 371 kB 00:00 2023-11-24T08:01:33.435 INFO:teuthology.orchestra.run.smithi164.stdout:(22/131): python3-rbd-18.0.0-7484.ga13ea5ff.el8 3.3 MB/s | 364 kB 00:00 2023-11-24T08:01:33.527 INFO:teuthology.orchestra.run.smithi164.stdout:(23/131): python3-rgw-18.0.0-7484.ga13ea5ff.el8 1.1 MB/s | 107 kB 00:00 2023-11-24T08:01:33.619 INFO:teuthology.orchestra.run.smithi164.stdout:(24/131): rbd-fuse-18.0.0-7484.ga13ea5ff.el8.x8 1.0 MB/s | 94 kB 00:00 2023-11-24T08:01:34.328 INFO:teuthology.orchestra.run.smithi164.stdout:(25/131): ceph-test-18.0.0-7484.ga13ea5ff.el8.x 15 MB/s | 49 MB 00:03 2023-11-24T08:01:34.428 INFO:teuthology.orchestra.run.smithi164.stdout:(26/131): librgw2-18.0.0-7484.ga13ea5ff.el8.x86 4.4 MB/s | 6.9 MB 00:01 2023-11-24T08:01:34.453 INFO:teuthology.orchestra.run.smithi164.stdout:(27/131): rbd-nbd-18.0.0-7484.ga13ea5ff.el8.x86 1.4 MB/s | 181 kB 00:00 2023-11-24T08:01:34.512 INFO:teuthology.orchestra.run.smithi164.stdout:(28/131): rbd-mirror-18.0.0-7484.ga13ea5ff.el8. 4.0 MB/s | 3.6 MB 00:00 2023-11-24T08:01:34.559 INFO:teuthology.orchestra.run.smithi164.stdout:(29/131): ceph-grafana-dashboards-18.0.0-7484.g 214 kB/s | 28 kB 00:00 2023-11-24T08:01:34.587 INFO:teuthology.orchestra.run.smithi164.stdout:(30/131): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 991 kB/s | 133 kB 00:00 2023-11-24T08:01:34.629 INFO:teuthology.orchestra.run.smithi164.stdout:(31/131): ceph-mgr-modules-core-18.0.0-7484.ga1 5.7 MB/s | 243 kB 00:00 2023-11-24T08:01:34.671 INFO:teuthology.orchestra.run.smithi164.stdout:(32/131): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 1.2 MB/s | 50 kB 00:00 2023-11-24T08:01:34.713 INFO:teuthology.orchestra.run.smithi164.stdout:(33/131): ceph-prometheus-alerts-18.0.0-7484.ga 361 kB/s | 15 kB 00:00 2023-11-24T08:01:34.755 INFO:teuthology.orchestra.run.smithi164.stdout:(34/131): ceph-mgr-dashboard-18.0.0-7484.ga13ea 7.2 MB/s | 1.8 MB 00:00 2023-11-24T08:01:34.780 INFO:teuthology.orchestra.run.smithi164.stdout:(35/131): ceph-volume-18.0.0-7484.ga13ea5ff.el8 3.8 MB/s | 262 kB 00:00 2023-11-24T08:01:34.853 INFO:teuthology.orchestra.run.smithi164.stdout:(36/131): cephadm-18.0.0-7484.ga13ea5ff.el8.noa 4.1 MB/s | 407 kB 00:00 2023-11-24T08:01:34.872 INFO:teuthology.orchestra.run.smithi164.stdout:(37/131): cephfs-top-18.0.0-7484.ga13ea5ff.el8. 197 kB/s | 18 kB 00:00 2023-11-24T08:01:34.964 INFO:teuthology.orchestra.run.smithi164.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 645 kB/s | 59 kB 00:00 2023-11-24T08:01:34.985 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-24T08:01:34.986 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-24T08:01:35.000 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-24T08:01:35.001 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-24T08:01:35.002 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-24T08:01:35.004 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-24T08:01:35.006 INFO:teuthology.orchestra.run.smithi153.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-24T08:01:35.009 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-24T08:01:35.010 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-24T08:01:35.014 INFO:teuthology.orchestra.run.smithi164.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.1 MB/s | 306 kB 00:00 2023-11-24T08:01:35.040 INFO:teuthology.orchestra.run.smithi164.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 996 kB/s | 75 kB 00:00 2023-11-24T08:01:35.107 INFO:teuthology.orchestra.run.smithi164.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 5.1 MB/s | 476 kB 00:00 2023-11-24T08:01:35.142 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-24T08:01:35.149 INFO:teuthology.orchestra.run.smithi164.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 402 kB/s | 44 kB 00:00 2023-11-24T08:01:35.155 INFO:teuthology.orchestra.run.smithi153.stdout:=========================================================================================================================== 2023-11-24T08:01:35.155 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-11-24T08:01:35.155 INFO:teuthology.orchestra.run.smithi153.stdout:=========================================================================================================================== 2023-11-24T08:01:35.155 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-24T08:01:35.155 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-24T08:01:35.155 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-24T08:01:35.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 6.4 k 2023-11-24T08:01:35.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 5.4 M 2023-11-24T08:01:35.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 920 k 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 171 k 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 1.6 M 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 133 k 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 1.8 M 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 7.4 M 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 50 k 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 14 M 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 49 M 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 262 k 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 407 k 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 262 k 2023-11-24T08:01:35.156 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 18 k 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 31 k 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 839 k 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 139 k 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-24T08:01:35.157 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 197 k 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 371 k 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 364 k 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 107 k 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 94 k 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.6 M 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 181 k 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.8 M 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.7 M 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-11-24T08:01:35.158 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-24T08:01:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 23 M 2023-11-24T08:01:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 28 k 2023-11-24T08:01:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 2.3 M 2023-11-24T08:01:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 243 k 2023-11-24T08:01:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 4.6 M 2023-11-24T08:01:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 18 M 2023-11-24T08:01:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 15 k 2023-11-24T08:01:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 24 k 2023-11-24T08:01:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-24T08:01:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-24T08:01:35.160 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-24T08:01:35.160 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-24T08:01:35.160 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-24T08:01:35.160 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 183 k 2023-11-24T08:01:35.160 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-24T08:01:35.160 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-24T08:01:35.160 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-24T08:01:35.160 INFO:teuthology.orchestra.run.smithi153.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-24T08:01:35.160 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-24T08:01:35.160 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-24T08:01:35.160 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 517 k 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 6.9 M 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-24T08:01:35.161 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 45 k 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 128 k 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-24T08:01:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-24T08:01:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-24T08:01:35.164 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-24T08:01:35.165 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout:Enabling module streams: 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql 10 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout:=========================================================================================================================== 2023-11-24T08:01:35.166 INFO:teuthology.orchestra.run.smithi153.stdout:Install 128 Packages 2023-11-24T08:01:35.167 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 3 Packages 2023-11-24T08:01:35.167 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:01:35.167 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 209 M 2023-11-24T08:01:35.167 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-24T08:01:35.174 INFO:teuthology.orchestra.run.smithi164.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2023-11-24T08:01:35.191 INFO:teuthology.orchestra.run.smithi164.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 788 kB/s | 33 kB 00:00 2023-11-24T08:01:35.208 INFO:teuthology.orchestra.run.smithi164.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 487 kB/s | 16 kB 00:00 2023-11-24T08:01:35.258 INFO:teuthology.orchestra.run.smithi164.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 7.6 MB/s | 384 kB 00:00 2023-11-24T08:01:35.284 INFO:teuthology.orchestra.run.smithi164.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-11-24T08:01:35.309 INFO:teuthology.orchestra.run.smithi164.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-11-24T08:01:35.334 INFO:teuthology.orchestra.run.smithi164.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-11-24T08:01:35.359 INFO:teuthology.orchestra.run.smithi164.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2023-11-24T08:01:35.434 INFO:teuthology.orchestra.run.smithi164.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 654 kB/s | 49 kB 00:00 2023-11-24T08:01:35.504 INFO:teuthology.orchestra.run.smithi153.stdout:(1/131): ceph-18.0.0-7484.ga13ea5ff.el8.x86_64. 37 kB/s | 6.4 kB 00:00 2023-11-24T08:01:35.567 INFO:teuthology.orchestra.run.smithi164.stdout:(52/131): ceph-mgr-diskprediction-local-18.0.0- 7.3 MB/s | 7.4 MB 00:01 2023-11-24T08:01:35.661 INFO:teuthology.orchestra.run.smithi164.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 260 kB/s | 59 kB 00:00 2023-11-24T08:01:35.721 INFO:teuthology.orchestra.run.smithi164.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 3.0 MB/s | 1.2 MB 00:00 2023-11-24T08:01:35.753 INFO:teuthology.orchestra.run.smithi164.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 325 kB/s | 60 kB 00:00 2023-11-24T08:01:35.778 INFO:teuthology.orchestra.run.smithi164.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 273 kB/s | 16 kB 00:00 2023-11-24T08:01:35.803 INFO:teuthology.orchestra.run.smithi164.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 672 kB/s | 34 kB 00:00 2023-11-24T08:01:35.829 INFO:teuthology.orchestra.run.smithi164.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-11-24T08:01:35.854 INFO:teuthology.orchestra.run.smithi164.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-11-24T08:01:35.879 INFO:teuthology.orchestra.run.smithi164.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2023-11-24T08:01:35.897 INFO:teuthology.orchestra.run.smithi153.stdout:(2/131): ceph-fuse-18.0.0-7484.ga13ea5ff.el8.x8 2.3 MB/s | 920 kB 00:00 2023-11-24T08:01:35.904 INFO:teuthology.orchestra.run.smithi164.stdout:(61/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-11-24T08:01:35.930 INFO:teuthology.orchestra.run.smithi164.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-11-24T08:01:35.955 INFO:teuthology.orchestra.run.smithi164.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2023-11-24T08:01:36.005 INFO:teuthology.orchestra.run.smithi153.stdout:(3/131): ceph-immutable-object-cache-18.0.0-748 1.5 MB/s | 171 kB 00:00 2023-11-24T08:01:36.013 INFO:teuthology.orchestra.run.smithi164.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 330 kB/s | 27 kB 00:00 2023-11-24T08:01:36.031 INFO:teuthology.orchestra.run.smithi164.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-11-24T08:01:36.056 INFO:teuthology.orchestra.run.smithi164.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-11-24T08:01:36.081 INFO:teuthology.orchestra.run.smithi164.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 914 kB/s | 61 kB 00:00 2023-11-24T08:01:36.106 INFO:teuthology.orchestra.run.smithi153.stdout:(4/131): ceph-base-18.0.0-7484.ga13ea5ff.el8.x8 6.9 MB/s | 5.4 MB 00:00 2023-11-24T08:01:36.106 INFO:teuthology.orchestra.run.smithi164.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 460 kB/s | 23 kB 00:00 2023-11-24T08:01:36.132 INFO:teuthology.orchestra.run.smithi164.stdout:(69/131): python3-webtest-2.0.33-1.el8.noarch.r 849 kB/s | 85 kB 00:00 2023-11-24T08:01:36.148 INFO:teuthology.orchestra.run.smithi164.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-11-24T08:01:36.199 INFO:teuthology.orchestra.run.smithi164.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2023-11-24T08:01:36.247 INFO:teuthology.orchestra.run.smithi153.stdout:(5/131): ceph-mgr-18.0.0-7484.ga13ea5ff.el8.x86 12 MB/s | 1.6 MB 00:00 2023-11-24T08:01:36.307 INFO:teuthology.orchestra.run.smithi164.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 721 kB/s | 110 kB 00:00 2023-11-24T08:01:36.333 INFO:teuthology.orchestra.run.smithi164.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 423 kB/s | 54 kB 00:00 2023-11-24T08:01:36.349 INFO:teuthology.orchestra.run.smithi164.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-11-24T08:01:36.391 INFO:teuthology.orchestra.run.smithi164.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-11-24T08:01:36.416 INFO:teuthology.orchestra.run.smithi164.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 580 kB/s | 39 kB 00:00 2023-11-24T08:01:36.450 INFO:teuthology.orchestra.run.smithi164.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-11-24T08:01:36.484 INFO:teuthology.orchestra.run.smithi164.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2023-11-24T08:01:36.509 INFO:teuthology.orchestra.run.smithi164.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-11-24T08:01:36.534 INFO:teuthology.orchestra.run.smithi164.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-11-24T08:01:36.556 INFO:teuthology.orchestra.run.smithi153.stdout:(6/131): ceph-mds-18.0.0-7484.ga13ea5ff.el8.x86 4.2 MB/s | 2.3 MB 00:00 2023-11-24T08:01:36.593 INFO:teuthology.orchestra.run.smithi164.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 8.4 MB/s | 713 kB 00:00 2023-11-24T08:01:36.615 INFO:teuthology.orchestra.run.smithi153.stdout:(7/131): ceph-mon-18.0.0-7484.ga13ea5ff.el8.x86 13 MB/s | 4.6 MB 00:00 2023-11-24T08:01:36.644 INFO:teuthology.orchestra.run.smithi164.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 528 kB/s | 27 kB 00:00 2023-11-24T08:01:36.685 INFO:teuthology.orchestra.run.smithi164.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.6 MB/s | 320 kB 00:00 2023-11-24T08:01:36.769 INFO:teuthology.orchestra.run.smithi164.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-11-24T08:01:36.794 INFO:teuthology.orchestra.run.smithi164.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 405 kB/s | 44 kB 00:00 2023-11-24T08:01:36.945 INFO:teuthology.orchestra.run.smithi164.stdout:(86/131): python3-scipy-1.0.0-21.module+el8.5.0 17 MB/s | 14 MB 00:00 2023-11-24T08:01:36.978 INFO:teuthology.orchestra.run.smithi164.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.4 MB/s | 457 kB 00:00 2023-11-24T08:01:37.003 INFO:teuthology.orchestra.run.smithi164.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2023-11-24T08:01:37.029 INFO:teuthology.orchestra.run.smithi164.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-11-24T08:01:37.045 INFO:teuthology.orchestra.run.smithi164.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2023-11-24T08:01:37.079 INFO:teuthology.orchestra.run.smithi164.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-11-24T08:01:37.096 INFO:teuthology.orchestra.run.smithi164.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-11-24T08:01:37.163 INFO:teuthology.orchestra.run.smithi164.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-11-24T08:01:37.222 INFO:teuthology.orchestra.run.smithi164.stdout:(94/131): python3-numpy-1.14.3-10.el8.x86_64.rp 8.3 MB/s | 3.7 MB 00:00 2023-11-24T08:01:37.247 INFO:teuthology.orchestra.run.smithi164.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.3 MB/s | 198 kB 00:00 2023-11-24T08:01:37.297 INFO:teuthology.orchestra.run.smithi164.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.9 MB/s | 202 kB 00:00 2023-11-24T08:01:37.347 INFO:teuthology.orchestra.run.smithi164.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-11-24T08:01:37.431 INFO:teuthology.orchestra.run.smithi164.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-11-24T08:01:37.498 INFO:teuthology.orchestra.run.smithi164.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-11-24T08:01:37.532 INFO:teuthology.orchestra.run.smithi164.stdout:(100/131): postgresql-contrib-10.21-2.module+el 7.9 MB/s | 808 kB 00:00 2023-11-24T08:01:37.582 INFO:teuthology.orchestra.run.smithi164.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-11-24T08:01:37.607 INFO:teuthology.orchestra.run.smithi164.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 624 kB/s | 47 kB 00:00 2023-11-24T08:01:37.632 INFO:teuthology.orchestra.run.smithi164.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-11-24T08:01:37.648 INFO:teuthology.orchestra.run.smithi153.stdout:(8/131): ceph-radosgw-18.0.0-7484.ga13ea5ff.el8 13 MB/s | 14 MB 00:01 2023-11-24T08:01:37.658 INFO:teuthology.orchestra.run.smithi164.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 846 kB/s | 43 kB 00:00 2023-11-24T08:01:37.716 INFO:teuthology.orchestra.run.smithi153.stdout:(9/131): ceph-selinux-18.0.0-7484.ga13ea5ff.el8 364 kB/s | 24 kB 00:00 2023-11-24T08:01:37.725 INFO:teuthology.orchestra.run.smithi164.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.3 MB/s | 220 kB 00:00 2023-11-24T08:01:37.750 INFO:teuthology.orchestra.run.smithi164.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 523 kB/s | 48 kB 00:00 2023-11-24T08:01:37.833 INFO:teuthology.orchestra.run.smithi164.stdout:(107/131): postgresql-server-10.21-2.module+el8 10 MB/s | 5.1 MB 00:00 2023-11-24T08:01:37.859 INFO:teuthology.orchestra.run.smithi164.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 393 kB/s | 43 kB 00:00 2023-11-24T08:01:37.884 INFO:teuthology.orchestra.run.smithi164.stdout:(109/131): libsepol-devel-2.9-3.el8.x86_64.rpm 547 kB/s | 87 kB 00:00 2023-11-24T08:01:37.909 INFO:teuthology.orchestra.run.smithi164.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 1.4 MB/s | 109 kB 00:00 2023-11-24T08:01:37.934 INFO:teuthology.orchestra.run.smithi164.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-11-24T08:01:37.987 INFO:teuthology.orchestra.run.smithi164.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 243 kB/s | 19 kB 00:00 2023-11-24T08:01:38.018 INFO:teuthology.orchestra.run.smithi164.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.8 MB/s | 155 kB 00:00 2023-11-24T08:01:38.044 INFO:teuthology.orchestra.run.smithi164.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.4 MB/s | 560 kB 00:00 2023-11-24T08:01:38.069 INFO:teuthology.orchestra.run.smithi164.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 355 kB/s | 18 kB 00:00 2023-11-24T08:01:38.111 INFO:teuthology.orchestra.run.smithi164.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.4 MB/s | 559 kB 00:00 2023-11-24T08:01:38.136 INFO:teuthology.orchestra.run.smithi164.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-11-24T08:01:38.161 INFO:teuthology.orchestra.run.smithi164.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-11-24T08:01:38.187 INFO:teuthology.orchestra.run.smithi164.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-11-24T08:01:38.212 INFO:teuthology.orchestra.run.smithi164.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-11-24T08:01:38.237 INFO:teuthology.orchestra.run.smithi164.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-11-24T08:01:38.288 INFO:teuthology.orchestra.run.smithi164.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.3 MB/s | 98 kB 00:00 2023-11-24T08:01:38.313 INFO:teuthology.orchestra.run.smithi164.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 767 kB/s | 58 kB 00:00 2023-11-24T08:01:38.338 INFO:teuthology.orchestra.run.smithi164.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 767 kB/s | 39 kB 00:00 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi164.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-11-24T08:01:38.405 INFO:teuthology.orchestra.run.smithi164.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-11-24T08:01:38.431 INFO:teuthology.orchestra.run.smithi164.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-11-24T08:01:38.481 INFO:teuthology.orchestra.run.smithi164.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.3 MB/s | 2.3 MB 00:00 2023-11-24T08:01:38.559 INFO:teuthology.orchestra.run.smithi164.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 10 MB/s | 798 kB 00:00 2023-11-24T08:01:38.974 INFO:teuthology.orchestra.run.smithi153.stdout:(10/131): ceph-common-18.0.0-7484.ga13ea5ff.el8 6.2 MB/s | 23 MB 00:03 2023-11-24T08:01:39.240 INFO:teuthology.orchestra.run.smithi164.stdout:(130/131): librados2-18.0.0-7484.ga13ea5ff.el8. 4.5 MB/s | 3.8 MB 00:00 2023-11-24T08:01:39.615 INFO:teuthology.orchestra.run.smithi164.stdout:(131/131): librbd1-18.0.0-7484.ga13ea5ff.el8.x8 3.1 MB/s | 3.7 MB 00:01 2023-11-24T08:01:39.618 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2023-11-24T08:01:39.618 INFO:teuthology.orchestra.run.smithi164.stdout:Total 18 MB/s | 209 MB 00:11 2023-11-24T08:01:39.641 INFO:teuthology.orchestra.run.smithi153.stdout:(11/131): ceph-osd-18.0.0-7484.ga13ea5ff.el8.x8 5.8 MB/s | 18 MB 00:03 2023-11-24T08:01:39.699 INFO:teuthology.orchestra.run.smithi153.stdout:(12/131): libcephfs-devel-18.0.0-7484.ga13ea5ff 535 kB/s | 31 kB 00:00 2023-11-24T08:01:39.724 INFO:teuthology.orchestra.run.smithi153.stdout:(13/131): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 350 kB/s | 262 kB 00:00 2023-11-24T08:01:39.883 INFO:teuthology.orchestra.run.smithi153.stdout:(14/131): libcephfs2-18.0.0-7484.ga13ea5ff.el8. 4.5 MB/s | 839 kB 00:00 2023-11-24T08:01:39.967 INFO:teuthology.orchestra.run.smithi153.stdout:(15/131): librados-devel-18.0.0-7484.ga13ea5ff. 1.6 MB/s | 139 kB 00:00 2023-11-24T08:01:40.033 INFO:teuthology.orchestra.run.smithi153.stdout:(16/131): libcephsqlite-18.0.0-7484.ga13ea5ff.e 593 kB/s | 183 kB 00:00 2023-11-24T08:01:40.109 INFO:teuthology.orchestra.run.smithi153.stdout:(17/131): libradosstriper1-18.0.0-7484.ga13ea5f 3.6 MB/s | 517 kB 00:00 2023-11-24T08:01:40.184 INFO:teuthology.orchestra.run.smithi153.stdout:(18/131): python3-ceph-argparse-18.0.0-7484.ga1 596 kB/s | 45 kB 00:00 2023-11-24T08:01:40.259 INFO:teuthology.orchestra.run.smithi153.stdout:(19/131): python3-ceph-common-18.0.0-7484.ga13e 1.7 MB/s | 128 kB 00:00 2023-11-24T08:01:40.343 INFO:teuthology.orchestra.run.smithi153.stdout:(20/131): python3-cephfs-18.0.0-7484.ga13ea5ff. 2.3 MB/s | 197 kB 00:00 2023-11-24T08:01:40.435 INFO:teuthology.orchestra.run.smithi153.stdout:(21/131): python3-rados-18.0.0-7484.ga13ea5ff.e 3.9 MB/s | 371 kB 00:00 2023-11-24T08:01:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2023-11-24T08:01:40.527 INFO:teuthology.orchestra.run.smithi153.stdout:(22/131): python3-rbd-18.0.0-7484.ga13ea5ff.el8 3.9 MB/s | 364 kB 00:00 2023-11-24T08:01:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2023-11-24T08:01:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2023-11-24T08:01:40.602 INFO:teuthology.orchestra.run.smithi153.stdout:(23/131): python3-rgw-18.0.0-7484.ga13ea5ff.el8 1.4 MB/s | 107 kB 00:00 2023-11-24T08:01:41.078 INFO:teuthology.orchestra.run.smithi153.stdout:(24/131): ceph-test-18.0.0-7484.ga13ea5ff.el8.x 15 MB/s | 49 MB 00:03 2023-11-24T08:01:41.103 INFO:teuthology.orchestra.run.smithi153.stdout:(25/131): rbd-fuse-18.0.0-7484.ga13ea5ff.el8.x8 187 kB/s | 94 kB 00:00 2023-11-24T08:01:41.178 INFO:teuthology.orchestra.run.smithi153.stdout:(26/131): rbd-nbd-18.0.0-7484.ga13ea5ff.el8.x86 2.4 MB/s | 181 kB 00:00 2023-11-24T08:01:41.253 INFO:teuthology.orchestra.run.smithi153.stdout:(27/131): ceph-grafana-dashboards-18.0.0-7484.g 372 kB/s | 28 kB 00:00 2023-11-24T08:01:41.329 INFO:teuthology.orchestra.run.smithi153.stdout:(28/131): rbd-mirror-18.0.0-7484.ga13ea5ff.el8. 14 MB/s | 3.6 MB 00:00 2023-11-24T08:01:41.354 INFO:teuthology.orchestra.run.smithi153.stdout:(29/131): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 1.3 MB/s | 133 kB 00:00 2023-11-24T08:01:41.455 INFO:teuthology.orchestra.run.smithi153.stdout:(30/131): ceph-mgr-dashboard-18.0.0-7484.ga13ea 14 MB/s | 1.8 MB 00:00 2023-11-24T08:01:41.506 INFO:teuthology.orchestra.run.smithi153.stdout:(31/131): ceph-mgr-modules-core-18.0.0-7484.ga1 4.8 MB/s | 243 kB 00:00 2023-11-24T08:01:41.555 INFO:teuthology.orchestra.run.smithi153.stdout:(32/131): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 1.0 MB/s | 50 kB 00:00 2023-11-24T08:01:41.606 INFO:teuthology.orchestra.run.smithi153.stdout:(33/131): ceph-prometheus-alerts-18.0.0-7484.ga 301 kB/s | 15 kB 00:00 2023-11-24T08:01:41.692 INFO:teuthology.orchestra.run.smithi153.stdout:(34/131): ceph-volume-18.0.0-7484.ga13ea5ff.el8 3.0 MB/s | 262 kB 00:00 2023-11-24T08:01:41.718 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2023-11-24T08:01:41.722 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2023-11-24T08:01:41.756 INFO:teuthology.orchestra.run.smithi153.stdout:(35/131): cephadm-18.0.0-7484.ga13ea5ff.el8.noa 6.1 MB/s | 407 kB 00:00 2023-11-24T08:01:41.815 INFO:teuthology.orchestra.run.smithi153.stdout:(36/131): cephfs-top-18.0.0-7484.ga13ea5ff.el8. 311 kB/s | 18 kB 00:00 2023-11-24T08:01:41.998 INFO:teuthology.orchestra.run.smithi153.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-11-24T08:01:42.040 INFO:teuthology.orchestra.run.smithi153.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-11-24T08:01:42.107 INFO:teuthology.orchestra.run.smithi153.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-11-24T08:01:42.266 INFO:teuthology.orchestra.run.smithi153.stdout:(40/131): ceph-mgr-diskprediction-local-18.0.0- 8.1 MB/s | 7.4 MB 00:00 2023-11-24T08:01:42.291 INFO:teuthology.orchestra.run.smithi153.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-11-24T08:01:42.409 INFO:teuthology.orchestra.run.smithi153.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 308 kB/s | 44 kB 00:00 2023-11-24T08:01:42.450 INFO:teuthology.orchestra.run.smithi153.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 793 kB/s | 33 kB 00:00 2023-11-24T08:01:42.500 INFO:teuthology.orchestra.run.smithi153.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 327 kB/s | 16 kB 00:00 2023-11-24T08:01:42.526 INFO:teuthology.orchestra.run.smithi153.stdout:(45/131): python3-beautifulsoup4-4.6.3-2.el8.1. 806 kB/s | 185 kB 00:00 2023-11-24T08:01:42.634 INFO:teuthology.orchestra.run.smithi153.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2023-11-24T08:01:42.668 INFO:teuthology.orchestra.run.smithi153.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 2.4 MB/s | 81 kB 00:00 2023-11-24T08:01:42.710 INFO:teuthology.orchestra.run.smithi153.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 267 kB/s | 11 kB 00:00 2023-11-24T08:01:42.752 INFO:teuthology.orchestra.run.smithi153.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 423 kB/s | 18 kB 00:00 2023-11-24T08:01:42.827 INFO:teuthology.orchestra.run.smithi153.stdout:(50/131): librgw2-18.0.0-7484.ga13ea5ff.el8.x86 2.5 MB/s | 6.9 MB 00:02 2023-11-24T08:01:42.878 INFO:teuthology.orchestra.run.smithi153.stdout:(51/131): python3-cheroot-8.5.2-1.el8.noarch.rp 457 kB/s | 173 kB 00:00 2023-11-24T08:01:42.994 INFO:teuthology.orchestra.run.smithi153.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 527 kB/s | 59 kB 00:00 2023-11-24T08:01:43.019 INFO:teuthology.orchestra.run.smithi153.stdout:(53/131): python3-logutils-0.3.5-11.el8.noarch. 254 kB/s | 49 kB 00:00 2023-11-24T08:01:43.061 INFO:teuthology.orchestra.run.smithi153.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 3.8 MB/s | 1.2 MB 00:00 2023-11-24T08:01:43.095 INFO:teuthology.orchestra.run.smithi153.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 469 kB/s | 16 kB 00:00 2023-11-24T08:01:43.112 INFO:teuthology.orchestra.run.smithi153.stdout:(56/131): python3-natsort-7.1.1-2.el8.noarch.rp 513 kB/s | 60 kB 00:00 2023-11-24T08:01:43.137 INFO:teuthology.orchestra.run.smithi153.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-11-24T08:01:43.171 INFO:teuthology.orchestra.run.smithi153.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 444 kB/s | 34 kB 00:00 2023-11-24T08:01:43.196 INFO:teuthology.orchestra.run.smithi153.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-11-24T08:01:43.221 INFO:teuthology.orchestra.run.smithi153.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 766 kB/s | 64 kB 00:00 2023-11-24T08:01:43.280 INFO:teuthology.orchestra.run.smithi153.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 172 kB/s | 19 kB 00:00 2023-11-24T08:01:43.297 INFO:teuthology.orchestra.run.smithi153.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2023-11-24T08:01:43.314 INFO:teuthology.orchestra.run.smithi153.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 318 kB/s | 29 kB 00:00 2023-11-24T08:01:43.347 INFO:teuthology.orchestra.run.smithi153.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 552 kB/s | 27 kB 00:00 2023-11-24T08:01:43.373 INFO:teuthology.orchestra.run.smithi153.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-11-24T08:01:43.398 INFO:teuthology.orchestra.run.smithi153.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-11-24T08:01:43.423 INFO:teuthology.orchestra.run.smithi153.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-11-24T08:01:43.465 INFO:teuthology.orchestra.run.smithi153.stdout:(68/131): python3-websocket-client-0.56.0-5.el8 521 kB/s | 61 kB 00:00 2023-11-24T08:01:43.490 INFO:teuthology.orchestra.run.smithi153.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-11-24T08:01:43.507 INFO:teuthology.orchestra.run.smithi153.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 210 kB/s | 23 kB 00:00 2023-11-24T08:01:43.566 INFO:teuthology.orchestra.run.smithi153.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-11-24T08:01:43.599 INFO:teuthology.orchestra.run.smithi153.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-11-24T08:01:43.674 INFO:teuthology.orchestra.run.smithi153.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2023-11-24T08:01:43.725 INFO:teuthology.orchestra.run.smithi153.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.2 MB/s | 323 kB 00:00 2023-11-24T08:01:43.759 INFO:teuthology.orchestra.run.smithi153.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-11-24T08:01:43.809 INFO:teuthology.orchestra.run.smithi153.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 14 MB/s | 688 kB 00:00 2023-11-24T08:01:43.843 INFO:teuthology.orchestra.run.smithi153.stdout:(77/131): thrift-0.13.0-2.el8.x86_64.rpm 4.1 MB/s | 1.7 MB 00:00 2023-11-24T08:01:43.885 INFO:teuthology.orchestra.run.smithi153.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-11-24T08:01:43.935 INFO:teuthology.orchestra.run.smithi153.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-11-24T08:01:43.960 INFO:teuthology.orchestra.run.smithi153.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.6 MB/s | 187 kB 00:00 2023-11-24T08:01:44.002 INFO:teuthology.orchestra.run.smithi153.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-11-24T08:01:44.077 INFO:teuthology.orchestra.run.smithi153.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 356 kB/s | 27 kB 00:00 2023-11-24T08:01:44.219 INFO:teuthology.orchestra.run.smithi153.stdout:(83/131): python3-scipy-1.0.0-21.module+el8.5.0 19 MB/s | 14 MB 00:00 2023-11-24T08:01:44.253 INFO:teuthology.orchestra.run.smithi153.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-11-24T08:01:44.278 INFO:teuthology.orchestra.run.smithi153.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 754 kB/s | 44 kB 00:00 2023-11-24T08:01:44.328 INFO:teuthology.orchestra.run.smithi153.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 8.9 MB/s | 457 kB 00:00 2023-11-24T08:01:44.370 INFO:teuthology.orchestra.run.smithi153.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-11-24T08:01:44.471 INFO:teuthology.orchestra.run.smithi153.stdout:(88/131): python3-babel-2.5.1-7.el8.noarch.rpm 9.4 MB/s | 4.8 MB 00:00 2023-11-24T08:01:44.504 INFO:teuthology.orchestra.run.smithi153.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 479 kB/s | 64 kB 00:00 2023-11-24T08:01:44.529 INFO:teuthology.orchestra.run.smithi153.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-11-24T08:01:44.555 INFO:teuthology.orchestra.run.smithi153.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 395 kB/s | 20 kB 00:00 2023-11-24T08:01:44.580 INFO:teuthology.orchestra.run.smithi153.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-11-24T08:01:44.639 INFO:teuthology.orchestra.run.smithi153.stdout:(93/131): python3-numpy-1.14.3-10.el8.x86_64.rp 9.7 MB/s | 3.7 MB 00:00 2023-11-24T08:01:44.672 INFO:teuthology.orchestra.run.smithi153.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2023-11-24T08:01:44.697 INFO:teuthology.orchestra.run.smithi153.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-11-24T08:01:44.739 INFO:teuthology.orchestra.run.smithi153.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-11-24T08:01:44.790 INFO:teuthology.orchestra.run.smithi153.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-11-24T08:01:44.923 INFO:teuthology.orchestra.run.smithi153.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 14 MB/s | 4.9 MB 00:00 2023-11-24T08:01:44.999 INFO:teuthology.orchestra.run.smithi153.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-11-24T08:01:45.032 INFO:teuthology.orchestra.run.smithi153.stdout:(100/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-11-24T08:01:45.066 INFO:teuthology.orchestra.run.smithi153.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-11-24T08:01:45.108 INFO:teuthology.orchestra.run.smithi153.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-11-24T08:01:45.124 INFO:teuthology.orchestra.run.smithi153.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.3 MB/s | 200 kB 00:00 2023-11-24T08:01:45.150 INFO:teuthology.orchestra.run.smithi153.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-11-24T08:01:45.175 INFO:teuthology.orchestra.run.smithi153.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-11-24T08:01:45.192 INFO:teuthology.orchestra.run.smithi153.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-11-24T08:01:45.217 INFO:teuthology.orchestra.run.smithi153.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-11-24T08:01:45.267 INFO:teuthology.orchestra.run.smithi153.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 570 kB/s | 43 kB 00:00 2023-11-24T08:01:45.293 INFO:teuthology.orchestra.run.smithi153.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 1.4 MB/s | 109 kB 00:00 2023-11-24T08:01:45.318 INFO:teuthology.orchestra.run.smithi153.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-11-24T08:01:45.352 INFO:teuthology.orchestra.run.smithi153.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-11-24T08:01:45.369 INFO:teuthology.orchestra.run.smithi153.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 371 kB/s | 19 kB 00:00 2023-11-24T08:01:45.444 INFO:teuthology.orchestra.run.smithi153.stdout:(113/131): postgresql-server-10.21-2.module+el8 7.7 MB/s | 5.1 MB 00:00 2023-11-24T08:01:45.469 INFO:teuthology.orchestra.run.smithi153.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.3 MB/s | 155 kB 00:00 2023-11-24T08:01:45.495 INFO:teuthology.orchestra.run.smithi153.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 356 kB/s | 18 kB 00:00 2023-11-24T08:01:45.528 INFO:teuthology.orchestra.run.smithi153.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.4 MB/s | 559 kB 00:00 2023-11-24T08:01:45.554 INFO:teuthology.orchestra.run.smithi153.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.0 MB/s | 605 kB 00:00 2023-11-24T08:01:45.579 INFO:teuthology.orchestra.run.smithi153.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-11-24T08:01:45.604 INFO:teuthology.orchestra.run.smithi153.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-11-24T08:01:45.661 INFO:teuthology.orchestra.run.smithi153.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2023-11-24T08:01:45.688 INFO:teuthology.orchestra.run.smithi153.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 713 kB/s | 60 kB 00:00 2023-11-24T08:01:45.714 INFO:teuthology.orchestra.run.smithi153.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.8 MB/s | 98 kB 00:00 2023-11-24T08:01:45.739 INFO:teuthology.orchestra.run.smithi153.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-11-24T08:01:45.764 INFO:teuthology.orchestra.run.smithi153.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 770 kB/s | 39 kB 00:00 2023-11-24T08:01:45.807 INFO:teuthology.orchestra.run.smithi153.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-11-24T08:01:45.831 INFO:teuthology.orchestra.run.smithi153.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-11-24T08:01:45.856 INFO:teuthology.orchestra.run.smithi153.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-11-24T08:01:45.915 INFO:teuthology.orchestra.run.smithi153.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.0 MB/s | 2.3 MB 00:00 2023-11-24T08:01:45.965 INFO:teuthology.orchestra.run.smithi153.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-11-24T08:01:46.249 INFO:teuthology.orchestra.run.smithi153.stdout:(130/131): librbd1-18.0.0-7484.ga13ea5ff.el8.x8 9.5 MB/s | 3.7 MB 00:00 2023-11-24T08:01:46.466 INFO:teuthology.orchestra.run.smithi153.stdout:(131/131): librados2-18.0.0-7484.ga13ea5ff.el8. 5.9 MB/s | 3.8 MB 00:00 2023-11-24T08:01:46.470 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-24T08:01:46.470 INFO:teuthology.orchestra.run.smithi153.stdout:Total 19 MB/s | 209 MB 00:11 2023-11-24T08:01:46.915 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2023-11-24T08:01:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-24T08:01:47.292 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-24T08:01:47.324 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-24T08:01:47.445 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-24T08:01:47.445 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-24T08:01:47.536 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-11-24T08:01:47.746 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-24T08:01:47.883 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-24T08:01:48.104 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-24T08:01:48.512 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-24T08:01:48.594 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-24T08:01:48.598 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-24T08:01:48.779 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T08:01:49.192 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T08:01:49.387 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T08:01:49.545 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T08:01:49.770 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T08:01:49.862 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T08:01:50.096 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 9/134 2023-11-24T08:01:50.358 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-24T08:01:50.598 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-24T08:01:51.006 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-24T08:01:51.268 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-24T08:01:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 14/134 2023-11-24T08:01:51.596 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 14/134 2023-11-24T08:01:51.813 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 15/134 2023-11-24T08:01:51.880 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 15/134 2023-11-24T08:01:52.103 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-24T08:01:52.245 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-24T08:01:52.428 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-24T08:01:53.043 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-24T08:01:53.236 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-24T08:01:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-24T08:01:53.763 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-24T08:01:53.816 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-24T08:01:53.910 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-24T08:01:54.028 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-11-24T08:01:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-11-24T08:01:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-24T08:01:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-24T08:01:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-24T08:01:54.716 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-11-24T08:01:55.018 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-11-24T08:01:55.064 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-24T08:01:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-11-24T08:01:55.306 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T08:01:55.573 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-11-24T08:01:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T08:01:55.775 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-11-24T08:01:55.890 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T08:01:55.959 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-11-24T08:01:56.046 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T08:01:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T08:01:56.223 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-24T08:01:56.304 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T08:01:56.417 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8. 26/134 2023-11-24T08:01:56.532 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 9/134 2023-11-24T08:01:56.555 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 27/134 2023-11-24T08:01:56.802 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-24T08:01:57.017 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-24T08:01:57.464 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-24T08:01:57.495 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_6 28/134 2023-11-24T08:01:57.730 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-24T08:01:57.835 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-11-24T08:01:57.930 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 14/134 2023-11-24T08:01:58.031 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 14/134 2023-11-24T08:01:58.139 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-11-24T08:01:58.173 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 15/134 2023-11-24T08:01:58.249 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 15/134 2023-11-24T08:01:58.413 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-11-24T08:01:58.414 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-24T08:01:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-24T08:01:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-24T08:01:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-24T08:01:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-24T08:01:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-24T08:02:00.218 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-24T08:02:00.438 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-24T08:02:00.439 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-11-24T08:02:00.778 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-11-24T08:02:01.006 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-24T08:02:01.152 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-11-24T08:02:01.216 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-24T08:02:01.399 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 36/134 2023-11-24T08:02:01.421 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-11-24T08:02:01.581 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_6 37/134 2023-11-24T08:02:01.682 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-11-24T08:02:01.779 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-11-24T08:02:01.926 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-11-24T08:02:01.970 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-11-24T08:02:02.103 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-11-24T08:02:02.162 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-11-24T08:02:02.297 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-11-24T08:02:02.341 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-11-24T08:02:02.508 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-11-24T08:02:02.566 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-24T08:02:02.778 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8. 26/134 2023-11-24T08:02:02.837 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-11-24T08:02:02.908 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 27/134 2023-11-24T08:02:03.414 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-11-24T08:02:03.766 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-11-24T08:02:03.854 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_6 28/134 2023-11-24T08:02:03.963 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-11-24T08:02:04.207 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-11-24T08:02:04.349 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-11-24T08:02:04.448 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-11-24T08:02:04.607 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-11-24T08:02:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-11-24T08:02:04.898 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-11-24T08:02:05.067 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-11-24T08:02:05.121 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-24T08:02:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-11-24T08:02:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-11-24T08:02:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-11-24T08:02:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-11-24T08:02:06.270 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-11-24T08:02:06.590 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-11-24T08:02:06.856 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-11-24T08:02:06.892 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-24T08:02:07.107 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-11-24T08:02:07.222 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-11-24T08:02:07.308 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-11-24T08:02:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-24T08:02:07.460 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-11-24T08:02:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-24T08:02:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-11-24T08:02:07.737 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-11-24T08:02:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 36/134 2023-11-24T08:02:07.975 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_6 37/134 2023-11-24T08:02:08.004 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-11-24T08:02:08.112 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-11-24T08:02:08.246 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-11-24T08:02:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-11-24T08:02:08.426 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-24T08:02:08.465 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-11-24T08:02:08.507 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-24T08:02:08.599 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-11-24T08:02:08.764 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-11-24T08:02:08.835 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-11-24T08:02:08.993 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-11-24T08:02:09.033 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-11-24T08:02:09.141 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-24T08:02:09.345 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-24T08:02:09.417 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-11-24T08:02:09.618 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-24T08:02:09.857 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-24T08:02:10.013 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-24T08:02:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-11-24T08:02:10.185 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-24T08:02:10.231 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-11-24T08:02:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-24T08:02:10.493 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-11-24T08:02:10.603 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-24T08:02:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-11-24T08:02:10.810 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-24T08:02:11.003 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-24T08:02:11.038 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-11-24T08:02:11.139 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-24T08:02:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-11-24T08:02:11.377 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-24T08:02:11.540 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-11-24T08:02:11.612 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-24T08:02:11.759 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-11-24T08:02:11.798 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-24T08:02:11.993 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-11-24T08:02:12.082 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-24T08:02:12.165 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-11-24T08:02:12.333 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-24T08:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-11-24T08:02:12.542 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-24T08:02:12.755 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-11-24T08:02:12.796 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-24T08:02:13.000 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-11-24T08:02:13.285 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-11-24T08:02:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-11-24T08:02:13.663 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-11-24T08:02:13.903 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-11-24T08:02:13.930 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-24T08:02:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-11-24T08:02:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-24T08:02:14.231 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-11-24T08:02:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-11-24T08:02:14.449 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-24T08:02:14.611 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-24T08:02:14.710 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-24T08:02:14.727 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-24T08:02:14.942 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-11-24T08:02:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-24T08:02:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-11-24T08:02:15.220 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-24T08:02:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-24T08:02:15.549 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-24T08:02:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-24T08:02:16.052 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-24T08:02:16.074 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-24T08:02:16.231 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-24T08:02:16.307 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 92/134 2023-11-24T08:02:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-24T08:02:16.393 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 92/134 2023-11-24T08:02:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-24T08:02:16.575 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 93/134 2023-11-24T08:02:16.792 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-24T08:02:16.974 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-24T08:02:17.173 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-24T08:02:17.309 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-24T08:02:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-24T08:02:17.757 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-24T08:02:17.975 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-24T08:02:18.242 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-24T08:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-24T08:02:18.668 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-24T08:02:18.875 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-24T08:02:19.976 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-24T08:02:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-24T08:02:20.351 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T08:02:20.535 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-24T08:02:20.607 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T08:02:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-24T08:02:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-24T08:02:21.196 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T08:02:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-24T08:02:21.513 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 95/134 2023-11-24T08:02:21.617 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 95/134 2023-11-24T08:02:21.740 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 96/134 2023-11-24T08:02:22.171 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-24T08:02:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 92/134 2023-11-24T08:02:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 92/134 2023-11-24T08:02:22.628 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 93/134 2023-11-24T08:02:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T08:02:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T08:02:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T08:02:27.557 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 95/134 2023-11-24T08:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 95/134 2023-11-24T08:02:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 96/134 2023-11-24T08:02:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 96/134 2023-11-24T08:02:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2023-11-24T08:02:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2023-11-24T08:02:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /dev 2023-11-24T08:02:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /run 2023-11-24T08:02:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2023-11-24T08:02:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2023-11-24T08:02:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2023-11-24T08:02:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2023-11-24T08:02:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /dev 2023-11-24T08:02:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:02:40.887 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 97/134 2023-11-24T08:02:42.498 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 97/134 2023-11-24T08:02:42.726 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 98/134 2023-11-24T08:02:42.958 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 98/134 2023-11-24T08:02:43.105 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 99/134 2023-11-24T08:02:43.561 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 99/134 2023-11-24T08:02:43.772 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 100/134 2023-11-24T08:02:43.792 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 100/134 2023-11-24T08:02:45.598 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 101/134 2023-11-24T08:02:45.837 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 101/134 2023-11-24T08:02:45.969 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 102/134 2023-11-24T08:02:46.186 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 103/134 2023-11-24T08:02:46.411 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 104/134 2023-11-24T08:02:46.485 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 96/134 2023-11-24T08:02:46.485 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2023-11-24T08:02:46.485 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2023-11-24T08:02:46.486 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2023-11-24T08:02:46.486 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /run 2023-11-24T08:02:46.486 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2023-11-24T08:02:46.486 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2023-11-24T08:02:46.486 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2023-11-24T08:02:46.486 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2023-11-24T08:02:46.486 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2023-11-24T08:02:46.486 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:02:46.628 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 104/134 2023-11-24T08:02:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 97/134 2023-11-24T08:02:46.833 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 105/134 2023-11-24T08:02:47.798 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 105/134 2023-11-24T08:02:47.961 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 106/134 2023-11-24T08:02:48.053 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 106/134 2023-11-24T08:02:48.435 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 97/134 2023-11-24T08:02:48.460 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 107/134 2023-11-24T08:02:48.628 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 98/134 2023-11-24T08:02:48.676 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 108/134 2023-11-24T08:02:48.713 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 108/134 2023-11-24T08:02:48.863 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 98/134 2023-11-24T08:02:48.905 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 109/134 2023-11-24T08:02:48.914 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 109/134 2023-11-24T08:02:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 99/134 2023-11-24T08:02:49.472 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 99/134 2023-11-24T08:02:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 100/134 2023-11-24T08:02:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 100/134 2023-11-24T08:02:50.231 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 110/134 2023-11-24T08:02:50.488 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 111/134 2023-11-24T08:02:50.523 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 111/134 2023-11-24T08:02:50.702 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 112/134 2023-11-24T08:02:50.745 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 112/134 2023-11-24T08:02:50.937 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 113/134 2023-11-24T08:02:51.298 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 113/134 2023-11-24T08:02:51.431 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 101/134 2023-11-24T08:02:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 114/134 2023-11-24T08:02:51.656 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 101/134 2023-11-24T08:02:51.771 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 102/134 2023-11-24T08:02:51.971 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 103/134 2023-11-24T08:02:52.130 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 104/134 2023-11-24T08:02:52.366 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 104/134 2023-11-24T08:02:52.686 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 105/134 2023-11-24T08:02:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 105/134 2023-11-24T08:02:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 106/134 2023-11-24T08:02:53.897 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 106/134 2023-11-24T08:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 107/134 2023-11-24T08:02:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 108/134 2023-11-24T08:02:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 108/134 2023-11-24T08:02:54.696 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 109/134 2023-11-24T08:02:54.708 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 109/134 2023-11-24T08:02:56.056 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 110/134 2023-11-24T08:02:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 114/134 2023-11-24T08:02:56.297 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 111/134 2023-11-24T08:02:56.331 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 111/134 2023-11-24T08:02:56.467 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 115/134 2023-11-24T08:02:56.488 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 112/134 2023-11-24T08:02:56.531 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 112/134 2023-11-24T08:02:56.651 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-11-24T08:02:56.680 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 113/134 2023-11-24T08:02:56.846 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-11-24T08:02:57.038 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 113/134 2023-11-24T08:02:57.197 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 114/134 2023-11-24T08:02:57.816 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-11-24T08:02:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-11-24T08:02:58.365 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 119/134 2023-11-24T08:02:58.597 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-24T08:02:58.747 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_ 121/134 2023-11-24T08:02:58.961 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-24T08:03:01.235 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T08:03:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T08:03:01.527 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T08:03:01.739 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 124/134 2023-11-24T08:03:01.879 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 114/134 2023-11-24T08:03:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 125/134 2023-11-24T08:03:02.193 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 115/134 2023-11-24T08:03:02.353 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 126/134 2023-11-24T08:03:02.353 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-11-24T08:03:02.553 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-11-24T08:03:02.702 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-24T08:03:02.833 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T08:03:02.843 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T08:03:03.050 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-11-24T08:03:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-11-24T08:03:03.356 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-11-24T08:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-11-24T08:03:03.608 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-11-24T08:03:03.621 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-11-24T08:03:03.621 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T08:03:03.774 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-11-24T08:03:03.878 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T08:03:03.879 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-24T08:03:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 119/134 2023-11-24T08:03:04.147 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-24T08:03:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-24T08:03:04.324 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_ 121/134 2023-11-24T08:03:04.357 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T08:03:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-24T08:03:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T08:03:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 1/134 2023-11-24T08:03:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2/134 2023-11-24T08:03:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 3/134 2023-11-24T08:03:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 4/134 2023-11-24T08:03:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/134 2023-11-24T08:03:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T08:03:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T08:03:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T08:03:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 9/134 2023-11-24T08:03:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 10/134 2023-11-24T08:03:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 11/134 2023-11-24T08:03:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 12/134 2023-11-24T08:03:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 13/134 2023-11-24T08:03:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_ 14/134 2023-11-24T08:03:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 15/134 2023-11-24T08:03:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 16/134 2023-11-24T08:03:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_6 17/134 2023-11-24T08:03:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 18/134 2023-11-24T08:03:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 19/134 2023-11-24T08:03:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/134 2023-11-24T08:03:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8. 21/134 2023-11-24T08:03:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_6 22/134 2023-11-24T08:03:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 23/134 2023-11-24T08:03:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 24/134 2023-11-24T08:03:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 25/134 2023-11-24T08:03:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 26/134 2023-11-24T08:03:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 27/134 2023-11-24T08:03:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 28/134 2023-11-24T08:03:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/134 2023-11-24T08:03:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 30/134 2023-11-24T08:03:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 31/134 2023-11-24T08:03:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/134 2023-11-24T08:03:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/134 2023-11-24T08:03:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 34/134 2023-11-24T08:03:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/134 2023-11-24T08:03:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 36/134 2023-11-24T08:03:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 37/134 2023-11-24T08:03:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 38/134 2023-11-24T08:03:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-24T08:03:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-24T08:03:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-24T08:03:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-24T08:03:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-24T08:03:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-24T08:03:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-24T08:03:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-24T08:03:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-24T08:03:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-24T08:03:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-24T08:03:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-11-24T08:03:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-11-24T08:03:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-11-24T08:03:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-11-24T08:03:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-11-24T08:03:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-11-24T08:03:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-11-24T08:03:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-11-24T08:03:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-11-24T08:03:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-11-24T08:03:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-11-24T08:03:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T08:03:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 129/134 2023-11-24T08:03:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-24T08:03:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 131/134 2023-11-24T08:03:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T08:03:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-24T08:03:06.743 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T08:03:07.028 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T08:03:07.047 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T08:03:07.226 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 124/134 2023-11-24T08:03:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 125/134 2023-11-24T08:03:07.801 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T08:03:07.801 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:51 ago on Fri 24 Nov 2023 08:01:16 AM UTC. 2023-11-24T08:03:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 126/134 2023-11-24T08:03:08.146 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-24T08:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T08:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T08:03:08.497 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-11-24T08:03:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-11-24T08:03:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-11-24T08:03:08.969 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-11-24T08:03:08.982 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-11-24T08:03:08.982 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T08:03:09.181 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T08:03:09.181 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-24T08:03:09.441 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-24T08:03:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T08:03:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T08:03:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 1/134 2023-11-24T08:03:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2/134 2023-11-24T08:03:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 3/134 2023-11-24T08:03:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 4/134 2023-11-24T08:03:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/134 2023-11-24T08:03:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T08:03:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T08:03:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T08:03:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 9/134 2023-11-24T08:03:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 10/134 2023-11-24T08:03:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 11/134 2023-11-24T08:03:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 12/134 2023-11-24T08:03:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 13/134 2023-11-24T08:03:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_ 14/134 2023-11-24T08:03:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 15/134 2023-11-24T08:03:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 16/134 2023-11-24T08:03:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_6 17/134 2023-11-24T08:03:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 18/134 2023-11-24T08:03:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 19/134 2023-11-24T08:03:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/134 2023-11-24T08:03:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8. 21/134 2023-11-24T08:03:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_6 22/134 2023-11-24T08:03:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 23/134 2023-11-24T08:03:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 24/134 2023-11-24T08:03:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 25/134 2023-11-24T08:03:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 26/134 2023-11-24T08:03:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 27/134 2023-11-24T08:03:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 28/134 2023-11-24T08:03:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/134 2023-11-24T08:03:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 30/134 2023-11-24T08:03:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 31/134 2023-11-24T08:03:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/134 2023-11-24T08:03:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/134 2023-11-24T08:03:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 34/134 2023-11-24T08:03:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/134 2023-11-24T08:03:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 36/134 2023-11-24T08:03:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 37/134 2023-11-24T08:03:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 38/134 2023-11-24T08:03:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-24T08:03:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-24T08:03:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-24T08:03:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-24T08:03:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-24T08:03:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-24T08:03:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-24T08:03:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-24T08:03:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-24T08:03:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-24T08:03:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-24T08:03:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-24T08:03:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-24T08:03:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-24T08:03:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-24T08:03:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-24T08:03:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-24T08:03:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-24T08:03:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-24T08:03:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-24T08:03:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-24T08:03:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-24T08:03:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-24T08:03:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-24T08:03:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-24T08:03:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-24T08:03:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-24T08:03:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-24T08:03:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-24T08:03:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-24T08:03:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-24T08:03:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-24T08:03:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-24T08:03:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-11-24T08:03:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-11-24T08:03:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-11-24T08:03:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-11-24T08:03:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-11-24T08:03:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-11-24T08:03:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-11-24T08:03:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-11-24T08:03:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-11-24T08:03:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-11-24T08:03:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-11-24T08:03:10.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-11-24T08:03:10.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-11-24T08:03:10.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-11-24T08:03:10.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-11-24T08:03:10.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-11-24T08:03:10.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-11-24T08:03:10.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-11-24T08:03:10.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-11-24T08:03:10.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-11-24T08:03:10.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-11-24T08:03:10.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-11-24T08:03:10.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-11-24T08:03:10.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-11-24T08:03:10.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-11-24T08:03:10.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-11-24T08:03:10.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-11-24T08:03:10.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-11-24T08:03:10.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-11-24T08:03:10.183 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-11-24T08:03:10.183 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-11-24T08:03:10.183 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-11-24T08:03:10.183 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-11-24T08:03:10.183 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-11-24T08:03:10.184 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-11-24T08:03:10.184 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-11-24T08:03:10.184 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-11-24T08:03:10.184 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-11-24T08:03:10.184 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-11-24T08:03:10.184 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-11-24T08:03:10.185 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-11-24T08:03:10.185 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-11-24T08:03:10.185 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-11-24T08:03:10.185 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-11-24T08:03:10.185 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-11-24T08:03:10.185 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-11-24T08:03:10.186 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-11-24T08:03:10.186 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-11-24T08:03:10.186 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-24T08:03:10.186 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-11-24T08:03:10.186 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-24T08:03:10.187 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-11-24T08:03:10.187 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-11-24T08:03:10.187 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-11-24T08:03:10.187 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-11-24T08:03:10.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-11-24T08:03:10.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T08:03:10.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 129/134 2023-11-24T08:03:10.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-24T08:03:10.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 131/134 2023-11-24T08:03:10.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T08:03:10.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-24T08:03:10.317 INFO:teuthology.orchestra.run.smithi164.stdout:Installed products updated. 2023-11-24T08:03:10.548 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.1-7.el8.noarch 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.0.4-10.el8.x86_64 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.549 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:10.550 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.1-9.el8.x86_64 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: jq-1.6-3.el8.x86_64 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-24T08:03:10.551 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: libpq-13.5-1.el8.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.552 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-24T08:03:10.553 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-24T08:03:10.554 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-24T08:03:10.554 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-24T08:03:10.554 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-24T08:03:10.554 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-24T08:03:10.554 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T08:03:10.554 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T08:03:10.554 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T08:03:10.554 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-24T08:03:10.554 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-24T08:03:10.554 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-24T08:03:10.554 INFO:teuthology.orchestra.run.smithi164.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-24T08:03:10.555 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-24T08:03:10.555 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.555 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.555 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.555 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-24T08:03:10.555 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-24T08:03:10.556 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-24T08:03:10.556 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-24T08:03:10.556 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-24T08:03:10.556 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-24T08:03:10.556 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-24T08:03:10.557 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-24T08:03:10.557 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-24T08:03:10.557 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-24T08:03:10.558 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-24T08:03:10.558 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-24T08:03:10.559 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-24T08:03:10.559 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-24T08:03:10.560 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-24T08:03:10.560 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-24T08:03:10.560 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-24T08:03:10.560 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-24T08:03:10.560 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-24T08:03:10.561 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-24T08:03:10.561 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-24T08:03:10.561 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-24T08:03:10.562 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-2.6-1.el8.noarch 2023-11-24T08:03:10.562 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-24T08:03:10.562 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-24T08:03:10.562 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-24T08:03:10.563 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-24T08:03:10.563 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-24T08:03:10.563 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-24T08:03:10.563 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.564 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.564 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-24T08:03:10.564 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-24T08:03:10.564 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.565 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-24T08:03:10.565 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-24T08:03:10.565 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-24T08:03:10.565 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-24T08:03:10.565 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-24T08:03:10.566 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-24T08:03:10.566 INFO:teuthology.orchestra.run.smithi164.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-24T08:03:10.566 INFO:teuthology.orchestra.run.smithi164.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-24T08:03:10.567 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-24T08:03:10.567 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-24T08:03:10.567 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-24T08:03:10.567 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-24T08:03:10.567 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-24T08:03:10.568 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.568 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.568 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:10.568 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-24T08:03:10.569 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-24T08:03:10.569 INFO:teuthology.orchestra.run.smithi164.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-24T08:03:10.569 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-24T08:03:10.569 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-24T08:03:10.570 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-24T08:03:10.570 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:10.571 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2023-11-24T08:03:10.828 DEBUG:teuthology.parallel:result is None 2023-11-24T08:03:13.037 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T08:03:13.038 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:50 ago on Fri 24 Nov 2023 08:01:23 AM UTC. 2023-11-24T08:03:15.543 INFO:teuthology.orchestra.run.smithi153.stdout:Installed products updated. 2023-11-24T08:03:15.773 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:15.773 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2023-11-24T08:03:15.773 INFO:teuthology.orchestra.run.smithi153.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-24T08:03:15.774 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.774 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.774 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-24T08:03:15.774 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-24T08:03:15.774 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.1-7.el8.noarch 2023-11-24T08:03:15.774 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.0.4-10.el8.x86_64 2023-11-24T08:03:15.774 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.774 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.774 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.774 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.774 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.775 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.1-9.el8.x86_64 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: jq-1.6-3.el8.x86_64 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-24T08:03:15.776 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: libpq-13.5-1.el8.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.777 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-24T08:03:15.778 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-24T08:03:15.779 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-24T08:03:15.780 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-2.6-1.el8.noarch 2023-11-24T08:03:15.781 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-24T08:03:15.782 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-24T08:03:15.783 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.784 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.784 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T08:03:15.784 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-24T08:03:15.784 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-24T08:03:15.784 INFO:teuthology.orchestra.run.smithi153.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-24T08:03:15.784 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-24T08:03:15.784 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-24T08:03:15.784 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-24T08:03:15.784 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:15.785 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-24T08:03:16.073 DEBUG:teuthology.parallel:result is None 2023-11-24T08:03:16.073 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:03:16.301 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T08:03:16.324 INFO:teuthology.orchestra.run.smithi153.stdout:18.0.0-7484.ga13ea5ff.el8 2023-11-24T08:03:16.325 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el8 2023-11-24T08:03:16.325 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T08:03:16.325 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:03:16.542 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T08:03:16.572 INFO:teuthology.orchestra.run.smithi164.stdout:18.0.0-7484.ga13ea5ff.el8 2023-11-24T08:03:16.572 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el8 2023-11-24T08:03:16.572 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T08:03:16.572 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-24T08:03:16.573 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:16.573 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T08:03:16.614 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:16.614 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T08:03:16.660 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-24T08:03:16.660 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:16.660 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T08:03:16.687 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T08:03:16.754 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:16.755 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T08:03:16.784 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T08:03:16.853 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-24T08:03:16.853 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:16.853 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T08:03:16.880 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T08:03:16.946 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:16.946 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T08:03:16.975 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T08:03:17.044 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-24T08:03:17.044 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:17.044 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T08:03:17.070 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T08:03:17.137 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:17.137 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T08:03:17.165 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T08:03:17.233 INFO:teuthology.run_tasks:Running task ceph... 2023-11-24T08:03:17.302 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-24T08:03:17.302 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2023-11-24T08:03:17.304 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2023-11-24T08:03:17.332 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-24T08:03:17.332 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T08:03:17.371 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T08:03:17.399 INFO:tasks.ceph:Creating extra log directories... 2023-11-24T08:03:17.399 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T08:03:17.438 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T08:03:17.471 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-24T08:03:17.472 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-24T08:03:17.472 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-24T08:03:17.472 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:17.472 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T08:03:17.519 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:17.654 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:17.681 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:17.681 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T08:03:17.698 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:17.833 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:17.865 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-24T08:03:17.865 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-24T08:03:17.865 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}', 'email': None, 'first_in_suite': False, 'job_id': '7465584', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-tests', 'sha1': '73843baf45f8a92d8e3fcbea3f024c97e73036da'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9764, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-tests', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '73843baf45f8a92d8e3fcbea3f024c97e73036da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-24_07:31:48', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-24T08:03:17.866 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T08:03:17.868 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T08:03:17.917 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T08:03:17.925 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T08:03:17.984 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:17.984 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T08:03:18.007 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T08:03:18.007 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2023-11-24T08:03:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T08:03:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:03:18.064 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 385832 Links: 1 2023-11-24T08:03:18.064 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:03:18.064 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:03:18.064 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-11-24 08:03:09.851584668 +0000 2023-11-24T08:03:18.064 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-11-24 08:00:26.342414277 +0000 2023-11-24T08:03:18.065 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-11-24 08:00:26.342414277 +0000 2023-11-24T08:03:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-11-24T08:03:18.065 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T08:03:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-11-24T08:03:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-11-24T08:03:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00023953 s, 2.1 MB/s 2023-11-24T08:03:18.130 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T08:03:18.188 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2023-11-24T08:03:18.245 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T08:03:18.245 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:03:18.246 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 391697 Links: 1 2023-11-24T08:03:18.246 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:03:18.246 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:03:18.246 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-11-24 08:03:09.851584668 +0000 2023-11-24T08:03:18.246 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-11-24 08:00:26.896404540 +0000 2023-11-24T08:03:18.246 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-11-24 08:00:26.896404540 +0000 2023-11-24T08:03:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-11-24T08:03:18.246 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T08:03:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-11-24T08:03:18.311 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-11-24T08:03:18.311 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000235012 s, 2.2 MB/s 2023-11-24T08:03:18.312 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T08:03:18.370 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2023-11-24T08:03:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T08:03:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:03:18.427 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 392272 Links: 1 2023-11-24T08:03:18.427 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:03:18.427 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:03:18.427 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-11-24 08:03:09.851584668 +0000 2023-11-24T08:03:18.427 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-11-24 08:00:27.420395330 +0000 2023-11-24T08:03:18.427 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-11-24 08:00:27.420395330 +0000 2023-11-24T08:03:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-11-24T08:03:18.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T08:03:18.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-11-24T08:03:18.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-11-24T08:03:18.493 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00023956 s, 2.1 MB/s 2023-11-24T08:03:18.494 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T08:03:18.552 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2023-11-24T08:03:18.609 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T08:03:18.609 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:03:18.609 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 394348 Links: 1 2023-11-24T08:03:18.609 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:03:18.609 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:03:18.609 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-11-24 08:03:09.851584668 +0000 2023-11-24T08:03:18.609 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-11-24 08:00:27.930386366 +0000 2023-11-24T08:03:18.610 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-11-24 08:00:27.930386366 +0000 2023-11-24T08:03:18.610 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-11-24T08:03:18.610 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T08:03:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-11-24T08:03:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-11-24T08:03:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00018607 s, 2.8 MB/s 2023-11-24T08:03:18.676 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T08:03:18.734 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:18.734 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:18.734 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T08:03:18.753 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T08:03:18.753 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2023-11-24T08:03:18.813 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T08:03:18.813 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:03:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 389327 Links: 1 2023-11-24T08:03:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:03:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:03:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2023-11-24 08:03:04.540869150 +0000 2023-11-24T08:03:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2023-11-24 08:00:29.888930119 +0000 2023-11-24T08:03:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2023-11-24 08:00:29.888930119 +0000 2023-11-24T08:03:18.814 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2023-11-24T08:03:18.814 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T08:03:18.881 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2023-11-24T08:03:18.881 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2023-11-24T08:03:18.881 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000246249 s, 2.1 MB/s 2023-11-24T08:03:18.882 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T08:03:18.942 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2023-11-24T08:03:19.001 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T08:03:19.001 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:03:19.002 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 377383 Links: 1 2023-11-24T08:03:19.002 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:03:19.002 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:03:19.002 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2023-11-24 08:03:04.541869134 +0000 2023-11-24T08:03:19.002 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2023-11-24 08:00:30.404921796 +0000 2023-11-24T08:03:19.002 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2023-11-24 08:00:30.404921796 +0000 2023-11-24T08:03:19.002 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2023-11-24T08:03:19.002 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T08:03:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2023-11-24T08:03:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2023-11-24T08:03:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000235017 s, 2.2 MB/s 2023-11-24T08:03:19.070 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T08:03:19.130 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2023-11-24T08:03:19.189 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T08:03:19.189 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:03:19.189 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 393306 Links: 1 2023-11-24T08:03:19.189 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:03:19.189 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:03:19.189 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2023-11-24 08:03:04.541869134 +0000 2023-11-24T08:03:19.189 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2023-11-24 08:00:30.912913607 +0000 2023-11-24T08:03:19.189 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2023-11-24 08:00:30.912913607 +0000 2023-11-24T08:03:19.190 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2023-11-24T08:03:19.190 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T08:03:19.257 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2023-11-24T08:03:19.257 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2023-11-24T08:03:19.257 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000234246 s, 2.2 MB/s 2023-11-24T08:03:19.258 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T08:03:19.317 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2023-11-24T08:03:19.376 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T08:03:19.376 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:03:19.376 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 390852 Links: 1 2023-11-24T08:03:19.376 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:03:19.376 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:03:19.376 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2023-11-24 08:03:04.541869134 +0000 2023-11-24T08:03:19.376 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2023-11-24 08:00:31.421905402 +0000 2023-11-24T08:03:19.376 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2023-11-24 08:00:31.421905402 +0000 2023-11-24T08:03:19.377 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2023-11-24T08:03:19.377 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T08:03:19.444 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2023-11-24T08:03:19.444 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2023-11-24T08:03:19.444 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000255292 s, 2.0 MB/s 2023-11-24T08:03:19.445 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T08:03:19.505 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:19.505 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T08:03:19.505 INFO:tasks.ceph:Generating config... 2023-11-24T08:03:19.508 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-24T08:03:19.508 INFO:tasks.ceph:[client] debug client = 20 2023-11-24T08:03:19.508 INFO:tasks.ceph:[client] debug ms = 1 2023-11-24T08:03:19.508 INFO:tasks.ceph:[client] pid file = 2023-11-24T08:03:19.508 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-24T08:03:19.508 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-24T08:03:19.508 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-24T08:03:19.508 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-24T08:03:19.508 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-24T08:03:19.508 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-24T08:03:19.509 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-24T08:03:19.510 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-24T08:03:19.510 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-24T08:03:19.510 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-24T08:03:19.510 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-24T08:03:19.510 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-24T08:03:19.510 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-24T08:03:19.510 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-24T08:03:19.510 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-24T08:03:19.510 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-24T08:03:19.510 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-24T08:03:19.511 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-24T08:03:19.511 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-24T08:03:19.511 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-24T08:03:19.511 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-24T08:03:19.511 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-24T08:03:19.511 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-24T08:03:19.511 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-24T08:03:19.511 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-24T08:03:19.511 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-24T08:03:19.511 INFO:tasks.ceph:Setting up mon.a... 2023-11-24T08:03:19.511 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-24T08:03:19.569 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.keyring 2023-11-24T08:03:19.572 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-24T08:03:19.619 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T08:03:19.645 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.153'), ('mon.b', '172.21.15.164'), ('mon.c', '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]')] 2023-11-24T08:03:19.646 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-24T08:03:19.647 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:19.647 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T08:03:19.702 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.153 --add b 172.21.15.164 --addv c '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:19.790 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:19.790 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: generated fsid a594d4d2-de60-4a04-bb93-76779d526986 2023-11-24T08:03:19.790 INFO:teuthology.orchestra.run.smithi153.stdout:setting min_mon_release = pacific 2023-11-24T08:03:19.790 INFO:teuthology.orchestra.run.smithi153.stdout:epoch 0 2023-11-24T08:03:19.790 INFO:teuthology.orchestra.run.smithi153.stdout:fsid a594d4d2-de60-4a04-bb93-76779d526986 2023-11-24T08:03:19.791 INFO:teuthology.orchestra.run.smithi153.stdout:last_changed 2023-11-24T08:03:19.789851+0000 2023-11-24T08:03:19.791 INFO:teuthology.orchestra.run.smithi153.stdout:created 2023-11-24T08:03:19.789851+0000 2023-11-24T08:03:19.791 INFO:teuthology.orchestra.run.smithi153.stdout:min_mon_release 16 (pacific) 2023-11-24T08:03:19.791 INFO:teuthology.orchestra.run.smithi153.stdout:election_strategy: 1 2023-11-24T08:03:19.791 INFO:teuthology.orchestra.run.smithi153.stdout:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2023-11-24T08:03:19.791 INFO:teuthology.orchestra.run.smithi153.stdout:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2023-11-24T08:03:19.791 INFO:teuthology.orchestra.run.smithi153.stdout:2: [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] mon.c 2023-11-24T08:03:19.791 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-24T08:03:19.792 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T08:03:19.808 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a594d4d2-de60-4a04-bb93-76779d526986... 2023-11-24T08:03:19.809 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T08:03:19.852 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T08:03:19.894 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2023-11-24T08:03:19.895 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2023-11-24T08:03:19.895 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T08:03:19.895 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.896 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2023-11-24T08:03:19.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2023-11-24T08:03:19.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2023-11-24T08:03:19.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2023-11-24T08:03:19.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T08:03:19.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T08:03:19.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2023-11-24T08:03:19.898 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.898 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T08:03:19.898 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.898 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2023-11-24T08:03:19.898 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = a594d4d2-de60-4a04-bb93-76779d526986 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.899 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2023-11-24T08:03:19.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2023-11-24T08:03:19.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2023-11-24T08:03:19.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2023-11-24T08:03:19.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2023-11-24T08:03:19.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2023-11-24T08:03:19.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2023-11-24T08:03:19.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2023-11-24T08:03:19.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2023-11-24T08:03:19.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.901 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2023-11-24T08:03:19.901 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2023-11-24T08:03:19.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.901 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2023-11-24T08:03:19.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.901 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2023-11-24T08:03:19.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.901 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2023-11-24T08:03:19.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.901 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2023-11-24T08:03:19.902 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2023-11-24T08:03:19.902 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.902 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2023-11-24T08:03:19.902 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2023-11-24T08:03:19.902 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2023-11-24T08:03:19.902 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2023-11-24T08:03:19.902 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2023-11-24T08:03:19.902 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2023-11-24T08:03:19.902 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2023-11-24T08:03:19.902 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2023-11-24T08:03:19.903 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2023-11-24T08:03:19.903 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-11-24T08:03:19.903 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2023-11-24T08:03:19.903 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2023-11-24T08:03:19.903 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T08:03:19.903 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2023-11-24T08:03:19.903 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2023-11-24T08:03:19.903 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2023-11-24T08:03:19.903 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2023-11-24T08:03:19.903 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-11-24T08:03:19.904 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.904 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2023-11-24T08:03:19.904 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-11-24T08:03:19.904 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2023-11-24T08:03:19.904 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-11-24T08:03:19.904 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-11-24T08:03:19.904 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:03:19.904 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:03:19.904 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2023-11-24T08:03:19.904 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2023-11-24T08:03:19.905 INFO:teuthology.orchestra.run.smithi153.stdout: debug finisher = 20 2023-11-24T08:03:19.905 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.905 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2023-11-24T08:03:19.905 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-11-24T08:03:19.905 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-11-24T08:03:19.905 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2023-11-24T08:03:19.905 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-11-24T08:03:19.905 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2023-11-24T08:03:19.905 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2023-11-24T08:03:19.905 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:03:19.905 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2023-11-24T08:03:19.906 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2023-11-24T08:03:19.906 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:03:19.906 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.906 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T08:03:19.906 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T08:03:19.906 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T08:03:19.906 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.906 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T08:03:19.906 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T08:03:19.906 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T08:03:19.907 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.907 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2023-11-24T08:03:19.907 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2023-11-24T08:03:19.907 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.907 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2023-11-24T08:03:19.907 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2023-11-24T08:03:19.907 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:19.907 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2023-11-24T08:03:19.907 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2023-11-24T08:03:19.907 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2023-11-24T08:03:19.908 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2023-11-24T08:03:19.908 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T08:03:19.908 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T08:03:19.908 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2023-11-24T08:03:19.908 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2023-11-24T08:03:19.908 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-11-24T08:03:19.908 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2023-11-24T08:03:19.908 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-11-24T08:03:19.908 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-11-24T08:03:19.909 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2023-11-24T08:03:19.909 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2023-11-24T08:03:19.909 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2023-11-24T08:03:19.909 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2023-11-24T08:03:19.910 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2023-11-24T08:03:19.910 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2023-11-24T08:03:19.910 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2023-11-24T08:03:19.910 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2023-11-24T08:03:19.910 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2023-11-24T08:03:19.910 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds balancer = 20 2023-11-24T08:03:19.910 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-11-24T08:03:19.910 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2023-11-24T08:03:19.910 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2023-11-24T08:03:19.911 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2023-11-24T08:03:19.911 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2023-11-24T08:03:19.911 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-11-24T08:03:19.911 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-11-24T08:03:19.911 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-11-24T08:03:19.912 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2023-11-24T08:03:19.912 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2023-11-24T08:03:19.912 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T08:03:19.912 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2023-11-24T08:03:19.912 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.912 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2023-11-24T08:03:19.912 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.912 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2023-11-24T08:03:19.912 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.912 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2023-11-24T08:03:19.913 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2023-11-24T08:03:19.913 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.913 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2023-11-24T08:03:19.913 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2023-11-24T08:03:19.913 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.913 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T08:03:19.913 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2023-11-24T08:03:19.913 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.913 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T08:03:19.913 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T08:03:19.914 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.914 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2023-11-24T08:03:19.914 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.914 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2023-11-24T08:03:19.914 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2023-11-24T08:03:19.914 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2023-11-24T08:03:19.914 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2023-11-24T08:03:19.914 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2023-11-24T08:03:19.914 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2023-11-24T08:03:19.914 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2023-11-24T08:03:19.914 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T08:03:19.915 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T08:03:19.915 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2023-11-24T08:03:19.915 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.915 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T08:03:19.915 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.915 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2023-11-24T08:03:19.915 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.915 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2023-11-24T08:03:19.915 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on skipped message = False 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = a594d4d2-de60-4a04-bb93-76779d526986 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2023-11-24T08:03:19.916 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2023-11-24T08:03:19.917 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2023-11-24T08:03:19.917 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.917 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2023-11-24T08:03:19.917 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2023-11-24T08:03:19.917 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.917 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2023-11-24T08:03:19.917 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2023-11-24T08:03:19.917 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2023-11-24T08:03:19.917 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2023-11-24T08:03:19.918 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.918 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2023-11-24T08:03:19.918 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2023-11-24T08:03:19.918 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.918 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2023-11-24T08:03:19.918 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.918 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2023-11-24T08:03:19.918 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.918 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2023-11-24T08:03:19.918 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: bdev async discard = True 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: bdev enable discard = True 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore allocator = bitmap 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-11-24T08:03:19.919 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2023-11-24T08:03:19.920 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: debug finisher = 20 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2023-11-24T08:03:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.922 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: mon op complaint time = 120 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: client mount timeout = 600 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2023-11-24T08:03:19.923 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = "" 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds = 20 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds balancer = 20 2023-11-24T08:03:19.924 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-11-24T08:03:19.925 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug frag = True 2023-11-24T08:03:19.925 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug scatterstat = True 2023-11-24T08:03:19.925 INFO:teuthology.orchestra.run.smithi164.stdout: mds op complaint time = 180 2023-11-24T08:03:19.925 INFO:teuthology.orchestra.run.smithi164.stdout: mds verify scatter = True 2023-11-24T08:03:19.925 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2023-11-24T08:03:19.925 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2023-11-24T08:03:19.925 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2023-11-24T08:03:19.926 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-24T08:03:19.927 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-24T08:03:20.028 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-24T08:03:20.029 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:20.029 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-24T08:03:20.045 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:20.046 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-24T08:03:20.102 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:03:20.102 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:20.102 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T08:03:20.102 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T08:03:20.180 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:20.180 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:20.237 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:03:20.237 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:20.237 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T08:03:20.237 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T08:03:20.281 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:20.282 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:20.341 INFO:tasks.ceph:Setting up mon nodes... 2023-11-24T08:03:20.342 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-24T08:03:20.342 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T08:03:20.396 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T08:03:20.399 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T08:03:20.473 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T08:03:20.476 INFO:tasks.ceph:Setting up mds nodes... 2023-11-24T08:03:20.476 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T08:03:20.530 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T08:03:20.533 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-24T08:03:20.559 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T08:03:20.653 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T08:03:20.656 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-24T08:03:20.682 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T08:03:20.742 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T08:03:20.745 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-24T08:03:20.773 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T08:03:20.869 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T08:03:20.871 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-24T08:03:20.898 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-24T08:03:20.898 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-24T08:03:20.943 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-24T08:03:20.956 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-24T08:03:20.999 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-24T08:03:21.012 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-24T08:03:21.056 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-24T08:03:21.069 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-24T08:03:21.152 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-24T08:03:21.165 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-24T08:03:21.166 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T08:03:21.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-24T08:03:21.193 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:21.193 INFO:tasks.ceph:role: osd.0 2023-11-24T08:03:21.193 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:03:21.193 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T08:03:21.267 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:21.267 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:21.267 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:21.267 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:21.267 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:21.267 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:21.267 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:21.267 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:21.267 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:21.268 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:21.701 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-11-24T08:03:21.703 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-11-24T08:03:21.704 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-24T08:03:21.886 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-24T08:03:21.920 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-24T08:03:21.988 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:21.988 INFO:tasks.ceph:role: osd.1 2023-11-24T08:03:21.988 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:03:21.989 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T08:03:22.065 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:22.065 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:22.065 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:22.065 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:22.065 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:22.065 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:22.065 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:22.065 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:22.065 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:22.065 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:22.504 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-11-24T08:03:22.506 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-11-24T08:03:22.506 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-24T08:03:22.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-24T08:03:22.649 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-24T08:03:22.716 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:22.717 INFO:tasks.ceph:role: osd.2 2023-11-24T08:03:22.717 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:03:22.717 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T08:03:22.791 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:22.791 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:22.791 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:22.792 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:22.792 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:22.792 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:22.792 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:22.792 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:22.792 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:22.792 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:23.248 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-11-24T08:03:23.250 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-11-24T08:03:23.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-24T08:03:23.421 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-24T08:03:23.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-24T08:03:23.520 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:23.520 INFO:tasks.ceph:role: osd.3 2023-11-24T08:03:23.520 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:03:23.520 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T08:03:23.594 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:23.595 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:23.595 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:23.595 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:23.595 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:23.595 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:23.595 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:23.595 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:23.595 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:23.595 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:24.030 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-11-24T08:03:24.031 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-11-24T08:03:24.031 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-24T08:03:24.207 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-24T08:03:24.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:24.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:24.344+0000 7f5acf100640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-24T08:03:24.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:24.344+0000 7f5acf100640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-24T08:03:24.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:24.344+0000 7f5acf100640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T08:03:24.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:24.344+0000 7f5acf100640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T08:03:24.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:24.344+0000 7f5acf100640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T08:03:24.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:24.344+0000 7f5acf100640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-24T08:03:27.216 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-24T08:03:27.247 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:27.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:27.337+0000 7f0458b58640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-24T08:03:27.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:27.337+0000 7f0458b58640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-24T08:03:27.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:27.337+0000 7f0458b58640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T08:03:27.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:27.337+0000 7f0458b58640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T08:03:27.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:27.337+0000 7f0458b58640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T08:03:27.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:27.338+0000 7f0458b58640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-24T08:03:30.208 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-24T08:03:30.238 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:30.326+0000 7fdccc036640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-24T08:03:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:30.326+0000 7fdccc036640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-24T08:03:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:30.326+0000 7fdccc036640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T08:03:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:30.326+0000 7fdccc036640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T08:03:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:30.326+0000 7fdccc036640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T08:03:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:30.327+0000 7fdccc036640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-24T08:03:33.194 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-24T08:03:33.225 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:33.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:33.314+0000 7fe384bae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-24T08:03:33.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:33.314+0000 7fe384bae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-24T08:03:33.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:33.314+0000 7fe384bae640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T08:03:33.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:33.314+0000 7fe384bae640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T08:03:33.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:33.314+0000 7fe384bae640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T08:03:33.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:33.315+0000 7fe384bae640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-24T08:03:36.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-24T08:03:36.214 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-24T08:03:36.247 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:36.247 INFO:tasks.ceph:role: osd.4 2023-11-24T08:03:36.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:03:36.248 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T08:03:36.326 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:36.326 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:36.326 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:36.326 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:36.327 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:36.327 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:36.327 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:36.327 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:36.327 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:36.328 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:36.767 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2023-11-24T08:03:36.769 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2023-11-24T08:03:36.769 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-24T08:03:36.943 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-24T08:03:36.978 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-24T08:03:37.047 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:37.047 INFO:tasks.ceph:role: osd.5 2023-11-24T08:03:37.047 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:03:37.047 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T08:03:37.122 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:37.122 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:37.123 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:37.123 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:37.123 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:37.123 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:37.123 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:37.123 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:37.123 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:37.123 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:37.544 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2023-11-24T08:03:37.546 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2023-11-24T08:03:37.546 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-24T08:03:37.655 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-24T08:03:37.686 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-24T08:03:37.754 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:37.754 INFO:tasks.ceph:role: osd.6 2023-11-24T08:03:37.754 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:03:37.754 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T08:03:37.828 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:37.829 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:37.829 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:37.829 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:37.829 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:37.829 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:37.829 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:37.830 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:37.830 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:37.830 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:38.270 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2023-11-24T08:03:38.272 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2023-11-24T08:03:38.272 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-24T08:03:38.443 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-24T08:03:38.477 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-24T08:03:38.545 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:38.546 INFO:tasks.ceph:role: osd.7 2023-11-24T08:03:38.546 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:03:38.546 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T08:03:38.620 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:38.620 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:38.620 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:38.621 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:38.621 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:38.621 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:38.621 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:38.621 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:38.621 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:38.621 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:39.061 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2023-11-24T08:03:39.063 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2023-11-24T08:03:39.063 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-24T08:03:39.247 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-24T08:03:39.284 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:39.395 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:39.392+0000 7f6422897640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-24T08:03:39.395 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:39.393+0000 7f6422897640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-24T08:03:39.395 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:39.393+0000 7f6422897640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T08:03:39.395 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:39.393+0000 7f6422897640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T08:03:39.395 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:39.393+0000 7f6422897640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T08:03:39.395 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:39.393+0000 7f6422897640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-24T08:03:42.261 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-24T08:03:42.292 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:42.385 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:42.383+0000 7f46c13e9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-24T08:03:42.385 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:42.383+0000 7f46c13e9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-24T08:03:42.385 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:42.383+0000 7f46c13e9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T08:03:42.385 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:42.383+0000 7f46c13e9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T08:03:42.385 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:42.383+0000 7f46c13e9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T08:03:42.385 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:42.383+0000 7f46c13e9640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-24T08:03:45.252 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-24T08:03:45.284 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:45.375 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:45.373+0000 7f45f70d6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-24T08:03:45.375 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:45.373+0000 7f45f70d6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-24T08:03:45.375 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:45.373+0000 7f45f70d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T08:03:45.376 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:45.373+0000 7f45f70d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T08:03:45.376 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:45.373+0000 7f45f70d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T08:03:45.376 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:45.374+0000 7f45f70d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-24T08:03:47.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:47.869 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:48.255 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-24T08:03:48.286 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:48.379 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:48.376+0000 7f1926fbc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-24T08:03:48.379 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:48.377+0000 7f1926fbc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-24T08:03:48.379 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:48.377+0000 7f1926fbc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T08:03:48.379 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:48.377+0000 7f1926fbc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T08:03:48.379 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:48.377+0000 7f1926fbc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T08:03:48.379 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:48.377+0000 7f1926fbc640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-24T08:03:51.248 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-24T08:03:51.279 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-24T08:03:51.280 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:51.280 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-24T08:03:51.312 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:51.312 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-24T08:03:51.383 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:51.384 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-24T08:03:51.453 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:51.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-24T08:03:51.521 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:51.522 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-24T08:03:51.590 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:51.590 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-24T08:03:51.657 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:51.657 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-24T08:03:51.724 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:51.724 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-24T08:03:51.756 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:51.757 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-24T08:03:51.827 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:51.827 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-24T08:03:51.898 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:51.898 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-24T08:03:51.967 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:51.968 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-24T08:03:52.037 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:52.037 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-24T08:03:52.105 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:52.105 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-24T08:03:52.172 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:52.172 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-24T08:03:52.191 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:52.191 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-24T08:03:52.249 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:52.249 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-24T08:03:52.267 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:52.267 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-24T08:03:52.325 INFO:tasks.ceph:Adding keys to all mons... 2023-11-24T08:03:52.325 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T08:03:52.328 DEBUG:teuthology.orchestra.run.smithi164:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T08:03:52.369 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2023-11-24T08:03:52.369 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDIWGBlXSmiFxAA7jtMExuEpOroMzEOELomPg== 2023-11-24T08:03:52.369 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2023-11-24T08:03:52.369 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDIWGBlx+KYHxAAFmTb68c8Q+OPuEy1aTPrRA== 2023-11-24T08:03:52.370 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2023-11-24T08:03:52.370 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDIWGBlVGztJhAAEqdk6SYM6OJ4VTgapBBIvA== 2023-11-24T08:03:52.370 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2023-11-24T08:03:52.370 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDMWGBlqA2SFBAAO/T01CTkjA4nWupGuLvJfA== 2023-11-24T08:03:52.370 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2023-11-24T08:03:52.370 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDPWGBl1D4rFBAAsB5U6NIJd1MnxnYz7iNsbg== 2023-11-24T08:03:52.370 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2023-11-24T08:03:52.370 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDSWGBlh+SCExAAWteEjpmcESWppG2uGuvRhA== 2023-11-24T08:03:52.370 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDVWGBlEjPOEhAA6fy3O+YzwFZ625c8GvAdww== 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDIWGBle/UvHBAAeeyUHoDjzbEwVnrh42R/pQ== 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDIWGBlYf05LBAAG8lBFt4GsIw9WCLOz1Nb6w== 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDIWGBle4zFMxAAsrvbC5k9Zj3Dz46bnOU0Pw== 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDbWGBlE8p6FxAA49f3frFNrFYxTVgvUn/UNA== 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDeWGBlNlnlFhAAD8/M/46F/1PmYqMFPvatSQ== 2023-11-24T08:03:52.371 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2023-11-24T08:03:52.372 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDhWGBlqQlSFhAAj8WBN4TrdU4xhBALj5+4JQ== 2023-11-24T08:03:52.372 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2023-11-24T08:03:52.372 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDkWGBljhGHFhAAhYVbRp1+nSzfgBwpHAzvKA== 2023-11-24T08:03:52.372 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2023-11-24T08:03:52.372 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDIWGBlu28wOBAATnuO3XTplxrcn9JD3ta5XQ== 2023-11-24T08:03:52.372 INFO:teuthology.orchestra.run.smithi153.stdout:[client.2] 2023-11-24T08:03:52.372 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDIWGBlSJ+FOxAAphdCFULGDZbuhcHaYu318A== 2023-11-24T08:03:52.372 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2023-11-24T08:03:52.372 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDJWGBlT7tPAxAAl1DsWQCIaZcKFC5TNkWxoA== 2023-11-24T08:03:52.372 INFO:teuthology.orchestra.run.smithi153.stdout:[client.3] 2023-11-24T08:03:52.372 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDJWGBliyYXCRAA/QCK4goQ9KvHf+XNyGoVnA== 2023-11-24T08:03:52.392 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.y] 2023-11-24T08:03:52.393 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDIWGBlXSmiFxAA7jtMExuEpOroMzEOELomPg== 2023-11-24T08:03:52.393 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2023-11-24T08:03:52.393 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDIWGBlx+KYHxAAFmTb68c8Q+OPuEy1aTPrRA== 2023-11-24T08:03:52.393 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2023-11-24T08:03:52.393 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDIWGBlVGztJhAAEqdk6SYM6OJ4VTgapBBIvA== 2023-11-24T08:03:52.393 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.0] 2023-11-24T08:03:52.393 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDMWGBlqA2SFBAAO/T01CTkjA4nWupGuLvJfA== 2023-11-24T08:03:52.393 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.1] 2023-11-24T08:03:52.393 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDPWGBl1D4rFBAAsB5U6NIJd1MnxnYz7iNsbg== 2023-11-24T08:03:52.393 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.2] 2023-11-24T08:03:52.393 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDSWGBlh+SCExAAWteEjpmcESWppG2uGuvRhA== 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.3] 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDVWGBlEjPOEhAA6fy3O+YzwFZ625c8GvAdww== 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.x] 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDIWGBle/UvHBAAeeyUHoDjzbEwVnrh42R/pQ== 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDIWGBlYf05LBAAG8lBFt4GsIw9WCLOz1Nb6w== 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDIWGBle4zFMxAAsrvbC5k9Zj3Dz46bnOU0Pw== 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.4] 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDbWGBlE8p6FxAA49f3frFNrFYxTVgvUn/UNA== 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.5] 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDeWGBlNlnlFhAAD8/M/46F/1PmYqMFPvatSQ== 2023-11-24T08:03:52.394 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.6] 2023-11-24T08:03:52.395 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDhWGBlqQlSFhAAj8WBN4TrdU4xhBALj5+4JQ== 2023-11-24T08:03:52.395 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.7] 2023-11-24T08:03:52.395 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDkWGBljhGHFhAAhYVbRp1+nSzfgBwpHAzvKA== 2023-11-24T08:03:52.395 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2023-11-24T08:03:52.395 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDIWGBlu28wOBAATnuO3XTplxrcn9JD3ta5XQ== 2023-11-24T08:03:52.395 INFO:teuthology.orchestra.run.smithi164.stdout:[client.2] 2023-11-24T08:03:52.395 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDIWGBlSJ+FOxAAphdCFULGDZbuhcHaYu318A== 2023-11-24T08:03:52.395 INFO:teuthology.orchestra.run.smithi164.stdout:[client.1] 2023-11-24T08:03:52.395 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDJWGBlT7tPAxAAl1DsWQCIaZcKFC5TNkWxoA== 2023-11-24T08:03:52.395 INFO:teuthology.orchestra.run.smithi164.stdout:[client.3] 2023-11-24T08:03:52.396 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDJWGBliyYXCRAA/QCK4goQ9KvHf+XNyGoVnA== 2023-11-24T08:03:52.396 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:03:52.416 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:03:52.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:52.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:52.553 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:52.556 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:52.612 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:52.614 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:52.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:52.669 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:52.722 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:52.725 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:52.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:52.782 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:52.835 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:03:52.837 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:03:52.890 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:52.892 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:52.949 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:52.952 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:53.007 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:53.010 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:53.063 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:53.065 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:53.118 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:53.120 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:53.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:53.175 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:53.230 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:53.232 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:53.288 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:53.290 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:53.347 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:53.349 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:53.406 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:53.408 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:53.465 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-24T08:03:53.465 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-24T08:03:53.491 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T08:03:53.590 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-24T08:03:53.616 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-24T08:03:53.643 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T08:03:53.742 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-24T08:03:53.767 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-24T08:03:53.834 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T08:03:53.932 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-24T08:03:53.959 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:53.962 DEBUG:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:54.015 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-24T08:03:54.016 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-24T08:03:54.016 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-24T08:03:54.019 INFO:tasks.ceph.mon.a:Started 2023-11-24T08:03:54.020 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-24T08:03:54.020 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-24T08:03:54.059 INFO:tasks.ceph.mon.b:Started 2023-11-24T08:03:54.060 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-24T08:03:54.060 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-24T08:03:54.062 INFO:tasks.ceph.mon.c:Started 2023-11-24T08:03:54.062 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-24T08:03:54.062 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-24T08:03:54.063 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-24T08:03:54.065 INFO:tasks.ceph.mgr.y:Started 2023-11-24T08:03:54.065 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-24T08:03:54.065 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-24T08:03:54.067 INFO:tasks.ceph.mgr.x:Started 2023-11-24T08:03:54.067 INFO:tasks.ceph:Setting crush tunables to default 2023-11-24T08:03:54.067 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd crush tunables default 2023-11-24T08:03:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.187+0000 7f1064ef5700 1 Processor -- start 2023-11-24T08:03:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.187+0000 7f1064ef5700 1 -- start start 2023-11-24T08:03:54.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f1064ef5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f106015e1d0 0x7f10600d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:54.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f1064ef5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10600cf240 0x7f10600d3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:54.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f1064ef5700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10600d3970 0x7f10600b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:54.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f1064ef5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10600d1aa0 con 0x7f106015e1d0 2023-11-24T08:03:54.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f1064ef5700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10600d2ff0 con 0x7f10600d3970 2023-11-24T08:03:54.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f1064ef5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600d1cf0 con 0x7f10600cf240 2023-11-24T08:03:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f105e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f106015e1d0 0x7f10600d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f105e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f106015e1d0 0x7f10600d2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34732/0 (socket says 172.21.15.153:34732) 2023-11-24T08:03:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f105e59c700 1 -- 172.21.15.153:0/2015144547 learned_addr learned my addr 172.21.15.153:0/2015144547 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:03:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f105e59c700 1 -- 172.21.15.153:0/2015144547 >> v2:172.21.15.153:3300/0 conn(0x7f106015e1d0 msgr2=0x7f10600d2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:03:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f105e59c700 1 -- 172.21.15.153:0/2015144547 >> v2:172.21.15.153:3300/0 conn(0x7f106015e1d0 msgr2=0x7f10600d2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f105e59c700 1 --2- 172.21.15.153:0/2015144547 >> v2:172.21.15.153:3300/0 conn(0x7f106015e1d0 0x7f10600d2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.188+0000 7f105e59c700 1 --2- 172.21.15.153:0/2015144547 >> v2:172.21.15.153:3300/0 conn(0x7f106015e1d0 0x7f10600d2ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.189+0000 7f105ed9d700 1 --2- 172.21.15.153:0/2015144547 >> v2:172.21.15.164:3300/0 conn(0x7f10600d3970 0x7f10600b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:54.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.189+0000 7f105dd9b700 1 --2- 172.21.15.153:0/2015144547 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10600cf240 0x7f10600d3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:54.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.189+0000 7f105ed9d700 1 -- 172.21.15.153:0/2015144547 >> v2:172.21.15.164:3300/0 conn(0x7f10600d3970 msgr2=0x7f10600b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T08:03:54.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.189+0000 7f105ed9d700 1 -- 172.21.15.153:0/2015144547 >> v2:172.21.15.164:3300/0 conn(0x7f10600d3970 msgr2=0x7f10600b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:54.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.189+0000 7f105ed9d700 1 --2- 172.21.15.153:0/2015144547 >> v2:172.21.15.164:3300/0 conn(0x7f10600d3970 0x7f10600b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:54.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.189+0000 7f105ed9d700 1 --2- 172.21.15.153:0/2015144547 >> v2:172.21.15.164:3300/0 conn(0x7f10600d3970 0x7f10600b5950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:54.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.189+0000 7f105dd9b700 1 -- 172.21.15.153:0/2015144547 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10600cf240 msgr2=0x7f10600d3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:03:54.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.189+0000 7f105dd9b700 1 -- 172.21.15.153:0/2015144547 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10600cf240 msgr2=0x7f10600d3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:54.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.189+0000 7f105dd9b700 1 --2- 172.21.15.153:0/2015144547 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10600cf240 0x7f10600d3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:54.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.189+0000 7f105dd9b700 1 --2- 172.21.15.153:0/2015144547 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10600cf240 0x7f10600d3430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:54.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.389+0000 7f105e59c700 1 --2- 172.21.15.153:0/2015144547 >> v2:172.21.15.153:3300/0 conn(0x7f106015e1d0 0x7f10600d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:54.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.389+0000 7f105e59c700 1 -- 172.21.15.153:0/2015144547 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10600cf240 msgr2=0x7f10600d3430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:03:54.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.389+0000 7f105e59c700 1 --2- 172.21.15.153:0/2015144547 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10600cf240 0x7f10600d3430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:54.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.389+0000 7f105e59c700 1 -- 172.21.15.153:0/2015144547 >> v2:172.21.15.164:3300/0 conn(0x7f10600d3970 msgr2=0x7f10600b5950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:03:54.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.389+0000 7f105e59c700 1 --2- 172.21.15.153:0/2015144547 >> v2:172.21.15.164:3300/0 conn(0x7f10600d3970 0x7f10600b5950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:54.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.389+0000 7f105e59c700 1 -- 172.21.15.153:0/2015144547 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10600d1fd0 con 0x7f106015e1d0 2023-11-24T08:03:54.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.389+0000 7f105e59c700 1 --2- 172.21.15.153:0/2015144547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f106015e1d0 0x7f10600d2ab0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f10600b6630 tx=0x7f1054009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7158ca0bb3100655 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:54.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.390+0000 7f105d59a700 1 -- 172.21.15.153:0/2015144547 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1054004230 con 0x7f106015e1d0 2023-11-24T08:03:54.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.390+0000 7f105d59a700 1 -- 172.21.15.153:0/2015144547 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1054004390 con 0x7f106015e1d0 2023-11-24T08:03:54.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.390+0000 7f105d59a700 1 -- 172.21.15.153:0/2015144547 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10540038e0 con 0x7f106015e1d0 2023-11-24T08:03:54.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.391+0000 7f1064ef5700 1 -- 172.21.15.153:0/2015144547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f106015e1d0 msgr2=0x7f10600d2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:54.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.391+0000 7f1064ef5700 1 --2- 172.21.15.153:0/2015144547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f106015e1d0 0x7f10600d2ab0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f10600b6630 tx=0x7f1054009c30 comp rx=0 tx=0).stop 2023-11-24T08:03:54.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.391+0000 7f1064ef5700 1 -- 172.21.15.153:0/2015144547 shutdown_connections 2023-11-24T08:03:54.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.391+0000 7f1064ef5700 1 --2- 172.21.15.153:0/2015144547 >> v2:172.21.15.164:3300/0 conn(0x7f10600d3970 0x7f10600b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:54.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.391+0000 7f1064ef5700 1 --2- 172.21.15.153:0/2015144547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f106015e1d0 0x7f10600d2ab0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:54.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.391+0000 7f1064ef5700 1 --2- 172.21.15.153:0/2015144547 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10600cf240 0x7f10600d3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:54.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.391+0000 7f1064ef5700 1 -- 172.21.15.153:0/2015144547 >> 172.21.15.153:0/2015144547 conn(0x7f10600d0950 msgr2=0x7f10600d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:54.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.391+0000 7f1064ef5700 1 -- 172.21.15.153:0/2015144547 shutdown_connections 2023-11-24T08:03:54.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.391+0000 7f1064ef5700 1 -- 172.21.15.153:0/2015144547 wait complete. 2023-11-24T08:03:54.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.393+0000 7f1064ef5700 1 Processor -- start 2023-11-24T08:03:54.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.393+0000 7f1064ef5700 1 -- start start 2023-11-24T08:03:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.394+0000 7f1064ef5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10600cf240 0x7f106015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.394+0000 7f1064ef5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10600d3970 0x7f10600ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.394+0000 7f1064ef5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f106015e1d0 0x7f10600aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.394+0000 7f1064ef5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600cac70 con 0x7f10600d3970 2023-11-24T08:03:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.394+0000 7f1064ef5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c9bd0 con 0x7f10600cf240 2023-11-24T08:03:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.394+0000 7f1064ef5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c9eb0 con 0x7f106015e1d0 2023-11-24T08:03:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.394+0000 7f105dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10600d3970 0x7f10600ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.394+0000 7f105dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10600d3970 0x7f10600ab540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34760/0 (socket says 172.21.15.153:34760) 2023-11-24T08:03:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.394+0000 7f105e59c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10600cf240 0x7f106015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.394+0000 7f105dd9b700 1 -- 172.21.15.153:0/417231678 learned_addr learned my addr 172.21.15.153:0/417231678 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:03:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.394+0000 7f105ed9d700 1 --2- 172.21.15.153:0/417231678 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f106015e1d0 0x7f10600aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:54.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.395+0000 7f105dd9b700 1 -- 172.21.15.153:0/417231678 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f106015e1d0 msgr2=0x7f10600aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:54.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.395+0000 7f105dd9b700 1 --2- 172.21.15.153:0/417231678 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f106015e1d0 0x7f10600aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:54.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.395+0000 7f105dd9b700 1 -- 172.21.15.153:0/417231678 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10600cf240 msgr2=0x7f106015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:54.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.395+0000 7f105dd9b700 1 --2- 172.21.15.153:0/417231678 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10600cf240 0x7f106015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:54.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.395+0000 7f105dd9b700 1 -- 172.21.15.153:0/417231678 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10540095b0 con 0x7f10600d3970 2023-11-24T08:03:54.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.395+0000 7f105e59c700 1 --2- 172.21.15.153:0/417231678 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10600cf240 0x7f106015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:54.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.395+0000 7f105dd9b700 1 --2- 172.21.15.153:0/417231678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10600d3970 0x7f10600ab540 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f105000e7e0 tx=0x7f105000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:54.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.396+0000 7f104effd700 1 -- 172.21.15.153:0/417231678 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000c070 con 0x7f10600d3970 2023-11-24T08:03:54.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.396+0000 7f104effd700 1 -- 172.21.15.153:0/417231678 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1050013630 con 0x7f10600d3970 2023-11-24T08:03:54.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.396+0000 7f104effd700 1 -- 172.21.15.153:0/417231678 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10500139e0 con 0x7f10600d3970 2023-11-24T08:03:54.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.396+0000 7f1064ef5700 1 -- 172.21.15.153:0/417231678 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10600ca190 con 0x7f10600d3970 2023-11-24T08:03:54.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.396+0000 7f1064ef5700 1 -- 172.21.15.153:0/417231678 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10600ca750 con 0x7f10600d3970 2023-11-24T08:03:54.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.396+0000 7f104effd700 1 -- 172.21.15.153:0/417231678 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f105001c400 con 0x7f10600d3970 2023-11-24T08:03:54.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.396+0000 7f104effd700 1 -- 172.21.15.153:0/417231678 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f105001b3b0 con 0x7f10600d3970 2023-11-24T08:03:54.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.397+0000 7f1064ef5700 1 -- 172.21.15.153:0/417231678 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1060068fb0 con 0x7f10600d3970 2023-11-24T08:03:54.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.399+0000 7f104effd700 1 -- 172.21.15.153:0/417231678 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1050017020 con 0x7f10600d3970 2023-11-24T08:03:54.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.476+0000 7f1064ef5700 1 -- 172.21.15.153:0/417231678 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f10600ca970 con 0x7f10600d3970 2023-11-24T08:03:54.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.478+0000 7f104effd700 1 -- 172.21.15.153:0/417231678 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f105000f040 con 0x7f10600d3970 2023-11-24T08:03:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.479+0000 7f1064ef5700 1 -- 172.21.15.153:0/417231678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10600d3970 msgr2=0x7f10600ab540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.479+0000 7f1064ef5700 1 --2- 172.21.15.153:0/417231678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10600d3970 0x7f10600ab540 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f105000e7e0 tx=0x7f105000eaf0 comp rx=0 tx=0).stop 2023-11-24T08:03:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.479+0000 7f1064ef5700 1 -- 172.21.15.153:0/417231678 shutdown_connections 2023-11-24T08:03:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.479+0000 7f1064ef5700 1 --2- 172.21.15.153:0/417231678 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f106015e1d0 0x7f10600aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.479+0000 7f1064ef5700 1 --2- 172.21.15.153:0/417231678 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10600cf240 0x7f106015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.479+0000 7f1064ef5700 1 --2- 172.21.15.153:0/417231678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10600d3970 0x7f10600ab540 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.479+0000 7f1064ef5700 1 -- 172.21.15.153:0/417231678 >> 172.21.15.153:0/417231678 conn(0x7f10600d0950 msgr2=0x7f10600b70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.479+0000 7f1064ef5700 1 -- 172.21.15.153:0/417231678 shutdown_connections 2023-11-24T08:03:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:54.479+0000 7f1064ef5700 1 -- 172.21.15.153:0/417231678 wait complete. 2023-11-24T08:03:54.482 INFO:teuthology.orchestra.run.smithi153.stderr:adjusted tunables profile to default 2023-11-24T08:03:54.493 INFO:tasks.ceph:check_enable_crimson: False 2023-11-24T08:03:54.493 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-24T08:03:54.493 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:54.494 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-24T08:03:54.504 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:54.502+0000 7f6863796200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T08:03:54.505 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:54.504+0000 7f0544518200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T08:03:54.520 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:54.520 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-24T08:03:54.570 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:54.569+0000 7f0544518200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T08:03:54.574 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:54.572+0000 7f6863796200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T08:03:54.587 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:54.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-24T08:03:54.646 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:54.644+0000 7f0544518200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T08:03:54.654 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:03:54.654 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-24T08:03:54.655 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:54.654+0000 7f6863796200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T08:03:54.681 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:54.681 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-24T08:03:54.707 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:54.708 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-24T08:03:54.726 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:54.725+0000 7f0544518200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T08:03:54.739 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:54.738+0000 7f6863796200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T08:03:54.751 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:54.752 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-24T08:03:54.818 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:03:54.818 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-24T08:03:54.876 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:54.875+0000 7f0544518200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T08:03:54.881 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:54.880+0000 7f6863796200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T08:03:54.888 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new a6065e1a-81e5-4b14-bdc6-6427e75ceebc 0 2023-11-24T08:03:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.049+0000 7f77fe8a4700 1 Processor -- start 2023-11-24T08:03:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.049+0000 7f77fe8a4700 1 -- start start 2023-11-24T08:03:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fe8a4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f77f81587f0 0x7f77f806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fe8a4700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f77f80b4370 0x7f77f815b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fe8a4700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f806b530 con 0x7f77f815b370 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fe8a4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f80ae5e0 con 0x7f77f81587f0 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fe8a4700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f815be30 con 0x7f77f80b4370 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fce41700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f77f80b4370 0x7f77f815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fce41700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f77f80b4370 0x7f77f815b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34406/0 (socket says 172.21.15.164:34406) 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77f77fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f77f815b370 0x7f77f80b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55980/0 (socket says 172.21.15.164:55980) 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fce41700 1 -- 172.21.15.164:0/3610267215 learned_addr learned my addr 172.21.15.164:0/3610267215 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77f7fff700 1 --2- 172.21.15.164:0/3610267215 >> v2:172.21.15.153:3300/0 conn(0x7f77f81587f0 0x7f77f806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fce41700 1 -- 172.21.15.164:0/3610267215 >> v2:172.21.15.153:3300/0 conn(0x7f77f81587f0 msgr2=0x7f77f806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fce41700 1 --2- 172.21.15.164:0/3610267215 >> v2:172.21.15.153:3300/0 conn(0x7f77f81587f0 0x7f77f806aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fce41700 1 -- 172.21.15.164:0/3610267215 >> v1:172.21.15.164:6789/0 conn(0x7f77f815b370 legacy=0x7f77f80b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77fce41700 1 -- 172.21.15.164:0/3610267215 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f815c110 con 0x7f77f80b4370 2023-11-24T08:03:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.050+0000 7f77f6ffd700 1 -- 172.21.15.164:0/3610267215 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695988235 0 0) 0x7f77f806b530 con 0x7f77f815b370 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77fce41700 1 --2- 172.21.15.164:0/3610267215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77f80b4370 0x7f77f815b800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009e50 tx=0x7f77f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46664668af992284 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77f6ffd700 1 -- 172.21.15.164:0/3610267215 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f000e070 con 0x7f77f80b4370 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77f6ffd700 1 -- 172.21.15.164:0/3610267215 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f000b8d0 con 0x7f77f80b4370 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77f6ffd700 1 -- 172.21.15.164:0/3610267215 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f000bc80 con 0x7f77f80b4370 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77fe8a4700 1 -- 172.21.15.164:0/3610267215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77f80b4370 msgr2=0x7f77f815b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77fe8a4700 1 --2- 172.21.15.164:0/3610267215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77f80b4370 0x7f77f815b800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009e50 tx=0x7f77f000b330 comp rx=0 tx=0).stop 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77fe8a4700 1 -- 172.21.15.164:0/3610267215 shutdown_connections 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77fe8a4700 1 --2- 172.21.15.164:0/3610267215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77f80b4370 0x7f77f815b800 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77fe8a4700 1 --2- 172.21.15.164:0/3610267215 >> v2:172.21.15.153:3300/0 conn(0x7f77f81587f0 0x7f77f806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77fe8a4700 1 -- 172.21.15.164:0/3610267215 >> 172.21.15.164:0/3610267215 conn(0x7f77f80d0bf0 msgr2=0x7f77f80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77fe8a4700 1 -- 172.21.15.164:0/3610267215 shutdown_connections 2023-11-24T08:03:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.051+0000 7f77fe8a4700 1 -- 172.21.15.164:0/3610267215 wait complete. 2023-11-24T08:03:55.057 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.052+0000 7f77fe8a4700 1 Processor -- start 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.053+0000 7f77fe8a4700 1 -- start start 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.053+0000 7f77fe8a4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77f80b4370 0x7f77f814a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.053+0000 7f77fe8a4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77f81587f0 0x7f77f80b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.053+0000 7f77fe8a4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77f815b370 0x7f77f81499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.053+0000 7f77fe8a4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f814b4a0 con 0x7f77f81587f0 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.053+0000 7f77fe8a4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f814a890 con 0x7f77f815b370 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.053+0000 7f77fe8a4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f814ab70 con 0x7f77f80b4370 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.053+0000 7f77fce41700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77f815b370 0x7f77f81499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.053+0000 7f77fce41700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77f815b370 0x7f77f81499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34412/0 (socket says 172.21.15.164:34412) 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.053+0000 7f77fce41700 1 -- 172.21.15.164:0/1860065445 learned_addr learned my addr 172.21.15.164:0/1860065445 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77f77fe700 1 --2- 172.21.15.164:0/1860065445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77f81587f0 0x7f77f80b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77f7fff700 1 --2- 172.21.15.164:0/1860065445 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77f80b4370 0x7f77f814a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77fce41700 1 -- 172.21.15.164:0/1860065445 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77f80b4370 msgr2=0x7f77f814a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77fce41700 1 --2- 172.21.15.164:0/1860065445 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77f80b4370 0x7f77f814a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77fce41700 1 -- 172.21.15.164:0/1860065445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77f81587f0 msgr2=0x7f77f80b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77fce41700 1 --2- 172.21.15.164:0/1860065445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77f81587f0 0x7f77f80b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77fce41700 1 -- 172.21.15.164:0/1860065445 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f0009b30 con 0x7f77f815b370 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77fce41700 1 --2- 172.21.15.164:0/1860065445 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77f815b370 0x7f77f81499b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f77f815bf70 tx=0x7f77f0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77f4ff9700 1 -- 172.21.15.164:0/1860065445 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0004880 con 0x7f77f815b370 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77f4ff9700 1 -- 172.21.15.164:0/1860065445 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f00099b0 con 0x7f77f815b370 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77fe8a4700 1 -- 172.21.15.164:0/1860065445 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f814ae50 con 0x7f77f815b370 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77f4ff9700 1 -- 172.21.15.164:0/1860065445 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f001c640 con 0x7f77f815b370 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77fe8a4700 1 -- 172.21.15.164:0/1860065445 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f80b1d10 con 0x7f77f815b370 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77f4ff9700 1 -- 172.21.15.164:0/1860065445 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f77f001caa0 con 0x7f77f815b370 2023-11-24T08:03:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.054+0000 7f77f4ff9700 1 -- 172.21.15.164:0/1860065445 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f77f0025b90 con 0x7f77f815b370 2023-11-24T08:03:55.060 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.055+0000 7f77fe8a4700 1 -- 172.21.15.164:0/1860065445 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f814b610 con 0x7f77f815b370 2023-11-24T08:03:55.060 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.057+0000 7f77f4ff9700 1 -- 172.21.15.164:0/1860065445 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f77f0020070 con 0x7f77f815b370 2023-11-24T08:03:55.143 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.141+0000 7f77fe8a4700 1 -- 172.21.15.164:0/1860065445 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a6065e1a-81e5-4b14-bdc6-6427e75ceebc", "id": 0} v 0) v1 -- 0x7f77f8068fb0 con 0x7f77f815b370 2023-11-24T08:03:55.145 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.144+0000 7f77f4ff9700 1 -- 172.21.15.164:0/1860065445 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6065e1a-81e5-4b14-bdc6-6427e75ceebc", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f77f00330b0 con 0x7f77f815b370 2023-11-24T08:03:55.146 INFO:teuthology.orchestra.run.smithi164.stdout:0 2023-11-24T08:03:55.147 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.145+0000 7f77fe8a4700 1 -- 172.21.15.164:0/1860065445 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77f815b370 msgr2=0x7f77f81499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.147 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.145+0000 7f77fe8a4700 1 --2- 172.21.15.164:0/1860065445 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77f815b370 0x7f77f81499b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f77f815bf70 tx=0x7f77f0004ad0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.147 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.145+0000 7f77fe8a4700 1 -- 172.21.15.164:0/1860065445 shutdown_connections 2023-11-24T08:03:55.148 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.145+0000 7f77fe8a4700 1 --2- 172.21.15.164:0/1860065445 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77f815b370 0x7f77f81499b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.148 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.145+0000 7f77fe8a4700 1 --2- 172.21.15.164:0/1860065445 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77f80b4370 0x7f77f814a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.148 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.145+0000 7f77fe8a4700 1 --2- 172.21.15.164:0/1860065445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77f81587f0 0x7f77f80b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.149 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.145+0000 7f77fe8a4700 1 -- 172.21.15.164:0/1860065445 >> 172.21.15.164:0/1860065445 conn(0x7f77f80d0bf0 msgr2=0x7f77f806b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.149 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.145+0000 7f77fe8a4700 1 -- 172.21.15.164:0/1860065445 shutdown_connections 2023-11-24T08:03:55.149 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.145+0000 7f77fe8a4700 1 -- 172.21.15.164:0/1860065445 wait complete. 2023-11-24T08:03:55.159 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new d416c3bb-a85f-4c70-b5ea-740bc5182eb9 1 2023-11-24T08:03:55.271 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:55.269+0000 7f6863796200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T08:03:55.278 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.277+0000 7f6ba3ef2700 1 Processor -- start 2023-11-24T08:03:55.279 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.277+0000 7f6ba3ef2700 1 -- start start 2023-11-24T08:03:55.281 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.278+0000 7f6ba3ef2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6b9c15ca30 0x7f6b9c0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.281 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.278+0000 7f6ba3ef2700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9c06fd30 con 0x7f6b9c15bf40 2023-11-24T08:03:55.281 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.278+0000 7f6ba3ef2700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9c06f770 con 0x7f6b9c0cccd0 2023-11-24T08:03:55.281 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.278+0000 7f6ba3ef2700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9c0cd6a0 con 0x7f6b9c15ca30 2023-11-24T08:03:55.281 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.278+0000 7f6ba148d700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f6b9c0cccd0 0x7f6b9c15c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55990/0 (socket says 172.21.15.164:55990) 2023-11-24T08:03:55.282 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.278+0000 7f6ba148d700 1 -- 172.21.15.164:0/2019193684 learned_addr learned my addr 172.21.15.164:0/2019193684 (peer_addr_for_me v1:172.21.15.164:0/0) 2023-11-24T08:03:55.282 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.278+0000 7f6ba248f700 1 --2- 172.21.15.164:0/2019193684 >> v2:172.21.15.153:3300/0 conn(0x7f6b9c15ca30 0x7f6b9c0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.282 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.278+0000 7f6ba0c8c700 1 -- 172.21.15.164:0/2019193684 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025472338 0 0) 0x7f6b9c06f770 con 0x7f6b9c0cccd0 2023-11-24T08:03:55.282 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.278+0000 7f6ba0c8c700 1 -- 172.21.15.164:0/2019193684 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b880035b0 con 0x7f6b9c0cccd0 2023-11-24T08:03:55.282 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.278+0000 7f6ba0c8c700 1 -- 172.21.15.164:0/2019193684 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797758591 0 0) 0x7f6b9c06fd30 con 0x7f6b9c15bf40 2023-11-24T08:03:55.282 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.278+0000 7f6ba0c8c700 1 -- 172.21.15.164:0/2019193684 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b9c06f770 con 0x7f6b9c15bf40 2023-11-24T08:03:55.282 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.279+0000 7f6ba248f700 1 -- 172.21.15.164:0/2019193684 >> v1:172.21.15.164:6789/0 conn(0x7f6b9c0cccd0 legacy=0x7f6b9c15c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.282 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.279+0000 7f6ba248f700 1 -- 172.21.15.164:0/2019193684 >> v1:172.21.15.153:6789/0 conn(0x7f6b9c15bf40 legacy=0x7f6b9c0af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.282 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.279+0000 7f6ba248f700 1 -- 172.21.15.164:0/2019193684 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c06fa50 con 0x7f6b9c15ca30 2023-11-24T08:03:55.282 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.279+0000 7f6ba248f700 1 --2- 172.21.15.164:0/2019193684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b9c15ca30 0x7f6b9c0cd160 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009d90 tx=0x7f6b9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50db5a129e80da62 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.283 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.279+0000 7f6ba0c8c700 1 -- 172.21.15.164:0/2019193684 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9400e070 con 0x7f6b9c15ca30 2023-11-24T08:03:55.283 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.279+0000 7f6ba0c8c700 1 -- 172.21.15.164:0/2019193684 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9400bb20 con 0x7f6b9c15ca30 2023-11-24T08:03:55.283 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.279+0000 7f6ba0c8c700 1 -- 172.21.15.164:0/2019193684 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94012430 con 0x7f6b9c15ca30 2023-11-24T08:03:55.283 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.279+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/2019193684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b9c15ca30 msgr2=0x7f6b9c0cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.283 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.279+0000 7f6ba3ef2700 1 --2- 172.21.15.164:0/2019193684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b9c15ca30 0x7f6b9c0cd160 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009d90 tx=0x7f6b9400b330 comp rx=0 tx=0).stop 2023-11-24T08:03:55.283 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.280+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/2019193684 shutdown_connections 2023-11-24T08:03:55.283 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.280+0000 7f6ba3ef2700 1 --2- 172.21.15.164:0/2019193684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b9c15ca30 0x7f6b9c0cd160 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.283 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.280+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/2019193684 >> 172.21.15.164:0/2019193684 conn(0x7f6b9c0b2050 msgr2=0x7f6b9c0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.283 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.280+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/2019193684 shutdown_connections 2023-11-24T08:03:55.283 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.280+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/2019193684 wait complete. 2023-11-24T08:03:55.286 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.281+0000 7f6ba3ef2700 1 Processor -- start 2023-11-24T08:03:55.286 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.281+0000 7f6ba3ef2700 1 -- start start 2023-11-24T08:03:55.286 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.282+0000 7f6ba3ef2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b9c0cccd0 0x7f6b9c143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.286 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.282+0000 7f6ba3ef2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b9c15bf40 0x7f6b9c154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.286 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.282+0000 7f6ba3ef2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b9c15ca30 0x7f6b9c154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.286 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.282+0000 7f6ba3ef2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c1568b0 con 0x7f6b9c15bf40 2023-11-24T08:03:55.287 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.282+0000 7f6ba3ef2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c1f5fe0 con 0x7f6b9c15ca30 2023-11-24T08:03:55.287 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.282+0000 7f6ba3ef2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c1f5d00 con 0x7f6b9c0cccd0 2023-11-24T08:03:55.287 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.282+0000 7f6ba248f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b9c15ca30 0x7f6b9c154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.287 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.282+0000 7f6ba248f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b9c15ca30 0x7f6b9c154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34424/0 (socket says 172.21.15.164:34424) 2023-11-24T08:03:55.287 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.282+0000 7f6ba248f700 1 -- 172.21.15.164:0/1421173476 learned_addr learned my addr 172.21.15.164:0/1421173476 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:55.287 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.282+0000 7f6ba148d700 1 --2- 172.21.15.164:0/1421173476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b9c15bf40 0x7f6b9c154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.287 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.282+0000 7f6ba1c8e700 1 --2- 172.21.15.164:0/1421173476 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b9c0cccd0 0x7f6b9c143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.287 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6ba248f700 1 -- 172.21.15.164:0/1421173476 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b9c0cccd0 msgr2=0x7f6b9c143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.287 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6ba248f700 1 --2- 172.21.15.164:0/1421173476 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b9c0cccd0 0x7f6b9c143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6ba248f700 1 -- 172.21.15.164:0/1421173476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b9c15bf40 msgr2=0x7f6b9c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6ba248f700 1 --2- 172.21.15.164:0/1421173476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b9c15bf40 0x7f6b9c154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6ba248f700 1 -- 172.21.15.164:0/1421173476 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b94009a70 con 0x7f6b9c15ca30 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6ba248f700 1 --2- 172.21.15.164:0/1421173476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b9c15ca30 0x7f6b9c154990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6b94013000 tx=0x7f6b94004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6b927fc700 1 -- 172.21.15.164:0/1421173476 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94012430 con 0x7f6b9c15ca30 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6b927fc700 1 -- 172.21.15.164:0/1421173476 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b94020070 con 0x7f6b9c15ca30 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6b927fc700 1 -- 172.21.15.164:0/1421173476 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9401ba50 con 0x7f6b9c15ca30 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/1421173476 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c1599e0 con 0x7f6b9c15ca30 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/1421173476 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9c159fa0 con 0x7f6b9c15ca30 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6b927fc700 1 -- 172.21.15.164:0/1421173476 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6b94027480 con 0x7f6b9c15ca30 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.283+0000 7f6b927fc700 1 -- 172.21.15.164:0/1421173476 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6b94022070 con 0x7f6b9c15ca30 2023-11-24T08:03:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.284+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/1421173476 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9c068d90 con 0x7f6b9c15ca30 2023-11-24T08:03:55.289 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.288+0000 7f6b927fc700 1 -- 172.21.15.164:0/1421173476 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6b9402c020 con 0x7f6b9c15ca30 2023-11-24T08:03:55.306 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:55.305+0000 7f0544518200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T08:03:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.374+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/1421173476 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d416c3bb-a85f-4c70-b5ea-740bc5182eb9", "id": 1} v 0) v1 -- 0x7f6b9c15a130 con 0x7f6b9c15ca30 2023-11-24T08:03:55.380 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.379+0000 7f6b927fc700 1 -- 172.21.15.164:0/1421173476 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d416c3bb-a85f-4c70-b5ea-740bc5182eb9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b94027a40 con 0x7f6b9c15ca30 2023-11-24T08:03:55.380 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-11-24T08:03:55.382 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.380+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/1421173476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b9c15ca30 msgr2=0x7f6b9c154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.382 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.380+0000 7f6ba3ef2700 1 --2- 172.21.15.164:0/1421173476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b9c15ca30 0x7f6b9c154990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6b94013000 tx=0x7f6b94004ad0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.382 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.380+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/1421173476 shutdown_connections 2023-11-24T08:03:55.382 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.380+0000 7f6ba3ef2700 1 --2- 172.21.15.164:0/1421173476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b9c15ca30 0x7f6b9c154990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.382 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.380+0000 7f6ba3ef2700 1 --2- 172.21.15.164:0/1421173476 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b9c0cccd0 0x7f6b9c143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.382 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.380+0000 7f6ba3ef2700 1 --2- 172.21.15.164:0/1421173476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b9c15bf40 0x7f6b9c154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.382 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.380+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/1421173476 >> 172.21.15.164:0/1421173476 conn(0x7f6b9c0b2050 msgr2=0x7f6b9c14fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.382 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.380+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/1421173476 shutdown_connections 2023-11-24T08:03:55.382 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.380+0000 7f6ba3ef2700 1 -- 172.21.15.164:0/1421173476 wait complete. 2023-11-24T08:03:55.390 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:55.388+0000 7f6863796200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T08:03:55.394 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 330df0f9-611a-442a-becf-3e8d2919cbbe 2 2023-11-24T08:03:55.431 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:55.429+0000 7f0544518200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T08:03:55.493 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:55.488+0000 7f6863796200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T08:03:55.516 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.514+0000 7fe23ce8c700 1 Processor -- start 2023-11-24T08:03:55.516 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.514+0000 7fe23ce8c700 1 -- start start 2023-11-24T08:03:55.516 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:55.514+0000 7f0544518200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T08:03:55.518 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.515+0000 7fe23ce8c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe2380c6c30 0x7fe2380cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.518 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.515+0000 7fe23ce8c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2380d0140 con 0x7fe23815bf50 2023-11-24T08:03:55.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.515+0000 7fe23ce8c700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2380cf3d0 con 0x7fe2380cef40 2023-11-24T08:03:55.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.515+0000 7fe23ce8c700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23815c330 con 0x7fe2380c6c30 2023-11-24T08:03:55.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.515+0000 7fe235d9b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe2380c6c30 0x7fe2380cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.515+0000 7fe235d9b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe2380c6c30 0x7fe2380cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34428/0 (socket says 172.21.15.164:34428) 2023-11-24T08:03:55.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.515+0000 7fe235d9b700 1 -- 172.21.15.164:0/1807593668 learned_addr learned my addr 172.21.15.164:0/1807593668 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:55.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.515+0000 7fe236d9d700 1 --1- 172.21.15.164:0/1807593668 >> v1:172.21.15.164:6789/0 conn(0x7fe2380cef40 0x7fe2380cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56006/0 (socket says 172.21.15.164:56006) 2023-11-24T08:03:55.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.516+0000 7fe235d9b700 1 -- 172.21.15.164:0/1807593668 >> v1:172.21.15.164:6789/0 conn(0x7fe2380cef40 legacy=0x7fe2380cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.516+0000 7fe235d9b700 1 -- 172.21.15.164:0/1807593668 >> v1:172.21.15.153:6789/0 conn(0x7fe23815bf50 legacy=0x7fe2380ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.516+0000 7fe235d9b700 1 -- 172.21.15.164:0/1807593668 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2380d03e0 con 0x7fe2380c6c30 2023-11-24T08:03:55.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.516+0000 7fe235d9b700 1 --2- 172.21.15.164:0/1807593668 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2380c6c30 0x7fe2380cea00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0098f0 tx=0x7fe22c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0a0c4b1b323685b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.516+0000 7fe23559a700 1 -- 172.21.15.164:0/1807593668 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c00b8a0 con 0x7fe2380c6c30 2023-11-24T08:03:55.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.516+0000 7fe23559a700 1 -- 172.21.15.164:0/1807593668 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c00ba00 con 0x7fe2380c6c30 2023-11-24T08:03:55.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.516+0000 7fe23559a700 1 -- 172.21.15.164:0/1807593668 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c00bd90 con 0x7fe2380c6c30 2023-11-24T08:03:55.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.517+0000 7fe23ce8c700 1 -- 172.21.15.164:0/1807593668 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2380c6c30 msgr2=0x7fe2380cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.517+0000 7fe23ce8c700 1 --2- 172.21.15.164:0/1807593668 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2380c6c30 0x7fe2380cea00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0098f0 tx=0x7fe22c009c00 comp rx=0 tx=0).stop 2023-11-24T08:03:55.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.517+0000 7fe23ce8c700 1 -- 172.21.15.164:0/1807593668 shutdown_connections 2023-11-24T08:03:55.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.517+0000 7fe23ce8c700 1 --2- 172.21.15.164:0/1807593668 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2380c6c30 0x7fe2380cea00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.517+0000 7fe23ce8c700 1 -- 172.21.15.164:0/1807593668 >> 172.21.15.164:0/1807593668 conn(0x7fe2380b3780 msgr2=0x7fe2380b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.517+0000 7fe23ce8c700 1 -- 172.21.15.164:0/1807593668 shutdown_connections 2023-11-24T08:03:55.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.517+0000 7fe23ce8c700 1 -- 172.21.15.164:0/1807593668 wait complete. 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.518+0000 7fe23ce8c700 1 Processor -- start 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.518+0000 7fe23ce8c700 1 -- start start 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.519+0000 7fe23ce8c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2380c6c30 0x7fe238157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.519+0000 7fe23ce8c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2380cef40 0x7fe2380b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.519+0000 7fe23ce8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23815bf50 0x7fe2380b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.519+0000 7fe23ce8c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c8c80 con 0x7fe23815bf50 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.519+0000 7fe23ce8c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c8f60 con 0x7fe2380cef40 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.519+0000 7fe23ce8c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c9240 con 0x7fe2380c6c30 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.519+0000 7fe235d9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2380cef40 0x7fe2380b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.519+0000 7fe235d9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2380cef40 0x7fe2380b6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34434/0 (socket says 172.21.15.164:34434) 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.519+0000 7fe235d9b700 1 -- 172.21.15.164:0/705163648 learned_addr learned my addr 172.21.15.164:0/705163648 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:55.523 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe236d9d700 1 --2- 172.21.15.164:0/705163648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23815bf50 0x7fe2380b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe23659c700 1 --2- 172.21.15.164:0/705163648 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2380c6c30 0x7fe238157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe235d9b700 1 -- 172.21.15.164:0/705163648 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2380c6c30 msgr2=0x7fe238157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe235d9b700 1 --2- 172.21.15.164:0/705163648 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2380c6c30 0x7fe238157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe235d9b700 1 -- 172.21.15.164:0/705163648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23815bf50 msgr2=0x7fe2380b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe235d9b700 1 --2- 172.21.15.164:0/705163648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23815bf50 0x7fe2380b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe235d9b700 1 -- 172.21.15.164:0/705163648 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c009550 con 0x7fe2380cef40 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe236d9d700 1 --2- 172.21.15.164:0/705163648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23815bf50 0x7fe2380b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe235d9b700 1 --2- 172.21.15.164:0/705163648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2380cef40 0x7fe2380b6de0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe22c000c00 tx=0x7fe22c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe226ffd700 1 -- 172.21.15.164:0/705163648 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c004380 con 0x7fe2380cef40 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe226ffd700 1 -- 172.21.15.164:0/705163648 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c01f070 con 0x7fe2380cef40 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe23ce8c700 1 -- 172.21.15.164:0/705163648 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2380c9520 con 0x7fe2380cef40 2023-11-24T08:03:55.524 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe226ffd700 1 -- 172.21.15.164:0/705163648 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0036a0 con 0x7fe2380cef40 2023-11-24T08:03:55.525 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe23ce8c700 1 -- 172.21.15.164:0/705163648 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe238158060 con 0x7fe2380cef40 2023-11-24T08:03:55.525 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe226ffd700 1 -- 172.21.15.164:0/705163648 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe22c021030 con 0x7fe2380cef40 2023-11-24T08:03:55.525 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.520+0000 7fe226ffd700 1 -- 172.21.15.164:0/705163648 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe22c01acd0 con 0x7fe2380cef40 2023-11-24T08:03:55.525 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.521+0000 7fe23ce8c700 1 -- 172.21.15.164:0/705163648 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe238068fb0 con 0x7fe2380cef40 2023-11-24T08:03:55.525 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.523+0000 7fe226ffd700 1 -- 172.21.15.164:0/705163648 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe22c015020 con 0x7fe2380cef40 2023-11-24T08:03:55.572 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:55.570+0000 7f6863796200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T08:03:55.601 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:55.599+0000 7f0544518200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T08:03:55.611 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.609+0000 7fe23ce8c700 1 -- 172.21.15.164:0/705163648 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "330df0f9-611a-442a-becf-3e8d2919cbbe", "id": 2} v 0) v1 -- 0x7fe2380c84e0 con 0x7fe2380cef40 2023-11-24T08:03:55.616 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.615+0000 7fe226ffd700 1 -- 172.21.15.164:0/705163648 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "330df0f9-611a-442a-becf-3e8d2919cbbe", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe22c01a450 con 0x7fe2380cef40 2023-11-24T08:03:55.617 INFO:teuthology.orchestra.run.smithi164.stdout:2 2023-11-24T08:03:55.618 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.616+0000 7fe23ce8c700 1 -- 172.21.15.164:0/705163648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2380cef40 msgr2=0x7fe2380b6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.618 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.616+0000 7fe23ce8c700 1 --2- 172.21.15.164:0/705163648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2380cef40 0x7fe2380b6de0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe22c000c00 tx=0x7fe22c004750 comp rx=0 tx=0).stop 2023-11-24T08:03:55.618 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.616+0000 7fe23ce8c700 1 -- 172.21.15.164:0/705163648 shutdown_connections 2023-11-24T08:03:55.618 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.616+0000 7fe23ce8c700 1 --2- 172.21.15.164:0/705163648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23815bf50 0x7fe2380b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.618 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.616+0000 7fe23ce8c700 1 --2- 172.21.15.164:0/705163648 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2380c6c30 0x7fe238157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.618 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.616+0000 7fe23ce8c700 1 --2- 172.21.15.164:0/705163648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2380cef40 0x7fe2380b6de0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.618 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.616+0000 7fe23ce8c700 1 -- 172.21.15.164:0/705163648 >> 172.21.15.164:0/705163648 conn(0x7fe2380b3780 msgr2=0x7fe2380ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.619 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.616+0000 7fe23ce8c700 1 -- 172.21.15.164:0/705163648 shutdown_connections 2023-11-24T08:03:55.619 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.616+0000 7fe23ce8c700 1 -- 172.21.15.164:0/705163648 wait complete. 2023-11-24T08:03:55.629 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 84627f84-784e-42e5-bcce-e2cd257e53a7 3 2023-11-24T08:03:55.794 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.792+0000 7f26e5234700 1 Processor -- start 2023-11-24T08:03:55.794 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.792+0000 7f26e5234700 1 -- start start 2023-11-24T08:03:55.797 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26e5234700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26e015bf50 0x7f26e00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.797 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26e5234700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00ce830 0x7f26e00cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.797 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26e5234700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f26e00cf1f0 0x7f26e00c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.797 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26e5234700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e015c330 con 0x7f26e015bf50 2023-11-24T08:03:55.797 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26e5234700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e00d0140 con 0x7f26e00cf1f0 2023-11-24T08:03:55.798 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26e5234700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00d03e0 con 0x7f26e00ce830 2023-11-24T08:03:55.798 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26df59e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f26e00cf1f0 0x7f26e00c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.798 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26de59c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00ce830 0x7f26e00cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.798 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26df59e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f26e00cf1f0 0x7f26e00c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34440/0 (socket says 172.21.15.164:34440) 2023-11-24T08:03:55.798 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26de59c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00ce830 0x7f26e00cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:53030/0 (socket says 172.21.15.164:53030) 2023-11-24T08:03:55.798 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26df59e700 1 -- 172.21.15.164:0/308720026 learned_addr learned my addr 172.21.15.164:0/308720026 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:55.799 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.793+0000 7f26ded9d700 1 --2- 172.21.15.164:0/308720026 >> v2:172.21.15.153:3300/0 conn(0x7f26e015bf50 0x7f26e00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.799 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26df59e700 1 -- 172.21.15.164:0/308720026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00ce830 msgr2=0x7f26e00cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:55.799 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26df59e700 1 --2- 172.21.15.164:0/308720026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00ce830 0x7f26e00cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.799 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26df59e700 1 -- 172.21.15.164:0/308720026 >> v2:172.21.15.153:3300/0 conn(0x7f26e015bf50 msgr2=0x7f26e00ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:55.799 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26df59e700 1 --2- 172.21.15.164:0/308720026 >> v2:172.21.15.153:3300/0 conn(0x7f26e015bf50 0x7f26e00ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.799 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26df59e700 1 -- 172.21.15.164:0/308720026 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00d06c0 con 0x7f26e00cf1f0 2023-11-24T08:03:55.799 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26de59c700 1 --2- 172.21.15.164:0/308720026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00ce830 0x7f26e00cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:55.799 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26df59e700 1 --2- 172.21.15.164:0/308720026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26e00cf1f0 0x7f26e00c5c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f26e00c8c00 tx=0x7f26d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a2da761edfe0d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.799 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26ddd9b700 1 -- 172.21.15.164:0/308720026 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800e070 con 0x7f26e00cf1f0 2023-11-24T08:03:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26ddd9b700 1 -- 172.21.15.164:0/308720026 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800b910 con 0x7f26e00cf1f0 2023-11-24T08:03:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26ddd9b700 1 -- 172.21.15.164:0/308720026 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800bcc0 con 0x7f26e00cf1f0 2023-11-24T08:03:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26e5234700 1 -- 172.21.15.164:0/308720026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26e00cf1f0 msgr2=0x7f26e00c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26e5234700 1 --2- 172.21.15.164:0/308720026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26e00cf1f0 0x7f26e00c5c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f26e00c8c00 tx=0x7f26d800b330 comp rx=0 tx=0).stop 2023-11-24T08:03:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26e5234700 1 -- 172.21.15.164:0/308720026 shutdown_connections 2023-11-24T08:03:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26e5234700 1 --2- 172.21.15.164:0/308720026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26e00cf1f0 0x7f26e00c5c20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26e5234700 1 --2- 172.21.15.164:0/308720026 >> v2:172.21.15.153:3300/0 conn(0x7f26e015bf50 0x7f26e00ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26e5234700 1 --2- 172.21.15.164:0/308720026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00ce830 0x7f26e00cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.794+0000 7f26e5234700 1 -- 172.21.15.164:0/308720026 >> 172.21.15.164:0/308720026 conn(0x7f26e00b3780 msgr2=0x7f26e00b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.795+0000 7f26e5234700 1 -- 172.21.15.164:0/308720026 shutdown_connections 2023-11-24T08:03:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.795+0000 7f26e5234700 1 -- 172.21.15.164:0/308720026 wait complete. 2023-11-24T08:03:55.803 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.796+0000 7f26e5234700 1 Processor -- start 2023-11-24T08:03:55.803 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.796+0000 7f26e5234700 1 -- start start 2023-11-24T08:03:55.803 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26e5234700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e00ce830 0x7f26e00c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.803 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26e5234700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00cf1f0 0x7f26e0149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.803 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26e5234700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26e015bf50 0x7f26e00b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.804 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26e5234700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e015a790 con 0x7f26e00ce830 2023-11-24T08:03:55.804 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26e5234700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00c9510 con 0x7f26e015bf50 2023-11-24T08:03:55.804 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26e5234700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00c97f0 con 0x7f26e00cf1f0 2023-11-24T08:03:55.804 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26de59c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00cf1f0 0x7f26e0149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.804 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26de59c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00cf1f0 0x7f26e0149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:53036/0 (socket says 172.21.15.164:53036) 2023-11-24T08:03:55.804 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26de59c700 1 -- 172.21.15.164:0/290585735 learned_addr learned my addr 172.21.15.164:0/290585735 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:55.804 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26df59e700 1 --2- 172.21.15.164:0/290585735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26e015bf50 0x7f26e00b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.804 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26ded9d700 1 --2- 172.21.15.164:0/290585735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e00ce830 0x7f26e00c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.804 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26de59c700 1 -- 172.21.15.164:0/290585735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26e015bf50 msgr2=0x7f26e00b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.805 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26de59c700 1 --2- 172.21.15.164:0/290585735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26e015bf50 0x7f26e00b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.805 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26de59c700 1 -- 172.21.15.164:0/290585735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e00ce830 msgr2=0x7f26e00c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.805 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26de59c700 1 --2- 172.21.15.164:0/290585735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e00ce830 0x7f26e00c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.805 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26de59c700 1 -- 172.21.15.164:0/290585735 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d40094a0 con 0x7f26e00cf1f0 2023-11-24T08:03:55.805 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26ded9d700 1 --2- 172.21.15.164:0/290585735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e00ce830 0x7f26e00c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:55.805 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26df59e700 1 --2- 172.21.15.164:0/290585735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26e015bf50 0x7f26e00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:55.805 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.797+0000 7f26de59c700 1 --2- 172.21.15.164:0/290585735 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00cf1f0 0x7f26e0149c10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26d400ec10 tx=0x7f26d400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.805 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.798+0000 7f26c77fe700 1 -- 172.21.15.164:0/290585735 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400c850 con 0x7f26e00cf1f0 2023-11-24T08:03:55.805 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.798+0000 7f26c77fe700 1 -- 172.21.15.164:0/290585735 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d400c9b0 con 0x7f26e00cf1f0 2023-11-24T08:03:55.805 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.798+0000 7f26c77fe700 1 -- 172.21.15.164:0/290585735 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400cd20 con 0x7f26e00cf1f0 2023-11-24T08:03:55.805 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.798+0000 7f26e5234700 1 -- 172.21.15.164:0/290585735 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d8009b30 con 0x7f26e00cf1f0 2023-11-24T08:03:55.806 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.798+0000 7f26e5234700 1 -- 172.21.15.164:0/290585735 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e0149410 con 0x7f26e00cf1f0 2023-11-24T08:03:55.806 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.798+0000 7f26c77fe700 1 -- 172.21.15.164:0/290585735 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f26d4005d20 con 0x7f26e00cf1f0 2023-11-24T08:03:55.806 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.798+0000 7f26c77fe700 1 -- 172.21.15.164:0/290585735 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f26d40068e0 con 0x7f26e00cf1f0 2023-11-24T08:03:55.806 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.799+0000 7f26e5234700 1 -- 172.21.15.164:0/290585735 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e0068fb0 con 0x7f26e00cf1f0 2023-11-24T08:03:55.806 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.801+0000 7f26c77fe700 1 -- 172.21.15.164:0/290585735 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f26d4021060 con 0x7f26e00cf1f0 2023-11-24T08:03:55.887 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.885+0000 7f26e5234700 1 -- 172.21.15.164:0/290585735 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "84627f84-784e-42e5-bcce-e2cd257e53a7", "id": 3} v 0) v1 -- 0x7f26e00b7ab0 con 0x7f26e00cf1f0 2023-11-24T08:03:55.890 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.889+0000 7f26c77fe700 1 -- 172.21.15.164:0/290585735 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84627f84-784e-42e5-bcce-e2cd257e53a7", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f26d4017070 con 0x7f26e00cf1f0 2023-11-24T08:03:55.890 INFO:teuthology.orchestra.run.smithi164.stdout:3 2023-11-24T08:03:55.891 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.890+0000 7f26e5234700 1 -- 172.21.15.164:0/290585735 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00cf1f0 msgr2=0x7f26e0149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.892 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.890+0000 7f26e5234700 1 --2- 172.21.15.164:0/290585735 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00cf1f0 0x7f26e0149c10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26d400ec10 tx=0x7f26d400ef20 comp rx=0 tx=0).stop 2023-11-24T08:03:55.892 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.890+0000 7f26e5234700 1 -- 172.21.15.164:0/290585735 shutdown_connections 2023-11-24T08:03:55.892 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.890+0000 7f26e5234700 1 --2- 172.21.15.164:0/290585735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26e015bf50 0x7f26e00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.892 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.890+0000 7f26e5234700 1 --2- 172.21.15.164:0/290585735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e00ce830 0x7f26e00c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.892 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.890+0000 7f26e5234700 1 --2- 172.21.15.164:0/290585735 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26e00cf1f0 0x7f26e0149c10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.892 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.890+0000 7f26e5234700 1 -- 172.21.15.164:0/290585735 >> 172.21.15.164:0/290585735 conn(0x7f26e00b3780 msgr2=0x7f26e0070550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.892 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.890+0000 7f26e5234700 1 -- 172.21.15.164:0/290585735 shutdown_connections 2023-11-24T08:03:55.892 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:55.890+0000 7f26e5234700 1 -- 172.21.15.164:0/290585735 wait complete. 2023-11-24T08:03:55.903 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 8b85c70d-b206-40de-9fe2-8aad22c2804b 4 2023-11-24T08:03:56.009 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:56.007+0000 7f6863796200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T08:03:56.026 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.024+0000 7f1b7ee62700 1 Processor -- start 2023-11-24T08:03:56.026 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.024+0000 7f1b7ee62700 1 -- start start 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b7ee62700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1b780746a0 0x7f1b780add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b7ee62700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7806b080 con 0x7f1b7815f9e0 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b7ee62700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7815c290 con 0x7f1b780cf610 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b7ee62700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b780cf9f0 con 0x7f1b780746a0 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b7d3ff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1b780746a0 0x7f1b780add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b7d3ff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1b780746a0 0x7f1b780add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34452/0 (socket says 172.21.15.164:34452) 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b7d3ff700 1 -- 172.21.15.164:0/132663185 learned_addr learned my addr 172.21.15.164:0/132663185 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:56.029 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b7d3ff700 1 -- 172.21.15.164:0/132663185 >> v1:172.21.15.164:6789/0 conn(0x7f1b780cf610 legacy=0x7f1b780b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.029 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b7d3ff700 1 -- 172.21.15.164:0/132663185 >> v1:172.21.15.153:6789/0 conn(0x7f1b7815f9e0 legacy=0x7f1b78073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.029 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b7d3ff700 1 -- 172.21.15.164:0/132663185 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7815ff80 con 0x7f1b780746a0 2023-11-24T08:03:56.029 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b7d3ff700 1 --2- 172.21.15.164:0/132663185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b780746a0 0x7f1b780add40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009e50 tx=0x7f1b7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7639a397ab9d104 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.029 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b777fe700 1 -- 172.21.15.164:0/132663185 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000e070 con 0x7f1b780746a0 2023-11-24T08:03:56.029 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b777fe700 1 -- 172.21.15.164:0/132663185 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7000b9c0 con 0x7f1b780746a0 2023-11-24T08:03:56.029 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.026+0000 7f1b777fe700 1 -- 172.21.15.164:0/132663185 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000bd70 con 0x7f1b780746a0 2023-11-24T08:03:56.030 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.027+0000 7f1b7ee62700 1 -- 172.21.15.164:0/132663185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b780746a0 msgr2=0x7f1b780add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.030 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.027+0000 7f1b7ee62700 1 --2- 172.21.15.164:0/132663185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b780746a0 0x7f1b780add40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009e50 tx=0x7f1b7000b330 comp rx=0 tx=0).stop 2023-11-24T08:03:56.030 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.027+0000 7f1b7ee62700 1 -- 172.21.15.164:0/132663185 shutdown_connections 2023-11-24T08:03:56.030 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.027+0000 7f1b7ee62700 1 --2- 172.21.15.164:0/132663185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b780746a0 0x7f1b780add40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.030 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.027+0000 7f1b7ee62700 1 -- 172.21.15.164:0/132663185 >> 172.21.15.164:0/132663185 conn(0x7f1b780d0bf0 msgr2=0x7f1b780d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.030 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.027+0000 7f1b7ee62700 1 -- 172.21.15.164:0/132663185 shutdown_connections 2023-11-24T08:03:56.030 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.027+0000 7f1b7ee62700 1 -- 172.21.15.164:0/132663185 wait complete. 2023-11-24T08:03:56.031 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.029+0000 7f1b7ee62700 1 Processor -- start 2023-11-24T08:03:56.031 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.029+0000 7f1b7ee62700 1 -- start start 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7ee62700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b780746a0 0x7f1b781403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7ee62700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b780cf610 0x7f1b78154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7ee62700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b7815f9e0 0x7f1b78157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7ee62700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b781576b0 con 0x7f1b780cf610 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7ee62700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b78157bf0 con 0x7f1b780746a0 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7ee62700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7815d5a0 con 0x7f1b7815f9e0 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7cbfe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b780746a0 0x7f1b781403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7d3ff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b7815f9e0 0x7f1b78157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7cbfe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b780746a0 0x7f1b781403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34454/0 (socket says 172.21.15.164:34454) 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7cbfe700 1 -- 172.21.15.164:0/257715654 learned_addr learned my addr 172.21.15.164:0/257715654 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b77fff700 1 --2- 172.21.15.164:0/257715654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b780cf610 0x7f1b78154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7cbfe700 1 -- 172.21.15.164:0/257715654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b7815f9e0 msgr2=0x7f1b78157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7cbfe700 1 --2- 172.21.15.164:0/257715654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b7815f9e0 0x7f1b78157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7cbfe700 1 -- 172.21.15.164:0/257715654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b780cf610 msgr2=0x7f1b78154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7cbfe700 1 --2- 172.21.15.164:0/257715654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b780cf610 0x7f1b78154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7cbfe700 1 -- 172.21.15.164:0/257715654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b70009b30 con 0x7f1b780746a0 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b7cbfe700 1 --2- 172.21.15.164:0/257715654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b780746a0 0x7f1b781403f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800c4e0 tx=0x7f1b6800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b757fa700 1 -- 172.21.15.164:0/257715654 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b680052d0 con 0x7f1b780746a0 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b757fa700 1 -- 172.21.15.164:0/257715654 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b68005430 con 0x7f1b780746a0 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.031+0000 7f1b757fa700 1 -- 172.21.15.164:0/257715654 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b680038c0 con 0x7f1b780746a0 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.032+0000 7f1b7ee62700 1 -- 172.21.15.164:0/257715654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b78157910 con 0x7f1b780746a0 2023-11-24T08:03:56.036 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.032+0000 7f1b7ee62700 1 -- 172.21.15.164:0/257715654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7815db20 con 0x7f1b780746a0 2023-11-24T08:03:56.036 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.032+0000 7f1b757fa700 1 -- 172.21.15.164:0/257715654 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1b68003d20 con 0x7f1b780746a0 2023-11-24T08:03:56.036 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.032+0000 7f1b757fa700 1 -- 172.21.15.164:0/257715654 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f1b68011d60 con 0x7f1b780746a0 2023-11-24T08:03:56.036 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.032+0000 7f1b7ee62700 1 -- 172.21.15.164:0/257715654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b780aed30 con 0x7f1b780746a0 2023-11-24T08:03:56.037 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.036+0000 7f1b757fa700 1 -- 172.21.15.164:0/257715654 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1b68017070 con 0x7f1b780746a0 2023-11-24T08:03:56.069 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:56.067+0000 7f0544518200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T08:03:56.122 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.121+0000 7f1b7ee62700 1 -- 172.21.15.164:0/257715654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8b85c70d-b206-40de-9fe2-8aad22c2804b", "id": 4} v 0) v1 -- 0x7f1b78068fb0 con 0x7f1b780746a0 2023-11-24T08:03:56.128 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.126+0000 7f1b757fa700 1 -- 172.21.15.164:0/257715654 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b85c70d-b206-40de-9fe2-8aad22c2804b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1b68011590 con 0x7f1b780746a0 2023-11-24T08:03:56.128 INFO:teuthology.orchestra.run.smithi164.stdout:4 2023-11-24T08:03:56.130 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.127+0000 7f1b7ee62700 1 -- 172.21.15.164:0/257715654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b780746a0 msgr2=0x7f1b781403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.130 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.127+0000 7f1b7ee62700 1 --2- 172.21.15.164:0/257715654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b780746a0 0x7f1b781403f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800c4e0 tx=0x7f1b6800c7f0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.130 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.128+0000 7f1b7ee62700 1 -- 172.21.15.164:0/257715654 shutdown_connections 2023-11-24T08:03:56.130 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.128+0000 7f1b7ee62700 1 --2- 172.21.15.164:0/257715654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b7815f9e0 0x7f1b78157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.130 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.128+0000 7f1b7ee62700 1 --2- 172.21.15.164:0/257715654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b780746a0 0x7f1b781403f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.130 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.128+0000 7f1b7ee62700 1 --2- 172.21.15.164:0/257715654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b780cf610 0x7f1b78154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.130 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.128+0000 7f1b7ee62700 1 -- 172.21.15.164:0/257715654 >> 172.21.15.164:0/257715654 conn(0x7f1b780d0bf0 msgr2=0x7f1b780b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.130 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.128+0000 7f1b7ee62700 1 -- 172.21.15.164:0/257715654 shutdown_connections 2023-11-24T08:03:56.130 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.128+0000 7f1b7ee62700 1 -- 172.21.15.164:0/257715654 wait complete. 2023-11-24T08:03:56.142 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new af815c84-01be-40c2-83a2-97483fc8fecf 5 2023-11-24T08:03:56.264 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.262+0000 7fd6e8726700 1 Processor -- start 2023-11-24T08:03:56.264 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.262+0000 7fd6e8726700 1 -- start start 2023-11-24T08:03:56.266 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e8726700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd6e015e160 0x7fd6e00b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.266 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e8726700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00afc90 0x7fd6e0073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.266 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e8726700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e00b3c60 con 0x7fd6e00744d0 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e8726700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e00b4500 con 0x7fd6e015e160 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e8726700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0074960 con 0x7fd6e00afc90 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e5cc1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00afc90 0x7fd6e0073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e64c2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd6e015e160 0x7fd6e00b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e64c2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd6e015e160 0x7fd6e00b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34460/0 (socket says 172.21.15.164:34460) 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e5cc1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00afc90 0x7fd6e0073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:53054/0 (socket says 172.21.15.164:53054) 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e64c2700 1 -- 172.21.15.164:0/2222791659 learned_addr learned my addr 172.21.15.164:0/2222791659 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e5cc1700 1 -- 172.21.15.164:0/2222791659 >> v2:172.21.15.164:3300/0 conn(0x7fd6e015e160 msgr2=0x7fd6e00b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e5cc1700 1 --2- 172.21.15.164:0/2222791659 >> v2:172.21.15.164:3300/0 conn(0x7fd6e015e160 0x7fd6e00b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e5cc1700 1 -- 172.21.15.164:0/2222791659 >> v1:172.21.15.164:6789/0 conn(0x7fd6e00744d0 legacy=0x7fd6e006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e5cc1700 1 -- 172.21.15.164:0/2222791659 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e00b58c0 con 0x7fd6e00afc90 2023-11-24T08:03:56.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e64c2700 1 --2- 172.21.15.164:0/2222791659 >> v2:172.21.15.164:3300/0 conn(0x7fd6e015e160 0x7fd6e00b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.263+0000 7fd6e5cc1700 1 --2- 172.21.15.164:0/2222791659 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00afc90 0x7fd6e0073f90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009840 tx=0x7fd6d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18a71681a0d16285 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.264+0000 7fd6e54c0700 1 -- 172.21.15.164:0/2222791659 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0011830 con 0x7fd6e00afc90 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.264+0000 7fd6e54c0700 1 -- 172.21.15.164:0/2222791659 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d0011990 con 0x7fd6e00afc90 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.264+0000 7fd6e54c0700 1 -- 172.21.15.164:0/2222791659 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0011d20 con 0x7fd6e00afc90 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.264+0000 7fd6e8726700 1 -- 172.21.15.164:0/2222791659 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00afc90 msgr2=0x7fd6e0073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.264+0000 7fd6e8726700 1 --2- 172.21.15.164:0/2222791659 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00afc90 0x7fd6e0073f90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009840 tx=0x7fd6d0009b50 comp rx=0 tx=0).stop 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.264+0000 7fd6e8726700 1 -- 172.21.15.164:0/2222791659 shutdown_connections 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.264+0000 7fd6e8726700 1 --2- 172.21.15.164:0/2222791659 >> v2:172.21.15.164:3300/0 conn(0x7fd6e015e160 0x7fd6e00b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.264+0000 7fd6e8726700 1 --2- 172.21.15.164:0/2222791659 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00afc90 0x7fd6e0073f90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.264+0000 7fd6e8726700 1 -- 172.21.15.164:0/2222791659 >> 172.21.15.164:0/2222791659 conn(0x7fd6e00d0bf0 msgr2=0x7fd6e00d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.264+0000 7fd6e8726700 1 -- 172.21.15.164:0/2222791659 shutdown_connections 2023-11-24T08:03:56.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.264+0000 7fd6e8726700 1 -- 172.21.15.164:0/2222791659 wait complete. 2023-11-24T08:03:56.271 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.265+0000 7fd6e8726700 1 Processor -- start 2023-11-24T08:03:56.271 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.266+0000 7fd6e8726700 1 -- start start 2023-11-24T08:03:56.271 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.266+0000 7fd6e8726700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00744d0 0x7fd6e00c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.271 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.266+0000 7fd6e8726700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6e00afc90 0x7fd6e00c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.271 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.266+0000 7fd6e8726700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6e015e160 0x7fd6e00c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.271 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.266+0000 7fd6e8726700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00c7660 con 0x7fd6e00afc90 2023-11-24T08:03:56.271 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.266+0000 7fd6e8726700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00c8830 con 0x7fd6e015e160 2023-11-24T08:03:56.271 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.266+0000 7fd6e8726700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00cc220 con 0x7fd6e00744d0 2023-11-24T08:03:56.271 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.266+0000 7fd6e64c2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00744d0 0x7fd6e00c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.266+0000 7fd6e6cc3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6e015e160 0x7fd6e00c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.266+0000 7fd6e64c2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00744d0 0x7fd6e00c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:53058/0 (socket says 172.21.15.164:53058) 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.266+0000 7fd6e64c2700 1 -- 172.21.15.164:0/2490902329 learned_addr learned my addr 172.21.15.164:0/2490902329 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6e5cc1700 1 --2- 172.21.15.164:0/2490902329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6e00afc90 0x7fd6e00c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6e64c2700 1 -- 172.21.15.164:0/2490902329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6e015e160 msgr2=0x7fd6e00c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6e64c2700 1 --2- 172.21.15.164:0/2490902329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6e015e160 0x7fd6e00c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6e64c2700 1 -- 172.21.15.164:0/2490902329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6e00afc90 msgr2=0x7fd6e00c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6e64c2700 1 --2- 172.21.15.164:0/2490902329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6e00afc90 0x7fd6e00c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6e64c2700 1 -- 172.21.15.164:0/2490902329 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc009550 con 0x7fd6e00744d0 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6e5cc1700 1 --2- 172.21.15.164:0/2490902329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6e00afc90 0x7fd6e00c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6e64c2700 1 --2- 172.21.15.164:0/2490902329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00744d0 0x7fd6e00c7120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00e9b0 tx=0x7fd6dc00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6d6ffd700 1 -- 172.21.15.164:0/2490902329 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00c850 con 0x7fd6e00744d0 2023-11-24T08:03:56.272 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6d6ffd700 1 -- 172.21.15.164:0/2490902329 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc00c9b0 con 0x7fd6e00744d0 2023-11-24T08:03:56.273 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6d6ffd700 1 -- 172.21.15.164:0/2490902329 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00cd20 con 0x7fd6e00744d0 2023-11-24T08:03:56.273 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6e8726700 1 -- 172.21.15.164:0/2490902329 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d00094a0 con 0x7fd6e00744d0 2023-11-24T08:03:56.273 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6e8726700 1 -- 172.21.15.164:0/2490902329 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e00c9020 con 0x7fd6e00744d0 2023-11-24T08:03:56.273 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6d6ffd700 1 -- 172.21.15.164:0/2490902329 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd6dc005d20 con 0x7fd6e00744d0 2023-11-24T08:03:56.273 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.267+0000 7fd6d6ffd700 1 -- 172.21.15.164:0/2490902329 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd6dc0067f0 con 0x7fd6e00744d0 2023-11-24T08:03:56.273 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.268+0000 7fd6e8726700 1 -- 172.21.15.164:0/2490902329 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e015d360 con 0x7fd6e00744d0 2023-11-24T08:03:56.273 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.270+0000 7fd6d6ffd700 1 -- 172.21.15.164:0/2490902329 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fd6dc021060 con 0x7fd6e00744d0 2023-11-24T08:03:56.357 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.355+0000 7fd6e8726700 1 -- 172.21.15.164:0/2490902329 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "af815c84-01be-40c2-83a2-97483fc8fecf", "id": 5} v 0) v1 -- 0x7fd6e0068fb0 con 0x7fd6e00744d0 2023-11-24T08:03:56.362 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.360+0000 7fd6d6ffd700 1 -- 172.21.15.164:0/2490902329 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af815c84-01be-40c2-83a2-97483fc8fecf", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd6dc017070 con 0x7fd6e00744d0 2023-11-24T08:03:56.362 INFO:teuthology.orchestra.run.smithi164.stdout:5 2023-11-24T08:03:56.363 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.361+0000 7fd6e8726700 1 -- 172.21.15.164:0/2490902329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00744d0 msgr2=0x7fd6e00c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.363 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.361+0000 7fd6e8726700 1 --2- 172.21.15.164:0/2490902329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00744d0 0x7fd6e00c7120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00e9b0 tx=0x7fd6dc00ecc0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.363 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.361+0000 7fd6e8726700 1 -- 172.21.15.164:0/2490902329 shutdown_connections 2023-11-24T08:03:56.363 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.361+0000 7fd6e8726700 1 --2- 172.21.15.164:0/2490902329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6e015e160 0x7fd6e00c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.363 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.361+0000 7fd6e8726700 1 --2- 172.21.15.164:0/2490902329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6e00744d0 0x7fd6e00c7120 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.364 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.361+0000 7fd6e8726700 1 --2- 172.21.15.164:0/2490902329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6e00afc90 0x7fd6e00c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.364 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.361+0000 7fd6e8726700 1 -- 172.21.15.164:0/2490902329 >> 172.21.15.164:0/2490902329 conn(0x7fd6e00d0bf0 msgr2=0x7fd6e0071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.364 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.361+0000 7fd6e8726700 1 -- 172.21.15.164:0/2490902329 shutdown_connections 2023-11-24T08:03:56.364 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.361+0000 7fd6e8726700 1 -- 172.21.15.164:0/2490902329 wait complete. 2023-11-24T08:03:56.375 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 23bfab6c-1646-4508-9629-df61b02320ff 6 2023-11-24T08:03:56.538 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.537+0000 7fbff06ed700 1 Processor -- start 2023-11-24T08:03:56.539 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.537+0000 7fbff06ed700 1 -- start start 2023-11-24T08:03:56.540 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbff06ed700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe815e290 0x7fbfe80ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.540 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbff06ed700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbfe80ad870 0x7fbfe806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.540 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbff06ed700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe806e400 con 0x7fbfe80aedc0 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbff06ed700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe806e630 con 0x7fbfe80ad870 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbff06ed700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe806e910 con 0x7fbfe815e290 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbfeec8a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbfe80ad870 0x7fbfe806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbfedc88700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe815e290 0x7fbfe80ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbfedc88700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe815e290 0x7fbfe80ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:53066/0 (socket says 172.21.15.164:53066) 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbfeec8a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbfe80ad870 0x7fbfe806f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34476/0 (socket says 172.21.15.164:34476) 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbfedc88700 1 -- 172.21.15.164:0/4061529853 learned_addr learned my addr 172.21.15.164:0/4061529853 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbfeec8a700 1 -- 172.21.15.164:0/4061529853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe815e290 msgr2=0x7fbfe80ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbfeec8a700 1 --2- 172.21.15.164:0/4061529853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe815e290 0x7fbfe80ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbfeec8a700 1 -- 172.21.15.164:0/4061529853 >> v1:172.21.15.164:6789/0 conn(0x7fbfe80aedc0 legacy=0x7fbfe80af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbfeec8a700 1 -- 172.21.15.164:0/4061529853 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe806ebf0 con 0x7fbfe80ad870 2023-11-24T08:03:56.541 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbfedc88700 1 --2- 172.21.15.164:0/4061529853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe815e290 0x7fbfe80ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:56.542 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.538+0000 7fbfeec8a700 1 --2- 172.21.15.164:0/4061529853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe80ad870 0x7fbfe806f6d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009d90 tx=0x7fbfe000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fa0eec53eb4da28 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.542 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.539+0000 7fbfed487700 1 -- 172.21.15.164:0/4061529853 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000e070 con 0x7fbfe80ad870 2023-11-24T08:03:56.542 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.539+0000 7fbfed487700 1 -- 172.21.15.164:0/4061529853 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe000bb20 con 0x7fbfe80ad870 2023-11-24T08:03:56.542 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.539+0000 7fbfed487700 1 -- 172.21.15.164:0/4061529853 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0012430 con 0x7fbfe80ad870 2023-11-24T08:03:56.545 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.539+0000 7fbff06ed700 1 -- 172.21.15.164:0/4061529853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe80ad870 msgr2=0x7fbfe806f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.545 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.539+0000 7fbff06ed700 1 --2- 172.21.15.164:0/4061529853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe80ad870 0x7fbfe806f6d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009d90 tx=0x7fbfe000b330 comp rx=0 tx=0).stop 2023-11-24T08:03:56.545 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.539+0000 7fbff06ed700 1 -- 172.21.15.164:0/4061529853 shutdown_connections 2023-11-24T08:03:56.545 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.539+0000 7fbff06ed700 1 --2- 172.21.15.164:0/4061529853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe80ad870 0x7fbfe806f6d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.545 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.539+0000 7fbff06ed700 1 --2- 172.21.15.164:0/4061529853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe815e290 0x7fbfe80ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.545 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.539+0000 7fbff06ed700 1 -- 172.21.15.164:0/4061529853 >> 172.21.15.164:0/4061529853 conn(0x7fbfe80b2050 msgr2=0x7fbfe80b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.545 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.539+0000 7fbff06ed700 1 -- 172.21.15.164:0/4061529853 shutdown_connections 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.539+0000 7fbff06ed700 1 -- 172.21.15.164:0/4061529853 wait complete. 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbff06ed700 1 Processor -- start 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbff06ed700 1 -- start start 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbff06ed700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe80ad870 0x7fbfe8154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbff06ed700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfe80aedc0 0x7fbfe815fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbff06ed700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe815e290 0x7fbfe8158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbff06ed700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8161570 con 0x7fbfe80aedc0 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbff06ed700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe81608f0 con 0x7fbfe815e290 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbff06ed700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8160bd0 con 0x7fbfe80ad870 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbfee489700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe80ad870 0x7fbfe8154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbfeec8a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe815e290 0x7fbfe8158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.546 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbfeec8a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe815e290 0x7fbfe8158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34482/0 (socket says 172.21.15.164:34482) 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbfeec8a700 1 -- 172.21.15.164:0/2391324139 learned_addr learned my addr 172.21.15.164:0/2391324139 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.541+0000 7fbfee489700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe80ad870 0x7fbfe8154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:53070/0 (socket says 172.21.15.164:53070) 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbfedc88700 1 --2- 172.21.15.164:0/2391324139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfe80aedc0 0x7fbfe815fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbfeec8a700 1 -- 172.21.15.164:0/2391324139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe80ad870 msgr2=0x7fbfe8154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbfeec8a700 1 --2- 172.21.15.164:0/2391324139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe80ad870 0x7fbfe8154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbfeec8a700 1 -- 172.21.15.164:0/2391324139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfe80aedc0 msgr2=0x7fbfe815fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbfeec8a700 1 --2- 172.21.15.164:0/2391324139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfe80aedc0 0x7fbfe815fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbfeec8a700 1 -- 172.21.15.164:0/2391324139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8009550 con 0x7fbfe815e290 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbfee489700 1 --2- 172.21.15.164:0/2391324139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe80ad870 0x7fbfe8154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbfeec8a700 1 --2- 172.21.15.164:0/2391324139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe815e290 0x7fbfe8158a50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0014040 tx=0x7fbfe0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbfdeffd700 1 -- 172.21.15.164:0/2391324139 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0012430 con 0x7fbfe815e290 2023-11-24T08:03:56.547 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbff06ed700 1 -- 172.21.15.164:0/2391324139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe0009a70 con 0x7fbfe815e290 2023-11-24T08:03:56.548 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbfdeffd700 1 -- 172.21.15.164:0/2391324139 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe0020070 con 0x7fbfe815e290 2023-11-24T08:03:56.548 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbfdeffd700 1 -- 172.21.15.164:0/2391324139 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0003ea0 con 0x7fbfe815e290 2023-11-24T08:03:56.548 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.542+0000 7fbff06ed700 1 -- 172.21.15.164:0/2391324139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe8161190 con 0x7fbfe815e290 2023-11-24T08:03:56.548 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.543+0000 7fbfdeffd700 1 -- 172.21.15.164:0/2391324139 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbfe0004340 con 0x7fbfe815e290 2023-11-24T08:03:56.548 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.543+0000 7fbfdeffd700 1 -- 172.21.15.164:0/2391324139 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fbfe0022070 con 0x7fbfe815e290 2023-11-24T08:03:56.548 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.543+0000 7fbff06ed700 1 -- 172.21.15.164:0/2391324139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe8151800 con 0x7fbfe815e290 2023-11-24T08:03:56.548 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.545+0000 7fbfdeffd700 1 -- 172.21.15.164:0/2391324139 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fbfe002c060 con 0x7fbfe815e290 2023-11-24T08:03:56.630 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.629+0000 7fbff06ed700 1 -- 172.21.15.164:0/2391324139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "23bfab6c-1646-4508-9629-df61b02320ff", "id": 6} v 0) v1 -- 0x7fbfe8068d90 con 0x7fbfe815e290 2023-11-24T08:03:56.635 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.634+0000 7fbfdeffd700 1 -- 172.21.15.164:0/2391324139 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23bfab6c-1646-4508-9629-df61b02320ff", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbfe0027480 con 0x7fbfe815e290 2023-11-24T08:03:56.636 INFO:teuthology.orchestra.run.smithi164.stdout:6 2023-11-24T08:03:56.637 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.635+0000 7fbff06ed700 1 -- 172.21.15.164:0/2391324139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe815e290 msgr2=0x7fbfe8158a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.637 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.635+0000 7fbff06ed700 1 --2- 172.21.15.164:0/2391324139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe815e290 0x7fbfe8158a50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0014040 tx=0x7fbfe0004ad0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.637 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.635+0000 7fbff06ed700 1 -- 172.21.15.164:0/2391324139 shutdown_connections 2023-11-24T08:03:56.637 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.635+0000 7fbff06ed700 1 --2- 172.21.15.164:0/2391324139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe815e290 0x7fbfe8158a50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.637 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.635+0000 7fbff06ed700 1 --2- 172.21.15.164:0/2391324139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe80ad870 0x7fbfe8154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.637 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.635+0000 7fbff06ed700 1 --2- 172.21.15.164:0/2391324139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfe80aedc0 0x7fbfe815fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.637 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.635+0000 7fbff06ed700 1 -- 172.21.15.164:0/2391324139 >> 172.21.15.164:0/2391324139 conn(0x7fbfe80b2050 msgr2=0x7fbfe80b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.637 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.635+0000 7fbff06ed700 1 -- 172.21.15.164:0/2391324139 shutdown_connections 2023-11-24T08:03:56.637 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.635+0000 7fbff06ed700 1 -- 172.21.15.164:0/2391324139 wait complete. 2023-11-24T08:03:56.649 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 9db18f97-85f2-4a6a-b358-a73c682805a2 7 2023-11-24T08:03:56.667 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:56.666+0000 7f6863796200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T08:03:56.736 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:56.734+0000 7f6863796200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T08:03:56.738 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:56.737+0000 7f0544518200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T08:03:56.772 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.771+0000 7fb5ec0d9700 1 Processor -- start 2023-11-24T08:03:56.772 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.771+0000 7fb5ec0d9700 1 -- start start 2023-11-24T08:03:56.775 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5ec0d9700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb5e4144bb0 0x7fb5e406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.775 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5ec0d9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb5e40b68d0 0x7fb5e40cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.775 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5ec0d9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e415f940 con 0x7fb5e406c540 2023-11-24T08:03:56.775 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5ec0d9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e406c9f0 con 0x7fb5e40b68d0 2023-11-24T08:03:56.775 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5ec0d9700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e40b6d40 con 0x7fb5e4144bb0 2023-11-24T08:03:56.776 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e9e75700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb5e4144bb0 0x7fb5e406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.776 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e9e75700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb5e4144bb0 0x7fb5e406c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34484/0 (socket says 172.21.15.164:34484) 2023-11-24T08:03:56.776 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e9e75700 1 -- 172.21.15.164:0/622115042 learned_addr learned my addr 172.21.15.164:0/622115042 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:56.776 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e9674700 1 --1- 172.21.15.164:0/622115042 >> v1:172.21.15.164:6789/0 conn(0x7fb5e406c540 0x7fb5e40b61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56062/0 (socket says 172.21.15.164:56062) 2023-11-24T08:03:56.776 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5ea676700 1 --2- 172.21.15.164:0/622115042 >> v2:172.21.15.153:3300/0 conn(0x7fb5e40b68d0 0x7fb5e40cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.776 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e9e75700 1 -- 172.21.15.164:0/622115042 >> v2:172.21.15.153:3300/0 conn(0x7fb5e40b68d0 msgr2=0x7fb5e40cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:56.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e9e75700 1 --2- 172.21.15.164:0/622115042 >> v2:172.21.15.153:3300/0 conn(0x7fb5e40b68d0 0x7fb5e40cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e9e75700 1 -- 172.21.15.164:0/622115042 >> v1:172.21.15.164:6789/0 conn(0x7fb5e406c540 legacy=0x7fb5e40b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e9e75700 1 -- 172.21.15.164:0/622115042 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e41604c0 con 0x7fb5e4144bb0 2023-11-24T08:03:56.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e9e75700 1 --2- 172.21.15.164:0/622115042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5e4144bb0 0x7fb5e406c000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4068c30 tx=0x7fb5e0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c915f76f5dfaf37c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e8e73700 1 -- 172.21.15.164:0/622115042 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0011830 con 0x7fb5e4144bb0 2023-11-24T08:03:56.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e8e73700 1 -- 172.21.15.164:0/622115042 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e0011990 con 0x7fb5e4144bb0 2023-11-24T08:03:56.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.772+0000 7fb5e8e73700 1 -- 172.21.15.164:0/622115042 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0011d20 con 0x7fb5e4144bb0 2023-11-24T08:03:56.778 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.773+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/622115042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5e4144bb0 msgr2=0x7fb5e406c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.778 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.773+0000 7fb5ec0d9700 1 --2- 172.21.15.164:0/622115042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5e4144bb0 0x7fb5e406c000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4068c30 tx=0x7fb5e0009bd0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.778 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.773+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/622115042 shutdown_connections 2023-11-24T08:03:56.778 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.773+0000 7fb5ec0d9700 1 --2- 172.21.15.164:0/622115042 >> v2:172.21.15.153:3300/0 conn(0x7fb5e40b68d0 0x7fb5e40cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.778 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.773+0000 7fb5ec0d9700 1 --2- 172.21.15.164:0/622115042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5e4144bb0 0x7fb5e406c000 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.778 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.773+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/622115042 >> 172.21.15.164:0/622115042 conn(0x7fb5e4071a70 msgr2=0x7fb5e4071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.779 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.773+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/622115042 shutdown_connections 2023-11-24T08:03:56.779 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.773+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/622115042 wait complete. 2023-11-24T08:03:56.781 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.774+0000 7fb5ec0d9700 1 Processor -- start 2023-11-24T08:03:56.782 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.774+0000 7fb5ec0d9700 1 -- start start 2023-11-24T08:03:56.782 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5ec0d9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e406c540 0x7fb5e415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.782 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5ec0d9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5e40b68d0 0x7fb5e415acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.782 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5ec0d9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5e4144bb0 0x7fb5e40ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.783 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5ec0d9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e40b4f00 con 0x7fb5e406c540 2023-11-24T08:03:56.783 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5ec0d9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e40b5150 con 0x7fb5e4144bb0 2023-11-24T08:03:56.783 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5ec0d9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e40b5430 con 0x7fb5e40b68d0 2023-11-24T08:03:56.783 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5e9674700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5e40b68d0 0x7fb5e415acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.783 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5ea676700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5e4144bb0 0x7fb5e40ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.783 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5e9674700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5e40b68d0 0x7fb5e415acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:53084/0 (socket says 172.21.15.164:53084) 2023-11-24T08:03:56.784 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5ea676700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5e4144bb0 0x7fb5e40ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34494/0 (socket says 172.21.15.164:34494) 2023-11-24T08:03:56.784 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5e9674700 1 -- 172.21.15.164:0/3191097706 learned_addr learned my addr 172.21.15.164:0/3191097706 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-11-24T08:03:56.784 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5e9e75700 1 --2- 172.21.15.164:0/3191097706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e406c540 0x7fb5e415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.784 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5e9674700 1 -- 172.21.15.164:0/3191097706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5e4144bb0 msgr2=0x7fb5e40ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.784 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5e9674700 1 --2- 172.21.15.164:0/3191097706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5e4144bb0 0x7fb5e40ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.784 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5e9674700 1 -- 172.21.15.164:0/3191097706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e406c540 msgr2=0x7fb5e415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.785 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.775+0000 7fb5e9674700 1 --2- 172.21.15.164:0/3191097706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e406c540 0x7fb5e415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.785 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.776+0000 7fb5e9674700 1 -- 172.21.15.164:0/3191097706 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0009550 con 0x7fb5e40b68d0 2023-11-24T08:03:56.785 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.776+0000 7fb5ea676700 1 --2- 172.21.15.164:0/3191097706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5e4144bb0 0x7fb5e40ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:56.785 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.776+0000 7fb5e9e75700 1 --2- 172.21.15.164:0/3191097706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e406c540 0x7fb5e415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:56.785 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.776+0000 7fb5e9674700 1 --2- 172.21.15.164:0/3191097706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5e40b68d0 0x7fb5e415acc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c500 tx=0x7fb5d400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.785 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.776+0000 7fb5da7fc700 1 -- 172.21.15.164:0/3191097706 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4005cb0 con 0x7fb5e40b68d0 2023-11-24T08:03:56.786 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.776+0000 7fb5da7fc700 1 -- 172.21.15.164:0/3191097706 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4005e10 con 0x7fb5e40b68d0 2023-11-24T08:03:56.786 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.776+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/3191097706 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e40b5710 con 0x7fb5e40b68d0 2023-11-24T08:03:56.786 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.776+0000 7fb5da7fc700 1 -- 172.21.15.164:0/3191097706 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40072d0 con 0x7fb5e40b68d0 2023-11-24T08:03:56.786 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.776+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/3191097706 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e40b5cd0 con 0x7fb5e40b68d0 2023-11-24T08:03:56.786 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.776+0000 7fb5da7fc700 1 -- 172.21.15.164:0/3191097706 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb5d401c440 con 0x7fb5e40b68d0 2023-11-24T08:03:56.787 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.776+0000 7fb5da7fc700 1 -- 172.21.15.164:0/3191097706 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fb5d4012a60 con 0x7fb5e40b68d0 2023-11-24T08:03:56.787 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.777+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/3191097706 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e406f960 con 0x7fb5e40b68d0 2023-11-24T08:03:56.787 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.781+0000 7fb5da7fc700 1 -- 172.21.15.164:0/3191097706 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb5d4021060 con 0x7fb5e40b68d0 2023-11-24T08:03:56.812 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:56.810+0000 7f0544518200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T08:03:56.867 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.865+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/3191097706 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9db18f97-85f2-4a6a-b358-a73c682805a2", "id": 7} v 0) v1 -- 0x7fb5e4068fb0 con 0x7fb5e40b68d0 2023-11-24T08:03:56.875 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.873+0000 7fb5da7fc700 1 -- 172.21.15.164:0/3191097706 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9db18f97-85f2-4a6a-b358-a73c682805a2", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb5d4017070 con 0x7fb5e40b68d0 2023-11-24T08:03:56.875 INFO:teuthology.orchestra.run.smithi164.stdout:7 2023-11-24T08:03:56.876 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.874+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/3191097706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5e40b68d0 msgr2=0x7fb5e415acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.876 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.874+0000 7fb5ec0d9700 1 --2- 172.21.15.164:0/3191097706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5e40b68d0 0x7fb5e415acc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c500 tx=0x7fb5d400c810 comp rx=0 tx=0).stop 2023-11-24T08:03:56.876 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.874+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/3191097706 shutdown_connections 2023-11-24T08:03:56.876 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.874+0000 7fb5ec0d9700 1 --2- 172.21.15.164:0/3191097706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5e4144bb0 0x7fb5e40ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.877 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.874+0000 7fb5ec0d9700 1 --2- 172.21.15.164:0/3191097706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e406c540 0x7fb5e415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.877 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.874+0000 7fb5ec0d9700 1 --2- 172.21.15.164:0/3191097706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5e40b68d0 0x7fb5e415acc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.877 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.874+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/3191097706 >> 172.21.15.164:0/3191097706 conn(0x7fb5e4071a70 msgr2=0x7fb5e415b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.877 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.874+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/3191097706 shutdown_connections 2023-11-24T08:03:56.877 INFO:teuthology.orchestra.run.smithi164.stderr:2023-11-24T08:03:56.874+0000 7fb5ec0d9700 1 -- 172.21.15.164:0/3191097706 wait complete. 2023-11-24T08:03:56.888 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-24T08:03:56.888 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-24T08:03:56.890 INFO:tasks.ceph.osd.0:Started 2023-11-24T08:03:56.890 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-24T08:03:56.890 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-24T08:03:56.892 INFO:tasks.ceph.osd.1:Started 2023-11-24T08:03:56.892 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-24T08:03:56.892 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-24T08:03:56.894 INFO:tasks.ceph.osd.2:Started 2023-11-24T08:03:56.894 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-24T08:03:56.894 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-24T08:03:56.897 INFO:tasks.ceph.osd.3:Started 2023-11-24T08:03:56.897 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-24T08:03:56.897 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-24T08:03:56.899 INFO:tasks.ceph.osd.4:Started 2023-11-24T08:03:56.899 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-24T08:03:56.899 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-24T08:03:56.901 INFO:tasks.ceph.osd.5:Started 2023-11-24T08:03:56.901 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-24T08:03:56.902 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-24T08:03:56.904 INFO:tasks.ceph.osd.6:Started 2023-11-24T08:03:56.904 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-24T08:03:56.904 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-24T08:03:56.906 INFO:tasks.ceph.osd.7:Started 2023-11-24T08:03:56.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:03:57.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.058+0000 7f6d36443700 1 Processor -- start 2023-11-24T08:03:57.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.058+0000 7f6d36443700 1 -- start start 2023-11-24T08:03:57.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.058+0000 7f6d36443700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6d3006c710 0x7f6d300b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:57.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.058+0000 7f6d36443700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d300af4d0 0x7f6d300afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:57.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.058+0000 7f6d36443700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d300ae430 con 0x7f6d3015e080 2023-11-24T08:03:57.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.058+0000 7f6d36443700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d300af0b0 con 0x7f6d3006c710 2023-11-24T08:03:57.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.058+0000 7f6d36443700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d300b05a0 con 0x7f6d300af4d0 2023-11-24T08:03:57.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6d3006c710 0x7f6d300b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:57.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6d3006c710 0x7f6d300b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34792/0 (socket says 172.21.15.153:34792) 2023-11-24T08:03:57.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2f7fe700 1 -- 172.21.15.153:0/4275827973 learned_addr learned my addr 172.21.15.153:0/4275827973 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:03:57.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d349e0700 1 --2- 172.21.15.153:0/4275827973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d300af4d0 0x7f6d300afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:57.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2f7fe700 1 -- 172.21.15.153:0/4275827973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d300af4d0 msgr2=0x7f6d300afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:57.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2f7fe700 1 --2- 172.21.15.153:0/4275827973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d300af4d0 0x7f6d300afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2f7fe700 1 -- 172.21.15.153:0/4275827973 >> v1:172.21.15.153:6789/0 conn(0x7f6d3015e080 legacy=0x7f6d3006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:57.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2effd700 1 -- 172.21.15.153:0/4275827973 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751209276 0 0) 0x7f6d300ae430 con 0x7f6d3015e080 2023-11-24T08:03:57.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2f7fe700 1 -- 172.21.15.153:0/4275827973 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d300ae710 con 0x7f6d3006c710 2023-11-24T08:03:57.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2f7fe700 1 --2- 172.21.15.153:0/4275827973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d3006c710 0x7f6d300b5050 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6d240098f0 tx=0x7f6d24009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdcd4104059d3abf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:57.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2effd700 1 -- 172.21.15.153:0/4275827973 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24011830 con 0x7f6d3006c710 2023-11-24T08:03:57.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2effd700 1 -- 172.21.15.153:0/4275827973 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d24011990 con 0x7f6d3006c710 2023-11-24T08:03:57.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.059+0000 7f6d2effd700 1 -- 172.21.15.153:0/4275827973 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24011d20 con 0x7f6d3006c710 2023-11-24T08:03:57.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.060+0000 7f6d36443700 1 -- 172.21.15.153:0/4275827973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d3006c710 msgr2=0x7f6d300b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:57.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.060+0000 7f6d36443700 1 --2- 172.21.15.153:0/4275827973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d3006c710 0x7f6d300b5050 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6d240098f0 tx=0x7f6d24009c00 comp rx=0 tx=0).stop 2023-11-24T08:03:57.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.060+0000 7f6d36443700 1 -- 172.21.15.153:0/4275827973 shutdown_connections 2023-11-24T08:03:57.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.060+0000 7f6d36443700 1 --2- 172.21.15.153:0/4275827973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d300af4d0 0x7f6d300afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.060+0000 7f6d36443700 1 --2- 172.21.15.153:0/4275827973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d3006c710 0x7f6d300b5050 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.060+0000 7f6d36443700 1 -- 172.21.15.153:0/4275827973 >> 172.21.15.153:0/4275827973 conn(0x7f6d30071b90 msgr2=0x7f6d30071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:57.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.060+0000 7f6d36443700 1 -- 172.21.15.153:0/4275827973 shutdown_connections 2023-11-24T08:03:57.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.060+0000 7f6d36443700 1 -- 172.21.15.153:0/4275827973 wait complete. 2023-11-24T08:03:57.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.062+0000 7f6d36443700 1 Processor -- start 2023-11-24T08:03:57.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.062+0000 7f6d36443700 1 -- start start 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d36443700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d3006c710 0x7f6d30151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d36443700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d300af4d0 0x7f6d3015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d36443700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d3015e080 0x7f6d3015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d36443700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015ed70 con 0x7f6d3006c710 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d36443700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d30151c60 con 0x7f6d3015e080 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d36443700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015e460 con 0x7f6d300af4d0 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d3006c710 0x7f6d30151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d3006c710 0x7f6d30151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34796/0 (socket says 172.21.15.153:34796) 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2ffff700 1 -- 172.21.15.153:0/213708295 learned_addr learned my addr 172.21.15.153:0/213708295 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2f7fe700 1 --2- 172.21.15.153:0/213708295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d300af4d0 0x7f6d3015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d349e0700 1 --2- 172.21.15.153:0/213708295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d3015e080 0x7f6d3015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:57.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2ffff700 1 -- 172.21.15.153:0/213708295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d300af4d0 msgr2=0x7f6d3015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2ffff700 1 --2- 172.21.15.153:0/213708295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d300af4d0 0x7f6d3015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2ffff700 1 -- 172.21.15.153:0/213708295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d3015e080 msgr2=0x7f6d3015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2ffff700 1 --2- 172.21.15.153:0/213708295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d3015e080 0x7f6d3015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2ffff700 1 -- 172.21.15.153:0/213708295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24009550 con 0x7f6d3006c710 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2f7fe700 1 --2- 172.21.15.153:0/213708295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d300af4d0 0x7f6d3015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2ffff700 1 --2- 172.21.15.153:0/213708295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d3006c710 0x7f6d30151720 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000c580 tx=0x7f6d2000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2cff9700 1 -- 172.21.15.153:0/213708295 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200054e0 con 0x7f6d3006c710 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2cff9700 1 -- 172.21.15.153:0/213708295 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20003680 con 0x7f6d3006c710 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d2cff9700 1 -- 172.21.15.153:0/213708295 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20003a30 con 0x7f6d3006c710 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d36443700 1 -- 172.21.15.153:0/213708295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d301f7a80 con 0x7f6d3006c710 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.063+0000 7f6d36443700 1 -- 172.21.15.153:0/213708295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3015e990 con 0x7f6d3006c710 2023-11-24T08:03:57.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.064+0000 7f6d2cff9700 1 -- 172.21.15.153:0/213708295 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6d2001c440 con 0x7f6d3006c710 2023-11-24T08:03:57.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.064+0000 7f6d2cff9700 1 -- 172.21.15.153:0/213708295 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6d20012ad0 con 0x7f6d3006c710 2023-11-24T08:03:57.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.064+0000 7f6d36443700 1 -- 172.21.15.153:0/213708295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d300753f0 con 0x7f6d3006c710 2023-11-24T08:03:57.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.068+0000 7f6d2cff9700 1 -- 172.21.15.153:0/213708295 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6d20017070 con 0x7f6d3006c710 2023-11-24T08:03:57.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.138+0000 7f6d36443700 1 -- 172.21.15.153:0/213708295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d30067f60 con 0x7f6d3006c710 2023-11-24T08:03:57.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.139+0000 7f6d2cff9700 1 -- 172.21.15.153:0/213708295 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6d2001c920 con 0x7f6d3006c710 2023-11-24T08:03:57.143 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:03:57.143 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":10,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:03:56.867721+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:03:57.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.140+0000 7f6d36443700 1 -- 172.21.15.153:0/213708295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d3006c710 msgr2=0x7f6d30151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:57.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.140+0000 7f6d36443700 1 --2- 172.21.15.153:0/213708295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d3006c710 0x7f6d30151720 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000c580 tx=0x7f6d2000c890 comp rx=0 tx=0).stop 2023-11-24T08:03:57.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.140+0000 7f6d36443700 1 -- 172.21.15.153:0/213708295 shutdown_connections 2023-11-24T08:03:57.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.140+0000 7f6d36443700 1 --2- 172.21.15.153:0/213708295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d3015e080 0x7f6d3015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.140+0000 7f6d36443700 1 --2- 172.21.15.153:0/213708295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d3006c710 0x7f6d30151720 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.140+0000 7f6d36443700 1 --2- 172.21.15.153:0/213708295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d300af4d0 0x7f6d3015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.140+0000 7f6d36443700 1 -- 172.21.15.153:0/213708295 >> 172.21.15.153:0/213708295 conn(0x7f6d30071b90 msgr2=0x7f6d300b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:57.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.140+0000 7f6d36443700 1 -- 172.21.15.153:0/213708295 shutdown_connections 2023-11-24T08:03:57.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:03:57.140+0000 7f6d36443700 1 -- 172.21.15.153:0/213708295 wait complete. 2023-11-24T08:03:57.154 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-24T08:03:57.154 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-24T08:03:57.489 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:57.488+0000 7f6863796200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:03:57.506 INFO:tasks.ceph.osd.4.smithi164.stderr:2023-11-24T08:03:57.504+0000 7f0c24590640 -1 Falling back to public interface 2023-11-24T08:03:57.506 INFO:tasks.ceph.osd.5.smithi164.stderr:2023-11-24T08:03:57.504+0000 7f543481d640 -1 Falling back to public interface 2023-11-24T08:03:57.507 INFO:tasks.ceph.osd.5.smithi164.stderr:2023-11-24T08:03:57.504+0000 7f542bbdb700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-11-24T08:03:57.507 INFO:tasks.ceph.osd.4.smithi164.stderr:2023-11-24T08:03:57.505+0000 7f0c1b94e700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2023-11-24T08:03:57.507 INFO:tasks.ceph.osd.4.smithi164.stderr:2023-11-24T08:03:57.505+0000 7f0c1b94e700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6804/0: (98) Address already in use 2023-11-24T08:03:57.521 INFO:tasks.ceph.osd.0.smithi153.stderr:2023-11-24T08:03:57.519+0000 7f40497d4640 -1 Falling back to public interface 2023-11-24T08:03:57.525 INFO:tasks.ceph.osd.7.smithi164.stderr:2023-11-24T08:03:57.524+0000 7fdd7a1b0640 -1 Falling back to public interface 2023-11-24T08:03:57.526 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-11-24T08:03:57.524+0000 7f07ea265640 -1 Falling back to public interface 2023-11-24T08:03:57.526 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-11-24T08:03:57.525+0000 7fa91f18e640 -1 Falling back to public interface 2023-11-24T08:03:57.528 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-11-24T08:03:57.527+0000 7f07e1623700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6821/0: (98) Address already in use 2023-11-24T08:03:57.530 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-11-24T08:03:57.528+0000 7f9309e38640 -1 Falling back to public interface 2023-11-24T08:03:57.532 INFO:tasks.ceph.osd.6.smithi164.stderr:2023-11-24T08:03:57.532+0000 7f00c28e8640 -1 Falling back to public interface 2023-11-24T08:03:57.539 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:57.537+0000 7f0544518200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:03:57.573 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:57.571+0000 7f6863796200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T08:03:57.617 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:57.615+0000 7f0544518200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T08:03:57.714 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:57.712+0000 7f6863796200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:03:57.757 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:57.756+0000 7f0544518200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:03:57.952 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:57.950+0000 7f6863796200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T08:03:57.960 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T08:03:57.994 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:57.994+0000 7f0544518200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T08:03:58.076 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.074+0000 7fa220692700 1 Processor -- start 2023-11-24T08:03:58.076 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.074+0000 7fa220692700 1 -- start start 2023-11-24T08:03:58.083 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.075+0000 7fa220692700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa218158910 0x7fa2180b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.083 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.075+0000 7fa220692700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa2180aff30 0x7fa21806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.083 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.075+0000 7fa220692700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21815ec90 con 0x7fa2180b0390 2023-11-24T08:03:58.083 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.075+0000 7fa220692700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa218158cf0 con 0x7fa218158910 2023-11-24T08:03:58.083 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.075+0000 7fa220692700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21815ef70 con 0x7fa2180aff30 2023-11-24T08:03:58.083 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.075+0000 7fa21e42e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa218158910 0x7fa2180b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.083 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.075+0000 7fa21e42e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa218158910 0x7fa2180b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34802/0 (socket says 172.21.15.153:34802) 2023-11-24T08:03:58.083 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.075+0000 7fa21e42e700 1 -- 172.21.15.153:0/1852788208 learned_addr learned my addr 172.21.15.153:0/1852788208 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:03:58.084 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.076+0000 7fa21dc2d700 1 --2- 172.21.15.153:0/1852788208 >> v2:172.21.15.164:3300/0 conn(0x7fa2180aff30 0x7fa21806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.084 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.076+0000 7fa21e42e700 1 -- 172.21.15.153:0/1852788208 >> v2:172.21.15.164:3300/0 conn(0x7fa2180aff30 msgr2=0x7fa21806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:58.084 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.076+0000 7fa21e42e700 1 --2- 172.21.15.153:0/1852788208 >> v2:172.21.15.164:3300/0 conn(0x7fa2180aff30 0x7fa21806c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.084 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.076+0000 7fa21e42e700 1 -- 172.21.15.153:0/1852788208 >> v1:172.21.15.153:6789/0 conn(0x7fa2180b0390 legacy=0x7fa218162210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:58.084 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.076+0000 7fa21e42e700 1 -- 172.21.15.153:0/1852788208 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21815f250 con 0x7fa218158910 2023-11-24T08:03:58.084 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.076+0000 7fa21d42c700 1 -- 172.21.15.153:0/1852788208 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695526489 0 0) 0x7fa21815ec90 con 0x7fa2180b0390 2023-11-24T08:03:58.084 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.076+0000 7fa21e42e700 1 --2- 172.21.15.153:0/1852788208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa218158910 0x7fa2180b48e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa218070610 tx=0x7fa214009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97f07821f92beb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:58.084 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.076+0000 7fa21d42c700 1 -- 172.21.15.153:0/1852788208 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400b870 con 0x7fa218158910 2023-11-24T08:03:58.084 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.076+0000 7fa21d42c700 1 -- 172.21.15.153:0/1852788208 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21400b9d0 con 0x7fa218158910 2023-11-24T08:03:58.084 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.076+0000 7fa21d42c700 1 -- 172.21.15.153:0/1852788208 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400bd60 con 0x7fa218158910 2023-11-24T08:03:58.084 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.077+0000 7fa220692700 1 -- 172.21.15.153:0/1852788208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa218158910 msgr2=0x7fa2180b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.077+0000 7fa220692700 1 --2- 172.21.15.153:0/1852788208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa218158910 0x7fa2180b48e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa218070610 tx=0x7fa214009bd0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.077+0000 7fa220692700 1 -- 172.21.15.153:0/1852788208 shutdown_connections 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.077+0000 7fa220692700 1 --2- 172.21.15.153:0/1852788208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa218158910 0x7fa2180b48e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.077+0000 7fa220692700 1 --2- 172.21.15.153:0/1852788208 >> v2:172.21.15.164:3300/0 conn(0x7fa2180aff30 0x7fa21806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.077+0000 7fa220692700 1 -- 172.21.15.153:0/1852788208 >> 172.21.15.153:0/1852788208 conn(0x7fa218071ae0 msgr2=0x7fa218071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.077+0000 7fa220692700 1 -- 172.21.15.153:0/1852788208 shutdown_connections 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.077+0000 7fa220692700 1 -- 172.21.15.153:0/1852788208 wait complete. 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.078+0000 7fa220692700 1 Processor -- start 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.078+0000 7fa220692700 1 -- start start 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.079+0000 7fa220692700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2180aff30 0x7fa21813d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.079+0000 7fa220692700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2180b0390 0x7fa2180b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.079+0000 7fa220692700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa218158910 0x7fa218151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.085 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.079+0000 7fa220692700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180b1150 con 0x7fa218158910 2023-11-24T08:03:58.086 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.079+0000 7fa220692700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180b1430 con 0x7fa2180aff30 2023-11-24T08:03:58.086 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.079+0000 7fa220692700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180b1710 con 0x7fa2180b0390 2023-11-24T08:03:58.086 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa21ec2f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa218158910 0x7fa218151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.086 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa21ec2f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa218158910 0x7fa218151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34812/0 (socket says 172.21.15.153:34812) 2023-11-24T08:03:58.086 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa21ec2f700 1 -- 172.21.15.153:0/2762788676 learned_addr learned my addr 172.21.15.153:0/2762788676 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:03:58.086 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa21dc2d700 1 --2- 172.21.15.153:0/2762788676 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2180b0390 0x7fa2180b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.086 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa21e42e700 1 --2- 172.21.15.153:0/2762788676 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2180aff30 0x7fa21813d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.086 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa21ec2f700 1 -- 172.21.15.153:0/2762788676 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2180b0390 msgr2=0x7fa2180b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:58.086 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa21ec2f700 1 --2- 172.21.15.153:0/2762788676 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2180b0390 0x7fa2180b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.086 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa21ec2f700 1 -- 172.21.15.153:0/2762788676 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2180aff30 msgr2=0x7fa21813d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:58.086 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa21ec2f700 1 --2- 172.21.15.153:0/2762788676 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2180aff30 0x7fa21813d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.087 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa21ec2f700 1 -- 172.21.15.153:0/2762788676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa214009550 con 0x7fa218158910 2023-11-24T08:03:58.087 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa21ec2f700 1 --2- 172.21.15.153:0/2762788676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa218158910 0x7fa218151f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa210001560 tx=0x7fa21000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:58.087 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa20effd700 1 -- 172.21.15.153:0/2762788676 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210003e30 con 0x7fa218158910 2023-11-24T08:03:58.087 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa20effd700 1 -- 172.21.15.153:0/2762788676 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210005070 con 0x7fa218158910 2023-11-24T08:03:58.087 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa220692700 1 -- 172.21.15.153:0/2762788676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2180b19f0 con 0x7fa218158910 2023-11-24T08:03:58.087 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa20effd700 1 -- 172.21.15.153:0/2762788676 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210005420 con 0x7fa218158910 2023-11-24T08:03:58.087 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.080+0000 7fa220692700 1 -- 172.21.15.153:0/2762788676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21813d7f0 con 0x7fa218158910 2023-11-24T08:03:58.087 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.081+0000 7fa20effd700 1 -- 172.21.15.153:0/2762788676 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa21001c440 con 0x7fa218158910 2023-11-24T08:03:58.087 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.081+0000 7fa20effd700 1 -- 172.21.15.153:0/2762788676 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa210012ad0 con 0x7fa218158910 2023-11-24T08:03:58.087 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.081+0000 7fa220692700 1 -- 172.21.15.153:0/2762788676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa218068fb0 con 0x7fa218158910 2023-11-24T08:03:58.088 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.084+0000 7fa20effd700 1 -- 172.21.15.153:0/2762788676 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa210017070 con 0x7fa218158910 2023-11-24T08:03:58.157 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.156+0000 7fa220692700 1 -- 172.21.15.153:0/2762788676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa21806cb30 con 0x7fa218158910 2023-11-24T08:03:58.161 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.156+0000 7fa20effd700 1 -- 172.21.15.153:0/2762788676 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa210012400 con 0x7fa218158910 2023-11-24T08:03:58.161 INFO:teuthology.misc.health.smithi153.stdout: 2023-11-24T08:03:58.161 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":10,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:03:56.867721+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:03:58.162 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.157+0000 7fa220692700 1 -- 172.21.15.153:0/2762788676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa218158910 msgr2=0x7fa218151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:58.162 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.157+0000 7fa220692700 1 --2- 172.21.15.153:0/2762788676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa218158910 0x7fa218151f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa210001560 tx=0x7fa21000cb50 comp rx=0 tx=0).stop 2023-11-24T08:03:58.162 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.157+0000 7fa220692700 1 -- 172.21.15.153:0/2762788676 shutdown_connections 2023-11-24T08:03:58.163 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.157+0000 7fa220692700 1 --2- 172.21.15.153:0/2762788676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa218158910 0x7fa218151f50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.163 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.157+0000 7fa220692700 1 --2- 172.21.15.153:0/2762788676 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2180aff30 0x7fa21813d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.163 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.157+0000 7fa220692700 1 --2- 172.21.15.153:0/2762788676 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2180b0390 0x7fa2180b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.163 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.157+0000 7fa220692700 1 -- 172.21.15.153:0/2762788676 >> 172.21.15.153:0/2762788676 conn(0x7fa218071ae0 msgr2=0x7fa218162210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:58.163 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.157+0000 7fa220692700 1 -- 172.21.15.153:0/2762788676 shutdown_connections 2023-11-24T08:03:58.163 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:03:58.157+0000 7fa220692700 1 -- 172.21.15.153:0/2762788676 wait complete. 2023-11-24T08:03:58.170 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T08:03:58.176 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:58.174+0000 7f6863796200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T08:03:58.211 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:58.209+0000 7f0544518200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T08:03:58.309 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:58.307+0000 7f6863796200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T08:03:58.346 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:58.345+0000 7f0544518200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T08:03:58.530 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:58.529+0000 7f6863796200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T08:03:58.569 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:58.566+0000 7f0544518200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T08:03:58.688 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:58.686+0000 7f6863796200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T08:03:58.723 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:58.722+0000 7f0544518200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T08:03:58.802 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:58.800+0000 7f6863796200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T08:03:58.837 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:58.836+0000 7f0544518200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T08:03:59.127 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:59.125+0000 7f6863796200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T08:03:59.165 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:59.163+0000 7f0544518200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T08:03:59.228 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:59.226+0000 7f6863796200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T08:03:59.264 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:59.263+0000 7f0544518200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T08:03:59.414 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:03:59.413+0000 7f6863796200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T08:03:59.453 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:03:59.452+0000 7f0544518200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T08:04:00.021 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:04:00.020+0000 7f6863796200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T08:04:00.060 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-11-24T08:04:00.059+0000 7f0544518200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T08:04:00.830 INFO:tasks.ceph.osd.0.smithi153.stderr:2023-11-24T08:04:00.828+0000 7f40497d4640 -1 osd.0 0 log_to_monitors true 2023-11-24T08:04:01.049 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:04:01.047+0000 7f681b6eb700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-24T08:04:01.053 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-11-24T08:04:01.051+0000 7f07ea265640 -1 osd.2 0 log_to_monitors true 2023-11-24T08:04:01.053 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:04:01.052+0000 7f681b6eb700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-24T08:04:01.062 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-11-24T08:04:01.061+0000 7fa91f18e640 -1 osd.1 0 log_to_monitors true 2023-11-24T08:04:01.068 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-11-24T08:04:01.067+0000 7f9309e38640 -1 osd.3 0 log_to_monitors true 2023-11-24T08:04:01.070 INFO:tasks.ceph.osd.7.smithi164.stderr:2023-11-24T08:04:01.069+0000 7fdd7a1b0640 -1 osd.7 0 log_to_monitors true 2023-11-24T08:04:01.071 INFO:tasks.ceph.osd.5.smithi164.stderr:2023-11-24T08:04:01.070+0000 7f543481d640 -1 osd.5 0 log_to_monitors true 2023-11-24T08:04:01.075 INFO:tasks.ceph.osd.6.smithi164.stderr:2023-11-24T08:04:01.074+0000 7f00c28e8640 -1 osd.6 0 log_to_monitors true 2023-11-24T08:04:01.076 INFO:tasks.ceph.osd.4.smithi164.stderr:2023-11-24T08:04:01.075+0000 7f0c24590640 -1 osd.4 0 log_to_monitors true 2023-11-24T08:04:04.095 INFO:tasks.ceph.osd.7.smithi164.stderr:2023-11-24T08:04:04.094+0000 7fdd6f56a700 -1 osd.7 0 waiting for initial osdmap 2023-11-24T08:04:04.111 INFO:tasks.ceph.osd.7.smithi164.stderr:2023-11-24T08:04:04.110+0000 7fdd66147700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:04:04.151 INFO:tasks.ceph.osd.6.smithi164.stderr:2023-11-24T08:04:04.149+0000 7f00b649f700 -1 osd.6 0 waiting for initial osdmap 2023-11-24T08:04:04.154 INFO:tasks.ceph.osd.5.smithi164.stderr:2023-11-24T08:04:04.153+0000 7f54283d4700 -1 osd.5 0 waiting for initial osdmap 2023-11-24T08:04:04.164 INFO:tasks.ceph.osd.6.smithi164.stderr:2023-11-24T08:04:04.163+0000 7f00ae87f700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:04:04.168 INFO:tasks.ceph.osd.5.smithi164.stderr:2023-11-24T08:04:04.167+0000 7f54207b4700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:04:04.178 INFO:tasks.ceph.osd.4.smithi164.stderr:2023-11-24T08:04:04.176+0000 7f0c18147700 -1 osd.4 0 waiting for initial osdmap 2023-11-24T08:04:04.193 INFO:tasks.ceph.osd.4.smithi164.stderr:2023-11-24T08:04:04.191+0000 7f0c10527700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:04:04.196 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-11-24T08:04:04.195+0000 7fa912d45700 -1 osd.1 0 waiting for initial osdmap 2023-11-24T08:04:04.209 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-11-24T08:04:04.208+0000 7fa90b125700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:04:04.236 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-11-24T08:04:04.235+0000 7f07dde1c700 -1 osd.2 0 waiting for initial osdmap 2023-11-24T08:04:04.253 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-11-24T08:04:04.251+0000 7f92fd9ef700 -1 osd.3 0 waiting for initial osdmap 2023-11-24T08:04:04.255 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-11-24T08:04:04.254+0000 7f07d61fc700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:04:04.262 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-11-24T08:04:04.261+0000 7f92f5dcf700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:04:04.280 INFO:tasks.ceph.osd.0.smithi153.stderr:2023-11-24T08:04:04.279+0000 7f403d38b700 -1 osd.0 0 waiting for initial osdmap 2023-11-24T08:04:04.297 INFO:tasks.ceph.osd.0.smithi153.stderr:2023-11-24T08:04:04.295+0000 7f403576b700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:04:04.977 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:05.096 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.094+0000 7fd210f9e700 1 Processor -- start 2023-11-24T08:04:05.096 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.094+0000 7fd210f9e700 1 -- start start 2023-11-24T08:04:05.098 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.095+0000 7fd210f9e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd20c15bbf0 0x7fd20c06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.098 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.095+0000 7fd210f9e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c06c9a0 con 0x7fd20c0ae920 2023-11-24T08:04:05.098 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.095+0000 7fd210f9e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c0b1320 con 0x7fd20c06c540 2023-11-24T08:04:05.098 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.095+0000 7fd210f9e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c0b0b20 con 0x7fd20c15bbf0 2023-11-24T08:04:05.098 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.095+0000 7fd20ad9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd20c0ae920 0x7fd20c161c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41020/0 (socket says 172.21.15.153:41020) 2023-11-24T08:04:05.098 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.095+0000 7fd20ad9d700 1 -- 172.21.15.153:0/2599580373 learned_addr learned my addr 172.21.15.153:0/2599580373 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:05.098 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.096+0000 7fd20a59c700 1 --2- 172.21.15.153:0/2599580373 >> v2:172.21.15.164:3300/0 conn(0x7fd20c15bbf0 0x7fd20c06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.098 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.096+0000 7fd20959a700 1 -- 172.21.15.153:0/2599580373 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203921883 0 0) 0x7fd20c06c9a0 con 0x7fd20c0ae920 2023-11-24T08:04:05.098 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.096+0000 7fd20959a700 1 -- 172.21.15.153:0/2599580373 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f40035b0 con 0x7fd20c0ae920 2023-11-24T08:04:05.098 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.096+0000 7fd20a59c700 1 -- 172.21.15.153:0/2599580373 >> v1:172.21.15.164:6789/0 conn(0x7fd20c06c540 legacy=0x7fd20c0ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.099 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.096+0000 7fd20a59c700 1 -- 172.21.15.153:0/2599580373 >> v1:172.21.15.153:6789/0 conn(0x7fd20c0ae920 legacy=0x7fd20c161c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.099 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.096+0000 7fd20a59c700 1 -- 172.21.15.153:0/2599580373 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c15f510 con 0x7fd20c15bbf0 2023-11-24T08:04:05.099 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.096+0000 7fd20a59c700 1 --2- 172.21.15.153:0/2599580373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd20c15bbf0 0x7fd20c06c000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd200009840 tx=0x7fd200009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea569c828f23c7bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.099 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.096+0000 7fd20959a700 1 -- 172.21.15.153:0/2599580373 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200011830 con 0x7fd20c15bbf0 2023-11-24T08:04:05.099 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.096+0000 7fd20959a700 1 -- 172.21.15.153:0/2599580373 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd200011990 con 0x7fd20c15bbf0 2023-11-24T08:04:05.099 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.096+0000 7fd20959a700 1 -- 172.21.15.153:0/2599580373 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200011d00 con 0x7fd20c15bbf0 2023-11-24T08:04:05.100 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.097+0000 7fd210f9e700 1 -- 172.21.15.153:0/2599580373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd20c15bbf0 msgr2=0x7fd20c06c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.100 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.097+0000 7fd210f9e700 1 --2- 172.21.15.153:0/2599580373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd20c15bbf0 0x7fd20c06c000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd200009840 tx=0x7fd200009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:05.100 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.097+0000 7fd210f9e700 1 -- 172.21.15.153:0/2599580373 shutdown_connections 2023-11-24T08:04:05.101 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.097+0000 7fd210f9e700 1 --2- 172.21.15.153:0/2599580373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd20c15bbf0 0x7fd20c06c000 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.101 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.097+0000 7fd210f9e700 1 -- 172.21.15.153:0/2599580373 >> 172.21.15.153:0/2599580373 conn(0x7fd20c071a50 msgr2=0x7fd20c071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.101 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.097+0000 7fd210f9e700 1 -- 172.21.15.153:0/2599580373 shutdown_connections 2023-11-24T08:04:05.101 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.097+0000 7fd210f9e700 1 -- 172.21.15.153:0/2599580373 wait complete. 2023-11-24T08:04:05.102 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.099+0000 7fd210f9e700 1 Processor -- start 2023-11-24T08:04:05.103 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.099+0000 7fd210f9e700 1 -- start start 2023-11-24T08:04:05.103 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.100+0000 7fd210f9e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c06c540 0x7fd20c161e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.103 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.100+0000 7fd210f9e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd20c0ae920 0x7fd20c0cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.104 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.100+0000 7fd210f9e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd20c15bbf0 0x7fd20c0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.104 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.100+0000 7fd210f9e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c15c1f0 con 0x7fd20c06c540 2023-11-24T08:04:05.104 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.100+0000 7fd210f9e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c15c490 con 0x7fd20c0ae920 2023-11-24T08:04:05.104 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.100+0000 7fd210f9e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c15c770 con 0x7fd20c15bbf0 2023-11-24T08:04:05.104 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.101+0000 7fd20ad9d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd20c15bbf0 0x7fd20c0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.104 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.101+0000 7fd20ad9d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd20c15bbf0 0x7fd20c0cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:46992/0 (socket says 172.21.15.153:46992) 2023-11-24T08:04:05.104 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.101+0000 7fd20ad9d700 1 -- 172.21.15.153:0/1720862429 learned_addr learned my addr 172.21.15.153:0/1720862429 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:05.105 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.101+0000 7fd20ad9d700 1 -- 172.21.15.153:0/1720862429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd20c0ae920 msgr2=0x7fd20c0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.105 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.101+0000 7fd20ad9d700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd20c0ae920 0x7fd20c0cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.105 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.101+0000 7fd20ad9d700 1 -- 172.21.15.153:0/1720862429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c06c540 msgr2=0x7fd20c161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.105 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.101+0000 7fd20ad9d700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c06c540 0x7fd20c161e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.105 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.101+0000 7fd20ad9d700 1 -- 172.21.15.153:0/1720862429 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000094a0 con 0x7fd20c15bbf0 2023-11-24T08:04:05.105 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.102+0000 7fd20ad9d700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd20c15bbf0 0x7fd20c0cf500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd20400cbb0 tx=0x7fd20400cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.107 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.102+0000 7fd1faffd700 1 -- 172.21.15.153:0/1720862429 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400ab50 con 0x7fd20c15bbf0 2023-11-24T08:04:05.107 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.102+0000 7fd1faffd700 1 -- 172.21.15.153:0/1720862429 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400acb0 con 0x7fd20c15bbf0 2023-11-24T08:04:05.107 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.103+0000 7fd210f9e700 1 -- 172.21.15.153:0/1720862429 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c15ca50 con 0x7fd20c15bbf0 2023-11-24T08:04:05.107 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.103+0000 7fd210f9e700 1 -- 172.21.15.153:0/1720862429 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c0cfa40 con 0x7fd20c15bbf0 2023-11-24T08:04:05.107 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.103+0000 7fd1faffd700 1 -- 172.21.15.153:0/1720862429 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204012600 con 0x7fd20c15bbf0 2023-11-24T08:04:05.107 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.105+0000 7fd1faffd700 1 -- 172.21.15.153:0/1720862429 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fd20401b3b0 con 0x7fd20c15bbf0 2023-11-24T08:04:05.108 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.106+0000 7fd1faffd700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd1ec06af10 0x7fd1ec06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.108 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.106+0000 7fd20a59c700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd1ec06af10 0x7fd1ec06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.108 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.106+0000 7fd1faffd700 1 -- 172.21.15.153:0/1720862429 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fd204088be0 con 0x7fd20c15bbf0 2023-11-24T08:04:05.108 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.107+0000 7fd210f9e700 1 -- 172.21.15.153:0/1720862429 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f00052f0 con 0x7fd20c15bbf0 2023-11-24T08:04:05.109 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.107+0000 7fd20a59c700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd1ec06af10 0x7fd1ec06d3d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd200009fd0 tx=0x7fd200010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.114 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.113+0000 7fd1faffd700 1 -- 172.21.15.153:0/1720862429 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd204054360 con 0x7fd20c15bbf0 2023-11-24T08:04:05.313 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.312+0000 7fd210f9e700 1 -- 172.21.15.153:0/1720862429 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1f00055a0 con 0x7fd20c15bbf0 2023-11-24T08:04:05.314 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.313+0000 7fd1faffd700 1 -- 172.21.15.153:0/1720862429 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10944 (secure 0 0 0) 0x7fd204017020 con 0x7fd20c15bbf0 2023-11-24T08:04:05.315 INFO:teuthology.misc.health.smithi153.stdout: 2023-11-24T08:04:05.315 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":13,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:05.097171+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:05.317 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 -- 172.21.15.153:0/1720862429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd1ec06af10 msgr2=0x7fd1ec06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.317 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd1ec06af10 0x7fd1ec06d3d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd200009fd0 tx=0x7fd200010000 comp rx=0 tx=0).stop 2023-11-24T08:04:05.317 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 -- 172.21.15.153:0/1720862429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd20c15bbf0 msgr2=0x7fd20c0cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.317 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd20c15bbf0 0x7fd20c0cf500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd20400cbb0 tx=0x7fd20400cf70 comp rx=0 tx=0).stop 2023-11-24T08:04:05.317 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 -- 172.21.15.153:0/1720862429 shutdown_connections 2023-11-24T08:04:05.317 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd20c15bbf0 0x7fd20c0cf500 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.317 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd1ec06af10 0x7fd1ec06d3d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.317 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c06c540 0x7fd20c161e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.317 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 --2- 172.21.15.153:0/1720862429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd20c0ae920 0x7fd20c0cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.318 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 -- 172.21.15.153:0/1720862429 >> 172.21.15.153:0/1720862429 conn(0x7fd20c071a50 msgr2=0x7fd20c06dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.318 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 -- 172.21.15.153:0/1720862429 shutdown_connections 2023-11-24T08:04:05.318 INFO:teuthology.misc.health.smithi153.stderr:2023-11-24T08:04:05.315+0000 7fd210f9e700 1 -- 172.21.15.153:0/1720862429 wait complete. 2023-11-24T08:04:05.328 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-24T08:04:05.328 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-24T08:04:05.328 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:04:05.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:04:05.331 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:04:05.331 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:04:05.331 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:04:05.333 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:04:05.333 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:04:05.333 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:04:05.339 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:04:05.339 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:04:05.339 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:04:05.342 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:04:05.342 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-24T08:04:05.342 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:05.412 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-11-24T08:04:05.412 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-11-24T08:04:05.426 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-11-24T08:04:05.426 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-11-24T08:04:05.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.471+0000 7f39deed7700 1 Processor -- start 2023-11-24T08:04:05.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.471+0000 7f39deed7700 1 -- start start 2023-11-24T08:04:05.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.471+0000 7f39deed7700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f39d815e1e0 0x7f39d80d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.471+0000 7f39deed7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39d80d3a00 0x7f39d80d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.471+0000 7f39deed7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80d0db0 0x7f39d806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.471+0000 7f39deed7700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d80d3150 con 0x7f39d80d3a00 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.471+0000 7f39deed7700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d80d1240 con 0x7f39d815e1e0 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.471+0000 7f39deed7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d815e5c0 con 0x7f39d80d0db0 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.471+0000 7f39d7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39d80d3a00 0x7f39d80d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39d7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39d80d3a00 0x7f39d80d0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35088/0 (socket says 172.21.15.153:35088) 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39d7fff700 1 -- 172.21.15.153:0/1860856526 learned_addr learned my addr 172.21.15.153:0/1860856526 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39dd474700 1 --2- 172.21.15.153:0/1860856526 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80d0db0 0x7f39d806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39dcc73700 1 --2- 172.21.15.153:0/1860856526 >> v2:172.21.15.164:3300/0 conn(0x7f39d815e1e0 0x7f39d80d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39d7fff700 1 -- 172.21.15.153:0/1860856526 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80d0db0 msgr2=0x7f39d806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39d7fff700 1 --2- 172.21.15.153:0/1860856526 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80d0db0 0x7f39d806aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39d7fff700 1 -- 172.21.15.153:0/1860856526 >> v2:172.21.15.164:3300/0 conn(0x7f39d815e1e0 msgr2=0x7f39d80d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39d7fff700 1 --2- 172.21.15.153:0/1860856526 >> v2:172.21.15.164:3300/0 conn(0x7f39d815e1e0 0x7f39d80d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39d7fff700 1 -- 172.21.15.153:0/1860856526 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d80d20b0 con 0x7f39d80d3a00 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39d7fff700 1 --2- 172.21.15.153:0/1860856526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d80d3a00 0x7f39d80d0870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f39d80d0840 tx=0x7f39c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f554de0d5b7ebe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39d77fe700 1 -- 172.21.15.153:0/1860856526 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0011830 con 0x7f39d80d3a00 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39d77fe700 1 -- 172.21.15.153:0/1860856526 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c0011990 con 0x7f39d80d3a00 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.472+0000 7f39d77fe700 1 -- 172.21.15.153:0/1860856526 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0011d20 con 0x7f39d80d3a00 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.473+0000 7f39deed7700 1 -- 172.21.15.153:0/1860856526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d80d3a00 msgr2=0x7f39d80d0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.473+0000 7f39deed7700 1 --2- 172.21.15.153:0/1860856526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d80d3a00 0x7f39d80d0870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f39d80d0840 tx=0x7f39c0009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.473+0000 7f39deed7700 1 -- 172.21.15.153:0/1860856526 shutdown_connections 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.473+0000 7f39deed7700 1 --2- 172.21.15.153:0/1860856526 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80d0db0 0x7f39d806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.473+0000 7f39deed7700 1 --2- 172.21.15.153:0/1860856526 >> v2:172.21.15.164:3300/0 conn(0x7f39d815e1e0 0x7f39d80d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.473+0000 7f39deed7700 1 --2- 172.21.15.153:0/1860856526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d80d3a00 0x7f39d80d0870 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.473+0000 7f39deed7700 1 -- 172.21.15.153:0/1860856526 >> 172.21.15.153:0/1860856526 conn(0x7f39d80b5b50 msgr2=0x7f39d80b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.473+0000 7f39deed7700 1 -- 172.21.15.153:0/1860856526 shutdown_connections 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.473+0000 7f39deed7700 1 -- 172.21.15.153:0/1860856526 wait complete. 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.474+0000 7f39deed7700 1 Processor -- start 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.474+0000 7f39deed7700 1 -- start start 2023-11-24T08:04:05.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.475+0000 7f39deed7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d80d0db0 0x7f39d81f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.475+0000 7f39deed7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80d3a00 0x7f39d8156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.475+0000 7f39deed7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d815e1e0 0x7f39d8160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.475+0000 7f39deed7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d8160500 con 0x7f39d80d0db0 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.475+0000 7f39deed7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d815f8f0 con 0x7f39d815e1e0 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.475+0000 7f39deed7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d815fbd0 con 0x7f39d80d3a00 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.475+0000 7f39dcc73700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d80d0db0 0x7f39d81f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.475+0000 7f39dcc73700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d80d0db0 0x7f39d81f3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35100/0 (socket says 172.21.15.153:35100) 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.475+0000 7f39dcc73700 1 -- 172.21.15.153:0/1258249085 learned_addr learned my addr 172.21.15.153:0/1258249085 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.475+0000 7f39dd474700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d815e1e0 0x7f39d8160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.475+0000 7f39d7fff700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80d3a00 0x7f39d8156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39dcc73700 1 -- 172.21.15.153:0/1258249085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80d3a00 msgr2=0x7f39d8156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39dcc73700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80d3a00 0x7f39d8156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39dcc73700 1 -- 172.21.15.153:0/1258249085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d815e1e0 msgr2=0x7f39d8160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39dcc73700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d815e1e0 0x7f39d8160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39dcc73700 1 -- 172.21.15.153:0/1258249085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0009550 con 0x7f39d80d0db0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39dd474700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d815e1e0 0x7f39d8160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39dcc73700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d80d0db0 0x7f39d81f3320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f39c800e870 tx=0x7f39c800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39d57fa700 1 -- 172.21.15.153:0/1258249085 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c8009590 con 0x7f39d80d0db0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39d57fa700 1 -- 172.21.15.153:0/1258249085 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c8013680 con 0x7f39d80d0db0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39deed7700 1 -- 172.21.15.153:0/1258249085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d815feb0 con 0x7f39d80d0db0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39d57fa700 1 -- 172.21.15.153:0/1258249085 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80139f0 con 0x7f39d80d0db0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.476+0000 7f39deed7700 1 -- 172.21.15.153:0/1258249085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d8149520 con 0x7f39d80d0db0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.477+0000 7f39deed7700 1 -- 172.21.15.153:0/1258249085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d80751e0 con 0x7f39d80d0db0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.477+0000 7f39d57fa700 1 -- 172.21.15.153:0/1258249085 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f39c8013b50 con 0x7f39d80d0db0 2023-11-24T08:04:05.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.478+0000 7f39d57fa700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39b806ae40 0x7f39b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.478+0000 7f39d7fff700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39b806ae40 0x7f39b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.478+0000 7f39d57fa700 1 -- 172.21.15.153:0/1258249085 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f39c8088e30 con 0x7f39d80d0db0 2023-11-24T08:04:05.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.478+0000 7f39d7fff700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39b806ae40 0x7f39b806d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39d80d3e30 tx=0x7f39c0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.482+0000 7f39d57fa700 1 -- 172.21.15.153:0/1258249085 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f39c8054490 con 0x7f39d80d0db0 2023-11-24T08:04:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.676+0000 7f39deed7700 1 -- 172.21.15.153:0/1258249085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39d80b6340 con 0x7f39d80d0db0 2023-11-24T08:04:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.677+0000 7f39d57fa700 1 -- 172.21.15.153:0/1258249085 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10944 (secure 0 0 0) 0x7f39c8057ab0 con 0x7f39d80d0db0 2023-11-24T08:04:05.678 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:05.679 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":13,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:05.097171+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:05.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 -- 172.21.15.153:0/1258249085 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39b806ae40 msgr2=0x7f39b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39b806ae40 0x7f39b806d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39d80d3e30 tx=0x7f39c0008030 comp rx=0 tx=0).stop 2023-11-24T08:04:05.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 -- 172.21.15.153:0/1258249085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d80d0db0 msgr2=0x7f39d81f3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d80d0db0 0x7f39d81f3320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f39c800e870 tx=0x7f39c800eb80 comp rx=0 tx=0).stop 2023-11-24T08:04:05.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 -- 172.21.15.153:0/1258249085 shutdown_connections 2023-11-24T08:04:05.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d815e1e0 0x7f39d8160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39b806ae40 0x7f39b806d300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d80d0db0 0x7f39d81f3320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 --2- 172.21.15.153:0/1258249085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80d3a00 0x7f39d8156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 -- 172.21.15.153:0/1258249085 >> 172.21.15.153:0/1258249085 conn(0x7f39d80b5b50 msgr2=0x7f39d80b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 -- 172.21.15.153:0/1258249085 shutdown_connections 2023-11-24T08:04:05.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.679+0000 7f39deed7700 1 -- 172.21.15.153:0/1258249085 wait complete. 2023-11-24T08:04:05.693 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-11-24T08:04:05.693 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:05.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.813+0000 7f2d0817f700 1 Processor -- start 2023-11-24T08:04:05.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.813+0000 7f2d0817f700 1 -- start start 2023-11-24T08:04:05.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0817f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0006c710 0x7f2d000b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0817f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2d000af4d0 0x7f2d000afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0817f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d000ae430 con 0x7f2d0015e080 2023-11-24T08:04:05.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0817f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d000af0b0 con 0x7f2d000af4d0 2023-11-24T08:04:05.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0817f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d000b05a0 con 0x7f2d0006c710 2023-11-24T08:04:05.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0671c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2d000af4d0 0x7f2d000afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0671c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2d000af4d0 0x7f2d000afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35134/0 (socket says 172.21.15.153:35134) 2023-11-24T08:04:05.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0671c700 1 -- 172.21.15.153:0/1193969469 learned_addr learned my addr 172.21.15.153:0/1193969469 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:05.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0571a700 1 --2- 172.21.15.153:0/1193969469 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0006c710 0x7f2d000b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0671c700 1 -- 172.21.15.153:0/1193969469 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0006c710 msgr2=0x7f2d000b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0671c700 1 --2- 172.21.15.153:0/1193969469 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0006c710 0x7f2d000b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0671c700 1 -- 172.21.15.153:0/1193969469 >> v1:172.21.15.164:6789/0 conn(0x7f2d0015e080 legacy=0x7f2d0006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d04f19700 1 -- 172.21.15.153:0/1193969469 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797254842 0 0) 0x7f2d000ae430 con 0x7f2d0015e080 2023-11-24T08:04:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0671c700 1 -- 172.21.15.153:0/1193969469 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d000ae710 con 0x7f2d000af4d0 2023-11-24T08:04:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d0671c700 1 --2- 172.21.15.153:0/1193969469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d000af4d0 0x7f2d000afb90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009e80 tx=0x7f2cf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f9c09f31c50ee4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d04f19700 1 -- 172.21.15.153:0/1193969469 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800e070 con 0x7f2d000af4d0 2023-11-24T08:04:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d04f19700 1 -- 172.21.15.153:0/1193969469 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf800b8d0 con 0x7f2d000af4d0 2023-11-24T08:04:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.814+0000 7f2d04f19700 1 -- 172.21.15.153:0/1193969469 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800bc80 con 0x7f2d000af4d0 2023-11-24T08:04:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.815+0000 7f2d0817f700 1 -- 172.21.15.153:0/1193969469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d000af4d0 msgr2=0x7f2d000afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.815+0000 7f2d0817f700 1 --2- 172.21.15.153:0/1193969469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d000af4d0 0x7f2d000afb90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009e80 tx=0x7f2cf800b330 comp rx=0 tx=0).stop 2023-11-24T08:04:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.815+0000 7f2d0817f700 1 -- 172.21.15.153:0/1193969469 shutdown_connections 2023-11-24T08:04:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.815+0000 7f2d0817f700 1 --2- 172.21.15.153:0/1193969469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d000af4d0 0x7f2d000afb90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.815+0000 7f2d0817f700 1 --2- 172.21.15.153:0/1193969469 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0006c710 0x7f2d000b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.815+0000 7f2d0817f700 1 -- 172.21.15.153:0/1193969469 >> 172.21.15.153:0/1193969469 conn(0x7f2d00071b90 msgr2=0x7f2d00071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.815+0000 7f2d0817f700 1 -- 172.21.15.153:0/1193969469 shutdown_connections 2023-11-24T08:04:05.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.815+0000 7f2d0817f700 1 -- 172.21.15.153:0/1193969469 wait complete. 2023-11-24T08:04:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.816+0000 7f2d0817f700 1 Processor -- start 2023-11-24T08:04:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.816+0000 7f2d0817f700 1 -- start start 2023-11-24T08:04:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0817f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0006c710 0x7f2d000cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0817f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d000af4d0 0x7f2d001604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0817f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0015e080 0x7f2d00160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0817f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0015f4b0 con 0x7f2d000af4d0 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0817f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0015f700 con 0x7f2d0006c710 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0817f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0015f9e0 con 0x7f2d0015e080 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0571a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d000af4d0 0x7f2d001604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0571a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d000af4d0 0x7f2d001604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35138/0 (socket says 172.21.15.153:35138) 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0571a700 1 -- 172.21.15.153:0/1770028950 learned_addr learned my addr 172.21.15.153:0/1770028950 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0671c700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0015e080 0x7f2d00160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d05f1b700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0006c710 0x7f2d000cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0571a700 1 -- 172.21.15.153:0/1770028950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0015e080 msgr2=0x7f2d00160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0571a700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0015e080 0x7f2d00160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0571a700 1 -- 172.21.15.153:0/1770028950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0006c710 msgr2=0x7f2d000cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0571a700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0006c710 0x7f2d000cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0571a700 1 -- 172.21.15.153:0/1770028950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf8009b30 con 0x7f2d000af4d0 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d05f1b700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0006c710 0x7f2d000cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.817+0000 7f2d0571a700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d000af4d0 0x7f2d001604c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000e9b0 tx=0x7f2cf000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.818+0000 7f2cf67fc700 1 -- 172.21.15.153:0/1770028950 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0009710 con 0x7f2d000af4d0 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.818+0000 7f2cf67fc700 1 -- 172.21.15.153:0/1770028950 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf000c850 con 0x7f2d000af4d0 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.818+0000 7f2cf67fc700 1 -- 172.21.15.153:0/1770028950 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000cbc0 con 0x7f2d000af4d0 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.818+0000 7f2d0817f700 1 -- 172.21.15.153:0/1770028950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0015fcc0 con 0x7f2d000af4d0 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.818+0000 7f2d0817f700 1 -- 172.21.15.153:0/1770028950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0014bec0 con 0x7f2d000af4d0 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.819+0000 7f2d0817f700 1 -- 172.21.15.153:0/1770028950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d000753f0 con 0x7f2d000af4d0 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.819+0000 7f2cf67fc700 1 -- 172.21.15.153:0/1770028950 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f2cf000cd20 con 0x7f2d000af4d0 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.819+0000 7f2cf67fc700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2ce406ae40 0x7f2ce406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.819+0000 7f2cf67fc700 1 -- 172.21.15.153:0/1770028950 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f2cf0089060 con 0x7f2d000af4d0 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.820+0000 7f2d05f1b700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2ce406ae40 0x7f2ce406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.820+0000 7f2d05f1b700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2ce406ae40 0x7f2ce406d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc000f60 tx=0x7f2cfc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:05.824+0000 7f2cf67fc700 1 -- 172.21.15.153:0/1770028950 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2cf0054750 con 0x7f2d000af4d0 2023-11-24T08:04:06.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.064+0000 7f2d0817f700 1 -- 172.21.15.153:0/1770028950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d00067f60 con 0x7f2d000af4d0 2023-11-24T08:04:06.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.064+0000 7f2cf67fc700 1 -- 172.21.15.153:0/1770028950 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f2cf0021540 con 0x7f2d000af4d0 2023-11-24T08:04:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:06.066 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/157182640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":157182640},{"type":"v1","addr":"172.21.15.153:6837","nonce":157182640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-24T08:04:06.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.066+0000 7f2d0817f700 1 -- 172.21.15.153:0/1770028950 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2ce406ae40 msgr2=0x7f2ce406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.066+0000 7f2d0817f700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2ce406ae40 0x7f2ce406d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc000f60 tx=0x7f2cfc009040 comp rx=0 tx=0).stop 2023-11-24T08:04:06.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.066+0000 7f2d0817f700 1 -- 172.21.15.153:0/1770028950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d000af4d0 msgr2=0x7f2d001604c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.066+0000 7f2d0817f700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d000af4d0 0x7f2d001604c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000e9b0 tx=0x7f2cf000ed70 comp rx=0 tx=0).stop 2023-11-24T08:04:06.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.066+0000 7f2d0817f700 1 -- 172.21.15.153:0/1770028950 shutdown_connections 2023-11-24T08:04:06.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.067+0000 7f2d0817f700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0015e080 0x7f2d00160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.067+0000 7f2d0817f700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0006c710 0x7f2d000cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.067+0000 7f2d0817f700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2ce406ae40 0x7f2ce406d300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.067+0000 7f2d0817f700 1 --2- 172.21.15.153:0/1770028950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d000af4d0 0x7f2d001604c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.067+0000 7f2d0817f700 1 -- 172.21.15.153:0/1770028950 >> 172.21.15.153:0/1770028950 conn(0x7f2d00071b90 msgr2=0x7f2d0006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:06.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.067+0000 7f2d0817f700 1 -- 172.21.15.153:0/1770028950 shutdown_connections 2023-11-24T08:04:06.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:06.067+0000 7f2d0817f700 1 -- 172.21.15.153:0/1770028950 wait complete. 2023-11-24T08:04:06.070 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 2 2023-11-24T08:04:08.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:08.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.202+0000 7fe8493cc700 1 Processor -- start 2023-11-24T08:04:08.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.202+0000 7fe8493cc700 1 -- start start 2023-11-24T08:04:08.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.203+0000 7fe8493cc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 0x7fe8441604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.203+0000 7fe8493cc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe8440d1c70 0x7fe8440d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.203+0000 7fe8493cc700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440b22d0 con 0x7fe8440b3370 2023-11-24T08:04:08.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.203+0000 7fe8493cc700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8440b2f50 con 0x7fe8440d1c70 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.203+0000 7fe8493cc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440d2640 con 0x7fe84415bdd0 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.203+0000 7fe8437fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe8440d1c70 0x7fe8440d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.203+0000 7fe842ffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 0x7fe8441604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.203+0000 7fe8427fc700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fe8440b3370 0x7fe8440b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:48988/0 (socket says 172.21.15.153:48988) 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.203+0000 7fe8427fc700 1 -- 172.21.15.153:0/1788306508 learned_addr learned my addr 172.21.15.153:0/1788306508 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.204+0000 7fe842ffd700 1 -- 172.21.15.153:0/1788306508 >> v2:172.21.15.164:3300/0 conn(0x7fe8440d1c70 msgr2=0x7fe8440d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.204+0000 7fe842ffd700 1 --2- 172.21.15.153:0/1788306508 >> v2:172.21.15.164:3300/0 conn(0x7fe8440d1c70 0x7fe8440d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.204+0000 7fe842ffd700 1 -- 172.21.15.153:0/1788306508 >> v1:172.21.15.164:6789/0 conn(0x7fe8440b3370 legacy=0x7fe8440b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.204+0000 7fe842ffd700 1 -- 172.21.15.153:0/1788306508 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440b25b0 con 0x7fe84415bdd0 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.204+0000 7fe8437fe700 1 --2- 172.21.15.153:0/1788306508 >> v2:172.21.15.164:3300/0 conn(0x7fe8440d1c70 0x7fe8440d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.204+0000 7fe842ffd700 1 --2- 172.21.15.153:0/1788306508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 0x7fe8441604e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009840 tx=0x7fe82c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73e086b863d919f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.204+0000 7fe841ffb700 1 -- 172.21.15.153:0/1788306508 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c011830 con 0x7fe84415bdd0 2023-11-24T08:04:08.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.204+0000 7fe841ffb700 1 -- 172.21.15.153:0/1788306508 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c011990 con 0x7fe84415bdd0 2023-11-24T08:04:08.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.204+0000 7fe841ffb700 1 -- 172.21.15.153:0/1788306508 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c011d20 con 0x7fe84415bdd0 2023-11-24T08:04:08.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.204+0000 7fe8493cc700 1 -- 172.21.15.153:0/1788306508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 msgr2=0x7fe8441604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.205+0000 7fe8493cc700 1 --2- 172.21.15.153:0/1788306508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 0x7fe8441604e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009840 tx=0x7fe82c009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:08.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.205+0000 7fe8493cc700 1 -- 172.21.15.153:0/1788306508 shutdown_connections 2023-11-24T08:04:08.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.205+0000 7fe8493cc700 1 --2- 172.21.15.153:0/1788306508 >> v2:172.21.15.164:3300/0 conn(0x7fe8440d1c70 0x7fe8440d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.205+0000 7fe8493cc700 1 --2- 172.21.15.153:0/1788306508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 0x7fe8441604e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.205+0000 7fe8493cc700 1 -- 172.21.15.153:0/1788306508 >> 172.21.15.153:0/1788306508 conn(0x7fe8440731a0 msgr2=0x7fe84409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:08.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.205+0000 7fe8493cc700 1 -- 172.21.15.153:0/1788306508 shutdown_connections 2023-11-24T08:04:08.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.205+0000 7fe8493cc700 1 -- 172.21.15.153:0/1788306508 wait complete. 2023-11-24T08:04:08.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.206+0000 7fe8493cc700 1 Processor -- start 2023-11-24T08:04:08.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.206+0000 7fe8493cc700 1 -- start start 2023-11-24T08:04:08.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8493cc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8440b3370 0x7fe844151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8493cc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8440d1c70 0x7fe8440ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8493cc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 0x7fe8440ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8493cc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844152040 con 0x7fe8440d1c70 2023-11-24T08:04:08.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8493cc700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440b5240 con 0x7fe8440b3370 2023-11-24T08:04:08.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8493cc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440b53d0 con 0x7fe84415bdd0 2023-11-24T08:04:08.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe842ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8440b3370 0x7fe844151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8437fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 0x7fe8440ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8427fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8440d1c70 0x7fe8440ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8437fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 0x7fe8440ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47280/0 (socket says 172.21.15.153:47280) 2023-11-24T08:04:08.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe842ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8440b3370 0x7fe844151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:56794/0 (socket says 172.21.15.153:56794) 2023-11-24T08:04:08.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8437fe700 1 -- 172.21.15.153:0/3494348535 learned_addr learned my addr 172.21.15.153:0/3494348535 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:08.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe842ffd700 1 -- 172.21.15.153:0/3494348535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 msgr2=0x7fe8440ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe842ffd700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 0x7fe8440ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe842ffd700 1 -- 172.21.15.153:0/3494348535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8440d1c70 msgr2=0x7fe8440ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe842ffd700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8440d1c70 0x7fe8440ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe842ffd700 1 -- 172.21.15.153:0/3494348535 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c009a70 con 0x7fe8440b3370 2023-11-24T08:04:08.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8437fe700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 0x7fe8440ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:08.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8427fc700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8440d1c70 0x7fe8440ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:08.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe842ffd700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8440b3370 0x7fe844151b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe82c016000 tx=0x7fe82c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe83b7fe700 1 -- 172.21.15.153:0/3494348535 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0036a0 con 0x7fe8440b3370 2023-11-24T08:04:08.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe83b7fe700 1 -- 172.21.15.153:0/3494348535 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c01e070 con 0x7fe8440b3370 2023-11-24T08:04:08.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe8493cc700 1 -- 172.21.15.153:0/3494348535 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c0094a0 con 0x7fe8440b3370 2023-11-24T08:04:08.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.207+0000 7fe83b7fe700 1 -- 172.21.15.153:0/3494348535 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c003a60 con 0x7fe8440b3370 2023-11-24T08:04:08.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.208+0000 7fe8493cc700 1 -- 172.21.15.153:0/3494348535 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8440cd910 con 0x7fe8440b3370 2023-11-24T08:04:08.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.208+0000 7fe8493cc700 1 -- 172.21.15.153:0/3494348535 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe844067f60 con 0x7fe8440b3370 2023-11-24T08:04:08.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.209+0000 7fe83b7fe700 1 -- 172.21.15.153:0/3494348535 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fe82c003bc0 con 0x7fe8440b3370 2023-11-24T08:04:08.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.209+0000 7fe83b7fe700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe82406ae40 0x7fe82406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.209+0000 7fe83b7fe700 1 -- 172.21.15.153:0/3494348535 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe82c08a050 con 0x7fe8440b3370 2023-11-24T08:04:08.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.209+0000 7fe8427fc700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe82406ae40 0x7fe82406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.210+0000 7fe8427fc700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe82406ae40 0x7fe82406d300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe8441f52d0 tx=0x7fe834009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.215+0000 7fe83b7fe700 1 -- 172.21.15.153:0/3494348535 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe82c0555c0 con 0x7fe8440b3370 2023-11-24T08:04:08.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.460+0000 7fe8493cc700 1 -- 172.21.15.153:0/3494348535 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8440b7c60 con 0x7fe8440b3370 2023-11-24T08:04:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.461+0000 7fe83b7fe700 1 -- 172.21.15.153:0/3494348535 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7fe82c020090 con 0x7fe8440b3370 2023-11-24T08:04:08.463 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:08.463 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/157182640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":157182640},{"type":"v1","addr":"172.21.15.153:6837","nonce":157182640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2853134113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2853134113},{"type":"v1","addr":"172.21.15.153:6836","nonce":2853134113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1191113201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1191113201},{"type":"v1","addr":"172.21.15.164:6833","nonce":1191113201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1557353565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1557353565},{"type":"v1","addr":"172.21.15.164:6835","nonce":1557353565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-24T08:04:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 -- 172.21.15.153:0/3494348535 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe82406ae40 msgr2=0x7fe82406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe82406ae40 0x7fe82406d300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe8441f52d0 tx=0x7fe834009040 comp rx=0 tx=0).stop 2023-11-24T08:04:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 -- 172.21.15.153:0/3494348535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8440b3370 msgr2=0x7fe844151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8440b3370 0x7fe844151b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe82c016000 tx=0x7fe82c004750 comp rx=0 tx=0).stop 2023-11-24T08:04:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 -- 172.21.15.153:0/3494348535 shutdown_connections 2023-11-24T08:04:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe84415bdd0 0x7fe8440ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8440b3370 0x7fe844151b00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe82406ae40 0x7fe82406d300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 --2- 172.21.15.153:0/3494348535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8440d1c70 0x7fe8440ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 -- 172.21.15.153:0/3494348535 >> 172.21.15.153:0/3494348535 conn(0x7fe8440731a0 msgr2=0x7fe8440b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 -- 172.21.15.153:0/3494348535 shutdown_connections 2023-11-24T08:04:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.464+0000 7fe8493cc700 1 -- 172.21.15.153:0/3494348535 wait complete. 2023-11-24T08:04:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 3 2023-11-24T08:04:08.478 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:08.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.598+0000 7ff85f86e700 1 Processor -- start 2023-11-24T08:04:08.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.598+0000 7ff85f86e700 1 -- start start 2023-11-24T08:04:08.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff85f86e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff85806c710 0x7ff8580b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff85f86e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8580af4d0 0x7ff8580afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff85f86e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8580ae430 con 0x7ff85815e080 2023-11-24T08:04:08.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff85f86e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8580af0b0 con 0x7ff85806c710 2023-11-24T08:04:08.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff85f86e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580b05a0 con 0x7ff8580af4d0 2023-11-24T08:04:08.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff85d60a700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff85815e080 0x7ff85806c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41328/0 (socket says 172.21.15.153:41328) 2023-11-24T08:04:08.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff85d60a700 1 -- 172.21.15.153:0/3978367574 learned_addr learned my addr 172.21.15.153:0/3978367574 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:08.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff85de0b700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8580af4d0 0x7ff8580afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff85ce09700 1 --2- 172.21.15.153:0/3978367574 >> v2:172.21.15.164:3300/0 conn(0x7ff85806c710 0x7ff8580b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274112202 0 0) 0x7ff8580ae430 con 0x7ff85815e080 2023-11-24T08:04:08.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8440035b0 con 0x7ff85815e080 2023-11-24T08:04:08.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3999922193 0 0) 0x7ff8440035b0 con 0x7ff85815e080 2023-11-24T08:04:08.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8580af4d0 msgr2=0x7ff8580afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:08.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff84ffff700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8580af4d0 0x7ff8580afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 >> v2:172.21.15.164:3300/0 conn(0x7ff85806c710 msgr2=0x7ff8580b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:08.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff84ffff700 1 --2- 172.21.15.153:0/3978367574 >> v2:172.21.15.164:3300/0 conn(0x7ff85806c710 0x7ff8580b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580ae710 con 0x7ff85815e080 2023-11-24T08:04:08.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.599+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7ff854001670 con 0x7ff85815e080 2023-11-24T08:04:08.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 >> v1:172.21.15.153:6789/0 conn(0x7ff85815e080 legacy=0x7ff85806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff84ffff700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8580af4d0 0x7ff844003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff84ffff700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844003f80 0x7ff844004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff84ffff700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff844004d90 0x7ff844005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580af0b0 con 0x7ff844003f80 2023-11-24T08:04:08.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580b05a0 con 0x7ff844004d90 2023-11-24T08:04:08.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84400ba10 con 0x7ff8580af4d0 2023-11-24T08:04:08.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff85ce09700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844003f80 0x7ff844004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff85d60a700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8580af4d0 0x7ff844003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff85de0b700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff844004d90 0x7ff844005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff85ce09700 1 -- 172.21.15.153:0/3978367574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8580af4d0 msgr2=0x7ff844003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:08.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff85ce09700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8580af4d0 0x7ff844003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff85ce09700 1 -- 172.21.15.153:0/3978367574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff844004d90 msgr2=0x7ff844005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:08.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff85ce09700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff844004d90 0x7ff844005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff85ce09700 1 -- 172.21.15.153:0/3978367574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8440035b0 con 0x7ff844003f80 2023-11-24T08:04:08.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff85ce09700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844003f80 0x7ff844004850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff848009b60 tx=0x7ff844005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cd84c88c5b5586 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800e660 con 0x7ff844003f80 2023-11-24T08:04:08.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84800e7c0 con 0x7ff844003f80 2023-11-24T08:04:08.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.600+0000 7ff84ffff700 1 -- 172.21.15.153:0/3978367574 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800eb30 con 0x7ff844003f80 2023-11-24T08:04:08.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.601+0000 7ff85f86e700 1 -- 172.21.15.153:0/3978367574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844003f80 msgr2=0x7ff844004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.601+0000 7ff85f86e700 1 --2- 172.21.15.153:0/3978367574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844003f80 0x7ff844004850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff848009b60 tx=0x7ff844005880 comp rx=0 tx=0).stop 2023-11-24T08:04:08.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.601+0000 7ff85de0b700 1 -- 172.21.15.153:0/3978367574 reap_dead start 2023-11-24T08:04:08.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.601+0000 7ff85f86e700 1 -- 172.21.15.153:0/3978367574 shutdown_connections 2023-11-24T08:04:08.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.601+0000 7ff85f86e700 1 -- 172.21.15.153:0/3978367574 >> 172.21.15.153:0/3978367574 conn(0x7ff858071b90 msgr2=0x7ff858071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:08.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.601+0000 7ff85f86e700 1 -- 172.21.15.153:0/3978367574 shutdown_connections 2023-11-24T08:04:08.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.601+0000 7ff85f86e700 1 -- 172.21.15.153:0/3978367574 wait complete. 2023-11-24T08:04:08.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.602+0000 7ff85f86e700 1 Processor -- start 2023-11-24T08:04:08.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.602+0000 7ff85f86e700 1 -- start start 2023-11-24T08:04:08.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85f86e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff844003f80 0x7ff8581f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85f86e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8581449c0 0x7ff8580b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85f86e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8580b1100 0x7ff8581f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85f86e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580b1580 con 0x7ff8580b1100 2023-11-24T08:04:08.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85f86e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85815a5e0 con 0x7ff8581449c0 2023-11-24T08:04:08.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85f86e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85815b440 con 0x7ff844003f80 2023-11-24T08:04:08.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85de0b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8580b1100 0x7ff8581f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85de0b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8580b1100 0x7ff8581f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35240/0 (socket says 172.21.15.153:35240) 2023-11-24T08:04:08.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85de0b700 1 -- 172.21.15.153:0/586918969 learned_addr learned my addr 172.21.15.153:0/586918969 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:08.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85d60a700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff844003f80 0x7ff8581f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85ce09700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8581449c0 0x7ff8580b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85de0b700 1 -- 172.21.15.153:0/586918969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff844003f80 msgr2=0x7ff8581f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85de0b700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff844003f80 0x7ff8581f3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85de0b700 1 -- 172.21.15.153:0/586918969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8581449c0 msgr2=0x7ff8580b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85de0b700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8581449c0 0x7ff8580b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85de0b700 1 -- 172.21.15.153:0/586918969 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85815a830 con 0x7ff8580b1100 2023-11-24T08:04:08.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff85de0b700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8580b1100 0x7ff8581f6dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff85806d350 tx=0x7ff850011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.603+0000 7ff84dffb700 1 -- 172.21.15.153:0/586918969 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000e040 con 0x7ff8580b1100 2023-11-24T08:04:08.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.604+0000 7ff84dffb700 1 -- 172.21.15.153:0/586918969 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85000f040 con 0x7ff8580b1100 2023-11-24T08:04:08.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.604+0000 7ff85f86e700 1 -- 172.21.15.153:0/586918969 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85815ab10 con 0x7ff8580b1100 2023-11-24T08:04:08.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.604+0000 7ff84dffb700 1 -- 172.21.15.153:0/586918969 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000fbe0 con 0x7ff8580b1100 2023-11-24T08:04:08.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.604+0000 7ff85f86e700 1 -- 172.21.15.153:0/586918969 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85815b0d0 con 0x7ff8580b1100 2023-11-24T08:04:08.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.605+0000 7ff85f86e700 1 -- 172.21.15.153:0/586918969 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8580753f0 con 0x7ff8580b1100 2023-11-24T08:04:08.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.605+0000 7ff84dffb700 1 -- 172.21.15.153:0/586918969 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7ff85000fd40 con 0x7ff8580b1100 2023-11-24T08:04:08.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.606+0000 7ff84dffb700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff83c06ae40 0x7ff83c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.606+0000 7ff84dffb700 1 -- 172.21.15.153:0/586918969 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff850089420 con 0x7ff8580b1100 2023-11-24T08:04:08.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.606+0000 7ff85d60a700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff83c06ae40 0x7ff83c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.606+0000 7ff85d60a700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff83c06ae40 0x7ff83c06d300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff854000fb0 tx=0x7ff854007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.610+0000 7ff84dffb700 1 -- 172.21.15.153:0/586918969 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff850054990 con 0x7ff8580b1100 2023-11-24T08:04:08.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.804+0000 7ff85f86e700 1 -- 172.21.15.153:0/586918969 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff858067f60 con 0x7ff8580b1100 2023-11-24T08:04:08.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.805+0000 7ff84dffb700 1 -- 172.21.15.153:0/586918969 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7ff850057fb0 con 0x7ff8580b1100 2023-11-24T08:04:08.807 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:08.807 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":16,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:08.109822+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 -- 172.21.15.153:0/586918969 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff83c06ae40 msgr2=0x7ff83c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff83c06ae40 0x7ff83c06d300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff854000fb0 tx=0x7ff854007980 comp rx=0 tx=0).stop 2023-11-24T08:04:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 -- 172.21.15.153:0/586918969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8580b1100 msgr2=0x7ff8581f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8580b1100 0x7ff8581f6dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff85806d350 tx=0x7ff850011ed0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 -- 172.21.15.153:0/586918969 shutdown_connections 2023-11-24T08:04:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff83c06ae40 0x7ff83c06d300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8580b1100 0x7ff8581f6dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff844003f80 0x7ff8581f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 --2- 172.21.15.153:0/586918969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8581449c0 0x7ff8580b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 -- 172.21.15.153:0/586918969 >> 172.21.15.153:0/586918969 conn(0x7ff858071b90 msgr2=0x7ff8580b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 -- 172.21.15.153:0/586918969 shutdown_connections 2023-11-24T08:04:08.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.808+0000 7ff85f86e700 1 -- 172.21.15.153:0/586918969 wait complete. 2023-11-24T08:04:08.821 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:08.822 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:08.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.944+0000 7fdd8560d700 1 Processor -- start 2023-11-24T08:04:08.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.944+0000 7fdd8560d700 1 -- start start 2023-11-24T08:04:08.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.944+0000 7fdd8560d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdd8015e140 0x7fdd800d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.944+0000 7fdd8560d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd800b80e0 con 0x7fdd800d39d0 2023-11-24T08:04:08.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.944+0000 7fdd8560d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd800b67d0 con 0x7fdd800b98c0 2023-11-24T08:04:08.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.944+0000 7fdd8560d700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8015e520 con 0x7fdd8015e140 2023-11-24T08:04:08.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7e7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdd800d39d0 0x7fdd800b59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41350/0 (socket says 172.21.15.153:41350) 2023-11-24T08:04:08.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7e7fc700 1 -- 172.21.15.153:0/845058483 learned_addr learned my addr 172.21.15.153:0/845058483 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:08.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7effd700 1 --2- 172.21.15.153:0/845058483 >> v2:172.21.15.164:3300/0 conn(0x7fdd8015e140 0x7fdd800d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7dffb700 1 -- 172.21.15.153:0/845058483 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108033476 0 0) 0x7fdd70001110 con 0x7fdd800d39d0 2023-11-24T08:04:08.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7dffb700 1 -- 172.21.15.153:0/845058483 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd6c0035b0 con 0x7fdd800d39d0 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7dffb700 1 -- 172.21.15.153:0/845058483 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230005476 0 0) 0x7fdd800b67d0 con 0x7fdd800b98c0 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7dffb700 1 -- 172.21.15.153:0/845058483 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd70001110 con 0x7fdd800b98c0 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7effd700 1 -- 172.21.15.153:0/845058483 >> v1:172.21.15.164:6789/0 conn(0x7fdd800b98c0 legacy=0x7fdd800b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7effd700 1 -- 172.21.15.153:0/845058483 >> v1:172.21.15.153:6789/0 conn(0x7fdd800d39d0 legacy=0x7fdd800b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7dffb700 1 -- 172.21.15.153:0/845058483 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 859035054 0 0) 0x7fdd6c0035b0 con 0x7fdd800d39d0 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7effd700 1 -- 172.21.15.153:0/845058483 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd800d2930 con 0x7fdd8015e140 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7effd700 1 --2- 172.21.15.153:0/845058483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd8015e140 0x7fdd800d3ec0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009840 tx=0x7fdd68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e80703b6a8f343a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7dffb700 1 -- 172.21.15.153:0/845058483 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70001800 con 0x7fdd8015e140 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7dffb700 1 -- 172.21.15.153:0/845058483 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68004030 con 0x7fdd8015e140 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.945+0000 7fdd7dffb700 1 -- 172.21.15.153:0/845058483 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680043c0 con 0x7fdd8015e140 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.946+0000 7fdd8560d700 1 -- 172.21.15.153:0/845058483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd8015e140 msgr2=0x7fdd800d3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.946+0000 7fdd8560d700 1 --2- 172.21.15.153:0/845058483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd8015e140 0x7fdd800d3ec0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009840 tx=0x7fdd68009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:08.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.946+0000 7fdd8560d700 1 -- 172.21.15.153:0/845058483 shutdown_connections 2023-11-24T08:04:08.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.946+0000 7fdd8560d700 1 --2- 172.21.15.153:0/845058483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd8015e140 0x7fdd800d3ec0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.946+0000 7fdd8560d700 1 -- 172.21.15.153:0/845058483 >> 172.21.15.153:0/845058483 conn(0x7fdd8006b410 msgr2=0x7fdd8006b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:08.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.946+0000 7fdd8560d700 1 -- 172.21.15.153:0/845058483 shutdown_connections 2023-11-24T08:04:08.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.946+0000 7fdd8560d700 1 -- 172.21.15.153:0/845058483 wait complete. 2023-11-24T08:04:08.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.948+0000 7fdd8560d700 1 Processor -- start 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.948+0000 7fdd8560d700 1 -- start start 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd8560d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd800b98c0 0x7fdd8015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd8560d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdd800d39d0 0x7fdd800cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd8560d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd8015e140 0x7fdd801606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd8560d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd801f3c30 con 0x7fdd800b98c0 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd8560d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800cbac0 con 0x7fdd8015e140 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd8560d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800cbda0 con 0x7fdd800d39d0 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd7effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd800b98c0 0x7fdd8015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd7effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd800b98c0 0x7fdd8015c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35250/0 (socket says 172.21.15.153:35250) 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd7effd700 1 -- 172.21.15.153:0/3886194576 learned_addr learned my addr 172.21.15.153:0/3886194576 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd7f7fe700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd8015e140 0x7fdd801606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd7e7fc700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdd800d39d0 0x7fdd800cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd7effd700 1 -- 172.21.15.153:0/3886194576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdd800d39d0 msgr2=0x7fdd800cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd7effd700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdd800d39d0 0x7fdd800cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd7effd700 1 -- 172.21.15.153:0/3886194576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd8015e140 msgr2=0x7fdd801606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd7effd700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd8015e140 0x7fdd801606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd7effd700 1 -- 172.21.15.153:0/3886194576 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd680094a0 con 0x7fdd800b98c0 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd7effd700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd800b98c0 0x7fdd8015c320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800a010 tx=0x7fdd68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd777fe700 1 -- 172.21.15.153:0/3886194576 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68003c50 con 0x7fdd800b98c0 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd777fe700 1 -- 172.21.15.153:0/3886194576 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6801f070 con 0x7fdd800b98c0 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd8560d700 1 -- 172.21.15.153:0/3886194576 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd800cc080 con 0x7fdd800b98c0 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd777fe700 1 -- 172.21.15.153:0/3886194576 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68011630 con 0x7fdd800b98c0 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.949+0000 7fdd8560d700 1 -- 172.21.15.153:0/3886194576 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8015c860 con 0x7fdd800b98c0 2023-11-24T08:04:08.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.950+0000 7fdd8560d700 1 -- 172.21.15.153:0/3886194576 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd800cc5a0 con 0x7fdd800b98c0 2023-11-24T08:04:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.951+0000 7fdd777fe700 1 -- 172.21.15.153:0/3886194576 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fdd68021030 con 0x7fdd800b98c0 2023-11-24T08:04:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.951+0000 7fdd777fe700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdd6006ae40 0x7fdd6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.951+0000 7fdd777fe700 1 -- 172.21.15.153:0/3886194576 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdd6808a2b0 con 0x7fdd800b98c0 2023-11-24T08:04:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.951+0000 7fdd7e7fc700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdd6006ae40 0x7fdd6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.951+0000 7fdd7e7fc700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdd6006ae40 0x7fdd6006d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd800d43d0 tx=0x7fdd70001060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:08.956+0000 7fdd777fe700 1 -- 172.21.15.153:0/3886194576 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd68055940 con 0x7fdd800b98c0 2023-11-24T08:04:09.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.077+0000 7fdd777fe700 1 -- 172.21.15.153:0/3886194576 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd68055d10 con 0x7fdd800b98c0 2023-11-24T08:04:09.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.149+0000 7fdd8560d700 1 -- 172.21.15.153:0/3886194576 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd80068fb0 con 0x7fdd800b98c0 2023-11-24T08:04:09.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.150+0000 7fdd777fe700 1 -- 172.21.15.153:0/3886194576 <== mon.0 v2:172.21.15.153:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd6806fa60 con 0x7fdd800b98c0 2023-11-24T08:04:09.152 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 -- 172.21.15.153:0/3886194576 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdd6006ae40 msgr2=0x7fdd6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdd6006ae40 0x7fdd6006d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd800d43d0 tx=0x7fdd70001060 comp rx=0 tx=0).stop 2023-11-24T08:04:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 -- 172.21.15.153:0/3886194576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd800b98c0 msgr2=0x7fdd8015c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd800b98c0 0x7fdd8015c320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800a010 tx=0x7fdd68004750 comp rx=0 tx=0).stop 2023-11-24T08:04:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 -- 172.21.15.153:0/3886194576 shutdown_connections 2023-11-24T08:04:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd8015e140 0x7fdd801606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdd6006ae40 0x7fdd6006d300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd800b98c0 0x7fdd8015c320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 --2- 172.21.15.153:0/3886194576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdd800d39d0 0x7fdd800cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 -- 172.21.15.153:0/3886194576 >> 172.21.15.153:0/3886194576 conn(0x7fdd8006b410 msgr2=0x7fdd800b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 -- 172.21.15.153:0/3886194576 shutdown_connections 2023-11-24T08:04:09.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.152+0000 7fdd8560d700 1 -- 172.21.15.153:0/3886194576 wait complete. 2023-11-24T08:04:09.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:04:09.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.284+0000 7ff8203fb700 1 Processor -- start 2023-11-24T08:04:09.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.284+0000 7ff8203fb700 1 -- start start 2023-11-24T08:04:09.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.285+0000 7ff8203fb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 0x7ff8180b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.285+0000 7ff8203fb700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff8180af4d0 0x7ff8180afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.285+0000 7ff8203fb700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8180ae430 con 0x7ff81806c000 2023-11-24T08:04:09.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.285+0000 7ff8203fb700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8180af0b0 con 0x7ff8180af4d0 2023-11-24T08:04:09.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.285+0000 7ff8203fb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180b05a0 con 0x7ff81815e080 2023-11-24T08:04:09.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d996700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff8180af4d0 0x7ff8180afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81e197700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 0x7ff8180b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81e998700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff81806c000 0x7ff818073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:49046/0 (socket says 172.21.15.153:49046) 2023-11-24T08:04:09.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81e998700 1 -- 172.21.15.153:0/2225974512 learned_addr learned my addr 172.21.15.153:0/2225974512 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:09.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d996700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff8180af4d0 0x7ff8180afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:56844/0 (socket says 172.21.15.153:56844) 2023-11-24T08:04:09.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81e197700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 0x7ff8180b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47328/0 (socket says 172.21.15.153:47328) 2023-11-24T08:04:09.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d195700 1 -- 172.21.15.153:0/2225974512 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383682816 0 0) 0x7ff8180ae430 con 0x7ff81806c000 2023-11-24T08:04:09.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d195700 1 -- 172.21.15.153:0/2225974512 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8040035b0 con 0x7ff81806c000 2023-11-24T08:04:09.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d996700 1 -- 172.21.15.153:0/2225974512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 msgr2=0x7ff8180b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:09.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d996700 1 --2- 172.21.15.153:0/2225974512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 0x7ff8180b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d996700 1 -- 172.21.15.153:0/2225974512 >> v1:172.21.15.164:6789/0 conn(0x7ff81806c000 legacy=0x7ff818073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d996700 1 -- 172.21.15.153:0/2225974512 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8180ae710 con 0x7ff8180af4d0 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81e197700 1 --2- 172.21.15.153:0/2225974512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 0x7ff8180b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d996700 1 --2- 172.21.15.153:0/2225974512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8180af4d0 0x7ff8180afb90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff814009870 tx=0x7ff814009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34a53f5c47315f8a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d195700 1 -- 172.21.15.153:0/2225974512 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814011830 con 0x7ff8180af4d0 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d195700 1 -- 172.21.15.153:0/2225974512 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff814011990 con 0x7ff8180af4d0 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.286+0000 7ff81d195700 1 -- 172.21.15.153:0/2225974512 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814011d00 con 0x7ff8180af4d0 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.287+0000 7ff8203fb700 1 -- 172.21.15.153:0/2225974512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8180af4d0 msgr2=0x7ff8180afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.287+0000 7ff8203fb700 1 --2- 172.21.15.153:0/2225974512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8180af4d0 0x7ff8180afb90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff814009870 tx=0x7ff814009b80 comp rx=0 tx=0).stop 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.287+0000 7ff8203fb700 1 -- 172.21.15.153:0/2225974512 shutdown_connections 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.287+0000 7ff8203fb700 1 --2- 172.21.15.153:0/2225974512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 0x7ff8180b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.287+0000 7ff8203fb700 1 --2- 172.21.15.153:0/2225974512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8180af4d0 0x7ff8180afb90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.287+0000 7ff8203fb700 1 -- 172.21.15.153:0/2225974512 >> 172.21.15.153:0/2225974512 conn(0x7ff818071b90 msgr2=0x7ff818071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:09.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.287+0000 7ff8203fb700 1 -- 172.21.15.153:0/2225974512 shutdown_connections 2023-11-24T08:04:09.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.287+0000 7ff8203fb700 1 -- 172.21.15.153:0/2225974512 wait complete. 2023-11-24T08:04:09.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.288+0000 7ff8203fb700 1 Processor -- start 2023-11-24T08:04:09.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.288+0000 7ff8203fb700 1 -- start start 2023-11-24T08:04:09.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff8203fb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff81806c000 0x7ff81814db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff8203fb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8180af4d0 0x7ff818159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff8203fb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 0x7ff8181563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff8203fb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff818157610 con 0x7ff8180af4d0 2023-11-24T08:04:09.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff8203fb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff818155040 con 0x7ff81806c000 2023-11-24T08:04:09.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff8203fb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff818155320 con 0x7ff81815e080 2023-11-24T08:04:09.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff81d996700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8180af4d0 0x7ff818159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff81d996700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8180af4d0 0x7ff818159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35264/0 (socket says 172.21.15.153:35264) 2023-11-24T08:04:09.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff81d996700 1 -- 172.21.15.153:0/2299688477 learned_addr learned my addr 172.21.15.153:0/2299688477 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:09.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff81e197700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff81806c000 0x7ff81814db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff81e998700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 0x7ff8181563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff81d996700 1 -- 172.21.15.153:0/2299688477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 msgr2=0x7ff8181563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff81d996700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 0x7ff8181563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff81d996700 1 -- 172.21.15.153:0/2299688477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff81806c000 msgr2=0x7ff81814db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff81d996700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff81806c000 0x7ff81814db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff81d996700 1 -- 172.21.15.153:0/2299688477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8080094a0 con 0x7ff8180af4d0 2023-11-24T08:04:09.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.289+0000 7ff81d996700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8180af4d0 0x7ff818159850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8140097c0 tx=0x7ff814004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.290+0000 7ff80effd700 1 -- 172.21.15.153:0/2299688477 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8140045c0 con 0x7ff8180af4d0 2023-11-24T08:04:09.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.290+0000 7ff80effd700 1 -- 172.21.15.153:0/2299688477 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81401f070 con 0x7ff8180af4d0 2023-11-24T08:04:09.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.290+0000 7ff8203fb700 1 -- 172.21.15.153:0/2299688477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8140094a0 con 0x7ff8180af4d0 2023-11-24T08:04:09.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.290+0000 7ff80effd700 1 -- 172.21.15.153:0/2299688477 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8140038c0 con 0x7ff8180af4d0 2023-11-24T08:04:09.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.290+0000 7ff8203fb700 1 -- 172.21.15.153:0/2299688477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8181558e0 con 0x7ff8180af4d0 2023-11-24T08:04:09.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.290+0000 7ff8203fb700 1 -- 172.21.15.153:0/2299688477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8180753f0 con 0x7ff8180af4d0 2023-11-24T08:04:09.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.291+0000 7ff80effd700 1 -- 172.21.15.153:0/2299688477 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff814003a20 con 0x7ff8180af4d0 2023-11-24T08:04:09.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.291+0000 7ff80effd700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7fc06aed0 0x7ff7fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.291+0000 7ff80effd700 1 -- 172.21.15.153:0/2299688477 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff814021070 con 0x7ff8180af4d0 2023-11-24T08:04:09.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.291+0000 7ff81e197700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7fc06aed0 0x7ff7fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.292+0000 7ff81e197700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7fc06aed0 0x7ff7fc06d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff808009c60 tx=0x7ff808008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.296+0000 7ff80effd700 1 -- 172.21.15.153:0/2299688477 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff814055ef0 con 0x7ff8180af4d0 2023-11-24T08:04:09.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.491+0000 7ff8203fb700 1 -- 172.21.15.153:0/2299688477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff818157750 con 0x7ff8180af4d0 2023-11-24T08:04:09.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.491+0000 7ff80effd700 1 -- 172.21.15.153:0/2299688477 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff818157750 con 0x7ff8180af4d0 2023-11-24T08:04:09.493 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:09.493 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-11-24T08:04:09.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:04:09.494 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-11-24T08:04:09.494 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": ".mgr" 2023-11-24T08:04:09.494 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:04:09.494 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-11-24T08:04:09.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.493+0000 7ff8203fb700 1 -- 172.21.15.153:0/2299688477 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7fc06aed0 msgr2=0x7ff7fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.493+0000 7ff8203fb700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7fc06aed0 0x7ff7fc06d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff808009c60 tx=0x7ff808008040 comp rx=0 tx=0).stop 2023-11-24T08:04:09.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.493+0000 7ff8203fb700 1 -- 172.21.15.153:0/2299688477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8180af4d0 msgr2=0x7ff818159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.493+0000 7ff8203fb700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8180af4d0 0x7ff818159850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8140097c0 tx=0x7ff814004750 comp rx=0 tx=0).stop 2023-11-24T08:04:09.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.494+0000 7ff8203fb700 1 -- 172.21.15.153:0/2299688477 shutdown_connections 2023-11-24T08:04:09.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.494+0000 7ff8203fb700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81815e080 0x7ff8181563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.494+0000 7ff8203fb700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff81806c000 0x7ff81814db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.494+0000 7ff8203fb700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7fc06aed0 0x7ff7fc06d390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.494+0000 7ff8203fb700 1 --2- 172.21.15.153:0/2299688477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8180af4d0 0x7ff818159850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.494+0000 7ff8203fb700 1 -- 172.21.15.153:0/2299688477 >> 172.21.15.153:0/2299688477 conn(0x7ff818071b90 msgr2=0x7ff8180b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:09.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.494+0000 7ff8203fb700 1 -- 172.21.15.153:0/2299688477 shutdown_connections 2023-11-24T08:04:09.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.494+0000 7ff8203fb700 1 -- 172.21.15.153:0/2299688477 wait complete. 2023-11-24T08:04:09.507 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:04:09.507 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:04:09.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.630+0000 7fa8a8876700 1 Processor -- start 2023-11-24T08:04:09.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.630+0000 7fa8a8876700 1 -- start start 2023-11-24T08:04:09.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.631+0000 7fa8a8876700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa8a40b01e0 0x7fa8a406e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.631+0000 7fa8a8876700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a40b05c0 con 0x7fa8a40746a0 2023-11-24T08:04:09.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.631+0000 7fa8a8876700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a40b4250 con 0x7fa8a40b59c0 2023-11-24T08:04:09.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.631+0000 7fa8a8876700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a41470a0 con 0x7fa8a40b01e0 2023-11-24T08:04:09.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a2d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa8a40746a0 0x7fa8a406aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41376/0 (socket says 172.21.15.153:41376) 2023-11-24T08:04:09.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a2d9d700 1 -- 172.21.15.153:0/3274344648 learned_addr learned my addr 172.21.15.153:0/3274344648 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:09.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a259c700 1 --2- 172.21.15.153:0/3274344648 >> v2:172.21.15.164:3300/0 conn(0x7fa8a40b01e0 0x7fa8a406e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a159a700 1 -- 172.21.15.153:0/3274344648 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884985396 0 0) 0x7fa8a40b05c0 con 0x7fa8a40746a0 2023-11-24T08:04:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a159a700 1 -- 172.21.15.153:0/3274344648 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa88c0035b0 con 0x7fa8a40746a0 2023-11-24T08:04:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a259c700 1 -- 172.21.15.153:0/3274344648 >> v1:172.21.15.164:6789/0 conn(0x7fa8a40b59c0 legacy=0x7fa8a4073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a259c700 1 -- 172.21.15.153:0/3274344648 >> v1:172.21.15.153:6789/0 conn(0x7fa8a40746a0 legacy=0x7fa8a406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a259c700 1 -- 172.21.15.153:0/3274344648 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a406dc00 con 0x7fa8a40b01e0 2023-11-24T08:04:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a259c700 1 --2- 172.21.15.153:0/3274344648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8a40b01e0 0x7fa8a406e9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa898009840 tx=0x7fa898009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25e43ebdc015c571 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a159a700 1 -- 172.21.15.153:0/3274344648 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898011830 con 0x7fa8a40b01e0 2023-11-24T08:04:09.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a159a700 1 -- 172.21.15.153:0/3274344648 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898011990 con 0x7fa8a40b01e0 2023-11-24T08:04:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.632+0000 7fa8a159a700 1 -- 172.21.15.153:0/3274344648 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898011d00 con 0x7fa8a40b01e0 2023-11-24T08:04:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.633+0000 7fa8a8876700 1 -- 172.21.15.153:0/3274344648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8a40b01e0 msgr2=0x7fa8a406e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.633+0000 7fa8a8876700 1 --2- 172.21.15.153:0/3274344648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8a40b01e0 0x7fa8a406e9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa898009840 tx=0x7fa898009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.633+0000 7fa8a8876700 1 -- 172.21.15.153:0/3274344648 shutdown_connections 2023-11-24T08:04:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.633+0000 7fa8a8876700 1 --2- 172.21.15.153:0/3274344648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8a40b01e0 0x7fa8a406e9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.633+0000 7fa8a8876700 1 -- 172.21.15.153:0/3274344648 >> 172.21.15.153:0/3274344648 conn(0x7fa8a40d0b40 msgr2=0x7fa8a40d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.633+0000 7fa8a8876700 1 -- 172.21.15.153:0/3274344648 shutdown_connections 2023-11-24T08:04:09.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.633+0000 7fa8a8876700 1 -- 172.21.15.153:0/3274344648 wait complete. 2023-11-24T08:04:09.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.634+0000 7fa8a8876700 1 Processor -- start 2023-11-24T08:04:09.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.634+0000 7fa8a8876700 1 -- start start 2023-11-24T08:04:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a8876700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a40746a0 0x7fa8a415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a8876700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8a40b01e0 0x7fa8a415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a8876700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8a40b59c0 0x7fa8a41f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a8876700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a415d840 con 0x7fa8a40746a0 2023-11-24T08:04:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a8876700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a415c7a0 con 0x7fa8a40b59c0 2023-11-24T08:04:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a8876700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a415ca80 con 0x7fa8a40b01e0 2023-11-24T08:04:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a40746a0 0x7fa8a415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a40746a0 0x7fa8a415aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35276/0 (socket says 172.21.15.153:35276) 2023-11-24T08:04:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a259c700 1 -- 172.21.15.153:0/2616519893 learned_addr learned my addr 172.21.15.153:0/2616519893 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a1d9b700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8a40b01e0 0x7fa8a415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a2d9d700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8a40b59c0 0x7fa8a41f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.635+0000 7fa8a259c700 1 -- 172.21.15.153:0/2616519893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8a40b01e0 msgr2=0x7fa8a415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa8a259c700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8a40b01e0 0x7fa8a415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa8a259c700 1 -- 172.21.15.153:0/2616519893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8a40b59c0 msgr2=0x7fa8a41f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa8a259c700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8a40b59c0 0x7fa8a41f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa8a259c700 1 -- 172.21.15.153:0/2616519893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8980094a0 con 0x7fa8a40746a0 2023-11-24T08:04:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa8a1d9b700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8a40b01e0 0x7fa8a415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa8a2d9d700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8a40b59c0 0x7fa8a41f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa8a259c700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a40746a0 0x7fa8a415aeb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa898009fd0 tx=0x7fa898004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa892ffd700 1 -- 172.21.15.153:0/2616519893 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980036a0 con 0x7fa8a40746a0 2023-11-24T08:04:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa892ffd700 1 -- 172.21.15.153:0/2616519893 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89801f070 con 0x7fa8a40746a0 2023-11-24T08:04:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa8a8876700 1 -- 172.21.15.153:0/2616519893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a415cd60 con 0x7fa8a40746a0 2023-11-24T08:04:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa892ffd700 1 -- 172.21.15.153:0/2616519893 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898003a20 con 0x7fa8a40746a0 2023-11-24T08:04:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.636+0000 7fa8a8876700 1 -- 172.21.15.153:0/2616519893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a415d320 con 0x7fa8a40746a0 2023-11-24T08:04:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.637+0000 7fa8a8876700 1 -- 172.21.15.153:0/2616519893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a415d690 con 0x7fa8a40746a0 2023-11-24T08:04:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.637+0000 7fa892ffd700 1 -- 172.21.15.153:0/2616519893 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa898003b80 con 0x7fa8a40746a0 2023-11-24T08:04:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.638+0000 7fa892ffd700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa88406aed0 0x7fa88406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.638+0000 7fa8a1d9b700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa88406aed0 0x7fa88406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.638+0000 7fa892ffd700 1 -- 172.21.15.153:0/2616519893 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa898021070 con 0x7fa8a40746a0 2023-11-24T08:04:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.638+0000 7fa8a1d9b700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa88406aed0 0x7fa88406d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40af0f0 tx=0x7fa894009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.642+0000 7fa892ffd700 1 -- 172.21.15.153:0/2616519893 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa898055fd0 con 0x7fa8a40746a0 2023-11-24T08:04:09.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:09.834+0000 7fa8a8876700 1 -- 172.21.15.153:0/2616519893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa8a415d4b0 con 0x7fa8a40746a0 2023-11-24T08:04:10.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.730+0000 7fa892ffd700 1 -- 172.21.15.153:0/2616519893 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa898015020 con 0x7fa8a40746a0 2023-11-24T08:04:10.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 -- 172.21.15.153:0/2616519893 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa88406aed0 msgr2=0x7fa88406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa88406aed0 0x7fa88406d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40af0f0 tx=0x7fa894009040 comp rx=0 tx=0).stop 2023-11-24T08:04:10.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 -- 172.21.15.153:0/2616519893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a40746a0 msgr2=0x7fa8a415aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a40746a0 0x7fa8a415aeb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa898009fd0 tx=0x7fa898004750 comp rx=0 tx=0).stop 2023-11-24T08:04:10.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 -- 172.21.15.153:0/2616519893 shutdown_connections 2023-11-24T08:04:10.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8a40b59c0 0x7fa8a41f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa88406aed0 0x7fa88406d390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a40746a0 0x7fa8a415aeb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 --2- 172.21.15.153:0/2616519893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8a40b01e0 0x7fa8a415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 -- 172.21.15.153:0/2616519893 >> 172.21.15.153:0/2616519893 conn(0x7fa8a40d0b40 msgr2=0x7fa8a40ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:10.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 -- 172.21.15.153:0/2616519893 shutdown_connections 2023-11-24T08:04:10.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.733+0000 7fa8a8876700 1 -- 172.21.15.153:0/2616519893 wait complete. 2023-11-24T08:04:10.737 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-11-24T08:04:10.752 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:04:10.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.881+0000 7f6c842ba700 1 Processor -- start 2023-11-24T08:04:10.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.881+0000 7f6c842ba700 1 -- start start 2023-11-24T08:04:10.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.882+0000 7f6c842ba700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c0b5da0 0x7f6c7c0afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.882+0000 7f6c842ba700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0b3c60 con 0x7f6c7c0746a0 2023-11-24T08:04:10.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.882+0000 7f6c842ba700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0b58c0 con 0x7f6c7c15e160 2023-11-24T08:04:10.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.882+0000 7f6c842ba700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b4500 con 0x7f6c7c0b5da0 2023-11-24T08:04:10.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.882+0000 7f6c81855700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6c7c0746a0 0x7f6c7c06d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41386/0 (socket says 172.21.15.153:41386) 2023-11-24T08:04:10.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.882+0000 7f6c81855700 1 -- 172.21.15.153:0/3814202269 learned_addr learned my addr 172.21.15.153:0/3814202269 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:10.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.882+0000 7f6c82857700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c0b5da0 0x7f6c7c0afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265152616 0 0) 0x7f6c7c0b3c60 con 0x7f6c7c0746a0 2023-11-24T08:04:10.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c680035b0 con 0x7f6c7c0746a0 2023-11-24T08:04:10.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3952694686 0 0) 0x7f6c680035b0 con 0x7f6c7c0746a0 2023-11-24T08:04:10.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c0b5da0 msgr2=0x7f6c7c0afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c0b5da0 0x7f6c7c0afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 >> v1:172.21.15.164:6789/0 conn(0x7f6c7c15e160 legacy=0x7f6c7c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c06bdc0 con 0x7f6c7c0746a0 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f6c78001670 con 0x7f6c7c0746a0 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 >> v1:172.21.15.153:6789/0 conn(0x7f6c7c0746a0 legacy=0x7f6c7c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 0x7f6c68003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c0b5da0 0x7f6c68004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c68004d90 0x7f6c68005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b4500 con 0x7f6c68003a30 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6800bac0 con 0x7f6c68004d90 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6800bc80 con 0x7f6c7c0b5da0 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c82056700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 0x7f6c68003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c81855700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c0b5da0 0x7f6c68004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c82857700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c68004d90 0x7f6c68005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c82056700 1 -- 172.21.15.153:0/3814202269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c0b5da0 msgr2=0x7f6c68004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c82056700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c0b5da0 0x7f6c68004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c82056700 1 -- 172.21.15.153:0/3814202269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c68004d90 msgr2=0x7f6c68005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c82056700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c68004d90 0x7f6c68005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c82056700 1 -- 172.21.15.153:0/3814202269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c680035b0 con 0x7f6c68003a30 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.883+0000 7f6c82056700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 0x7f6c68003e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c007fd0 tx=0x7f6c68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f2021705080f70 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.884+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0012f0 con 0x7f6c68003a30 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.884+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c0052f0 con 0x7f6c68003a30 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.884+0000 7f6c81054700 1 -- 172.21.15.153:0/3814202269 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c006860 con 0x7f6c68003a30 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.884+0000 7f6c842ba700 1 -- 172.21.15.153:0/3814202269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 msgr2=0x7f6c68003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.884+0000 7f6c842ba700 1 --2- 172.21.15.153:0/3814202269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 0x7f6c68003e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c007fd0 tx=0x7f6c68005880 comp rx=0 tx=0).stop 2023-11-24T08:04:10.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.884+0000 7f6c82857700 1 -- 172.21.15.153:0/3814202269 reap_dead start 2023-11-24T08:04:10.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.884+0000 7f6c842ba700 1 -- 172.21.15.153:0/3814202269 shutdown_connections 2023-11-24T08:04:10.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.884+0000 7f6c842ba700 1 -- 172.21.15.153:0/3814202269 >> 172.21.15.153:0/3814202269 conn(0x7f6c7c0d0bf0 msgr2=0x7f6c7c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:10.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.884+0000 7f6c842ba700 1 -- 172.21.15.153:0/3814202269 shutdown_connections 2023-11-24T08:04:10.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.884+0000 7f6c842ba700 1 -- 172.21.15.153:0/3814202269 wait complete. 2023-11-24T08:04:10.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.886+0000 7f6c842ba700 1 Processor -- start 2023-11-24T08:04:10.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.886+0000 7f6c842ba700 1 -- start start 2023-11-24T08:04:10.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c842ba700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 0x7f6c7c0c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c842ba700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c7c14c990 0x7f6c7c14a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c842ba700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c14a900 0x7f6c7c15c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c842ba700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c150d60 con 0x7f6c68003a30 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c842ba700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0c6c80 con 0x7f6c7c14c990 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c842ba700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c14cec0 con 0x7f6c7c14a900 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c82056700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 0x7f6c7c0c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c82056700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 0x7f6c7c0c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35292/0 (socket says 172.21.15.153:35292) 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c82056700 1 -- 172.21.15.153:0/253308224 learned_addr learned my addr 172.21.15.153:0/253308224 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c81855700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c7c14c990 0x7f6c7c14a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c82857700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c14a900 0x7f6c7c15c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c82056700 1 -- 172.21.15.153:0/253308224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c14a900 msgr2=0x7f6c7c15c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c82056700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c14a900 0x7f6c7c15c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c82056700 1 -- 172.21.15.153:0/253308224 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c7c14c990 msgr2=0x7f6c7c14a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c82056700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c7c14c990 0x7f6c7c14a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c82056700 1 -- 172.21.15.153:0/253308224 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c14d1a0 con 0x7f6c68003a30 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c82056700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 0x7f6c7c0c6740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c004000 tx=0x7f6c6c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c72ffd700 1 -- 172.21.15.153:0/253308224 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c006d70 con 0x7f6c68003a30 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c72ffd700 1 -- 172.21.15.153:0/253308224 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c007020 con 0x7f6c68003a30 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c842ba700 1 -- 172.21.15.153:0/253308224 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c14d480 con 0x7f6c68003a30 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c72ffd700 1 -- 172.21.15.153:0/253308224 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0073d0 con 0x7f6c68003a30 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.887+0000 7f6c842ba700 1 -- 172.21.15.153:0/253308224 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c14a560 con 0x7f6c68003a30 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.888+0000 7f6c842ba700 1 -- 172.21.15.153:0/253308224 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c1f7030 con 0x7f6c68003a30 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.889+0000 7f6c72ffd700 1 -- 172.21.15.153:0/253308224 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c6c007530 con 0x7f6c68003a30 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.889+0000 7f6c72ffd700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6c6006aed0 0x7f6c6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.889+0000 7f6c81855700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6c6006aed0 0x7f6c6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.889+0000 7f6c72ffd700 1 -- 172.21.15.153:0/253308224 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6c6c08a5a0 con 0x7f6c68003a30 2023-11-24T08:04:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.890+0000 7f6c81855700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6c6006aed0 0x7f6c6006d390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0c9130 tx=0x7f6c78000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:10.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:10.894+0000 7f6c72ffd700 1 -- 172.21.15.153:0/253308224 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c6c055840 con 0x7f6c68003a30 2023-11-24T08:04:11.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.086+0000 7f6c842ba700 1 -- 172.21.15.153:0/253308224 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6c7c068fb0 con 0x7f6c68003a30 2023-11-24T08:04:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.739+0000 7f6c72ffd700 1 -- 172.21.15.153:0/253308224 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6c6c058e60 con 0x7f6c68003a30 2023-11-24T08:04:11.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 -- 172.21.15.153:0/253308224 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6c6006aed0 msgr2=0x7f6c6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6c6006aed0 0x7f6c6006d390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0c9130 tx=0x7f6c78000ed0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 -- 172.21.15.153:0/253308224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 msgr2=0x7f6c7c0c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 0x7f6c7c0c6740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c004000 tx=0x7f6c6c001120 comp rx=0 tx=0).stop 2023-11-24T08:04:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 -- 172.21.15.153:0/253308224 shutdown_connections 2023-11-24T08:04:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c7c14a900 0x7f6c7c15c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6c6006aed0 0x7f6c6006d390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c68003a30 0x7f6c7c0c6740 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 --2- 172.21.15.153:0/253308224 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c7c14c990 0x7f6c7c14a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 -- 172.21.15.153:0/253308224 >> 172.21.15.153:0/253308224 conn(0x7f6c7c0d0bf0 msgr2=0x7f6c7c0afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 -- 172.21.15.153:0/253308224 shutdown_connections 2023-11-24T08:04:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.742+0000 7f6c842ba700 1 -- 172.21.15.153:0/253308224 wait complete. 2023-11-24T08:04:11.747 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-11-24T08:04:11.765 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:04:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.889+0000 7fdba9072700 1 Processor -- start 2023-11-24T08:04:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.889+0000 7fdba9072700 1 -- start start 2023-11-24T08:04:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.890+0000 7fdba9072700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdba415e160 0x7fdba40b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.890+0000 7fdba9072700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdba40afc90 0x7fdba4073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.890+0000 7fdba9072700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdba40744d0 0x7fdba406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.890+0000 7fdba9072700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba40b4500 con 0x7fdba415e160 2023-11-24T08:04:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.890+0000 7fdba9072700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba4074960 con 0x7fdba40744d0 2023-11-24T08:04:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.890+0000 7fdba9072700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40b3c60 con 0x7fdba40afc90 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.890+0000 7fdba2d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdba415e160 0x7fdba40b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.890+0000 7fdba2d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdba415e160 0x7fdba40b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35300/0 (socket says 172.21.15.153:35300) 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.890+0000 7fdba2d9d700 1 -- 172.21.15.153:0/1169115560 learned_addr learned my addr 172.21.15.153:0/1169115560 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.890+0000 7fdba359e700 1 --2- 172.21.15.153:0/1169115560 >> v2:172.21.15.164:3300/0 conn(0x7fdba40744d0 0x7fdba406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.890+0000 7fdba259c700 1 --2- 172.21.15.153:0/1169115560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdba40afc90 0x7fdba4073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba2d9d700 1 -- 172.21.15.153:0/1169115560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdba40afc90 msgr2=0x7fdba4073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba2d9d700 1 --2- 172.21.15.153:0/1169115560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdba40afc90 0x7fdba4073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba2d9d700 1 -- 172.21.15.153:0/1169115560 >> v2:172.21.15.164:3300/0 conn(0x7fdba40744d0 msgr2=0x7fdba406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba2d9d700 1 --2- 172.21.15.153:0/1169115560 >> v2:172.21.15.164:3300/0 conn(0x7fdba40744d0 0x7fdba406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba2d9d700 1 -- 172.21.15.153:0/1169115560 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba40b58c0 con 0x7fdba415e160 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba259c700 1 --2- 172.21.15.153:0/1169115560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdba40afc90 0x7fdba4073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba2d9d700 1 --2- 172.21.15.153:0/1169115560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba415e160 0x7fdba40b5da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdba40d1cd0 tx=0x7fdb98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5038f31c572ab6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba1d9b700 1 -- 172.21.15.153:0/1169115560 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98011830 con 0x7fdba415e160 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba1d9b700 1 -- 172.21.15.153:0/1169115560 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb98011990 con 0x7fdba415e160 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba1d9b700 1 -- 172.21.15.153:0/1169115560 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98011d20 con 0x7fdba415e160 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba9072700 1 -- 172.21.15.153:0/1169115560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba415e160 msgr2=0x7fdba40b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba9072700 1 --2- 172.21.15.153:0/1169115560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba415e160 0x7fdba40b5da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdba40d1cd0 tx=0x7fdb98009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba9072700 1 -- 172.21.15.153:0/1169115560 shutdown_connections 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba9072700 1 --2- 172.21.15.153:0/1169115560 >> v2:172.21.15.164:3300/0 conn(0x7fdba40744d0 0x7fdba406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba9072700 1 --2- 172.21.15.153:0/1169115560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba415e160 0x7fdba40b5da0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba9072700 1 --2- 172.21.15.153:0/1169115560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdba40afc90 0x7fdba4073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.891+0000 7fdba9072700 1 -- 172.21.15.153:0/1169115560 >> 172.21.15.153:0/1169115560 conn(0x7fdba40d0bf0 msgr2=0x7fdba40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.892+0000 7fdba9072700 1 -- 172.21.15.153:0/1169115560 shutdown_connections 2023-11-24T08:04:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.892+0000 7fdba9072700 1 -- 172.21.15.153:0/1169115560 wait complete. 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.893+0000 7fdba9072700 1 Processor -- start 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.893+0000 7fdba9072700 1 -- start start 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba9072700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdba40744d0 0x7fdba414e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba9072700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba40afc90 0x7fdba40c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba9072700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdba415e160 0x7fdba41f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba9072700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40cfb00 con 0x7fdba40afc90 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba9072700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba41f4f20 con 0x7fdba415e160 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba9072700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40c6f10 con 0x7fdba40744d0 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba40afc90 0x7fdba40c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba40afc90 0x7fdba40c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35306/0 (socket says 172.21.15.153:35306) 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba259c700 1 -- 172.21.15.153:0/1581610538 learned_addr learned my addr 172.21.15.153:0/1581610538 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba2d9d700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdba40744d0 0x7fdba414e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba359e700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdba415e160 0x7fdba41f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba259c700 1 -- 172.21.15.153:0/1581610538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdba40744d0 msgr2=0x7fdba414e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba259c700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdba40744d0 0x7fdba414e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba259c700 1 -- 172.21.15.153:0/1581610538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdba415e160 msgr2=0x7fdba41f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba259c700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdba415e160 0x7fdba41f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba259c700 1 -- 172.21.15.153:0/1581610538 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98009550 con 0x7fdba40afc90 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdba259c700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba40afc90 0x7fdba40c65e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400e810 tx=0x7fdb9400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.894+0000 7fdb8b7fe700 1 -- 172.21.15.153:0/1581610538 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94013610 con 0x7fdba40afc90 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.895+0000 7fdb8b7fe700 1 -- 172.21.15.153:0/1581610538 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb94013770 con 0x7fdba40afc90 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.895+0000 7fdba9072700 1 -- 172.21.15.153:0/1581610538 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba40c71f0 con 0x7fdba40afc90 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.895+0000 7fdb8b7fe700 1 -- 172.21.15.153:0/1581610538 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94013b20 con 0x7fdba40afc90 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.895+0000 7fdba9072700 1 -- 172.21.15.153:0/1581610538 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba40c77b0 con 0x7fdba40afc90 2023-11-24T08:04:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.895+0000 7fdba9072700 1 -- 172.21.15.153:0/1581610538 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba40b51c0 con 0x7fdba40afc90 2023-11-24T08:04:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.896+0000 7fdb8b7fe700 1 -- 172.21.15.153:0/1581610538 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb94013c80 con 0x7fdba40afc90 2023-11-24T08:04:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.897+0000 7fdb8b7fe700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdb9006aed0 0x7fdb9006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.897+0000 7fdba2d9d700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdb9006aed0 0x7fdb9006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.897+0000 7fdb8b7fe700 1 -- 172.21.15.153:0/1581610538 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdb94089150 con 0x7fdba40afc90 2023-11-24T08:04:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.897+0000 7fdba2d9d700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdb9006aed0 0x7fdb9006d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb98014040 tx=0x7fdb98008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:11.901+0000 7fdb8b7fe700 1 -- 172.21.15.153:0/1581610538 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb940541c0 con 0x7fdba40afc90 2023-11-24T08:04:12.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.136+0000 7fdba9072700 1 -- 172.21.15.153:0/1581610538 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdba41f5090 con 0x7fdba40afc90 2023-11-24T08:04:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.752+0000 7fdb8b7fe700 1 -- 172.21.15.153:0/1581610538 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdb940577e0 con 0x7fdba40afc90 2023-11-24T08:04:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.758+0000 7fdba9072700 1 -- 172.21.15.153:0/1581610538 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdb9006aed0 msgr2=0x7fdb9006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.758+0000 7fdba9072700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdb9006aed0 0x7fdb9006d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb98014040 tx=0x7fdb98008030 comp rx=0 tx=0).stop 2023-11-24T08:04:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.758+0000 7fdba9072700 1 -- 172.21.15.153:0/1581610538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba40afc90 msgr2=0x7fdba40c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.758+0000 7fdba9072700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba40afc90 0x7fdba40c65e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400e810 tx=0x7fdb9400eb20 comp rx=0 tx=0).stop 2023-11-24T08:04:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.760+0000 7fdba9072700 1 -- 172.21.15.153:0/1581610538 shutdown_connections 2023-11-24T08:04:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.760+0000 7fdba9072700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdba415e160 0x7fdba41f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.760+0000 7fdba9072700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdba40744d0 0x7fdba414e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.760+0000 7fdba9072700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdb9006aed0 0x7fdb9006d390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.760+0000 7fdba9072700 1 --2- 172.21.15.153:0/1581610538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba40afc90 0x7fdba40c65e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.760+0000 7fdba9072700 1 -- 172.21.15.153:0/1581610538 >> 172.21.15.153:0/1581610538 conn(0x7fdba40d0bf0 msgr2=0x7fdba406ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.761+0000 7fdba9072700 1 -- 172.21.15.153:0/1581610538 shutdown_connections 2023-11-24T08:04:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.761+0000 7fdba9072700 1 -- 172.21.15.153:0/1581610538 wait complete. 2023-11-24T08:04:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 2 and data pool 3 2023-11-24T08:04:12.783 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:12.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.903+0000 7f7d2c37b700 1 Processor -- start 2023-11-24T08:04:12.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.903+0000 7f7d2c37b700 1 -- start start 2023-11-24T08:04:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d2c37b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7d2415e080 0x7f7d240b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d2c37b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d240ae430 con 0x7f7d2406c710 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d2c37b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d240ae710 con 0x7f7d240af4d0 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d2c37b700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d240af0b0 con 0x7f7d2415e080 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d2a918700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7d2406c710 0x7f7d2406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41420/0 (socket says 172.21.15.153:41420) 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d2a918700 1 -- 172.21.15.153:0/3446284017 learned_addr learned my addr 172.21.15.153:0/3446284017 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d2a117700 1 --2- 172.21.15.153:0/3446284017 >> v2:172.21.15.164:3300/0 conn(0x7f7d2415e080 0x7f7d240b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d29115700 1 -- 172.21.15.153:0/3446284017 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511518214 0 0) 0x7f7d240ae430 con 0x7f7d2406c710 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d29115700 1 -- 172.21.15.153:0/3446284017 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d100035b0 con 0x7f7d2406c710 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d29115700 1 -- 172.21.15.153:0/3446284017 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923648467 0 0) 0x7f7d240ae710 con 0x7f7d240af4d0 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d29115700 1 -- 172.21.15.153:0/3446284017 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d240ae430 con 0x7f7d240af4d0 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d2a117700 1 -- 172.21.15.153:0/3446284017 >> v1:172.21.15.164:6789/0 conn(0x7f7d240af4d0 legacy=0x7f7d2406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d2a117700 1 -- 172.21.15.153:0/3446284017 >> v1:172.21.15.153:6789/0 conn(0x7f7d2406c710 legacy=0x7f7d2406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d29115700 1 -- 172.21.15.153:0/3446284017 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869102287 0 0) 0x7f7d100035b0 con 0x7f7d2406c710 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.904+0000 7f7d2a117700 1 -- 172.21.15.153:0/3446284017 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d240ae9f0 con 0x7f7d2415e080 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.905+0000 7f7d2a117700 1 --2- 172.21.15.153:0/3446284017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d2415e080 0x7f7d240b5050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009840 tx=0x7f7d20009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47ebe6ae813d4a50 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.905+0000 7f7d29115700 1 -- 172.21.15.153:0/3446284017 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0019f0 con 0x7f7d2415e080 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.905+0000 7f7d29115700 1 -- 172.21.15.153:0/3446284017 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d20004030 con 0x7f7d2415e080 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.905+0000 7f7d29115700 1 -- 172.21.15.153:0/3446284017 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200043c0 con 0x7f7d2415e080 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.905+0000 7f7d2c37b700 1 -- 172.21.15.153:0/3446284017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d2415e080 msgr2=0x7f7d240b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.905+0000 7f7d2c37b700 1 --2- 172.21.15.153:0/3446284017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d2415e080 0x7f7d240b5050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009840 tx=0x7f7d20009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.905+0000 7f7d2c37b700 1 -- 172.21.15.153:0/3446284017 shutdown_connections 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.905+0000 7f7d2c37b700 1 --2- 172.21.15.153:0/3446284017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d2415e080 0x7f7d240b5050 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.905+0000 7f7d2c37b700 1 -- 172.21.15.153:0/3446284017 >> 172.21.15.153:0/3446284017 conn(0x7f7d24071b90 msgr2=0x7f7d24071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.905+0000 7f7d2c37b700 1 -- 172.21.15.153:0/3446284017 shutdown_connections 2023-11-24T08:04:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.905+0000 7f7d2c37b700 1 -- 172.21.15.153:0/3446284017 wait complete. 2023-11-24T08:04:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2c37b700 1 Processor -- start 2023-11-24T08:04:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2c37b700 1 -- start start 2023-11-24T08:04:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2c37b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2406c710 0x7f7d24157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2c37b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d240af4d0 0x7f7d241420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2c37b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d2415e080 0x7f7d24142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2c37b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2415f6a0 con 0x7f7d2406c710 2023-11-24T08:04:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2c37b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d24142620 con 0x7f7d240af4d0 2023-11-24T08:04:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2c37b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2415a710 con 0x7f7d2415e080 2023-11-24T08:04:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2a117700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2406c710 0x7f7d24157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2a117700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2406c710 0x7f7d24157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35318/0 (socket says 172.21.15.153:35318) 2023-11-24T08:04:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2a117700 1 -- 172.21.15.153:0/1137452784 learned_addr learned my addr 172.21.15.153:0/1137452784 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.907+0000 7f7d2a918700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d2415e080 0x7f7d24142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d29916700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d240af4d0 0x7f7d241420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d2a117700 1 -- 172.21.15.153:0/1137452784 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d2415e080 msgr2=0x7f7d24142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d2a117700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d2415e080 0x7f7d24142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d2a117700 1 -- 172.21.15.153:0/1137452784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d240af4d0 msgr2=0x7f7d241420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d2a117700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d240af4d0 0x7f7d241420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d2a117700 1 -- 172.21.15.153:0/1137452784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d200094a0 con 0x7f7d2406c710 2023-11-24T08:04:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d2a918700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d2415e080 0x7f7d24142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d29916700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d240af4d0 0x7f7d241420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d2a117700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2406c710 0x7f7d24157370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d20000c00 tx=0x7f7d20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d1affd700 1 -- 172.21.15.153:0/1137452784 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20003d70 con 0x7f7d2406c710 2023-11-24T08:04:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d1affd700 1 -- 172.21.15.153:0/1137452784 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2001f070 con 0x7f7d2406c710 2023-11-24T08:04:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d2c37b700 1 -- 172.21.15.153:0/1137452784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2415a150 con 0x7f7d2406c710 2023-11-24T08:04:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d1affd700 1 -- 172.21.15.153:0/1137452784 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20011850 con 0x7f7d2406c710 2023-11-24T08:04:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.908+0000 7f7d2c37b700 1 -- 172.21.15.153:0/1137452784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d24142db0 con 0x7f7d2406c710 2023-11-24T08:04:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.909+0000 7f7d2c37b700 1 -- 172.21.15.153:0/1137452784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d240753f0 con 0x7f7d2406c710 2023-11-24T08:04:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.909+0000 7f7d1affd700 1 -- 172.21.15.153:0/1137452784 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d20021030 con 0x7f7d2406c710 2023-11-24T08:04:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.910+0000 7f7d1affd700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7d0806aed0 0x7f7d0806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.910+0000 7f7d1affd700 1 -- 172.21.15.153:0/1137452784 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d2008a920 con 0x7f7d2406c710 2023-11-24T08:04:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.910+0000 7f7d29916700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7d0806aed0 0x7f7d0806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.910+0000 7f7d29916700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7d0806aed0 0x7f7d0806d390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d240d04d0 tx=0x7f7d14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:12.914+0000 7f7d1affd700 1 -- 172.21.15.153:0/1137452784 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7d20055b00 con 0x7f7d2406c710 2023-11-24T08:04:13.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.107+0000 7f7d2c37b700 1 -- 172.21.15.153:0/1137452784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d24067f60 con 0x7f7d2406c710 2023-11-24T08:04:13.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.108+0000 7f7d1affd700 1 -- 172.21.15.153:0/1137452784 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16554 (secure 0 0 0) 0x7f7d200045b0 con 0x7f7d2406c710 2023-11-24T08:04:13.111 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:13.111 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":19,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:12.137543+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:13.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 -- 172.21.15.153:0/1137452784 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7d0806aed0 msgr2=0x7f7d0806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7d0806aed0 0x7f7d0806d390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d240d04d0 tx=0x7f7d14009040 comp rx=0 tx=0).stop 2023-11-24T08:04:13.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 -- 172.21.15.153:0/1137452784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2406c710 msgr2=0x7f7d24157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2406c710 0x7f7d24157370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d20000c00 tx=0x7f7d20004750 comp rx=0 tx=0).stop 2023-11-24T08:04:13.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 -- 172.21.15.153:0/1137452784 shutdown_connections 2023-11-24T08:04:13.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d2415e080 0x7f7d24142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7d0806aed0 0x7f7d0806d390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2406c710 0x7f7d24157370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 --2- 172.21.15.153:0/1137452784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d240af4d0 0x7f7d241420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 -- 172.21.15.153:0/1137452784 >> 172.21.15.153:0/1137452784 conn(0x7f7d24071b90 msgr2=0x7f7d240b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 -- 172.21.15.153:0/1137452784 shutdown_connections 2023-11-24T08:04:13.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.111+0000 7f7d2c37b700 1 -- 172.21.15.153:0/1137452784 wait complete. 2023-11-24T08:04:13.125 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:13.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.245+0000 7fafc7c8c700 1 Processor -- start 2023-11-24T08:04:13.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.246+0000 7fafc7c8c700 1 -- start start 2023-11-24T08:04:13.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.246+0000 7fafc7c8c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fafc015bdd0 0x7fafc01604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.246+0000 7fafc7c8c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fafc00b3370 0x7fafc00b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.246+0000 7fafc7c8c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafc00d1c70 0x7fafc00d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.246+0000 7fafc7c8c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc00b2f50 con 0x7fafc015bdd0 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.246+0000 7fafc7c8c700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc00d2660 con 0x7fafc00b3370 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.246+0000 7fafc7c8c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc00b2030 con 0x7fafc00d1c70 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.246+0000 7fafc5a28700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fafc015bdd0 0x7fafc01604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc5a28700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fafc015bdd0 0x7fafc01604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35326/0 (socket says 172.21.15.153:35326) 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc5a28700 1 -- 172.21.15.153:0/3049627907 learned_addr learned my addr 172.21.15.153:0/3049627907 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc6229700 1 --2- 172.21.15.153:0/3049627907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafc00d1c70 0x7fafc00d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc5227700 1 --2- 172.21.15.153:0/3049627907 >> v2:172.21.15.164:3300/0 conn(0x7fafc00b3370 0x7fafc00b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc5a28700 1 -- 172.21.15.153:0/3049627907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafc00d1c70 msgr2=0x7fafc00d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc5a28700 1 --2- 172.21.15.153:0/3049627907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafc00d1c70 0x7fafc00d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc5a28700 1 -- 172.21.15.153:0/3049627907 >> v2:172.21.15.164:3300/0 conn(0x7fafc00b3370 msgr2=0x7fafc00b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc5a28700 1 --2- 172.21.15.153:0/3049627907 >> v2:172.21.15.164:3300/0 conn(0x7fafc00b3370 0x7fafc00b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc5a28700 1 -- 172.21.15.153:0/3049627907 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc00b22d0 con 0x7fafc015bdd0 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc5a28700 1 --2- 172.21.15.153:0/3049627907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafc015bdd0 0x7fafc01604e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fafc00714c0 tx=0x7fafb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4a51b39f4e3dec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc4a26700 1 -- 172.21.15.153:0/3049627907 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0011830 con 0x7fafc015bdd0 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc4a26700 1 -- 172.21.15.153:0/3049627907 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb0011990 con 0x7fafc015bdd0 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.247+0000 7fafc4a26700 1 -- 172.21.15.153:0/3049627907 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0011d20 con 0x7fafc015bdd0 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.248+0000 7fafc7c8c700 1 -- 172.21.15.153:0/3049627907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafc015bdd0 msgr2=0x7fafc01604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.248+0000 7fafc7c8c700 1 --2- 172.21.15.153:0/3049627907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafc015bdd0 0x7fafc01604e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fafc00714c0 tx=0x7fafb0009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.248+0000 7fafc7c8c700 1 -- 172.21.15.153:0/3049627907 shutdown_connections 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.248+0000 7fafc7c8c700 1 --2- 172.21.15.153:0/3049627907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafc00d1c70 0x7fafc00d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.248+0000 7fafc7c8c700 1 --2- 172.21.15.153:0/3049627907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafc015bdd0 0x7fafc01604e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.248+0000 7fafc7c8c700 1 --2- 172.21.15.153:0/3049627907 >> v2:172.21.15.164:3300/0 conn(0x7fafc00b3370 0x7fafc00b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.248+0000 7fafc7c8c700 1 -- 172.21.15.153:0/3049627907 >> 172.21.15.153:0/3049627907 conn(0x7fafc00731a0 msgr2=0x7fafc009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.248+0000 7fafc7c8c700 1 -- 172.21.15.153:0/3049627907 shutdown_connections 2023-11-24T08:04:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.248+0000 7fafc7c8c700 1 -- 172.21.15.153:0/3049627907 wait complete. 2023-11-24T08:04:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.249+0000 7fafc7c8c700 1 Processor -- start 2023-11-24T08:04:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.249+0000 7fafc7c8c700 1 -- start start 2023-11-24T08:04:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc7c8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafc00b3370 0x7fafc00b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc7c8c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafc00d1c70 0x7fafc015eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc7c8c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafc015bdd0 0x7fafc0148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc7c8c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc00b51c0 con 0x7fafc00b3370 2023-11-24T08:04:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc7c8c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc00c6680 con 0x7fafc00d1c70 2023-11-24T08:04:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc7c8c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc00c6f10 con 0x7fafc015bdd0 2023-11-24T08:04:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc5a28700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafc00b3370 0x7fafc00b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc5a28700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafc00b3370 0x7fafc00b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35332/0 (socket says 172.21.15.153:35332) 2023-11-24T08:04:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc5a28700 1 -- 172.21.15.153:0/2001543414 learned_addr learned my addr 172.21.15.153:0/2001543414 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc6229700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafc015bdd0 0x7fafc0148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc5227700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafc00d1c70 0x7fafc015eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc5a28700 1 -- 172.21.15.153:0/2001543414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafc015bdd0 msgr2=0x7fafc0148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc5a28700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafc015bdd0 0x7fafc0148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc5a28700 1 -- 172.21.15.153:0/2001543414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafc00d1c70 msgr2=0x7fafc015eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc5a28700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafc00d1c70 0x7fafc015eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc5a28700 1 -- 172.21.15.153:0/2001543414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0009550 con 0x7fafc00b3370 2023-11-24T08:04:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc5a28700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafc00b3370 0x7fafc00b48d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009c10 tx=0x7fafb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafb67fc700 1 -- 172.21.15.153:0/2001543414 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0004450 con 0x7fafc00b3370 2023-11-24T08:04:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafb67fc700 1 -- 172.21.15.153:0/2001543414 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb001e070 con 0x7fafc00b3370 2023-11-24T08:04:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafb67fc700 1 -- 172.21.15.153:0/2001543414 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb00038e0 con 0x7fafc00b3370 2023-11-24T08:04:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc7c8c700 1 -- 172.21.15.153:0/2001543414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc01591f0 con 0x7fafc00b3370 2023-11-24T08:04:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.250+0000 7fafc7c8c700 1 -- 172.21.15.153:0/2001543414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc00b4f90 con 0x7fafc00b3370 2023-11-24T08:04:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.251+0000 7fafc7c8c700 1 -- 172.21.15.153:0/2001543414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc00c71f0 con 0x7fafc00b3370 2023-11-24T08:04:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.252+0000 7fafb67fc700 1 -- 172.21.15.153:0/2001543414 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafb0003a40 con 0x7fafc00b3370 2023-11-24T08:04:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.252+0000 7fafb67fc700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fafa406aed0 0x7fafa406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.252+0000 7fafb67fc700 1 -- 172.21.15.153:0/2001543414 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafb008a220 con 0x7fafc00b3370 2023-11-24T08:04:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.252+0000 7fafc5227700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fafa406aed0 0x7fafa406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.252+0000 7fafc5227700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fafa406aed0 0x7fafa406d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fafc01597c0 tx=0x7fafbc009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.257+0000 7fafb67fc700 1 -- 172.21.15.153:0/2001543414 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafb0055360 con 0x7fafc00b3370 2023-11-24T08:04:13.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.452+0000 7fafc7c8c700 1 -- 172.21.15.153:0/2001543414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafc0067f60 con 0x7fafc00b3370 2023-11-24T08:04:13.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.453+0000 7fafb67fc700 1 -- 172.21.15.153:0/2001543414 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16554 (secure 0 0 0) 0x7fafb0058980 con 0x7fafc00b3370 2023-11-24T08:04:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:13.455 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":19,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:12.137543+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:13.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 -- 172.21.15.153:0/2001543414 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fafa406aed0 msgr2=0x7fafa406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fafa406aed0 0x7fafa406d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fafc01597c0 tx=0x7fafbc009210 comp rx=0 tx=0).stop 2023-11-24T08:04:13.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 -- 172.21.15.153:0/2001543414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafc00b3370 msgr2=0x7fafc00b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafc00b3370 0x7fafc00b48d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009c10 tx=0x7fafb0004750 comp rx=0 tx=0).stop 2023-11-24T08:04:13.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 -- 172.21.15.153:0/2001543414 shutdown_connections 2023-11-24T08:04:13.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafc015bdd0 0x7fafc0148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fafa406aed0 0x7fafa406d390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafc00b3370 0x7fafc00b48d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 --2- 172.21.15.153:0/2001543414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafc00d1c70 0x7fafc015eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 -- 172.21.15.153:0/2001543414 >> 172.21.15.153:0/2001543414 conn(0x7fafc00731a0 msgr2=0x7fafc00aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 -- 172.21.15.153:0/2001543414 shutdown_connections 2023-11-24T08:04:13.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.455+0000 7fafc7c8c700 1 -- 172.21.15.153:0/2001543414 wait complete. 2023-11-24T08:04:13.470 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:04:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.592+0000 7fe80873c700 1 Processor -- start 2023-11-24T08:04:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.592+0000 7fe80873c700 1 -- start start 2023-11-24T08:04:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.593+0000 7fe80873c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe80015b370 0x7fe80015b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.593+0000 7fe80873c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8000ae5e0 con 0x7fe8000b3c60 2023-11-24T08:04:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.593+0000 7fe80873c700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80015be30 con 0x7fe8001587f0 2023-11-24T08:04:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.593+0000 7fe80873c700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80015c110 con 0x7fe80015b370 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.593+0000 7fe806cd9700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe8000b3c60 0x7fe8000af060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41448/0 (socket says 172.21.15.153:41448) 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.593+0000 7fe806cd9700 1 -- 172.21.15.153:0/1414551732 learned_addr learned my addr 172.21.15.153:0/1414551732 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.593+0000 7fe805cd7700 1 --2- 172.21.15.153:0/1414551732 >> v2:172.21.15.164:3300/0 conn(0x7fe80015b370 0x7fe80015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.594+0000 7fe8054d6700 1 -- 172.21.15.153:0/1414551732 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694182908 0 0) 0x7fe8000ae5e0 con 0x7fe8000b3c60 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.594+0000 7fe8054d6700 1 -- 172.21.15.153:0/1414551732 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7ec0035b0 con 0x7fe8000b3c60 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.594+0000 7fe805cd7700 1 -- 172.21.15.153:0/1414551732 >> v1:172.21.15.164:6789/0 conn(0x7fe8001587f0 legacy=0x7fe80006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.594+0000 7fe805cd7700 1 -- 172.21.15.153:0/1414551732 >> v1:172.21.15.153:6789/0 conn(0x7fe8000b3c60 legacy=0x7fe8000af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.594+0000 7fe805cd7700 1 -- 172.21.15.153:0/1414551732 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8000ae860 con 0x7fe80015b370 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.594+0000 7fe805cd7700 1 --2- 172.21.15.153:0/1414551732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80015b370 0x7fe80015b800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009870 tx=0x7fe7fc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49f871b8040359a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.594+0000 7fe8054d6700 1 -- 172.21.15.153:0/1414551732 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc011830 con 0x7fe80015b370 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.594+0000 7fe8054d6700 1 -- 172.21.15.153:0/1414551732 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc011990 con 0x7fe80015b370 2023-11-24T08:04:13.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.594+0000 7fe8054d6700 1 -- 172.21.15.153:0/1414551732 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc011d00 con 0x7fe80015b370 2023-11-24T08:04:13.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.595+0000 7fe80873c700 1 -- 172.21.15.153:0/1414551732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80015b370 msgr2=0x7fe80015b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.595+0000 7fe80873c700 1 --2- 172.21.15.153:0/1414551732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80015b370 0x7fe80015b800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009870 tx=0x7fe7fc009b80 comp rx=0 tx=0).stop 2023-11-24T08:04:13.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.595+0000 7fe80873c700 1 -- 172.21.15.153:0/1414551732 shutdown_connections 2023-11-24T08:04:13.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.595+0000 7fe80873c700 1 --2- 172.21.15.153:0/1414551732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80015b370 0x7fe80015b800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.595+0000 7fe80873c700 1 -- 172.21.15.153:0/1414551732 >> 172.21.15.153:0/1414551732 conn(0x7fe8000d0bf0 msgr2=0x7fe8000d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.595+0000 7fe80873c700 1 -- 172.21.15.153:0/1414551732 shutdown_connections 2023-11-24T08:04:13.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.595+0000 7fe80873c700 1 -- 172.21.15.153:0/1414551732 wait complete. 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.596+0000 7fe80873c700 1 Processor -- start 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.596+0000 7fe80873c700 1 -- start start 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe80873c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8000b3c60 0x7fe8000b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe80873c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8001587f0 0x7fe800073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe80873c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80015b370 0x7fe8000744d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe80873c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8000afe40 con 0x7fe8001587f0 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe80873c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8000b1e00 con 0x7fe80015b370 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe80873c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80009e0e0 con 0x7fe8000b3c60 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe805cd7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8001587f0 0x7fe800073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe805cd7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8001587f0 0x7fe800073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35348/0 (socket says 172.21.15.153:35348) 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe805cd7700 1 -- 172.21.15.153:0/1232225176 learned_addr learned my addr 172.21.15.153:0/1232225176 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:13.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe806cd9700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80015b370 0x7fe8000744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe8064d8700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8000b3c60 0x7fe8000b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe805cd7700 1 -- 172.21.15.153:0/1232225176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8000b3c60 msgr2=0x7fe8000b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe805cd7700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8000b3c60 0x7fe8000b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe805cd7700 1 -- 172.21.15.153:0/1232225176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80015b370 msgr2=0x7fe8000744d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe805cd7700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80015b370 0x7fe8000744d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe805cd7700 1 -- 172.21.15.153:0/1232225176 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0094a0 con 0x7fe8001587f0 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe805cd7700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8001587f0 0x7fe800073f90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0090b0 tx=0x7fe7fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe7f6ffd700 1 -- 172.21.15.153:0/1232225176 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc01a930 con 0x7fe8001587f0 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe7f6ffd700 1 -- 172.21.15.153:0/1232225176 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc01aa90 con 0x7fe8001587f0 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe80873c700 1 -- 172.21.15.153:0/1232225176 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80009e3c0 con 0x7fe8001587f0 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe7f6ffd700 1 -- 172.21.15.153:0/1232225176 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc01ae00 con 0x7fe8001587f0 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.597+0000 7fe80873c700 1 -- 172.21.15.153:0/1232225176 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80009e980 con 0x7fe8001587f0 2023-11-24T08:04:13.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.598+0000 7fe80873c700 1 -- 172.21.15.153:0/1232225176 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe800068fb0 con 0x7fe8001587f0 2023-11-24T08:04:13.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.599+0000 7fe7f6ffd700 1 -- 172.21.15.153:0/1232225176 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe7fc02d450 con 0x7fe8001587f0 2023-11-24T08:04:13.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.599+0000 7fe7f6ffd700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe7e406aed0 0x7fe7e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.599+0000 7fe7f6ffd700 1 -- 172.21.15.153:0/1232225176 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7fc08a8c0 con 0x7fe8001587f0 2023-11-24T08:04:13.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.599+0000 7fe8064d8700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe7e406aed0 0x7fe7e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.599+0000 7fe8064d8700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe7e406aed0 0x7fe7e406d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0007fd0 tx=0x7fe7f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.604+0000 7fe7f6ffd700 1 -- 172.21.15.153:0/1232225176 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe7fc055a00 con 0x7fe8001587f0 2023-11-24T08:04:13.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:13.840+0000 7fe80873c700 1 -- 172.21.15.153:0/1232225176 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe8000b16a0 con 0x7fe8001587f0 2023-11-24T08:04:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.776+0000 7fe7f6ffd700 1 -- 172.21.15.153:0/1232225176 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe7fc015070 con 0x7fe8001587f0 2023-11-24T08:04:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 -- 172.21.15.153:0/1232225176 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe7e406aed0 msgr2=0x7fe7e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe7e406aed0 0x7fe7e406d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0007fd0 tx=0x7fe7f0009040 comp rx=0 tx=0).stop 2023-11-24T08:04:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 -- 172.21.15.153:0/1232225176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8001587f0 msgr2=0x7fe800073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8001587f0 0x7fe800073f90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0090b0 tx=0x7fe7fc004750 comp rx=0 tx=0).stop 2023-11-24T08:04:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 -- 172.21.15.153:0/1232225176 shutdown_connections 2023-11-24T08:04:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80015b370 0x7fe8000744d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8000b3c60 0x7fe8000b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe7e406aed0 0x7fe7e406d390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 --2- 172.21.15.153:0/1232225176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8001587f0 0x7fe800073f90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 -- 172.21.15.153:0/1232225176 >> 172.21.15.153:0/1232225176 conn(0x7fe8000d0bf0 msgr2=0x7fe80006bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 -- 172.21.15.153:0/1232225176 shutdown_connections 2023-11-24T08:04:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.779+0000 7fe80873c700 1 -- 172.21.15.153:0/1232225176 wait complete. 2023-11-24T08:04:14.795 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:04:14.795 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:04:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.924+0000 7f01c8842700 1 Processor -- start 2023-11-24T08:04:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.924+0000 7f01c8842700 1 -- start start 2023-11-24T08:04:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.925+0000 7f01c8842700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01c415e160 0x7f01c40b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.925+0000 7f01c8842700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f01c40afc90 0x7f01c4073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.925+0000 7f01c8842700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f01c40744d0 0x7f01c406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.925+0000 7f01c8842700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c40b4500 con 0x7f01c40744d0 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.925+0000 7f01c8842700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c4074960 con 0x7f01c40afc90 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.925+0000 7f01c8842700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c40b3c60 con 0x7f01c415e160 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.925+0000 7f01c2d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f01c40744d0 0x7f01c406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.925+0000 7f01c2d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f01c40744d0 0x7f01c406d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35356/0 (socket says 172.21.15.153:35356) 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.925+0000 7f01c2d9d700 1 -- 172.21.15.153:0/304246843 learned_addr learned my addr 172.21.15.153:0/304246843 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.925+0000 7f01c259c700 1 --2- 172.21.15.153:0/304246843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01c415e160 0x7f01c40b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c1d9b700 1 --2- 172.21.15.153:0/304246843 >> v2:172.21.15.164:3300/0 conn(0x7f01c40afc90 0x7f01c4073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c2d9d700 1 -- 172.21.15.153:0/304246843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01c415e160 msgr2=0x7f01c40b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c2d9d700 1 --2- 172.21.15.153:0/304246843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01c415e160 0x7f01c40b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c2d9d700 1 -- 172.21.15.153:0/304246843 >> v2:172.21.15.164:3300/0 conn(0x7f01c40afc90 msgr2=0x7f01c4073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c2d9d700 1 --2- 172.21.15.153:0/304246843 >> v2:172.21.15.164:3300/0 conn(0x7f01c40afc90 0x7f01c4073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c2d9d700 1 -- 172.21.15.153:0/304246843 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c40b58c0 con 0x7f01c40744d0 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c2d9d700 1 --2- 172.21.15.153:0/304246843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01c40744d0 0x7f01c406d930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01c409f020 tx=0x7f01bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e00393a895a7ef4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c159a700 1 -- 172.21.15.153:0/304246843 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00e070 con 0x7f01c40744d0 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c159a700 1 -- 172.21.15.153:0/304246843 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc00b910 con 0x7f01c40744d0 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c159a700 1 -- 172.21.15.153:0/304246843 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00bcc0 con 0x7f01c40744d0 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c8842700 1 -- 172.21.15.153:0/304246843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01c40744d0 msgr2=0x7f01c406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.926+0000 7f01c8842700 1 --2- 172.21.15.153:0/304246843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01c40744d0 0x7f01c406d930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01c409f020 tx=0x7f01bc00b330 comp rx=0 tx=0).stop 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.927+0000 7f01c8842700 1 -- 172.21.15.153:0/304246843 shutdown_connections 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.927+0000 7f01c8842700 1 --2- 172.21.15.153:0/304246843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01c40744d0 0x7f01c406d930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.927+0000 7f01c8842700 1 --2- 172.21.15.153:0/304246843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01c415e160 0x7f01c40b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.927+0000 7f01c8842700 1 --2- 172.21.15.153:0/304246843 >> v2:172.21.15.164:3300/0 conn(0x7f01c40afc90 0x7f01c4073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.927+0000 7f01c8842700 1 -- 172.21.15.153:0/304246843 >> 172.21.15.153:0/304246843 conn(0x7f01c40d0bf0 msgr2=0x7f01c40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.927+0000 7f01c8842700 1 -- 172.21.15.153:0/304246843 shutdown_connections 2023-11-24T08:04:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.927+0000 7f01c8842700 1 -- 172.21.15.153:0/304246843 wait complete. 2023-11-24T08:04:14.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.928+0000 7f01c8842700 1 Processor -- start 2023-11-24T08:04:14.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.928+0000 7f01c8842700 1 -- start start 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c8842700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01c40744d0 0x7f01c4144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c8842700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01c40afc90 0x7f01c4160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c8842700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01c415e160 0x7f01c41530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c8842700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c415fc30 con 0x7f01c415e160 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c8842700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4156430 con 0x7f01c40afc90 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c8842700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c415fe80 con 0x7f01c40744d0 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01c415e160 0x7f01c41530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01c415e160 0x7f01c41530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35364/0 (socket says 172.21.15.153:35364) 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c2d9d700 1 -- 172.21.15.153:0/1213372768 learned_addr learned my addr 172.21.15.153:0/1213372768 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c259c700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01c40744d0 0x7f01c4144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c1d9b700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01c40afc90 0x7f01c4160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c2d9d700 1 -- 172.21.15.153:0/1213372768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01c40744d0 msgr2=0x7f01c4144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c2d9d700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01c40744d0 0x7f01c4144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c2d9d700 1 -- 172.21.15.153:0/1213372768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01c40afc90 msgr2=0x7f01c4160f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c2d9d700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01c40afc90 0x7f01c4160f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c2d9d700 1 -- 172.21.15.153:0/1213372768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc009b30 con 0x7f01c415e160 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c259c700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01c40744d0 0x7f01c4144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c2d9d700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01c415e160 0x7f01c41530d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01c4072ed0 tx=0x7f01bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01b2ffd700 1 -- 172.21.15.153:0/1213372768 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00ce80 con 0x7f01c415e160 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01b2ffd700 1 -- 172.21.15.153:0/1213372768 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc004250 con 0x7f01c415e160 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01c8842700 1 -- 172.21.15.153:0/1213372768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c4160160 con 0x7f01c415e160 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.929+0000 7f01b2ffd700 1 -- 172.21.15.153:0/1213372768 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc004600 con 0x7f01c415e160 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.930+0000 7f01c8842700 1 -- 172.21.15.153:0/1213372768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c4160720 con 0x7f01c415e160 2023-11-24T08:04:14.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.930+0000 7f01b0ff9700 1 -- 172.21.15.153:0/1213372768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019c0052e0 con 0x7f01c415e160 2023-11-24T08:04:14.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.931+0000 7f01b2ffd700 1 -- 172.21.15.153:0/1213372768 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01bc004760 con 0x7f01c415e160 2023-11-24T08:04:14.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.931+0000 7f01b2ffd700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f01a406aed0 0x7f01a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.931+0000 7f01b2ffd700 1 -- 172.21.15.153:0/1213372768 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01bc08a9d0 con 0x7f01c415e160 2023-11-24T08:04:14.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.931+0000 7f01c259c700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f01a406aed0 0x7f01a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.932+0000 7f01c259c700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f01a406aed0 0x7f01a406d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009a40 tx=0x7f01b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:14.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:14.936+0000 7f01b2ffd700 1 -- 172.21.15.153:0/1213372768 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f01bc055b10 con 0x7f01c415e160 2023-11-24T08:04:15.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.170+0000 7f01b0ff9700 1 -- 172.21.15.153:0/1213372768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f019c005860 con 0x7f01c415e160 2023-11-24T08:04:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.777+0000 7f01b2ffd700 1 -- 172.21.15.153:0/1213372768 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f01bc02a0c0 con 0x7f01c415e160 2023-11-24T08:04:15.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 -- 172.21.15.153:0/1213372768 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f01a406aed0 msgr2=0x7f01a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:15.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f01a406aed0 0x7f01a406d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009a40 tx=0x7f01b8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 -- 172.21.15.153:0/1213372768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01c415e160 msgr2=0x7f01c41530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01c415e160 0x7f01c41530d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01c4072ed0 tx=0x7f01bc004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 -- 172.21.15.153:0/1213372768 shutdown_connections 2023-11-24T08:04:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f01a406aed0 0x7f01a406d390 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01c415e160 0x7f01c41530d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01c40744d0 0x7f01c4144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 --2- 172.21.15.153:0/1213372768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01c40afc90 0x7f01c4160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 -- 172.21.15.153:0/1213372768 >> 172.21.15.153:0/1213372768 conn(0x7f01c40d0bf0 msgr2=0x7f01c415d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 -- 172.21.15.153:0/1213372768 shutdown_connections 2023-11-24T08:04:15.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.780+0000 7f01b0ff9700 1 -- 172.21.15.153:0/1213372768 wait complete. 2023-11-24T08:04:15.797 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:04:15.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:15.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.922+0000 7f73ed666700 1 Processor -- start 2023-11-24T08:04:15.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.922+0000 7f73ed666700 1 -- start start 2023-11-24T08:04:15.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73ed666700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f73e815e1e0 0x7f73e80d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:15.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73ed666700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e80d0f80 0x7f73e80b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:15.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73ed666700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80d20b0 con 0x7f73e80d3a00 2023-11-24T08:04:15.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73ed666700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e80d3150 con 0x7f73e815e1e0 2023-11-24T08:04:15.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73ed666700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e815e5c0 con 0x7f73e80d0f80 2023-11-24T08:04:15.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f73e815e1e0 0x7f73e80d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:15.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f73e815e1e0 0x7f73e80d34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35368/0 (socket says 172.21.15.153:35368) 2023-11-24T08:04:15.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e6ffd700 1 -- 172.21.15.153:0/1905383241 learned_addr learned my addr 172.21.15.153:0/1905383241 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:15.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e77fe700 1 --2- 172.21.15.153:0/1905383241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e80d0f80 0x7f73e80b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:15.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e6ffd700 1 -- 172.21.15.153:0/1905383241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e80d0f80 msgr2=0x7f73e80b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:15.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e6ffd700 1 --2- 172.21.15.153:0/1905383241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e80d0f80 0x7f73e80b6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:15.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e6ffd700 1 -- 172.21.15.153:0/1905383241 >> v1:172.21.15.153:6789/0 conn(0x7f73e80d3a00 legacy=0x7f73e80d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:15.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e6ffd700 1 -- 172.21.15.153:0/1905383241 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80d2390 con 0x7f73e815e1e0 2023-11-24T08:04:15.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e5ffb700 1 -- 172.21.15.153:0/1905383241 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860526006 0 0) 0x7f73e80d20b0 con 0x7f73e80d3a00 2023-11-24T08:04:15.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e77fe700 1 --2- 172.21.15.153:0/1905383241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e80d0f80 0x7f73e80b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:15.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e6ffd700 1 --2- 172.21.15.153:0/1905383241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e815e1e0 0x7f73e80d34c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009920 tx=0x7f73d8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4f43ffdcba036 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e5ffb700 1 -- 172.21.15.153:0/1905383241 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800ba20 con 0x7f73e815e1e0 2023-11-24T08:04:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e5ffb700 1 -- 172.21.15.153:0/1905383241 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d800bb80 con 0x7f73e815e1e0 2023-11-24T08:04:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.923+0000 7f73e5ffb700 1 -- 172.21.15.153:0/1905383241 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8009e70 con 0x7f73e815e1e0 2023-11-24T08:04:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.924+0000 7f73ed666700 1 -- 172.21.15.153:0/1905383241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e815e1e0 msgr2=0x7f73e80d34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.924+0000 7f73ed666700 1 --2- 172.21.15.153:0/1905383241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e815e1e0 0x7f73e80d34c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009920 tx=0x7f73d8009c30 comp rx=0 tx=0).stop 2023-11-24T08:04:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.924+0000 7f73ed666700 1 -- 172.21.15.153:0/1905383241 shutdown_connections 2023-11-24T08:04:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.924+0000 7f73ed666700 1 --2- 172.21.15.153:0/1905383241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e80d0f80 0x7f73e80b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.924+0000 7f73ed666700 1 --2- 172.21.15.153:0/1905383241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e815e1e0 0x7f73e80d34c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.924+0000 7f73ed666700 1 -- 172.21.15.153:0/1905383241 >> 172.21.15.153:0/1905383241 conn(0x7f73e80b5b50 msgr2=0x7f73e80b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.924+0000 7f73ed666700 1 -- 172.21.15.153:0/1905383241 shutdown_connections 2023-11-24T08:04:15.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.924+0000 7f73ed666700 1 -- 172.21.15.153:0/1905383241 wait complete. 2023-11-24T08:04:15.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.925+0000 7f73ed666700 1 Processor -- start 2023-11-24T08:04:15.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.925+0000 7f73ed666700 1 -- start start 2023-11-24T08:04:15.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73ed666700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e80d0f80 0x7f73e8151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:15.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73ed666700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73e80d3a00 0x7f73e8158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:15.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73ed666700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e815e1e0 0x7f73e80cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:15.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73ed666700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80cb970 con 0x7f73e80d0f80 2023-11-24T08:04:15.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73ed666700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8151e60 con 0x7f73e80d3a00 2023-11-24T08:04:15.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73ed666700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8156640 con 0x7f73e815e1e0 2023-11-24T08:04:15.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e80d0f80 0x7f73e8151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:15.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e80d0f80 0x7f73e8151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35374/0 (socket says 172.21.15.153:35374) 2023-11-24T08:04:15.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e6ffd700 1 -- 172.21.15.153:0/353837494 learned_addr learned my addr 172.21.15.153:0/353837494 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:15.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e77fe700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e815e1e0 0x7f73e80cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:15.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e67fc700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73e80d3a00 0x7f73e8158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:15.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e6ffd700 1 -- 172.21.15.153:0/353837494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e815e1e0 msgr2=0x7f73e80cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:15.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e6ffd700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e815e1e0 0x7f73e80cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:15.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e6ffd700 1 -- 172.21.15.153:0/353837494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73e80d3a00 msgr2=0x7f73e8158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:15.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e6ffd700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73e80d3a00 0x7f73e8158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:15.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e6ffd700 1 -- 172.21.15.153:0/353837494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d8009550 con 0x7f73e80d0f80 2023-11-24T08:04:15.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e77fe700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e815e1e0 0x7f73e80cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:15.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.926+0000 7f73e6ffd700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e80d0f80 0x7f73e8151920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f73d8000c00 tx=0x7f73d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:15.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.927+0000 7f73cf7fe700 1 -- 172.21.15.153:0/353837494 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80036a0 con 0x7f73e80d0f80 2023-11-24T08:04:15.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.927+0000 7f73ed666700 1 -- 172.21.15.153:0/353837494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e8159370 con 0x7f73e80d0f80 2023-11-24T08:04:15.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.927+0000 7f73ed666700 1 -- 172.21.15.153:0/353837494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e80cb2b0 con 0x7f73e80d0f80 2023-11-24T08:04:15.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.927+0000 7f73cf7fe700 1 -- 172.21.15.153:0/353837494 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d801e070 con 0x7f73e80d0f80 2023-11-24T08:04:15.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.927+0000 7f73cf7fe700 1 -- 172.21.15.153:0/353837494 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8003a00 con 0x7f73e80d0f80 2023-11-24T08:04:15.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.928+0000 7f73ed666700 1 -- 172.21.15.153:0/353837494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c80052e0 con 0x7f73e80d0f80 2023-11-24T08:04:15.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.928+0000 7f73cf7fe700 1 -- 172.21.15.153:0/353837494 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73d8003b60 con 0x7f73e80d0f80 2023-11-24T08:04:15.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.928+0000 7f73cf7fe700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73d406aed0 0x7f73d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:15.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.928+0000 7f73cf7fe700 1 -- 172.21.15.153:0/353837494 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73d8020070 con 0x7f73e80d0f80 2023-11-24T08:04:15.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.928+0000 7f73e67fc700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73d406aed0 0x7f73d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:15.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.929+0000 7f73e67fc700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73d406aed0 0x7f73d406d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f73e80b2ae0 tx=0x7f73dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:15.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:15.933+0000 7f73cf7fe700 1 -- 172.21.15.153:0/353837494 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73d8055bf0 con 0x7f73e80d0f80 2023-11-24T08:04:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.165+0000 7f73ed666700 1 -- 172.21.15.153:0/353837494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73c8005590 con 0x7f73e80d0f80 2023-11-24T08:04:16.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.166+0000 7f73cf7fe700 1 -- 172.21.15.153:0/353837494 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f73d8059210 con 0x7f73e80d0f80 2023-11-24T08:04:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:16.168 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/157182640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":157182640},{"type":"v1","addr":"172.21.15.153:6837","nonce":157182640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2853134113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2853134113},{"type":"v1","addr":"172.21.15.153:6836","nonce":2853134113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1191113201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1191113201},{"type":"v1","addr":"172.21.15.164:6833","nonce":1191113201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:12.137876+0000","modified":"2023-11-24T08:04:15.171907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1557353565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1557353565},{"type":"v1","addr":"172.21.15.164:6835","nonce":1557353565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:16.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 -- 172.21.15.153:0/353837494 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73d406aed0 msgr2=0x7f73d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73d406aed0 0x7f73d406d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f73e80b2ae0 tx=0x7f73dc009040 comp rx=0 tx=0).stop 2023-11-24T08:04:16.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 -- 172.21.15.153:0/353837494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e80d0f80 msgr2=0x7f73e8151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e80d0f80 0x7f73e8151920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f73d8000c00 tx=0x7f73d8004750 comp rx=0 tx=0).stop 2023-11-24T08:04:16.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 -- 172.21.15.153:0/353837494 shutdown_connections 2023-11-24T08:04:16.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73e815e1e0 0x7f73e80cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73d406aed0 0x7f73d406d390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e80d0f80 0x7f73e8151920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 --2- 172.21.15.153:0/353837494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73e80d3a00 0x7f73e8158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 -- 172.21.15.153:0/353837494 >> 172.21.15.153:0/353837494 conn(0x7f73e80b5b50 msgr2=0x7f73e815d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:16.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 -- 172.21.15.153:0/353837494 shutdown_connections 2023-11-24T08:04:16.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.168+0000 7f73ed666700 1 -- 172.21.15.153:0/353837494 wait complete. 2023-11-24T08:04:16.171 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2023-11-24T08:04:16.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.301+0000 7f463a016700 1 Processor -- start 2023-11-24T08:04:16.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.301+0000 7f463a016700 1 -- start start 2023-11-24T08:04:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.301+0000 7f463a016700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f46341446a0 0x7f46340b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.301+0000 7f463a016700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46340adf00 0x7f463406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.301+0000 7f463a016700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46340af950 con 0x7f463406c540 2023-11-24T08:04:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.301+0000 7f463a016700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4634144a80 con 0x7f46341446a0 2023-11-24T08:04:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.301+0000 7f463a016700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463406c9b0 con 0x7f46340adf00 2023-11-24T08:04:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f4633fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f463406c540 0x7f463406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41490/0 (socket says 172.21.15.153:41490) 2023-11-24T08:04:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f4633fff700 1 -- 172.21.15.153:0/3290268985 learned_addr learned my addr 172.21.15.153:0/3290268985 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f4632ffd700 1 --2- 172.21.15.153:0/3290268985 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46340adf00 0x7f463406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f46337fe700 1 --2- 172.21.15.153:0/3290268985 >> v2:172.21.15.164:3300/0 conn(0x7f46341446a0 0x7f46340b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f46327fc700 1 -- 172.21.15.153:0/3290268985 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955970176 0 0) 0x7f46340af950 con 0x7f463406c540 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f46327fc700 1 -- 172.21.15.153:0/3290268985 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f461c0035b0 con 0x7f463406c540 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f4632ffd700 1 -- 172.21.15.153:0/3290268985 >> v2:172.21.15.164:3300/0 conn(0x7f46341446a0 msgr2=0x7f46340b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f4632ffd700 1 --2- 172.21.15.153:0/3290268985 >> v2:172.21.15.164:3300/0 conn(0x7f46341446a0 0x7f46340b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f4632ffd700 1 -- 172.21.15.153:0/3290268985 >> v1:172.21.15.153:6789/0 conn(0x7f463406c540 legacy=0x7f463406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f4632ffd700 1 -- 172.21.15.153:0/3290268985 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340afc30 con 0x7f46340adf00 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f46337fe700 1 --2- 172.21.15.153:0/3290268985 >> v2:172.21.15.164:3300/0 conn(0x7f46341446a0 0x7f46340b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f4632ffd700 1 --2- 172.21.15.153:0/3290268985 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46340adf00 0x7f463406c000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4624009840 tx=0x7f4624009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d6c1c9213e102bf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f46327fc700 1 -- 172.21.15.153:0/3290268985 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624011830 con 0x7f46340adf00 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f46327fc700 1 -- 172.21.15.153:0/3290268985 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4624011990 con 0x7f46340adf00 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.302+0000 7f46327fc700 1 -- 172.21.15.153:0/3290268985 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624011d00 con 0x7f46340adf00 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.303+0000 7f463a016700 1 -- 172.21.15.153:0/3290268985 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46340adf00 msgr2=0x7f463406c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.303+0000 7f463a016700 1 --2- 172.21.15.153:0/3290268985 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46340adf00 0x7f463406c000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4624009840 tx=0x7f4624009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.303+0000 7f463a016700 1 -- 172.21.15.153:0/3290268985 shutdown_connections 2023-11-24T08:04:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.303+0000 7f463a016700 1 --2- 172.21.15.153:0/3290268985 >> v2:172.21.15.164:3300/0 conn(0x7f46341446a0 0x7f46340b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.303+0000 7f463a016700 1 --2- 172.21.15.153:0/3290268985 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46340adf00 0x7f463406c000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.303+0000 7f463a016700 1 -- 172.21.15.153:0/3290268985 >> 172.21.15.153:0/3290268985 conn(0x7f4634071b90 msgr2=0x7f4634071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.303+0000 7f463a016700 1 -- 172.21.15.153:0/3290268985 shutdown_connections 2023-11-24T08:04:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.303+0000 7f463a016700 1 -- 172.21.15.153:0/3290268985 wait complete. 2023-11-24T08:04:16.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.304+0000 7f463a016700 1 Processor -- start 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.304+0000 7f463a016700 1 -- start start 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f463a016700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f463406c540 0x7f46340cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f463a016700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46340adf00 0x7f4634156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f463a016700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341446a0 0x7f463406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f463a016700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4634141c90 con 0x7f46341446a0 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f463a016700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340cfd10 con 0x7f463406c540 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f463a016700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46340cfff0 con 0x7f46340adf00 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f4633fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341446a0 0x7f463406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f4633fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341446a0 0x7f463406dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35392/0 (socket says 172.21.15.153:35392) 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f4633fff700 1 -- 172.21.15.153:0/2899796780 learned_addr learned my addr 172.21.15.153:0/2899796780 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f4632ffd700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46340adf00 0x7f4634156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f4633fff700 1 -- 172.21.15.153:0/2899796780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46340adf00 msgr2=0x7f4634156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f4633fff700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46340adf00 0x7f4634156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f4633fff700 1 -- 172.21.15.153:0/2899796780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f463406c540 msgr2=0x7f46340cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f4633fff700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f463406c540 0x7f46340cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.305+0000 7f4633fff700 1 -- 172.21.15.153:0/2899796780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46280094a0 con 0x7f46341446a0 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.306+0000 7f4633fff700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341446a0 0x7f463406dfd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f462c00cb40 tx=0x7f462c00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.306+0000 7f461bfff700 1 -- 172.21.15.153:0/2899796780 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00ab50 con 0x7f46341446a0 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.306+0000 7f461bfff700 1 -- 172.21.15.153:0/2899796780 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c00acb0 con 0x7f46341446a0 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.306+0000 7f461bfff700 1 -- 172.21.15.153:0/2899796780 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c012620 con 0x7f46341446a0 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.306+0000 7f463a016700 1 -- 172.21.15.153:0/2899796780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46240094a0 con 0x7f46341446a0 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.306+0000 7f463a016700 1 -- 172.21.15.153:0/2899796780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4634141ee0 con 0x7f46341446a0 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.307+0000 7f463a016700 1 -- 172.21.15.153:0/2899796780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46340753f0 con 0x7f46341446a0 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.307+0000 7f461bfff700 1 -- 172.21.15.153:0/2899796780 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f462c01b3b0 con 0x7f46341446a0 2023-11-24T08:04:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.307+0000 7f461bfff700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f462006aed0 0x7f462006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.308+0000 7f461bfff700 1 -- 172.21.15.153:0/2899796780 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f462c089410 con 0x7f46341446a0 2023-11-24T08:04:16.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.308+0000 7f46337fe700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f462006aed0 0x7f462006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.308+0000 7f46337fe700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f462006aed0 0x7f462006d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4628006f10 tx=0x7f4628006e60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:16.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.312+0000 7f461bfff700 1 -- 172.21.15.153:0/2899796780 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f462c0544c0 con 0x7f46341446a0 2023-11-24T08:04:16.436 INFO:tasks.ceph.mds.d.smithi164.stderr:2023-11-24T08:04:16.435+0000 7fd9c591b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:04:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.504+0000 7f463a016700 1 -- 172.21.15.153:0/2899796780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4634067f60 con 0x7f46341446a0 2023-11-24T08:04:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.505+0000 7f461bfff700 1 -- 172.21.15.153:0/2899796780 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f462c057ae0 con 0x7f46341446a0 2023-11-24T08:04:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:16.508 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.507+0000 7f463a016700 1 -- 172.21.15.153:0/2899796780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f462006aed0 msgr2=0x7f462006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.507+0000 7f463a016700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f462006aed0 0x7f462006d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4628006f10 tx=0x7f4628006e60 comp rx=0 tx=0).stop 2023-11-24T08:04:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.507+0000 7f463a016700 1 -- 172.21.15.153:0/2899796780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341446a0 msgr2=0x7f463406dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.507+0000 7f463a016700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341446a0 0x7f463406dfd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f462c00cb40 tx=0x7f462c00cf00 comp rx=0 tx=0).stop 2023-11-24T08:04:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.508+0000 7f463a016700 1 -- 172.21.15.153:0/2899796780 shutdown_connections 2023-11-24T08:04:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.508+0000 7f463a016700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f462006aed0 0x7f462006d390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.508+0000 7f463a016700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341446a0 0x7f463406dfd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.508+0000 7f463a016700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f463406c540 0x7f46340cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.508+0000 7f463a016700 1 --2- 172.21.15.153:0/2899796780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46340adf00 0x7f4634156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.508+0000 7f463a016700 1 -- 172.21.15.153:0/2899796780 >> 172.21.15.153:0/2899796780 conn(0x7f4634071b90 msgr2=0x7f463415e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.508+0000 7f463a016700 1 -- 172.21.15.153:0/2899796780 shutdown_connections 2023-11-24T08:04:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.508+0000 7f463a016700 1 -- 172.21.15.153:0/2899796780 wait complete. 2023-11-24T08:04:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:04:16.522 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:04:16.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.640+0000 7ff473239700 1 Processor -- start 2023-11-24T08:04:16.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.640+0000 7ff473239700 1 -- start start 2023-11-24T08:04:16.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.641+0000 7ff473239700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff46c15bdd0 0x7ff46c1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.641+0000 7ff473239700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff46c0d1c70 0x7ff46c0d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.641+0000 7ff473239700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46c0b22d0 con 0x7ff46c0b3370 2023-11-24T08:04:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.641+0000 7ff473239700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46c0b2f50 con 0x7ff46c15bdd0 2023-11-24T08:04:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.641+0000 7ff473239700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0d2640 con 0x7ff46c0d1c70 2023-11-24T08:04:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.641+0000 7ff46bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff46c0b3370 0x7ff46c0b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41500/0 (socket says 172.21.15.153:41500) 2023-11-24T08:04:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.641+0000 7ff46bfff700 1 -- 172.21.15.153:0/241456696 learned_addr learned my addr 172.21.15.153:0/241456696 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.641+0000 7ff4717d6700 1 --2- 172.21.15.153:0/241456696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff46c0d1c70 0x7ff46c0d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.641+0000 7ff470fd5700 1 --2- 172.21.15.153:0/241456696 >> v2:172.21.15.164:3300/0 conn(0x7ff46c15bdd0 0x7ff46c1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.641+0000 7ff46b7fe700 1 -- 172.21.15.153:0/241456696 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770867315 0 0) 0x7ff46c0b22d0 con 0x7ff46c0b3370 2023-11-24T08:04:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.641+0000 7ff46b7fe700 1 -- 172.21.15.153:0/241456696 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff45c0035b0 con 0x7ff46c0b3370 2023-11-24T08:04:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff4717d6700 1 -- 172.21.15.153:0/241456696 >> v2:172.21.15.164:3300/0 conn(0x7ff46c15bdd0 msgr2=0x7ff46c1604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff4717d6700 1 --2- 172.21.15.153:0/241456696 >> v2:172.21.15.164:3300/0 conn(0x7ff46c15bdd0 0x7ff46c1604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff4717d6700 1 -- 172.21.15.153:0/241456696 >> v1:172.21.15.153:6789/0 conn(0x7ff46c0b3370 legacy=0x7ff46c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff4717d6700 1 -- 172.21.15.153:0/241456696 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c0b25b0 con 0x7ff46c0d1c70 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff4717d6700 1 --2- 172.21.15.153:0/241456696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff46c0d1c70 0x7ff46c0d2100 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff464009d90 tx=0x7ff46400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=905b0295cca3e0fa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff46b7fe700 1 -- 172.21.15.153:0/241456696 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400e070 con 0x7ff46c0d1c70 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff46b7fe700 1 -- 172.21.15.153:0/241456696 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46400bb20 con 0x7ff46c0d1c70 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff46b7fe700 1 -- 172.21.15.153:0/241456696 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400be90 con 0x7ff46c0d1c70 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff473239700 1 -- 172.21.15.153:0/241456696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff46c0d1c70 msgr2=0x7ff46c0d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff473239700 1 --2- 172.21.15.153:0/241456696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff46c0d1c70 0x7ff46c0d2100 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff464009d90 tx=0x7ff46400b330 comp rx=0 tx=0).stop 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff473239700 1 -- 172.21.15.153:0/241456696 shutdown_connections 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff473239700 1 --2- 172.21.15.153:0/241456696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff46c0d1c70 0x7ff46c0d2100 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff473239700 1 --2- 172.21.15.153:0/241456696 >> v2:172.21.15.164:3300/0 conn(0x7ff46c15bdd0 0x7ff46c1604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.642+0000 7ff473239700 1 -- 172.21.15.153:0/241456696 >> 172.21.15.153:0/241456696 conn(0x7ff46c0731a0 msgr2=0x7ff46c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.643+0000 7ff473239700 1 -- 172.21.15.153:0/241456696 shutdown_connections 2023-11-24T08:04:16.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.643+0000 7ff473239700 1 -- 172.21.15.153:0/241456696 wait complete. 2023-11-24T08:04:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.644+0000 7ff473239700 1 Processor -- start 2023-11-24T08:04:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.644+0000 7ff473239700 1 -- start start 2023-11-24T08:04:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff473239700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0b3370 0x7ff46c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff473239700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff46c0d1c70 0x7ff46c0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff473239700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff46c15bdd0 0x7ff46c0c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff473239700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c1f18e0 con 0x7ff46c0b3370 2023-11-24T08:04:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff473239700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c1f1bc0 con 0x7ff46c0d1c70 2023-11-24T08:04:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff473239700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c1f1ea0 con 0x7ff46c15bdd0 2023-11-24T08:04:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff470fd5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0b3370 0x7ff46c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff470fd5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0b3370 0x7ff46c0cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35402/0 (socket says 172.21.15.153:35402) 2023-11-24T08:04:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff470fd5700 1 -- 172.21.15.153:0/1764421689 learned_addr learned my addr 172.21.15.153:0/1764421689 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff470fd5700 1 -- 172.21.15.153:0/1764421689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff46c15bdd0 msgr2=0x7ff46c0c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff470fd5700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff46c15bdd0 0x7ff46c0c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff470fd5700 1 -- 172.21.15.153:0/1764421689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff46c0d1c70 msgr2=0x7ff46c0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff470fd5700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff46c0d1c70 0x7ff46c0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.645+0000 7ff470fd5700 1 -- 172.21.15.153:0/1764421689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464009a70 con 0x7ff46c0b3370 2023-11-24T08:04:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.646+0000 7ff470fd5700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0b3370 0x7ff46c0cd940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff46000e870 tx=0x7ff46000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.646+0000 7ff4697fa700 1 -- 172.21.15.153:0/1764421689 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff460009590 con 0x7ff46c0b3370 2023-11-24T08:04:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.646+0000 7ff473239700 1 -- 172.21.15.153:0/1764421689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c1f2180 con 0x7ff46c0b3370 2023-11-24T08:04:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.646+0000 7ff4697fa700 1 -- 172.21.15.153:0/1764421689 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46000ee70 con 0x7ff46c0b3370 2023-11-24T08:04:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.646+0000 7ff4697fa700 1 -- 172.21.15.153:0/1764421689 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46000ca50 con 0x7ff46c0b3370 2023-11-24T08:04:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.646+0000 7ff473239700 1 -- 172.21.15.153:0/1764421689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c0cbb20 con 0x7ff46c0b3370 2023-11-24T08:04:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.647+0000 7ff473239700 1 -- 172.21.15.153:0/1764421689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c067f60 con 0x7ff46c0b3370 2023-11-24T08:04:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.647+0000 7ff4697fa700 1 -- 172.21.15.153:0/1764421689 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff46000cbb0 con 0x7ff46c0b3370 2023-11-24T08:04:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.648+0000 7ff4697fa700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff45006aed0 0x7ff45006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.648+0000 7ff4697fa700 1 -- 172.21.15.153:0/1764421689 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff460089610 con 0x7ff46c0b3370 2023-11-24T08:04:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.648+0000 7ff46bfff700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff45006aed0 0x7ff45006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.648+0000 7ff46bfff700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff45006aed0 0x7ff45006d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff458007fd0 tx=0x7ff458007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.652+0000 7ff4697fa700 1 -- 172.21.15.153:0/1764421689 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff460054640 con 0x7ff46c0b3370 2023-11-24T08:04:16.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.840+0000 7ff473239700 1 -- 172.21.15.153:0/1764421689 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff46c1f1d30 con 0x7ff45006aed0 2023-11-24T08:04:16.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.847+0000 7ff4697fa700 1 -- 172.21.15.153:0/1764421689 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264716 (secure 0 0 0) 0x7ff46c1f1d30 con 0x7ff45006aed0 2023-11-24T08:04:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:16.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.850+0000 7ff473239700 1 -- 172.21.15.153:0/1764421689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff45006aed0 msgr2=0x7ff45006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.850+0000 7ff473239700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff45006aed0 0x7ff45006d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff458007fd0 tx=0x7ff458007980 comp rx=0 tx=0).stop 2023-11-24T08:04:16.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.850+0000 7ff473239700 1 -- 172.21.15.153:0/1764421689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0b3370 msgr2=0x7ff46c0cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.850+0000 7ff473239700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0b3370 0x7ff46c0cd940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff46000e870 tx=0x7ff46000ec30 comp rx=0 tx=0).stop 2023-11-24T08:04:16.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.850+0000 7ff473239700 1 -- 172.21.15.153:0/1764421689 shutdown_connections 2023-11-24T08:04:16.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.850+0000 7ff473239700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff46c15bdd0 0x7ff46c0c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.850+0000 7ff473239700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff45006aed0 0x7ff45006d390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.850+0000 7ff473239700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0b3370 0x7ff46c0cd940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.850+0000 7ff473239700 1 --2- 172.21.15.153:0/1764421689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff46c0d1c70 0x7ff46c0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.850+0000 7ff473239700 1 -- 172.21.15.153:0/1764421689 >> 172.21.15.153:0/1764421689 conn(0x7ff46c0731a0 msgr2=0x7ff46c0703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:16.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.851+0000 7ff473239700 1 -- 172.21.15.153:0/1764421689 shutdown_connections 2023-11-24T08:04:16.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:16.851+0000 7ff473239700 1 -- 172.21.15.153:0/1764421689 wait complete. 2023-11-24T08:04:16.859 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:04:16.864 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-11-24T08:04:16.042294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218980,"kb_used_data":2796,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755740,"statfs":{"total":773094113280,"available":772869877760,"internally_reserved":0,"allocated":2863104,"data_stored":1739217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.310089"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876573+0000","last_change":"2023-11-24T08:04:12.770599+0000","last_active":"2023-11-24T08:04:13.876573+0000","last_peered":"2023-11-24T08:04:13.876573+0000","last_clean":"2023-11-24T08:04:13.876573+0000","last_became_active":"2023-11-24T08:04:12.770351+0000","last_became_peered":"2023-11-24T08:04:12.770351+0000","last_unstale":"2023-11-24T08:04:13.876573+0000","last_undegraded":"2023-11-24T08:04:13.876573+0000","last_fullsized":"2023-11-24T08:04:13.876573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:02.788396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765876+0000","last_change":"2023-11-24T08:04:12.763019+0000","last_active":"2023-11-24T08:04:13.765876+0000","last_peered":"2023-11-24T08:04:13.765876+0000","last_clean":"2023-11-24T08:04:13.765876+0000","last_became_active":"2023-11-24T08:04:12.757900+0000","last_became_peered":"2023-11-24T08:04:12.757900+0000","last_unstale":"2023-11-24T08:04:13.765876+0000","last_undegraded":"2023-11-24T08:04:13.765876+0000","last_fullsized":"2023-11-24T08:04:13.765876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366717+0000","last_change":"2023-11-24T08:04:12.758286+0000","last_active":"2023-11-24T08:04:14.366717+0000","last_peered":"2023-11-24T08:04:14.366717+0000","last_clean":"2023-11-24T08:04:14.366717+0000","last_became_active":"2023-11-24T08:04:12.758023+0000","last_became_peered":"2023-11-24T08:04:12.758023+0000","last_unstale":"2023-11-24T08:04:14.366717+0000","last_undegraded":"2023-11-24T08:04:14.366717+0000","last_fullsized":"2023-11-24T08:04:14.366717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177733+0000","last_change":"2023-11-24T08:04:12.772929+0000","last_active":"2023-11-24T08:04:14.177733+0000","last_peered":"2023-11-24T08:04:14.177733+0000","last_clean":"2023-11-24T08:04:14.177733+0000","last_became_active":"2023-11-24T08:04:12.772279+0000","last_became_peered":"2023-11-24T08:04:12.772279+0000","last_unstale":"2023-11-24T08:04:14.177733+0000","last_undegraded":"2023-11-24T08:04:14.177733+0000","last_fullsized":"2023-11-24T08:04:14.177733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:26.559888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876184+0000","last_change":"2023-11-24T08:04:12.758540+0000","last_active":"2023-11-24T08:04:13.876184+0000","last_peered":"2023-11-24T08:04:13.876184+0000","last_clean":"2023-11-24T08:04:13.876184+0000","last_became_active":"2023-11-24T08:04:12.758277+0000","last_became_peered":"2023-11-24T08:04:12.758277+0000","last_unstale":"2023-11-24T08:04:13.876184+0000","last_undegraded":"2023-11-24T08:04:13.876184+0000","last_fullsized":"2023-11-24T08:04:13.876184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177333+0000","last_change":"2023-11-24T08:04:12.773276+0000","last_active":"2023-11-24T08:04:14.177333+0000","last_peered":"2023-11-24T08:04:14.177333+0000","last_clean":"2023-11-24T08:04:14.177333+0000","last_became_active":"2023-11-24T08:04:12.772869+0000","last_became_peered":"2023-11-24T08:04:12.772869+0000","last_unstale":"2023-11-24T08:04:14.177333+0000","last_undegraded":"2023-11-24T08:04:14.177333+0000","last_fullsized":"2023-11-24T08:04:14.177333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876172+0000","last_change":"2023-11-24T08:04:12.755259+0000","last_active":"2023-11-24T08:04:13.876172+0000","last_peered":"2023-11-24T08:04:13.876172+0000","last_clean":"2023-11-24T08:04:13.876172+0000","last_became_active":"2023-11-24T08:04:12.754963+0000","last_became_peered":"2023-11-24T08:04:12.754963+0000","last_unstale":"2023-11-24T08:04:13.876172+0000","last_undegraded":"2023-11-24T08:04:13.876172+0000","last_fullsized":"2023-11-24T08:04:13.876172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.272910+0000","last_change":"2023-11-24T08:04:12.766658+0000","last_active":"2023-11-24T08:04:14.272910+0000","last_peered":"2023-11-24T08:04:14.272910+0000","last_clean":"2023-11-24T08:04:14.272910+0000","last_became_active":"2023-11-24T08:04:12.765918+0000","last_became_peered":"2023-11-24T08:04:12.765918+0000","last_unstale":"2023-11-24T08:04:14.272910+0000","last_undegraded":"2023-11-24T08:04:14.272910+0000","last_fullsized":"2023-11-24T08:04:14.272910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876569+0000","last_change":"2023-11-24T08:04:12.769707+0000","last_active":"2023-11-24T08:04:13.876569+0000","last_peered":"2023-11-24T08:04:13.876569+0000","last_clean":"2023-11-24T08:04:13.876569+0000","last_became_active":"2023-11-24T08:04:12.767682+0000","last_became_peered":"2023-11-24T08:04:12.767682+0000","last_unstale":"2023-11-24T08:04:13.876569+0000","last_undegraded":"2023-11-24T08:04:13.876569+0000","last_fullsized":"2023-11-24T08:04:13.876569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.914874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367340+0000","last_change":"2023-11-24T08:04:12.765821+0000","last_active":"2023-11-24T08:04:14.367340+0000","last_peered":"2023-11-24T08:04:14.367340+0000","last_clean":"2023-11-24T08:04:14.367340+0000","last_became_active":"2023-11-24T08:04:12.765549+0000","last_became_peered":"2023-11-24T08:04:12.765549+0000","last_unstale":"2023-11-24T08:04:14.367340+0000","last_undegraded":"2023-11-24T08:04:14.367340+0000","last_fullsized":"2023-11-24T08:04:14.367340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367063+0000","last_change":"2023-11-24T08:04:12.765436+0000","last_active":"2023-11-24T08:04:14.367063+0000","last_peered":"2023-11-24T08:04:14.367063+0000","last_clean":"2023-11-24T08:04:14.367063+0000","last_became_active":"2023-11-24T08:04:12.765117+0000","last_became_peered":"2023-11-24T08:04:12.765117+0000","last_unstale":"2023-11-24T08:04:14.367063+0000","last_undegraded":"2023-11-24T08:04:14.367063+0000","last_fullsized":"2023-11-24T08:04:14.367063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768755+0000","last_change":"2023-11-24T08:04:12.753974+0000","last_active":"2023-11-24T08:04:13.768755+0000","last_peered":"2023-11-24T08:04:13.768755+0000","last_clean":"2023-11-24T08:04:13.768755+0000","last_became_active":"2023-11-24T08:04:12.753656+0000","last_became_peered":"2023-11-24T08:04:12.753656+0000","last_unstale":"2023-11-24T08:04:13.768755+0000","last_undegraded":"2023-11-24T08:04:13.768755+0000","last_fullsized":"2023-11-24T08:04:13.768755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:12.285221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273087+0000","last_change":"2023-11-24T08:04:12.764978+0000","last_active":"2023-11-24T08:04:14.273087+0000","last_peered":"2023-11-24T08:04:14.273087+0000","last_clean":"2023-11-24T08:04:14.273087+0000","last_became_active":"2023-11-24T08:04:12.764683+0000","last_became_peered":"2023-11-24T08:04:12.764683+0000","last_unstale":"2023-11-24T08:04:14.273087+0000","last_undegraded":"2023-11-24T08:04:14.273087+0000","last_fullsized":"2023-11-24T08:04:14.273087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366598+0000","last_change":"2023-11-24T08:04:12.759358+0000","last_active":"2023-11-24T08:04:14.366598+0000","last_peered":"2023-11-24T08:04:14.366598+0000","last_clean":"2023-11-24T08:04:14.366598+0000","last_became_active":"2023-11-24T08:04:12.757744+0000","last_became_peered":"2023-11-24T08:04:12.757744+0000","last_unstale":"2023-11-24T08:04:14.366598+0000","last_undegraded":"2023-11-24T08:04:14.366598+0000","last_fullsized":"2023-11-24T08:04:14.366598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:20.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765466+0000","last_change":"2023-11-24T08:04:12.760210+0000","last_active":"2023-11-24T08:04:13.765466+0000","last_peered":"2023-11-24T08:04:13.765466+0000","last_clean":"2023-11-24T08:04:13.765466+0000","last_became_active":"2023-11-24T08:04:12.759781+0000","last_became_peered":"2023-11-24T08:04:12.759781+0000","last_unstale":"2023-11-24T08:04:13.765466+0000","last_undegraded":"2023-11-24T08:04:13.765466+0000","last_fullsized":"2023-11-24T08:04:13.765466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177285+0000","last_change":"2023-11-24T08:04:12.766373+0000","last_active":"2023-11-24T08:04:14.177285+0000","last_peered":"2023-11-24T08:04:14.177285+0000","last_clean":"2023-11-24T08:04:14.177285+0000","last_became_active":"2023-11-24T08:04:12.766108+0000","last_became_peered":"2023-11-24T08:04:12.766108+0000","last_unstale":"2023-11-24T08:04:14.177285+0000","last_undegraded":"2023-11-24T08:04:14.177285+0000","last_fullsized":"2023-11-24T08:04:14.177285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177881+0000","last_change":"2023-11-24T08:04:12.765327+0000","last_active":"2023-11-24T08:04:14.177881+0000","last_peered":"2023-11-24T08:04:14.177881+0000","last_clean":"2023-11-24T08:04:14.177881+0000","last_became_active":"2023-11-24T08:04:12.765017+0000","last_became_peered":"2023-11-24T08:04:12.765017+0000","last_unstale":"2023-11-24T08:04:14.177881+0000","last_undegraded":"2023-11-24T08:04:14.177881+0000","last_fullsized":"2023-11-24T08:04:14.177881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.914874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366457+0000","last_change":"2023-11-24T08:04:12.765919+0000","last_active":"2023-11-24T08:04:14.366457+0000","last_peered":"2023-11-24T08:04:14.366457+0000","last_clean":"2023-11-24T08:04:14.366457+0000","last_became_active":"2023-11-24T08:04:12.765641+0000","last_became_peered":"2023-11-24T08:04:12.765641+0000","last_unstale":"2023-11-24T08:04:14.366457+0000","last_undegraded":"2023-11-24T08:04:14.366457+0000","last_fullsized":"2023-11-24T08:04:14.366457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:58.975401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876303+0000","last_change":"2023-11-24T08:04:12.760146+0000","last_active":"2023-11-24T08:04:13.876303+0000","last_peered":"2023-11-24T08:04:13.876303+0000","last_clean":"2023-11-24T08:04:13.876303+0000","last_became_active":"2023-11-24T08:04:12.759741+0000","last_became_peered":"2023-11-24T08:04:12.759741+0000","last_unstale":"2023-11-24T08:04:13.876303+0000","last_undegraded":"2023-11-24T08:04:13.876303+0000","last_fullsized":"2023-11-24T08:04:13.876303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366921+0000","last_change":"2023-11-24T08:04:11.759390+0000","last_active":"2023-11-24T08:04:14.366921+0000","last_peered":"2023-11-24T08:04:14.366921+0000","last_clean":"2023-11-24T08:04:14.366921+0000","last_became_active":"2023-11-24T08:04:11.759120+0000","last_became_peered":"2023-11-24T08:04:11.759120+0000","last_unstale":"2023-11-24T08:04:14.366921+0000","last_undegraded":"2023-11-24T08:04:14.366921+0000","last_fullsized":"2023-11-24T08:04:14.366921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:05.082044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273176+0000","last_change":"2023-11-24T08:04:12.756765+0000","last_active":"2023-11-24T08:04:14.273176+0000","last_peered":"2023-11-24T08:04:14.273176+0000","last_clean":"2023-11-24T08:04:14.273176+0000","last_became_active":"2023-11-24T08:04:12.756478+0000","last_became_peered":"2023-11-24T08:04:12.756478+0000","last_unstale":"2023-11-24T08:04:14.273176+0000","last_undegraded":"2023-11-24T08:04:14.273176+0000","last_fullsized":"2023-11-24T08:04:14.273176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273275+0000","last_change":"2023-11-24T08:04:11.766651+0000","last_active":"2023-11-24T08:04:14.273275+0000","last_peered":"2023-11-24T08:04:14.273275+0000","last_clean":"2023-11-24T08:04:14.273275+0000","last_became_active":"2023-11-24T08:04:11.766382+0000","last_became_peered":"2023-11-24T08:04:11.766382+0000","last_unstale":"2023-11-24T08:04:14.273275+0000","last_undegraded":"2023-11-24T08:04:14.273275+0000","last_fullsized":"2023-11-24T08:04:14.273275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:08:10.447749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366718+0000","last_change":"2023-11-24T08:04:12.763132+0000","last_active":"2023-11-24T08:04:14.366718+0000","last_peered":"2023-11-24T08:04:14.366718+0000","last_clean":"2023-11-24T08:04:14.366718+0000","last_became_active":"2023-11-24T08:04:12.762841+0000","last_became_peered":"2023-11-24T08:04:12.762841+0000","last_unstale":"2023-11-24T08:04:14.366718+0000","last_undegraded":"2023-11-24T08:04:14.366718+0000","last_fullsized":"2023-11-24T08:04:14.366718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876511+0000","last_change":"2023-11-24T08:04:11.764101+0000","last_active":"2023-11-24T08:04:13.876511+0000","last_peered":"2023-11-24T08:04:13.876511+0000","last_clean":"2023-11-24T08:04:13.876511+0000","last_became_active":"2023-11-24T08:04:11.763785+0000","last_became_peered":"2023-11-24T08:04:11.763785+0000","last_unstale":"2023-11-24T08:04:13.876511+0000","last_undegraded":"2023-11-24T08:04:13.876511+0000","last_fullsized":"2023-11-24T08:04:13.876511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:20.626156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177450+0000","last_change":"2023-11-24T08:04:12.771603+0000","last_active":"2023-11-24T08:04:14.177450+0000","last_peered":"2023-11-24T08:04:14.177450+0000","last_clean":"2023-11-24T08:04:14.177450+0000","last_became_active":"2023-11-24T08:04:12.771221+0000","last_became_peered":"2023-11-24T08:04:12.771221+0000","last_unstale":"2023-11-24T08:04:14.177450+0000","last_undegraded":"2023-11-24T08:04:14.177450+0000","last_fullsized":"2023-11-24T08:04:14.177450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876124+0000","last_change":"2023-11-24T08:04:11.764690+0000","last_active":"2023-11-24T08:04:13.876124+0000","last_peered":"2023-11-24T08:04:13.876124+0000","last_clean":"2023-11-24T08:04:13.876124+0000","last_became_active":"2023-11-24T08:04:11.764316+0000","last_became_peered":"2023-11-24T08:04:11.764316+0000","last_unstale":"2023-11-24T08:04:13.876124+0000","last_undegraded":"2023-11-24T08:04:13.876124+0000","last_fullsized":"2023-11-24T08:04:13.876124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177790+0000","last_change":"2023-11-24T08:04:12.771927+0000","last_active":"2023-11-24T08:04:14.177790+0000","last_peered":"2023-11-24T08:04:14.177790+0000","last_clean":"2023-11-24T08:04:14.177790+0000","last_became_active":"2023-11-24T08:04:12.770523+0000","last_became_peered":"2023-11-24T08:04:12.770523+0000","last_unstale":"2023-11-24T08:04:14.177790+0000","last_undegraded":"2023-11-24T08:04:14.177790+0000","last_fullsized":"2023-11-24T08:04:14.177790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:53:11.480855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273404+0000","last_change":"2023-11-24T08:04:11.764289+0000","last_active":"2023-11-24T08:04:14.273404+0000","last_peered":"2023-11-24T08:04:14.273404+0000","last_clean":"2023-11-24T08:04:14.273404+0000","last_became_active":"2023-11-24T08:04:11.763993+0000","last_became_peered":"2023-11-24T08:04:11.763993+0000","last_unstale":"2023-11-24T08:04:14.273404+0000","last_undegraded":"2023-11-24T08:04:14.273404+0000","last_fullsized":"2023-11-24T08:04:14.273404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:05.082044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768270+0000","last_change":"2023-11-24T08:04:12.759447+0000","last_active":"2023-11-24T08:04:13.768270+0000","last_peered":"2023-11-24T08:04:13.768270+0000","last_clean":"2023-11-24T08:04:13.768270+0000","last_became_active":"2023-11-24T08:04:12.759147+0000","last_became_peered":"2023-11-24T08:04:12.759147+0000","last_unstale":"2023-11-24T08:04:13.768270+0000","last_undegraded":"2023-11-24T08:04:13.768270+0000","last_fullsized":"2023-11-24T08:04:13.768270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:03:32.465127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366918+0000","last_change":"2023-11-24T08:04:11.768035+0000","last_active":"2023-11-24T08:04:14.366918+0000","last_peered":"2023-11-24T08:04:14.366918+0000","last_clean":"2023-11-24T08:04:14.366918+0000","last_became_active":"2023-11-24T08:04:11.767674+0000","last_became_peered":"2023-11-24T08:04:11.767674+0000","last_unstale":"2023-11-24T08:04:14.366918+0000","last_undegraded":"2023-11-24T08:04:14.366918+0000","last_fullsized":"2023-11-24T08:04:14.366918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366939+0000","last_change":"2023-11-24T08:04:12.755036+0000","last_active":"2023-11-24T08:04:14.366939+0000","last_peered":"2023-11-24T08:04:14.366939+0000","last_clean":"2023-11-24T08:04:14.366939+0000","last_became_active":"2023-11-24T08:04:12.754766+0000","last_became_peered":"2023-11-24T08:04:12.754766+0000","last_unstale":"2023-11-24T08:04:14.366939+0000","last_undegraded":"2023-11-24T08:04:14.366939+0000","last_fullsized":"2023-11-24T08:04:14.366939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273015+0000","last_change":"2023-11-24T08:04:11.764114+0000","last_active":"2023-11-24T08:04:14.273015+0000","last_peered":"2023-11-24T08:04:14.273015+0000","last_clean":"2023-11-24T08:04:14.273015+0000","last_became_active":"2023-11-24T08:04:11.763825+0000","last_became_peered":"2023-11-24T08:04:11.763825+0000","last_unstale":"2023-11-24T08:04:14.273015+0000","last_undegraded":"2023-11-24T08:04:14.273015+0000","last_fullsized":"2023-11-24T08:04:14.273015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273198+0000","last_change":"2023-11-24T08:04:12.756326+0000","last_active":"2023-11-24T08:04:14.273198+0000","last_peered":"2023-11-24T08:04:14.273198+0000","last_clean":"2023-11-24T08:04:14.273198+0000","last_became_active":"2023-11-24T08:04:12.755997+0000","last_became_peered":"2023-11-24T08:04:12.755997+0000","last_unstale":"2023-11-24T08:04:14.273198+0000","last_undegraded":"2023-11-24T08:04:14.273198+0000","last_fullsized":"2023-11-24T08:04:14.273198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177300+0000","last_change":"2023-11-24T08:04:11.767935+0000","last_active":"2023-11-24T08:04:14.177300+0000","last_peered":"2023-11-24T08:04:14.177300+0000","last_clean":"2023-11-24T08:04:14.177300+0000","last_became_active":"2023-11-24T08:04:11.767619+0000","last_became_peered":"2023-11-24T08:04:11.767619+0000","last_unstale":"2023-11-24T08:04:14.177300+0000","last_undegraded":"2023-11-24T08:04:14.177300+0000","last_fullsized":"2023-11-24T08:04:14.177300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:54.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765652+0000","last_change":"2023-11-24T08:04:12.760472+0000","last_active":"2023-11-24T08:04:13.765652+0000","last_peered":"2023-11-24T08:04:13.765652+0000","last_clean":"2023-11-24T08:04:13.765652+0000","last_became_active":"2023-11-24T08:04:12.759672+0000","last_became_peered":"2023-11-24T08:04:12.759672+0000","last_unstale":"2023-11-24T08:04:13.765652+0000","last_undegraded":"2023-11-24T08:04:13.765652+0000","last_fullsized":"2023-11-24T08:04:13.765652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367355+0000","last_change":"2023-11-24T08:04:11.763764+0000","last_active":"2023-11-24T08:04:14.367355+0000","last_peered":"2023-11-24T08:04:14.367355+0000","last_clean":"2023-11-24T08:04:14.367355+0000","last_became_active":"2023-11-24T08:04:11.763483+0000","last_became_peered":"2023-11-24T08:04:11.763483+0000","last_unstale":"2023-11-24T08:04:14.367355+0000","last_undegraded":"2023-11-24T08:04:14.367355+0000","last_fullsized":"2023-11-24T08:04:14.367355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177975+0000","last_change":"2023-11-24T08:04:12.761020+0000","last_active":"2023-11-24T08:04:14.177975+0000","last_peered":"2023-11-24T08:04:14.177975+0000","last_clean":"2023-11-24T08:04:14.177975+0000","last_became_active":"2023-11-24T08:04:12.760701+0000","last_became_peered":"2023-11-24T08:04:12.760701+0000","last_unstale":"2023-11-24T08:04:14.177975+0000","last_undegraded":"2023-11-24T08:04:14.177975+0000","last_fullsized":"2023-11-24T08:04:14.177975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:58:32.049664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177726+0000","last_change":"2023-11-24T08:04:11.762776+0000","last_active":"2023-11-24T08:04:14.177726+0000","last_peered":"2023-11-24T08:04:14.177726+0000","last_clean":"2023-11-24T08:04:14.177726+0000","last_became_active":"2023-11-24T08:04:11.762480+0000","last_became_peered":"2023-11-24T08:04:11.762480+0000","last_unstale":"2023-11-24T08:04:14.177726+0000","last_undegraded":"2023-11-24T08:04:14.177726+0000","last_fullsized":"2023-11-24T08:04:14.177726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366882+0000","last_change":"2023-11-24T08:04:12.766040+0000","last_active":"2023-11-24T08:04:14.366882+0000","last_peered":"2023-11-24T08:04:14.366882+0000","last_clean":"2023-11-24T08:04:14.366882+0000","last_became_active":"2023-11-24T08:04:12.765772+0000","last_became_peered":"2023-11-24T08:04:12.765772+0000","last_unstale":"2023-11-24T08:04:14.366882+0000","last_undegraded":"2023-11-24T08:04:14.366882+0000","last_fullsized":"2023-11-24T08:04:14.366882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765732+0000","last_change":"2023-11-24T08:04:11.765479+0000","last_active":"2023-11-24T08:04:13.765732+0000","last_peered":"2023-11-24T08:04:13.765732+0000","last_clean":"2023-11-24T08:04:13.765732+0000","last_became_active":"2023-11-24T08:04:11.765216+0000","last_became_peered":"2023-11-24T08:04:11.765216+0000","last_unstale":"2023-11-24T08:04:13.765732+0000","last_undegraded":"2023-11-24T08:04:13.765732+0000","last_fullsized":"2023-11-24T08:04:13.765732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768676+0000","last_change":"2023-11-24T08:04:12.755487+0000","last_active":"2023-11-24T08:04:13.768676+0000","last_peered":"2023-11-24T08:04:13.768676+0000","last_clean":"2023-11-24T08:04:13.768676+0000","last_became_active":"2023-11-24T08:04:12.755113+0000","last_became_peered":"2023-11-24T08:04:12.755113+0000","last_unstale":"2023-11-24T08:04:13.768676+0000","last_undegraded":"2023-11-24T08:04:13.768676+0000","last_fullsized":"2023-11-24T08:04:13.768676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:58.916630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367128+0000","last_change":"2023-11-24T08:04:11.765679+0000","last_active":"2023-11-24T08:04:14.367128+0000","last_peered":"2023-11-24T08:04:14.367128+0000","last_clean":"2023-11-24T08:04:14.367128+0000","last_became_active":"2023-11-24T08:04:11.764903+0000","last_became_peered":"2023-11-24T08:04:11.764903+0000","last_unstale":"2023-11-24T08:04:14.367128+0000","last_undegraded":"2023-11-24T08:04:14.367128+0000","last_fullsized":"2023-11-24T08:04:14.367128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:46.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876321+0000","last_change":"2023-11-24T08:04:12.761708+0000","last_active":"2023-11-24T08:04:13.876321+0000","last_peered":"2023-11-24T08:04:13.876321+0000","last_clean":"2023-11-24T08:04:13.876321+0000","last_became_active":"2023-11-24T08:04:12.761352+0000","last_became_peered":"2023-11-24T08:04:12.761352+0000","last_unstale":"2023-11-24T08:04:13.876321+0000","last_undegraded":"2023-11-24T08:04:13.876321+0000","last_fullsized":"2023-11-24T08:04:13.876321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:03.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366917+0000","last_change":"2023-11-24T08:04:11.761027+0000","last_active":"2023-11-24T08:04:14.366917+0000","last_peered":"2023-11-24T08:04:14.366917+0000","last_clean":"2023-11-24T08:04:14.366917+0000","last_became_active":"2023-11-24T08:04:11.759840+0000","last_became_peered":"2023-11-24T08:04:11.759840+0000","last_unstale":"2023-11-24T08:04:14.366917+0000","last_undegraded":"2023-11-24T08:04:14.366917+0000","last_fullsized":"2023-11-24T08:04:14.366917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366442+0000","last_change":"2023-11-24T08:04:12.761170+0000","last_active":"2023-11-24T08:04:14.366442+0000","last_peered":"2023-11-24T08:04:14.366442+0000","last_clean":"2023-11-24T08:04:14.366442+0000","last_became_active":"2023-11-24T08:04:12.760886+0000","last_became_peered":"2023-11-24T08:04:12.760886+0000","last_unstale":"2023-11-24T08:04:14.366442+0000","last_undegraded":"2023-11-24T08:04:14.366442+0000","last_fullsized":"2023-11-24T08:04:14.366442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:09.942884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177767+0000","last_change":"2023-11-24T08:04:11.764401+0000","last_active":"2023-11-24T08:04:14.177767+0000","last_peered":"2023-11-24T08:04:14.177767+0000","last_clean":"2023-11-24T08:04:14.177767+0000","last_became_active":"2023-11-24T08:04:11.764134+0000","last_became_peered":"2023-11-24T08:04:11.764134+0000","last_unstale":"2023-11-24T08:04:14.177767+0000","last_undegraded":"2023-11-24T08:04:14.177767+0000","last_fullsized":"2023-11-24T08:04:14.177767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:20.626156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876305+0000","last_change":"2023-11-24T08:04:12.768388+0000","last_active":"2023-11-24T08:04:13.876305+0000","last_peered":"2023-11-24T08:04:13.876305+0000","last_clean":"2023-11-24T08:04:13.876305+0000","last_became_active":"2023-11-24T08:04:12.768067+0000","last_became_peered":"2023-11-24T08:04:12.768067+0000","last_unstale":"2023-11-24T08:04:13.876305+0000","last_undegraded":"2023-11-24T08:04:13.876305+0000","last_fullsized":"2023-11-24T08:04:13.876305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366915+0000","last_change":"2023-11-24T08:04:11.755395+0000","last_active":"2023-11-24T08:04:14.366915+0000","last_peered":"2023-11-24T08:04:14.366915+0000","last_clean":"2023-11-24T08:04:14.366915+0000","last_became_active":"2023-11-24T08:04:11.755135+0000","last_became_peered":"2023-11-24T08:04:11.755135+0000","last_unstale":"2023-11-24T08:04:14.366915+0000","last_undegraded":"2023-11-24T08:04:14.366915+0000","last_fullsized":"2023-11-24T08:04:14.366915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366928+0000","last_change":"2023-11-24T08:04:12.756222+0000","last_active":"2023-11-24T08:04:14.366928+0000","last_peered":"2023-11-24T08:04:14.366928+0000","last_clean":"2023-11-24T08:04:14.366928+0000","last_became_active":"2023-11-24T08:04:12.755930+0000","last_became_peered":"2023-11-24T08:04:12.755930+0000","last_unstale":"2023-11-24T08:04:14.366928+0000","last_undegraded":"2023-11-24T08:04:14.366928+0000","last_fullsized":"2023-11-24T08:04:14.366928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:20.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366287+0000","last_change":"2023-11-24T08:04:11.760945+0000","last_active":"2023-11-24T08:04:14.366287+0000","last_peered":"2023-11-24T08:04:14.366287+0000","last_clean":"2023-11-24T08:04:14.366287+0000","last_became_active":"2023-11-24T08:04:11.760661+0000","last_became_peered":"2023-11-24T08:04:11.760661+0000","last_unstale":"2023-11-24T08:04:14.366287+0000","last_undegraded":"2023-11-24T08:04:14.366287+0000","last_fullsized":"2023-11-24T08:04:14.366287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876042+0000","last_change":"2023-11-24T08:04:12.762670+0000","last_active":"2023-11-24T08:04:13.876042+0000","last_peered":"2023-11-24T08:04:13.876042+0000","last_clean":"2023-11-24T08:04:13.876042+0000","last_became_active":"2023-11-24T08:04:12.762385+0000","last_became_peered":"2023-11-24T08:04:12.762385+0000","last_unstale":"2023-11-24T08:04:13.876042+0000","last_undegraded":"2023-11-24T08:04:13.876042+0000","last_fullsized":"2023-11-24T08:04:13.876042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768772+0000","last_change":"2023-11-24T08:04:11.765361+0000","last_active":"2023-11-24T08:04:13.768772+0000","last_peered":"2023-11-24T08:04:13.768772+0000","last_clean":"2023-11-24T08:04:13.768772+0000","last_became_active":"2023-11-24T08:04:11.760138+0000","last_became_peered":"2023-11-24T08:04:11.760138+0000","last_unstale":"2023-11-24T08:04:13.768772+0000","last_undegraded":"2023-11-24T08:04:13.768772+0000","last_fullsized":"2023-11-24T08:04:13.768772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:59:09.945020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876616+0000","last_change":"2023-11-24T08:04:12.770971+0000","last_active":"2023-11-24T08:04:13.876616+0000","last_peered":"2023-11-24T08:04:13.876616+0000","last_clean":"2023-11-24T08:04:13.876616+0000","last_became_active":"2023-11-24T08:04:12.768881+0000","last_became_peered":"2023-11-24T08:04:12.768881+0000","last_unstale":"2023-11-24T08:04:13.876616+0000","last_undegraded":"2023-11-24T08:04:13.876616+0000","last_fullsized":"2023-11-24T08:04:13.876616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:58:32.049664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765677+0000","last_change":"2023-11-24T08:04:11.758492+0000","last_active":"2023-11-24T08:04:13.765677+0000","last_peered":"2023-11-24T08:04:13.765677+0000","last_clean":"2023-11-24T08:04:13.765677+0000","last_became_active":"2023-11-24T08:04:11.758227+0000","last_became_peered":"2023-11-24T08:04:11.758227+0000","last_unstale":"2023-11-24T08:04:13.765677+0000","last_undegraded":"2023-11-24T08:04:13.765677+0000","last_fullsized":"2023-11-24T08:04:13.765677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177844+0000","last_change":"2023-11-24T08:04:12.762628+0000","last_active":"2023-11-24T08:04:14.177844+0000","last_peered":"2023-11-24T08:04:14.177844+0000","last_clean":"2023-11-24T08:04:14.177844+0000","last_became_active":"2023-11-24T08:04:12.762342+0000","last_became_peered":"2023-11-24T08:04:12.762342+0000","last_unstale":"2023-11-24T08:04:14.177844+0000","last_undegraded":"2023-11-24T08:04:14.177844+0000","last_fullsized":"2023-11-24T08:04:14.177844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:02.788396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177560+0000","last_change":"2023-11-24T08:04:11.763677+0000","last_active":"2023-11-24T08:04:14.177560+0000","last_peered":"2023-11-24T08:04:14.177560+0000","last_clean":"2023-11-24T08:04:14.177560+0000","last_became_active":"2023-11-24T08:04:11.763410+0000","last_became_peered":"2023-11-24T08:04:11.763410+0000","last_unstale":"2023-11-24T08:04:14.177560+0000","last_undegraded":"2023-11-24T08:04:14.177560+0000","last_fullsized":"2023-11-24T08:04:14.177560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:06.394632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768313+0000","last_change":"2023-11-24T08:04:12.758637+0000","last_active":"2023-11-24T08:04:13.768313+0000","last_peered":"2023-11-24T08:04:13.768313+0000","last_clean":"2023-11-24T08:04:13.768313+0000","last_became_active":"2023-11-24T08:04:12.758149+0000","last_became_peered":"2023-11-24T08:04:12.758149+0000","last_unstale":"2023-11-24T08:04:13.768313+0000","last_undegraded":"2023-11-24T08:04:13.768313+0000","last_fullsized":"2023-11-24T08:04:13.768313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:23.086508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765399+0000","last_change":"2023-11-24T08:04:12.762936+0000","last_active":"2023-11-24T08:04:13.765399+0000","last_peered":"2023-11-24T08:04:13.765399+0000","last_clean":"2023-11-24T08:04:13.765399+0000","last_became_active":"2023-11-24T08:04:12.758492+0000","last_became_peered":"2023-11-24T08:04:12.758492+0000","last_unstale":"2023-11-24T08:04:13.765399+0000","last_undegraded":"2023-11-24T08:04:13.765399+0000","last_fullsized":"2023-11-24T08:04:13.765399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366780+0000","last_change":"2023-11-24T08:04:11.764139+0000","last_active":"2023-11-24T08:04:14.366780+0000","last_peered":"2023-11-24T08:04:14.366780+0000","last_clean":"2023-11-24T08:04:14.366780+0000","last_became_active":"2023-11-24T08:04:11.763864+0000","last_became_peered":"2023-11-24T08:04:11.763864+0000","last_unstale":"2023-11-24T08:04:14.366780+0000","last_undegraded":"2023-11-24T08:04:14.366780+0000","last_fullsized":"2023-11-24T08:04:14.366780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:22.082092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273173+0000","last_change":"2023-11-24T08:04:12.774072+0000","last_active":"2023-11-24T08:04:14.273173+0000","last_peered":"2023-11-24T08:04:14.273173+0000","last_clean":"2023-11-24T08:04:14.273173+0000","last_became_active":"2023-11-24T08:04:12.773801+0000","last_became_peered":"2023-11-24T08:04:12.773801+0000","last_unstale":"2023-11-24T08:04:14.273173+0000","last_undegraded":"2023-11-24T08:04:14.273173+0000","last_fullsized":"2023-11-24T08:04:14.273173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177347+0000","last_change":"2023-11-24T08:04:11.762293+0000","last_active":"2023-11-24T08:04:14.177347+0000","last_peered":"2023-11-24T08:04:14.177347+0000","last_clean":"2023-11-24T08:04:14.177347+0000","last_became_active":"2023-11-24T08:04:11.762010+0000","last_became_peered":"2023-11-24T08:04:11.762010+0000","last_unstale":"2023-11-24T08:04:14.177347+0000","last_undegraded":"2023-11-24T08:04:14.177347+0000","last_fullsized":"2023-11-24T08:04:14.177347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:14.105245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T08:04:12.749389+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:04:12.749389+0000","last_peered":"2023-11-24T08:04:12.749389+0000","last_clean":"2023-11-24T08:04:12.749389+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:04:12.749389+0000","last_undegraded":"2023-11-24T08:04:12.749389+0000","last_fullsized":"2023-11-24T08:04:12.749389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366595+0000","last_change":"2023-11-24T08:04:12.755042+0000","last_active":"2023-11-24T08:04:14.366595+0000","last_peered":"2023-11-24T08:04:14.366595+0000","last_clean":"2023-11-24T08:04:14.366595+0000","last_became_active":"2023-11-24T08:04:12.754746+0000","last_became_peered":"2023-11-24T08:04:12.754746+0000","last_unstale":"2023-11-24T08:04:14.366595+0000","last_undegraded":"2023-11-24T08:04:14.366595+0000","last_fullsized":"2023-11-24T08:04:14.366595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:15.109662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.875943+0000","last_change":"2023-11-24T08:04:11.760961+0000","last_active":"2023-11-24T08:04:13.875943+0000","last_peered":"2023-11-24T08:04:13.875943+0000","last_clean":"2023-11-24T08:04:13.875943+0000","last_became_active":"2023-11-24T08:04:11.760601+0000","last_became_peered":"2023-11-24T08:04:11.760601+0000","last_unstale":"2023-11-24T08:04:13.875943+0000","last_undegraded":"2023-11-24T08:04:13.875943+0000","last_fullsized":"2023-11-24T08:04:13.875943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876405+0000","last_change":"2023-11-24T08:04:11.755227+0000","last_active":"2023-11-24T08:04:13.876405+0000","last_peered":"2023-11-24T08:04:13.876405+0000","last_clean":"2023-11-24T08:04:13.876405+0000","last_became_active":"2023-11-24T08:04:11.754941+0000","last_became_peered":"2023-11-24T08:04:11.754941+0000","last_unstale":"2023-11-24T08:04:13.876405+0000","last_undegraded":"2023-11-24T08:04:13.876405+0000","last_fullsized":"2023-11-24T08:04:13.876405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:42.565319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765594+0000","last_change":"2023-11-24T08:04:12.758793+0000","last_active":"2023-11-24T08:04:13.765594+0000","last_peered":"2023-11-24T08:04:13.765594+0000","last_clean":"2023-11-24T08:04:13.765594+0000","last_became_active":"2023-11-24T08:04:12.758047+0000","last_became_peered":"2023-11-24T08:04:12.758047+0000","last_unstale":"2023-11-24T08:04:13.765594+0000","last_undegraded":"2023-11-24T08:04:13.765594+0000","last_fullsized":"2023-11-24T08:04:13.765594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765668+0000","last_change":"2023-11-24T08:04:11.762149+0000","last_active":"2023-11-24T08:04:13.765668+0000","last_peered":"2023-11-24T08:04:13.765668+0000","last_clean":"2023-11-24T08:04:13.765668+0000","last_became_active":"2023-11-24T08:04:11.761849+0000","last_became_peered":"2023-11-24T08:04:11.761849+0000","last_unstale":"2023-11-24T08:04:13.765668+0000","last_undegraded":"2023-11-24T08:04:13.765668+0000","last_fullsized":"2023-11-24T08:04:13.765668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273373+0000","last_change":"2023-11-24T08:04:12.762149+0000","last_active":"2023-11-24T08:04:14.273373+0000","last_peered":"2023-11-24T08:04:14.273373+0000","last_clean":"2023-11-24T08:04:14.273373+0000","last_became_active":"2023-11-24T08:04:12.761859+0000","last_became_peered":"2023-11-24T08:04:12.761859+0000","last_unstale":"2023-11-24T08:04:14.273373+0000","last_undegraded":"2023-11-24T08:04:14.273373+0000","last_fullsized":"2023-11-24T08:04:14.273373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367333+0000","last_change":"2023-11-24T08:04:11.763616+0000","last_active":"2023-11-24T08:04:14.367333+0000","last_peered":"2023-11-24T08:04:14.367333+0000","last_clean":"2023-11-24T08:04:14.367333+0000","last_became_active":"2023-11-24T08:04:11.763330+0000","last_became_peered":"2023-11-24T08:04:11.763330+0000","last_unstale":"2023-11-24T08:04:14.367333+0000","last_undegraded":"2023-11-24T08:04:14.367333+0000","last_fullsized":"2023-11-24T08:04:14.367333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:52:58.082140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366794+0000","last_change":"2023-11-24T08:04:12.754815+0000","last_active":"2023-11-24T08:04:14.366794+0000","last_peered":"2023-11-24T08:04:14.366794+0000","last_clean":"2023-11-24T08:04:14.366794+0000","last_became_active":"2023-11-24T08:04:12.754517+0000","last_became_peered":"2023-11-24T08:04:12.754517+0000","last_unstale":"2023-11-24T08:04:14.366794+0000","last_undegraded":"2023-11-24T08:04:14.366794+0000","last_fullsized":"2023-11-24T08:04:14.366794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.875829+0000","last_change":"2023-11-24T08:04:11.759058+0000","last_active":"2023-11-24T08:04:13.875829+0000","last_peered":"2023-11-24T08:04:13.875829+0000","last_clean":"2023-11-24T08:04:13.875829+0000","last_became_active":"2023-11-24T08:04:11.758773+0000","last_became_peered":"2023-11-24T08:04:11.758773+0000","last_unstale":"2023-11-24T08:04:13.875829+0000","last_undegraded":"2023-11-24T08:04:13.875829+0000","last_fullsized":"2023-11-24T08:04:13.875829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:22.082092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768472+0000","last_change":"2023-11-24T08:04:12.759647+0000","last_active":"2023-11-24T08:04:13.768472+0000","last_peered":"2023-11-24T08:04:13.768472+0000","last_clean":"2023-11-24T08:04:13.768472+0000","last_became_active":"2023-11-24T08:04:12.758979+0000","last_became_peered":"2023-11-24T08:04:12.758979+0000","last_unstale":"2023-11-24T08:04:13.768472+0000","last_undegraded":"2023-11-24T08:04:13.768472+0000","last_fullsized":"2023-11-24T08:04:13.768472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:24.233200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765561+0000","last_change":"2023-11-24T08:04:11.752414+0000","last_active":"2023-11-24T08:04:13.765561+0000","last_peered":"2023-11-24T08:04:13.765561+0000","last_clean":"2023-11-24T08:04:13.765561+0000","last_became_active":"2023-11-24T08:04:11.752132+0000","last_became_peered":"2023-11-24T08:04:11.752132+0000","last_unstale":"2023-11-24T08:04:13.765561+0000","last_undegraded":"2023-11-24T08:04:13.765561+0000","last_fullsized":"2023-11-24T08:04:13.765561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:08.938467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273028+0000","last_change":"2023-11-24T08:04:12.760154+0000","last_active":"2023-11-24T08:04:14.273028+0000","last_peered":"2023-11-24T08:04:14.273028+0000","last_clean":"2023-11-24T08:04:14.273028+0000","last_became_active":"2023-11-24T08:04:12.759870+0000","last_became_peered":"2023-11-24T08:04:12.759870+0000","last_unstale":"2023-11-24T08:04:14.273028+0000","last_undegraded":"2023-11-24T08:04:14.273028+0000","last_fullsized":"2023-11-24T08:04:14.273028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765767+0000","last_change":"2023-11-24T08:04:11.763991+0000","last_active":"2023-11-24T08:04:13.765767+0000","last_peered":"2023-11-24T08:04:13.765767+0000","last_clean":"2023-11-24T08:04:13.765767+0000","last_became_active":"2023-11-24T08:04:11.763720+0000","last_became_peered":"2023-11-24T08:04:11.763720+0000","last_unstale":"2023-11-24T08:04:13.765767+0000","last_undegraded":"2023-11-24T08:04:13.765767+0000","last_fullsized":"2023-11-24T08:04:13.765767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273371+0000","last_change":"2023-11-24T08:04:12.759529+0000","last_active":"2023-11-24T08:04:14.273371+0000","last_peered":"2023-11-24T08:04:14.273371+0000","last_clean":"2023-11-24T08:04:14.273371+0000","last_became_active":"2023-11-24T08:04:12.758748+0000","last_became_peered":"2023-11-24T08:04:12.758748+0000","last_unstale":"2023-11-24T08:04:14.273371+0000","last_undegraded":"2023-11-24T08:04:14.273371+0000","last_fullsized":"2023-11-24T08:04:14.273371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876108+0000","last_change":"2023-11-24T08:04:11.760060+0000","last_active":"2023-11-24T08:04:13.876108+0000","last_peered":"2023-11-24T08:04:13.876108+0000","last_clean":"2023-11-24T08:04:13.876108+0000","last_became_active":"2023-11-24T08:04:11.759649+0000","last_became_peered":"2023-11-24T08:04:11.759649+0000","last_unstale":"2023-11-24T08:04:13.876108+0000","last_undegraded":"2023-11-24T08:04:13.876108+0000","last_fullsized":"2023-11-24T08:04:13.876108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367073+0000","last_change":"2023-11-24T08:04:12.754189+0000","last_active":"2023-11-24T08:04:14.367073+0000","last_peered":"2023-11-24T08:04:14.367073+0000","last_clean":"2023-11-24T08:04:14.367073+0000","last_became_active":"2023-11-24T08:04:12.753907+0000","last_became_peered":"2023-11-24T08:04:12.753907+0000","last_unstale":"2023-11-24T08:04:14.367073+0000","last_undegraded":"2023-11-24T08:04:14.367073+0000","last_fullsized":"2023-11-24T08:04:14.367073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366634+0000","last_change":"2023-11-24T08:04:11.762544+0000","last_active":"2023-11-24T08:04:14.366634+0000","last_peered":"2023-11-24T08:04:14.366634+0000","last_clean":"2023-11-24T08:04:14.366634+0000","last_became_active":"2023-11-24T08:04:11.762250+0000","last_became_peered":"2023-11-24T08:04:11.762250+0000","last_unstale":"2023-11-24T08:04:14.366634+0000","last_undegraded":"2023-11-24T08:04:14.366634+0000","last_fullsized":"2023-11-24T08:04:14.366634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:46.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876467+0000","last_change":"2023-11-24T08:04:12.765834+0000","last_active":"2023-11-24T08:04:13.876467+0000","last_peered":"2023-11-24T08:04:13.876467+0000","last_clean":"2023-11-24T08:04:13.876467+0000","last_became_active":"2023-11-24T08:04:12.765570+0000","last_became_peered":"2023-11-24T08:04:12.765570+0000","last_unstale":"2023-11-24T08:04:13.876467+0000","last_undegraded":"2023-11-24T08:04:13.876467+0000","last_fullsized":"2023-11-24T08:04:13.876467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:53:11.480855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765690+0000","last_change":"2023-11-24T08:04:11.755014+0000","last_active":"2023-11-24T08:04:13.765690+0000","last_peered":"2023-11-24T08:04:13.765690+0000","last_clean":"2023-11-24T08:04:13.765690+0000","last_became_active":"2023-11-24T08:04:11.754748+0000","last_became_peered":"2023-11-24T08:04:11.754748+0000","last_unstale":"2023-11-24T08:04:13.765690+0000","last_undegraded":"2023-11-24T08:04:13.765690+0000","last_fullsized":"2023-11-24T08:04:13.765690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177569+0000","last_change":"2023-11-24T08:04:12.771453+0000","last_active":"2023-11-24T08:04:14.177569+0000","last_peered":"2023-11-24T08:04:14.177569+0000","last_clean":"2023-11-24T08:04:14.177569+0000","last_became_active":"2023-11-24T08:04:12.770894+0000","last_became_peered":"2023-11-24T08:04:12.770894+0000","last_unstale":"2023-11-24T08:04:14.177569+0000","last_undegraded":"2023-11-24T08:04:14.177569+0000","last_fullsized":"2023-11-24T08:04:14.177569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:03.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366534+0000","last_change":"2023-11-24T08:04:11.764045+0000","last_active":"2023-11-24T08:04:14.366534+0000","last_peered":"2023-11-24T08:04:14.366534+0000","last_clean":"2023-11-24T08:04:14.366534+0000","last_became_active":"2023-11-24T08:04:11.763769+0000","last_became_peered":"2023-11-24T08:04:11.763769+0000","last_unstale":"2023-11-24T08:04:14.366534+0000","last_undegraded":"2023-11-24T08:04:14.366534+0000","last_fullsized":"2023-11-24T08:04:14.366534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:57.912213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876406+0000","last_change":"2023-11-24T08:04:12.769943+0000","last_active":"2023-11-24T08:04:13.876406+0000","last_peered":"2023-11-24T08:04:13.876406+0000","last_clean":"2023-11-24T08:04:13.876406+0000","last_became_active":"2023-11-24T08:04:12.768782+0000","last_became_peered":"2023-11-24T08:04:12.768782+0000","last_unstale":"2023-11-24T08:04:13.876406+0000","last_undegraded":"2023-11-24T08:04:13.876406+0000","last_fullsized":"2023-11-24T08:04:13.876406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:26.559888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366930+0000","last_change":"2023-11-24T08:04:12.756131+0000","last_active":"2023-11-24T08:04:14.366930+0000","last_peered":"2023-11-24T08:04:14.366930+0000","last_clean":"2023-11-24T08:04:14.366930+0000","last_became_active":"2023-11-24T08:04:12.755871+0000","last_became_peered":"2023-11-24T08:04:12.755871+0000","last_unstale":"2023-11-24T08:04:14.366930+0000","last_undegraded":"2023-11-24T08:04:14.366930+0000","last_fullsized":"2023-11-24T08:04:14.366930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:15.109662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366678+0000","last_change":"2023-11-24T08:04:12.763889+0000","last_active":"2023-11-24T08:04:14.366678+0000","last_peered":"2023-11-24T08:04:14.366678+0000","last_clean":"2023-11-24T08:04:14.366678+0000","last_became_active":"2023-11-24T08:04:12.763582+0000","last_became_peered":"2023-11-24T08:04:12.763582+0000","last_unstale":"2023-11-24T08:04:14.366678+0000","last_undegraded":"2023-11-24T08:04:14.366678+0000","last_fullsized":"2023-11-24T08:04:14.366678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:08:11.452166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177507+0000","last_change":"2023-11-24T08:04:12.773095+0000","last_active":"2023-11-24T08:04:14.177507+0000","last_peered":"2023-11-24T08:04:14.177507+0000","last_clean":"2023-11-24T08:04:14.177507+0000","last_became_active":"2023-11-24T08:04:12.772811+0000","last_became_peered":"2023-11-24T08:04:12.772811+0000","last_unstale":"2023-11-24T08:04:14.177507+0000","last_undegraded":"2023-11-24T08:04:14.177507+0000","last_fullsized":"2023-11-24T08:04:14.177507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366824+0000","last_change":"2023-11-24T08:04:12.760168+0000","last_active":"2023-11-24T08:04:14.366824+0000","last_peered":"2023-11-24T08:04:14.366824+0000","last_clean":"2023-11-24T08:04:14.366824+0000","last_became_active":"2023-11-24T08:04:12.759868+0000","last_became_peered":"2023-11-24T08:04:12.759868+0000","last_unstale":"2023-11-24T08:04:14.366824+0000","last_undegraded":"2023-11-24T08:04:14.366824+0000","last_fullsized":"2023-11-24T08:04:14.366824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273253+0000","last_change":"2023-11-24T08:04:12.756627+0000","last_active":"2023-11-24T08:04:14.273253+0000","last_peered":"2023-11-24T08:04:14.273253+0000","last_clean":"2023-11-24T08:04:14.273253+0000","last_became_active":"2023-11-24T08:04:12.756360+0000","last_became_peered":"2023-11-24T08:04:12.756360+0000","last_unstale":"2023-11-24T08:04:14.273253+0000","last_undegraded":"2023-11-24T08:04:14.273253+0000","last_fullsized":"2023-11-24T08:04:14.273253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765638+0000","last_change":"2023-11-24T08:04:12.759234+0000","last_active":"2023-11-24T08:04:13.765638+0000","last_peered":"2023-11-24T08:04:13.765638+0000","last_clean":"2023-11-24T08:04:13.765638+0000","last_became_active":"2023-11-24T08:04:12.758458+0000","last_became_peered":"2023-11-24T08:04:12.758458+0000","last_unstale":"2023-11-24T08:04:13.765638+0000","last_undegraded":"2023-11-24T08:04:13.765638+0000","last_fullsized":"2023-11-24T08:04:13.765638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367321+0000","last_change":"2023-11-24T08:04:12.755695+0000","last_active":"2023-11-24T08:04:14.367321+0000","last_peered":"2023-11-24T08:04:14.367321+0000","last_clean":"2023-11-24T08:04:14.367321+0000","last_became_active":"2023-11-24T08:04:12.755415+0000","last_became_peered":"2023-11-24T08:04:12.755415+0000","last_unstale":"2023-11-24T08:04:14.367321+0000","last_undegraded":"2023-11-24T08:04:14.367321+0000","last_fullsized":"2023-11-24T08:04:14.367321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273363+0000","last_change":"2023-11-24T08:04:12.761355+0000","last_active":"2023-11-24T08:04:14.273363+0000","last_peered":"2023-11-24T08:04:14.273363+0000","last_clean":"2023-11-24T08:04:14.273363+0000","last_became_active":"2023-11-24T08:04:12.761068+0000","last_became_peered":"2023-11-24T08:04:12.761068+0000","last_unstale":"2023-11-24T08:04:14.273363+0000","last_undegraded":"2023-11-24T08:04:14.273363+0000","last_fullsized":"2023-11-24T08:04:14.273363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177495+0000","last_change":"2023-11-24T08:04:12.764876+0000","last_active":"2023-11-24T08:04:14.177495+0000","last_peered":"2023-11-24T08:04:14.177495+0000","last_clean":"2023-11-24T08:04:14.177495+0000","last_became_active":"2023-11-24T08:04:12.764548+0000","last_became_peered":"2023-11-24T08:04:12.764548+0000","last_unstale":"2023-11-24T08:04:14.177495+0000","last_undegraded":"2023-11-24T08:04:14.177495+0000","last_fullsized":"2023-11-24T08:04:14.177495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.272974+0000","last_change":"2023-11-24T08:04:12.761400+0000","last_active":"2023-11-24T08:04:14.272974+0000","last_peered":"2023-11-24T08:04:14.272974+0000","last_clean":"2023-11-24T08:04:14.272974+0000","last_became_active":"2023-11-24T08:04:12.761102+0000","last_became_peered":"2023-11-24T08:04:12.761102+0000","last_unstale":"2023-11-24T08:04:14.272974+0000","last_undegraded":"2023-11-24T08:04:14.272974+0000","last_fullsized":"2023-11-24T08:04:14.272974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177430+0000","last_change":"2023-11-24T08:04:12.773448+0000","last_active":"2023-11-24T08:04:14.177430+0000","last_peered":"2023-11-24T08:04:14.177430+0000","last_clean":"2023-11-24T08:04:14.177430+0000","last_became_active":"2023-11-24T08:04:12.773121+0000","last_became_peered":"2023-11-24T08:04:12.773121+0000","last_unstale":"2023-11-24T08:04:14.177430+0000","last_undegraded":"2023-11-24T08:04:14.177430+0000","last_fullsized":"2023-11-24T08:04:14.177430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366803+0000","last_change":"2023-11-24T08:04:12.762494+0000","last_active":"2023-11-24T08:04:14.366803+0000","last_peered":"2023-11-24T08:04:14.366803+0000","last_clean":"2023-11-24T08:04:14.366803+0000","last_became_active":"2023-11-24T08:04:12.762095+0000","last_became_peered":"2023-11-24T08:04:12.762095+0000","last_unstale":"2023-11-24T08:04:14.366803+0000","last_undegraded":"2023-11-24T08:04:14.366803+0000","last_fullsized":"2023-11-24T08:04:14.366803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367122+0000","last_change":"2023-11-24T08:04:12.754219+0000","last_active":"2023-11-24T08:04:14.367122+0000","last_peered":"2023-11-24T08:04:14.367122+0000","last_clean":"2023-11-24T08:04:14.367122+0000","last_became_active":"2023-11-24T08:04:12.753940+0000","last_became_peered":"2023-11-24T08:04:12.753940+0000","last_unstale":"2023-11-24T08:04:14.367122+0000","last_undegraded":"2023-11-24T08:04:14.367122+0000","last_fullsized":"2023-11-24T08:04:14.367122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:04:16.870 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:04:17.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.023+0000 7f1dd4913700 1 Processor -- start 2023-11-24T08:04:17.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.023+0000 7f1dd4913700 1 -- start start 2023-11-24T08:04:17.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.024+0000 7f1dd4913700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1dd015bdd0 0x7f1dd01604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.024+0000 7f1dd4913700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1dd00d1c70 0x7f1dd00d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.024+0000 7f1dd4913700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd00b22d0 con 0x7f1dd00b3370 2023-11-24T08:04:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.024+0000 7f1dd4913700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00b2f50 con 0x7f1dd00d1c70 2023-11-24T08:04:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.024+0000 7f1dd4913700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00d2640 con 0x7f1dd015bdd0 2023-11-24T08:04:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.024+0000 7f1dced9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1dd00d1c70 0x7f1dd00d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.024+0000 7f1dced9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1dd00d1c70 0x7f1dd00d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35414/0 (socket says 172.21.15.153:35414) 2023-11-24T08:04:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.024+0000 7f1dced9d700 1 -- 172.21.15.153:0/2683238562 learned_addr learned my addr 172.21.15.153:0/2683238562 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.024+0000 7f1dce59c700 1 --2- 172.21.15.153:0/2683238562 >> v2:172.21.15.164:3300/0 conn(0x7f1dd015bdd0 0x7f1dd01604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dced9d700 1 -- 172.21.15.153:0/2683238562 >> v2:172.21.15.164:3300/0 conn(0x7f1dd015bdd0 msgr2=0x7f1dd01604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dced9d700 1 --2- 172.21.15.153:0/2683238562 >> v2:172.21.15.164:3300/0 conn(0x7f1dd015bdd0 0x7f1dd01604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dced9d700 1 -- 172.21.15.153:0/2683238562 >> v1:172.21.15.164:6789/0 conn(0x7f1dd00b3370 legacy=0x7f1dd00b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:17.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dced9d700 1 -- 172.21.15.153:0/2683238562 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00b25b0 con 0x7f1dd00d1c70 2023-11-24T08:04:17.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dce59c700 1 --2- 172.21.15.153:0/2683238562 >> v2:172.21.15.164:3300/0 conn(0x7f1dd015bdd0 0x7f1dd01604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:17.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dced9d700 1 --2- 172.21.15.153:0/2683238562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dd00d1c70 0x7f1dd00d2100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1dd006ec10 tx=0x7f1dc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130e01a52ce43de4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:17.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dcd59a700 1 -- 172.21.15.153:0/2683238562 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800e070 con 0x7f1dd00d1c70 2023-11-24T08:04:17.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dcd59a700 1 -- 172.21.15.153:0/2683238562 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc8003a20 con 0x7f1dd00d1c70 2023-11-24T08:04:17.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dcd59a700 1 -- 172.21.15.153:0/2683238562 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8003dd0 con 0x7f1dd00d1c70 2023-11-24T08:04:17.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dd4913700 1 -- 172.21.15.153:0/2683238562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dd00d1c70 msgr2=0x7f1dd00d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dd4913700 1 --2- 172.21.15.153:0/2683238562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dd00d1c70 0x7f1dd00d2100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1dd006ec10 tx=0x7f1dc800b330 comp rx=0 tx=0).stop 2023-11-24T08:04:17.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dd4913700 1 -- 172.21.15.153:0/2683238562 shutdown_connections 2023-11-24T08:04:17.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dd4913700 1 --2- 172.21.15.153:0/2683238562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dd00d1c70 0x7f1dd00d2100 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dd4913700 1 --2- 172.21.15.153:0/2683238562 >> v2:172.21.15.164:3300/0 conn(0x7f1dd015bdd0 0x7f1dd01604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dd4913700 1 -- 172.21.15.153:0/2683238562 >> 172.21.15.153:0/2683238562 conn(0x7f1dd00731a0 msgr2=0x7f1dd009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:17.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dd4913700 1 -- 172.21.15.153:0/2683238562 shutdown_connections 2023-11-24T08:04:17.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.025+0000 7f1dd4913700 1 -- 172.21.15.153:0/2683238562 wait complete. 2023-11-24T08:04:17.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.027+0000 7f1dd4913700 1 Processor -- start 2023-11-24T08:04:17.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.027+0000 7f1dd4913700 1 -- start start 2023-11-24T08:04:17.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.027+0000 7f1dd4913700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1dd00b3370 0x7f1dd0156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dd4913700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dd00d1c70 0x7f1dd00ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dd4913700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dd015bdd0 0x7f1dd01568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dd4913700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00ca8c0 con 0x7f1dd015bdd0 2023-11-24T08:04:17.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dd4913700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00caad0 con 0x7f1dd00d1c70 2023-11-24T08:04:17.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dd4913700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00cadb0 con 0x7f1dd00b3370 2023-11-24T08:04:17.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dced9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dd015bdd0 0x7f1dd01568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dced9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dd015bdd0 0x7f1dd01568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35420/0 (socket says 172.21.15.153:35420) 2023-11-24T08:04:17.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dced9d700 1 -- 172.21.15.153:0/2716933780 learned_addr learned my addr 172.21.15.153:0/2716933780 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:17.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dcdd9b700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dd00d1c70 0x7f1dd00ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dce59c700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1dd00b3370 0x7f1dd0156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dced9d700 1 -- 172.21.15.153:0/2716933780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1dd00b3370 msgr2=0x7f1dd0156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dced9d700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1dd00b3370 0x7f1dd0156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dced9d700 1 -- 172.21.15.153:0/2716933780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dd00d1c70 msgr2=0x7f1dd00ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dced9d700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dd00d1c70 0x7f1dd00ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dced9d700 1 -- 172.21.15.153:0/2716933780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8009b30 con 0x7f1dd015bdd0 2023-11-24T08:04:17.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dced9d700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dd015bdd0 0x7f1dd01568a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8015040 tx=0x7f1dc8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:17.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dbeffd700 1 -- 172.21.15.153:0/2716933780 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8004440 con 0x7f1dd015bdd0 2023-11-24T08:04:17.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dbeffd700 1 -- 172.21.15.153:0/2716933780 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc80045c0 con 0x7f1dd015bdd0 2023-11-24T08:04:17.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dd4913700 1 -- 172.21.15.153:0/2716933780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd00cb090 con 0x7f1dd015bdd0 2023-11-24T08:04:17.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dbeffd700 1 -- 172.21.15.153:0/2716933780 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8004970 con 0x7f1dd015bdd0 2023-11-24T08:04:17.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.028+0000 7f1dd4913700 1 -- 172.21.15.153:0/2716933780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd01575e0 con 0x7f1dd015bdd0 2023-11-24T08:04:17.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.029+0000 7f1dd4913700 1 -- 172.21.15.153:0/2716933780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd00cac10 con 0x7f1dd015bdd0 2023-11-24T08:04:17.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.030+0000 7f1dbeffd700 1 -- 172.21.15.153:0/2716933780 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dc8012430 con 0x7f1dd015bdd0 2023-11-24T08:04:17.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.030+0000 7f1dbeffd700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1db006aed0 0x7f1db006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.030+0000 7f1dbeffd700 1 -- 172.21.15.153:0/2716933780 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dc808aa30 con 0x7f1dd015bdd0 2023-11-24T08:04:17.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.030+0000 7f1dce59c700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1db006aed0 0x7f1db006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.031+0000 7f1dce59c700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1db006aed0 0x7f1db006d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4006fd0 tx=0x7f1dc4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:17.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.035+0000 7f1dbeffd700 1 -- 172.21.15.153:0/2716933780 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1dd00cac10 con 0x7f1dd015bdd0 2023-11-24T08:04:17.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.222+0000 7f1dd4913700 1 -- 172.21.15.153:0/2716933780 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1dd00b2b70 con 0x7f1db006aed0 2023-11-24T08:04:17.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.229+0000 7f1dbeffd700 1 -- 172.21.15.153:0/2716933780 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264716 (secure 0 0 0) 0x7f1dc400c040 con 0x7f1db006aed0 2023-11-24T08:04:17.234 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 -- 172.21.15.153:0/2716933780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1db006aed0 msgr2=0x7f1db006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1db006aed0 0x7f1db006d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4006fd0 tx=0x7f1dc4008040 comp rx=0 tx=0).stop 2023-11-24T08:04:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 -- 172.21.15.153:0/2716933780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dd015bdd0 msgr2=0x7f1dd01568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dd015bdd0 0x7f1dd01568a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8015040 tx=0x7f1dc8004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 -- 172.21.15.153:0/2716933780 shutdown_connections 2023-11-24T08:04:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1db006aed0 0x7f1db006d390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1dd015bdd0 0x7f1dd01568a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1dd00b3370 0x7f1dd0156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 --2- 172.21.15.153:0/2716933780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dd00d1c70 0x7f1dd00ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 -- 172.21.15.153:0/2716933780 >> 172.21.15.153:0/2716933780 conn(0x7f1dd00731a0 msgr2=0x7f1dd00b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 -- 172.21.15.153:0/2716933780 shutdown_connections 2023-11-24T08:04:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.233+0000 7f1dd4913700 1 -- 172.21.15.153:0/2716933780 wait complete. 2023-11-24T08:04:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:04:17.246 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-11-24T08:04:16.042294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218980,"kb_used_data":2796,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755740,"statfs":{"total":773094113280,"available":772869877760,"internally_reserved":0,"allocated":2863104,"data_stored":1739217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.310089"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876573+0000","last_change":"2023-11-24T08:04:12.770599+0000","last_active":"2023-11-24T08:04:13.876573+0000","last_peered":"2023-11-24T08:04:13.876573+0000","last_clean":"2023-11-24T08:04:13.876573+0000","last_became_active":"2023-11-24T08:04:12.770351+0000","last_became_peered":"2023-11-24T08:04:12.770351+0000","last_unstale":"2023-11-24T08:04:13.876573+0000","last_undegraded":"2023-11-24T08:04:13.876573+0000","last_fullsized":"2023-11-24T08:04:13.876573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:02.788396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765876+0000","last_change":"2023-11-24T08:04:12.763019+0000","last_active":"2023-11-24T08:04:13.765876+0000","last_peered":"2023-11-24T08:04:13.765876+0000","last_clean":"2023-11-24T08:04:13.765876+0000","last_became_active":"2023-11-24T08:04:12.757900+0000","last_became_peered":"2023-11-24T08:04:12.757900+0000","last_unstale":"2023-11-24T08:04:13.765876+0000","last_undegraded":"2023-11-24T08:04:13.765876+0000","last_fullsized":"2023-11-24T08:04:13.765876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366717+0000","last_change":"2023-11-24T08:04:12.758286+0000","last_active":"2023-11-24T08:04:14.366717+0000","last_peered":"2023-11-24T08:04:14.366717+0000","last_clean":"2023-11-24T08:04:14.366717+0000","last_became_active":"2023-11-24T08:04:12.758023+0000","last_became_peered":"2023-11-24T08:04:12.758023+0000","last_unstale":"2023-11-24T08:04:14.366717+0000","last_undegraded":"2023-11-24T08:04:14.366717+0000","last_fullsized":"2023-11-24T08:04:14.366717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177733+0000","last_change":"2023-11-24T08:04:12.772929+0000","last_active":"2023-11-24T08:04:14.177733+0000","last_peered":"2023-11-24T08:04:14.177733+0000","last_clean":"2023-11-24T08:04:14.177733+0000","last_became_active":"2023-11-24T08:04:12.772279+0000","last_became_peered":"2023-11-24T08:04:12.772279+0000","last_unstale":"2023-11-24T08:04:14.177733+0000","last_undegraded":"2023-11-24T08:04:14.177733+0000","last_fullsized":"2023-11-24T08:04:14.177733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:26.559888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876184+0000","last_change":"2023-11-24T08:04:12.758540+0000","last_active":"2023-11-24T08:04:13.876184+0000","last_peered":"2023-11-24T08:04:13.876184+0000","last_clean":"2023-11-24T08:04:13.876184+0000","last_became_active":"2023-11-24T08:04:12.758277+0000","last_became_peered":"2023-11-24T08:04:12.758277+0000","last_unstale":"2023-11-24T08:04:13.876184+0000","last_undegraded":"2023-11-24T08:04:13.876184+0000","last_fullsized":"2023-11-24T08:04:13.876184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177333+0000","last_change":"2023-11-24T08:04:12.773276+0000","last_active":"2023-11-24T08:04:14.177333+0000","last_peered":"2023-11-24T08:04:14.177333+0000","last_clean":"2023-11-24T08:04:14.177333+0000","last_became_active":"2023-11-24T08:04:12.772869+0000","last_became_peered":"2023-11-24T08:04:12.772869+0000","last_unstale":"2023-11-24T08:04:14.177333+0000","last_undegraded":"2023-11-24T08:04:14.177333+0000","last_fullsized":"2023-11-24T08:04:14.177333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876172+0000","last_change":"2023-11-24T08:04:12.755259+0000","last_active":"2023-11-24T08:04:13.876172+0000","last_peered":"2023-11-24T08:04:13.876172+0000","last_clean":"2023-11-24T08:04:13.876172+0000","last_became_active":"2023-11-24T08:04:12.754963+0000","last_became_peered":"2023-11-24T08:04:12.754963+0000","last_unstale":"2023-11-24T08:04:13.876172+0000","last_undegraded":"2023-11-24T08:04:13.876172+0000","last_fullsized":"2023-11-24T08:04:13.876172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.272910+0000","last_change":"2023-11-24T08:04:12.766658+0000","last_active":"2023-11-24T08:04:14.272910+0000","last_peered":"2023-11-24T08:04:14.272910+0000","last_clean":"2023-11-24T08:04:14.272910+0000","last_became_active":"2023-11-24T08:04:12.765918+0000","last_became_peered":"2023-11-24T08:04:12.765918+0000","last_unstale":"2023-11-24T08:04:14.272910+0000","last_undegraded":"2023-11-24T08:04:14.272910+0000","last_fullsized":"2023-11-24T08:04:14.272910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876569+0000","last_change":"2023-11-24T08:04:12.769707+0000","last_active":"2023-11-24T08:04:13.876569+0000","last_peered":"2023-11-24T08:04:13.876569+0000","last_clean":"2023-11-24T08:04:13.876569+0000","last_became_active":"2023-11-24T08:04:12.767682+0000","last_became_peered":"2023-11-24T08:04:12.767682+0000","last_unstale":"2023-11-24T08:04:13.876569+0000","last_undegraded":"2023-11-24T08:04:13.876569+0000","last_fullsized":"2023-11-24T08:04:13.876569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.914874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367340+0000","last_change":"2023-11-24T08:04:12.765821+0000","last_active":"2023-11-24T08:04:14.367340+0000","last_peered":"2023-11-24T08:04:14.367340+0000","last_clean":"2023-11-24T08:04:14.367340+0000","last_became_active":"2023-11-24T08:04:12.765549+0000","last_became_peered":"2023-11-24T08:04:12.765549+0000","last_unstale":"2023-11-24T08:04:14.367340+0000","last_undegraded":"2023-11-24T08:04:14.367340+0000","last_fullsized":"2023-11-24T08:04:14.367340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367063+0000","last_change":"2023-11-24T08:04:12.765436+0000","last_active":"2023-11-24T08:04:14.367063+0000","last_peered":"2023-11-24T08:04:14.367063+0000","last_clean":"2023-11-24T08:04:14.367063+0000","last_became_active":"2023-11-24T08:04:12.765117+0000","last_became_peered":"2023-11-24T08:04:12.765117+0000","last_unstale":"2023-11-24T08:04:14.367063+0000","last_undegraded":"2023-11-24T08:04:14.367063+0000","last_fullsized":"2023-11-24T08:04:14.367063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768755+0000","last_change":"2023-11-24T08:04:12.753974+0000","last_active":"2023-11-24T08:04:13.768755+0000","last_peered":"2023-11-24T08:04:13.768755+0000","last_clean":"2023-11-24T08:04:13.768755+0000","last_became_active":"2023-11-24T08:04:12.753656+0000","last_became_peered":"2023-11-24T08:04:12.753656+0000","last_unstale":"2023-11-24T08:04:13.768755+0000","last_undegraded":"2023-11-24T08:04:13.768755+0000","last_fullsized":"2023-11-24T08:04:13.768755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:12.285221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273087+0000","last_change":"2023-11-24T08:04:12.764978+0000","last_active":"2023-11-24T08:04:14.273087+0000","last_peered":"2023-11-24T08:04:14.273087+0000","last_clean":"2023-11-24T08:04:14.273087+0000","last_became_active":"2023-11-24T08:04:12.764683+0000","last_became_peered":"2023-11-24T08:04:12.764683+0000","last_unstale":"2023-11-24T08:04:14.273087+0000","last_undegraded":"2023-11-24T08:04:14.273087+0000","last_fullsized":"2023-11-24T08:04:14.273087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366598+0000","last_change":"2023-11-24T08:04:12.759358+0000","last_active":"2023-11-24T08:04:14.366598+0000","last_peered":"2023-11-24T08:04:14.366598+0000","last_clean":"2023-11-24T08:04:14.366598+0000","last_became_active":"2023-11-24T08:04:12.757744+0000","last_became_peered":"2023-11-24T08:04:12.757744+0000","last_unstale":"2023-11-24T08:04:14.366598+0000","last_undegraded":"2023-11-24T08:04:14.366598+0000","last_fullsized":"2023-11-24T08:04:14.366598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:20.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765466+0000","last_change":"2023-11-24T08:04:12.760210+0000","last_active":"2023-11-24T08:04:13.765466+0000","last_peered":"2023-11-24T08:04:13.765466+0000","last_clean":"2023-11-24T08:04:13.765466+0000","last_became_active":"2023-11-24T08:04:12.759781+0000","last_became_peered":"2023-11-24T08:04:12.759781+0000","last_unstale":"2023-11-24T08:04:13.765466+0000","last_undegraded":"2023-11-24T08:04:13.765466+0000","last_fullsized":"2023-11-24T08:04:13.765466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177285+0000","last_change":"2023-11-24T08:04:12.766373+0000","last_active":"2023-11-24T08:04:14.177285+0000","last_peered":"2023-11-24T08:04:14.177285+0000","last_clean":"2023-11-24T08:04:14.177285+0000","last_became_active":"2023-11-24T08:04:12.766108+0000","last_became_peered":"2023-11-24T08:04:12.766108+0000","last_unstale":"2023-11-24T08:04:14.177285+0000","last_undegraded":"2023-11-24T08:04:14.177285+0000","last_fullsized":"2023-11-24T08:04:14.177285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177881+0000","last_change":"2023-11-24T08:04:12.765327+0000","last_active":"2023-11-24T08:04:14.177881+0000","last_peered":"2023-11-24T08:04:14.177881+0000","last_clean":"2023-11-24T08:04:14.177881+0000","last_became_active":"2023-11-24T08:04:12.765017+0000","last_became_peered":"2023-11-24T08:04:12.765017+0000","last_unstale":"2023-11-24T08:04:14.177881+0000","last_undegraded":"2023-11-24T08:04:14.177881+0000","last_fullsized":"2023-11-24T08:04:14.177881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.914874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366457+0000","last_change":"2023-11-24T08:04:12.765919+0000","last_active":"2023-11-24T08:04:14.366457+0000","last_peered":"2023-11-24T08:04:14.366457+0000","last_clean":"2023-11-24T08:04:14.366457+0000","last_became_active":"2023-11-24T08:04:12.765641+0000","last_became_peered":"2023-11-24T08:04:12.765641+0000","last_unstale":"2023-11-24T08:04:14.366457+0000","last_undegraded":"2023-11-24T08:04:14.366457+0000","last_fullsized":"2023-11-24T08:04:14.366457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:58.975401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876303+0000","last_change":"2023-11-24T08:04:12.760146+0000","last_active":"2023-11-24T08:04:13.876303+0000","last_peered":"2023-11-24T08:04:13.876303+0000","last_clean":"2023-11-24T08:04:13.876303+0000","last_became_active":"2023-11-24T08:04:12.759741+0000","last_became_peered":"2023-11-24T08:04:12.759741+0000","last_unstale":"2023-11-24T08:04:13.876303+0000","last_undegraded":"2023-11-24T08:04:13.876303+0000","last_fullsized":"2023-11-24T08:04:13.876303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366921+0000","last_change":"2023-11-24T08:04:11.759390+0000","last_active":"2023-11-24T08:04:14.366921+0000","last_peered":"2023-11-24T08:04:14.366921+0000","last_clean":"2023-11-24T08:04:14.366921+0000","last_became_active":"2023-11-24T08:04:11.759120+0000","last_became_peered":"2023-11-24T08:04:11.759120+0000","last_unstale":"2023-11-24T08:04:14.366921+0000","last_undegraded":"2023-11-24T08:04:14.366921+0000","last_fullsized":"2023-11-24T08:04:14.366921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:05.082044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273176+0000","last_change":"2023-11-24T08:04:12.756765+0000","last_active":"2023-11-24T08:04:14.273176+0000","last_peered":"2023-11-24T08:04:14.273176+0000","last_clean":"2023-11-24T08:04:14.273176+0000","last_became_active":"2023-11-24T08:04:12.756478+0000","last_became_peered":"2023-11-24T08:04:12.756478+0000","last_unstale":"2023-11-24T08:04:14.273176+0000","last_undegraded":"2023-11-24T08:04:14.273176+0000","last_fullsized":"2023-11-24T08:04:14.273176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273275+0000","last_change":"2023-11-24T08:04:11.766651+0000","last_active":"2023-11-24T08:04:14.273275+0000","last_peered":"2023-11-24T08:04:14.273275+0000","last_clean":"2023-11-24T08:04:14.273275+0000","last_became_active":"2023-11-24T08:04:11.766382+0000","last_became_peered":"2023-11-24T08:04:11.766382+0000","last_unstale":"2023-11-24T08:04:14.273275+0000","last_undegraded":"2023-11-24T08:04:14.273275+0000","last_fullsized":"2023-11-24T08:04:14.273275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:08:10.447749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366718+0000","last_change":"2023-11-24T08:04:12.763132+0000","last_active":"2023-11-24T08:04:14.366718+0000","last_peered":"2023-11-24T08:04:14.366718+0000","last_clean":"2023-11-24T08:04:14.366718+0000","last_became_active":"2023-11-24T08:04:12.762841+0000","last_became_peered":"2023-11-24T08:04:12.762841+0000","last_unstale":"2023-11-24T08:04:14.366718+0000","last_undegraded":"2023-11-24T08:04:14.366718+0000","last_fullsized":"2023-11-24T08:04:14.366718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876511+0000","last_change":"2023-11-24T08:04:11.764101+0000","last_active":"2023-11-24T08:04:13.876511+0000","last_peered":"2023-11-24T08:04:13.876511+0000","last_clean":"2023-11-24T08:04:13.876511+0000","last_became_active":"2023-11-24T08:04:11.763785+0000","last_became_peered":"2023-11-24T08:04:11.763785+0000","last_unstale":"2023-11-24T08:04:13.876511+0000","last_undegraded":"2023-11-24T08:04:13.876511+0000","last_fullsized":"2023-11-24T08:04:13.876511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:20.626156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177450+0000","last_change":"2023-11-24T08:04:12.771603+0000","last_active":"2023-11-24T08:04:14.177450+0000","last_peered":"2023-11-24T08:04:14.177450+0000","last_clean":"2023-11-24T08:04:14.177450+0000","last_became_active":"2023-11-24T08:04:12.771221+0000","last_became_peered":"2023-11-24T08:04:12.771221+0000","last_unstale":"2023-11-24T08:04:14.177450+0000","last_undegraded":"2023-11-24T08:04:14.177450+0000","last_fullsized":"2023-11-24T08:04:14.177450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876124+0000","last_change":"2023-11-24T08:04:11.764690+0000","last_active":"2023-11-24T08:04:13.876124+0000","last_peered":"2023-11-24T08:04:13.876124+0000","last_clean":"2023-11-24T08:04:13.876124+0000","last_became_active":"2023-11-24T08:04:11.764316+0000","last_became_peered":"2023-11-24T08:04:11.764316+0000","last_unstale":"2023-11-24T08:04:13.876124+0000","last_undegraded":"2023-11-24T08:04:13.876124+0000","last_fullsized":"2023-11-24T08:04:13.876124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177790+0000","last_change":"2023-11-24T08:04:12.771927+0000","last_active":"2023-11-24T08:04:14.177790+0000","last_peered":"2023-11-24T08:04:14.177790+0000","last_clean":"2023-11-24T08:04:14.177790+0000","last_became_active":"2023-11-24T08:04:12.770523+0000","last_became_peered":"2023-11-24T08:04:12.770523+0000","last_unstale":"2023-11-24T08:04:14.177790+0000","last_undegraded":"2023-11-24T08:04:14.177790+0000","last_fullsized":"2023-11-24T08:04:14.177790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:53:11.480855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273404+0000","last_change":"2023-11-24T08:04:11.764289+0000","last_active":"2023-11-24T08:04:14.273404+0000","last_peered":"2023-11-24T08:04:14.273404+0000","last_clean":"2023-11-24T08:04:14.273404+0000","last_became_active":"2023-11-24T08:04:11.763993+0000","last_became_peered":"2023-11-24T08:04:11.763993+0000","last_unstale":"2023-11-24T08:04:14.273404+0000","last_undegraded":"2023-11-24T08:04:14.273404+0000","last_fullsized":"2023-11-24T08:04:14.273404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:05.082044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768270+0000","last_change":"2023-11-24T08:04:12.759447+0000","last_active":"2023-11-24T08:04:13.768270+0000","last_peered":"2023-11-24T08:04:13.768270+0000","last_clean":"2023-11-24T08:04:13.768270+0000","last_became_active":"2023-11-24T08:04:12.759147+0000","last_became_peered":"2023-11-24T08:04:12.759147+0000","last_unstale":"2023-11-24T08:04:13.768270+0000","last_undegraded":"2023-11-24T08:04:13.768270+0000","last_fullsized":"2023-11-24T08:04:13.768270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:03:32.465127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366918+0000","last_change":"2023-11-24T08:04:11.768035+0000","last_active":"2023-11-24T08:04:14.366918+0000","last_peered":"2023-11-24T08:04:14.366918+0000","last_clean":"2023-11-24T08:04:14.366918+0000","last_became_active":"2023-11-24T08:04:11.767674+0000","last_became_peered":"2023-11-24T08:04:11.767674+0000","last_unstale":"2023-11-24T08:04:14.366918+0000","last_undegraded":"2023-11-24T08:04:14.366918+0000","last_fullsized":"2023-11-24T08:04:14.366918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366939+0000","last_change":"2023-11-24T08:04:12.755036+0000","last_active":"2023-11-24T08:04:14.366939+0000","last_peered":"2023-11-24T08:04:14.366939+0000","last_clean":"2023-11-24T08:04:14.366939+0000","last_became_active":"2023-11-24T08:04:12.754766+0000","last_became_peered":"2023-11-24T08:04:12.754766+0000","last_unstale":"2023-11-24T08:04:14.366939+0000","last_undegraded":"2023-11-24T08:04:14.366939+0000","last_fullsized":"2023-11-24T08:04:14.366939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273015+0000","last_change":"2023-11-24T08:04:11.764114+0000","last_active":"2023-11-24T08:04:14.273015+0000","last_peered":"2023-11-24T08:04:14.273015+0000","last_clean":"2023-11-24T08:04:14.273015+0000","last_became_active":"2023-11-24T08:04:11.763825+0000","last_became_peered":"2023-11-24T08:04:11.763825+0000","last_unstale":"2023-11-24T08:04:14.273015+0000","last_undegraded":"2023-11-24T08:04:14.273015+0000","last_fullsized":"2023-11-24T08:04:14.273015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273198+0000","last_change":"2023-11-24T08:04:12.756326+0000","last_active":"2023-11-24T08:04:14.273198+0000","last_peered":"2023-11-24T08:04:14.273198+0000","last_clean":"2023-11-24T08:04:14.273198+0000","last_became_active":"2023-11-24T08:04:12.755997+0000","last_became_peered":"2023-11-24T08:04:12.755997+0000","last_unstale":"2023-11-24T08:04:14.273198+0000","last_undegraded":"2023-11-24T08:04:14.273198+0000","last_fullsized":"2023-11-24T08:04:14.273198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177300+0000","last_change":"2023-11-24T08:04:11.767935+0000","last_active":"2023-11-24T08:04:14.177300+0000","last_peered":"2023-11-24T08:04:14.177300+0000","last_clean":"2023-11-24T08:04:14.177300+0000","last_became_active":"2023-11-24T08:04:11.767619+0000","last_became_peered":"2023-11-24T08:04:11.767619+0000","last_unstale":"2023-11-24T08:04:14.177300+0000","last_undegraded":"2023-11-24T08:04:14.177300+0000","last_fullsized":"2023-11-24T08:04:14.177300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:54.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765652+0000","last_change":"2023-11-24T08:04:12.760472+0000","last_active":"2023-11-24T08:04:13.765652+0000","last_peered":"2023-11-24T08:04:13.765652+0000","last_clean":"2023-11-24T08:04:13.765652+0000","last_became_active":"2023-11-24T08:04:12.759672+0000","last_became_peered":"2023-11-24T08:04:12.759672+0000","last_unstale":"2023-11-24T08:04:13.765652+0000","last_undegraded":"2023-11-24T08:04:13.765652+0000","last_fullsized":"2023-11-24T08:04:13.765652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367355+0000","last_change":"2023-11-24T08:04:11.763764+0000","last_active":"2023-11-24T08:04:14.367355+0000","last_peered":"2023-11-24T08:04:14.367355+0000","last_clean":"2023-11-24T08:04:14.367355+0000","last_became_active":"2023-11-24T08:04:11.763483+0000","last_became_peered":"2023-11-24T08:04:11.763483+0000","last_unstale":"2023-11-24T08:04:14.367355+0000","last_undegraded":"2023-11-24T08:04:14.367355+0000","last_fullsized":"2023-11-24T08:04:14.367355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177975+0000","last_change":"2023-11-24T08:04:12.761020+0000","last_active":"2023-11-24T08:04:14.177975+0000","last_peered":"2023-11-24T08:04:14.177975+0000","last_clean":"2023-11-24T08:04:14.177975+0000","last_became_active":"2023-11-24T08:04:12.760701+0000","last_became_peered":"2023-11-24T08:04:12.760701+0000","last_unstale":"2023-11-24T08:04:14.177975+0000","last_undegraded":"2023-11-24T08:04:14.177975+0000","last_fullsized":"2023-11-24T08:04:14.177975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:58:32.049664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177726+0000","last_change":"2023-11-24T08:04:11.762776+0000","last_active":"2023-11-24T08:04:14.177726+0000","last_peered":"2023-11-24T08:04:14.177726+0000","last_clean":"2023-11-24T08:04:14.177726+0000","last_became_active":"2023-11-24T08:04:11.762480+0000","last_became_peered":"2023-11-24T08:04:11.762480+0000","last_unstale":"2023-11-24T08:04:14.177726+0000","last_undegraded":"2023-11-24T08:04:14.177726+0000","last_fullsized":"2023-11-24T08:04:14.177726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366882+0000","last_change":"2023-11-24T08:04:12.766040+0000","last_active":"2023-11-24T08:04:14.366882+0000","last_peered":"2023-11-24T08:04:14.366882+0000","last_clean":"2023-11-24T08:04:14.366882+0000","last_became_active":"2023-11-24T08:04:12.765772+0000","last_became_peered":"2023-11-24T08:04:12.765772+0000","last_unstale":"2023-11-24T08:04:14.366882+0000","last_undegraded":"2023-11-24T08:04:14.366882+0000","last_fullsized":"2023-11-24T08:04:14.366882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765732+0000","last_change":"2023-11-24T08:04:11.765479+0000","last_active":"2023-11-24T08:04:13.765732+0000","last_peered":"2023-11-24T08:04:13.765732+0000","last_clean":"2023-11-24T08:04:13.765732+0000","last_became_active":"2023-11-24T08:04:11.765216+0000","last_became_peered":"2023-11-24T08:04:11.765216+0000","last_unstale":"2023-11-24T08:04:13.765732+0000","last_undegraded":"2023-11-24T08:04:13.765732+0000","last_fullsized":"2023-11-24T08:04:13.765732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768676+0000","last_change":"2023-11-24T08:04:12.755487+0000","last_active":"2023-11-24T08:04:13.768676+0000","last_peered":"2023-11-24T08:04:13.768676+0000","last_clean":"2023-11-24T08:04:13.768676+0000","last_became_active":"2023-11-24T08:04:12.755113+0000","last_became_peered":"2023-11-24T08:04:12.755113+0000","last_unstale":"2023-11-24T08:04:13.768676+0000","last_undegraded":"2023-11-24T08:04:13.768676+0000","last_fullsized":"2023-11-24T08:04:13.768676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:58.916630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367128+0000","last_change":"2023-11-24T08:04:11.765679+0000","last_active":"2023-11-24T08:04:14.367128+0000","last_peered":"2023-11-24T08:04:14.367128+0000","last_clean":"2023-11-24T08:04:14.367128+0000","last_became_active":"2023-11-24T08:04:11.764903+0000","last_became_peered":"2023-11-24T08:04:11.764903+0000","last_unstale":"2023-11-24T08:04:14.367128+0000","last_undegraded":"2023-11-24T08:04:14.367128+0000","last_fullsized":"2023-11-24T08:04:14.367128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:46.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876321+0000","last_change":"2023-11-24T08:04:12.761708+0000","last_active":"2023-11-24T08:04:13.876321+0000","last_peered":"2023-11-24T08:04:13.876321+0000","last_clean":"2023-11-24T08:04:13.876321+0000","last_became_active":"2023-11-24T08:04:12.761352+0000","last_became_peered":"2023-11-24T08:04:12.761352+0000","last_unstale":"2023-11-24T08:04:13.876321+0000","last_undegraded":"2023-11-24T08:04:13.876321+0000","last_fullsized":"2023-11-24T08:04:13.876321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:03.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366917+0000","last_change":"2023-11-24T08:04:11.761027+0000","last_active":"2023-11-24T08:04:14.366917+0000","last_peered":"2023-11-24T08:04:14.366917+0000","last_clean":"2023-11-24T08:04:14.366917+0000","last_became_active":"2023-11-24T08:04:11.759840+0000","last_became_peered":"2023-11-24T08:04:11.759840+0000","last_unstale":"2023-11-24T08:04:14.366917+0000","last_undegraded":"2023-11-24T08:04:14.366917+0000","last_fullsized":"2023-11-24T08:04:14.366917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366442+0000","last_change":"2023-11-24T08:04:12.761170+0000","last_active":"2023-11-24T08:04:14.366442+0000","last_peered":"2023-11-24T08:04:14.366442+0000","last_clean":"2023-11-24T08:04:14.366442+0000","last_became_active":"2023-11-24T08:04:12.760886+0000","last_became_peered":"2023-11-24T08:04:12.760886+0000","last_unstale":"2023-11-24T08:04:14.366442+0000","last_undegraded":"2023-11-24T08:04:14.366442+0000","last_fullsized":"2023-11-24T08:04:14.366442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:09.942884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177767+0000","last_change":"2023-11-24T08:04:11.764401+0000","last_active":"2023-11-24T08:04:14.177767+0000","last_peered":"2023-11-24T08:04:14.177767+0000","last_clean":"2023-11-24T08:04:14.177767+0000","last_became_active":"2023-11-24T08:04:11.764134+0000","last_became_peered":"2023-11-24T08:04:11.764134+0000","last_unstale":"2023-11-24T08:04:14.177767+0000","last_undegraded":"2023-11-24T08:04:14.177767+0000","last_fullsized":"2023-11-24T08:04:14.177767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:20.626156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876305+0000","last_change":"2023-11-24T08:04:12.768388+0000","last_active":"2023-11-24T08:04:13.876305+0000","last_peered":"2023-11-24T08:04:13.876305+0000","last_clean":"2023-11-24T08:04:13.876305+0000","last_became_active":"2023-11-24T08:04:12.768067+0000","last_became_peered":"2023-11-24T08:04:12.768067+0000","last_unstale":"2023-11-24T08:04:13.876305+0000","last_undegraded":"2023-11-24T08:04:13.876305+0000","last_fullsized":"2023-11-24T08:04:13.876305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366915+0000","last_change":"2023-11-24T08:04:11.755395+0000","last_active":"2023-11-24T08:04:14.366915+0000","last_peered":"2023-11-24T08:04:14.366915+0000","last_clean":"2023-11-24T08:04:14.366915+0000","last_became_active":"2023-11-24T08:04:11.755135+0000","last_became_peered":"2023-11-24T08:04:11.755135+0000","last_unstale":"2023-11-24T08:04:14.366915+0000","last_undegraded":"2023-11-24T08:04:14.366915+0000","last_fullsized":"2023-11-24T08:04:14.366915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366928+0000","last_change":"2023-11-24T08:04:12.756222+0000","last_active":"2023-11-24T08:04:14.366928+0000","last_peered":"2023-11-24T08:04:14.366928+0000","last_clean":"2023-11-24T08:04:14.366928+0000","last_became_active":"2023-11-24T08:04:12.755930+0000","last_became_peered":"2023-11-24T08:04:12.755930+0000","last_unstale":"2023-11-24T08:04:14.366928+0000","last_undegraded":"2023-11-24T08:04:14.366928+0000","last_fullsized":"2023-11-24T08:04:14.366928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:20.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366287+0000","last_change":"2023-11-24T08:04:11.760945+0000","last_active":"2023-11-24T08:04:14.366287+0000","last_peered":"2023-11-24T08:04:14.366287+0000","last_clean":"2023-11-24T08:04:14.366287+0000","last_became_active":"2023-11-24T08:04:11.760661+0000","last_became_peered":"2023-11-24T08:04:11.760661+0000","last_unstale":"2023-11-24T08:04:14.366287+0000","last_undegraded":"2023-11-24T08:04:14.366287+0000","last_fullsized":"2023-11-24T08:04:14.366287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876042+0000","last_change":"2023-11-24T08:04:12.762670+0000","last_active":"2023-11-24T08:04:13.876042+0000","last_peered":"2023-11-24T08:04:13.876042+0000","last_clean":"2023-11-24T08:04:13.876042+0000","last_became_active":"2023-11-24T08:04:12.762385+0000","last_became_peered":"2023-11-24T08:04:12.762385+0000","last_unstale":"2023-11-24T08:04:13.876042+0000","last_undegraded":"2023-11-24T08:04:13.876042+0000","last_fullsized":"2023-11-24T08:04:13.876042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768772+0000","last_change":"2023-11-24T08:04:11.765361+0000","last_active":"2023-11-24T08:04:13.768772+0000","last_peered":"2023-11-24T08:04:13.768772+0000","last_clean":"2023-11-24T08:04:13.768772+0000","last_became_active":"2023-11-24T08:04:11.760138+0000","last_became_peered":"2023-11-24T08:04:11.760138+0000","last_unstale":"2023-11-24T08:04:13.768772+0000","last_undegraded":"2023-11-24T08:04:13.768772+0000","last_fullsized":"2023-11-24T08:04:13.768772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:59:09.945020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876616+0000","last_change":"2023-11-24T08:04:12.770971+0000","last_active":"2023-11-24T08:04:13.876616+0000","last_peered":"2023-11-24T08:04:13.876616+0000","last_clean":"2023-11-24T08:04:13.876616+0000","last_became_active":"2023-11-24T08:04:12.768881+0000","last_became_peered":"2023-11-24T08:04:12.768881+0000","last_unstale":"2023-11-24T08:04:13.876616+0000","last_undegraded":"2023-11-24T08:04:13.876616+0000","last_fullsized":"2023-11-24T08:04:13.876616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:58:32.049664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765677+0000","last_change":"2023-11-24T08:04:11.758492+0000","last_active":"2023-11-24T08:04:13.765677+0000","last_peered":"2023-11-24T08:04:13.765677+0000","last_clean":"2023-11-24T08:04:13.765677+0000","last_became_active":"2023-11-24T08:04:11.758227+0000","last_became_peered":"2023-11-24T08:04:11.758227+0000","last_unstale":"2023-11-24T08:04:13.765677+0000","last_undegraded":"2023-11-24T08:04:13.765677+0000","last_fullsized":"2023-11-24T08:04:13.765677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177844+0000","last_change":"2023-11-24T08:04:12.762628+0000","last_active":"2023-11-24T08:04:14.177844+0000","last_peered":"2023-11-24T08:04:14.177844+0000","last_clean":"2023-11-24T08:04:14.177844+0000","last_became_active":"2023-11-24T08:04:12.762342+0000","last_became_peered":"2023-11-24T08:04:12.762342+0000","last_unstale":"2023-11-24T08:04:14.177844+0000","last_undegraded":"2023-11-24T08:04:14.177844+0000","last_fullsized":"2023-11-24T08:04:14.177844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:02.788396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177560+0000","last_change":"2023-11-24T08:04:11.763677+0000","last_active":"2023-11-24T08:04:14.177560+0000","last_peered":"2023-11-24T08:04:14.177560+0000","last_clean":"2023-11-24T08:04:14.177560+0000","last_became_active":"2023-11-24T08:04:11.763410+0000","last_became_peered":"2023-11-24T08:04:11.763410+0000","last_unstale":"2023-11-24T08:04:14.177560+0000","last_undegraded":"2023-11-24T08:04:14.177560+0000","last_fullsized":"2023-11-24T08:04:14.177560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:06.394632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768313+0000","last_change":"2023-11-24T08:04:12.758637+0000","last_active":"2023-11-24T08:04:13.768313+0000","last_peered":"2023-11-24T08:04:13.768313+0000","last_clean":"2023-11-24T08:04:13.768313+0000","last_became_active":"2023-11-24T08:04:12.758149+0000","last_became_peered":"2023-11-24T08:04:12.758149+0000","last_unstale":"2023-11-24T08:04:13.768313+0000","last_undegraded":"2023-11-24T08:04:13.768313+0000","last_fullsized":"2023-11-24T08:04:13.768313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:23.086508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765399+0000","last_change":"2023-11-24T08:04:12.762936+0000","last_active":"2023-11-24T08:04:13.765399+0000","last_peered":"2023-11-24T08:04:13.765399+0000","last_clean":"2023-11-24T08:04:13.765399+0000","last_became_active":"2023-11-24T08:04:12.758492+0000","last_became_peered":"2023-11-24T08:04:12.758492+0000","last_unstale":"2023-11-24T08:04:13.765399+0000","last_undegraded":"2023-11-24T08:04:13.765399+0000","last_fullsized":"2023-11-24T08:04:13.765399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366780+0000","last_change":"2023-11-24T08:04:11.764139+0000","last_active":"2023-11-24T08:04:14.366780+0000","last_peered":"2023-11-24T08:04:14.366780+0000","last_clean":"2023-11-24T08:04:14.366780+0000","last_became_active":"2023-11-24T08:04:11.763864+0000","last_became_peered":"2023-11-24T08:04:11.763864+0000","last_unstale":"2023-11-24T08:04:14.366780+0000","last_undegraded":"2023-11-24T08:04:14.366780+0000","last_fullsized":"2023-11-24T08:04:14.366780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:22.082092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273173+0000","last_change":"2023-11-24T08:04:12.774072+0000","last_active":"2023-11-24T08:04:14.273173+0000","last_peered":"2023-11-24T08:04:14.273173+0000","last_clean":"2023-11-24T08:04:14.273173+0000","last_became_active":"2023-11-24T08:04:12.773801+0000","last_became_peered":"2023-11-24T08:04:12.773801+0000","last_unstale":"2023-11-24T08:04:14.273173+0000","last_undegraded":"2023-11-24T08:04:14.273173+0000","last_fullsized":"2023-11-24T08:04:14.273173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177347+0000","last_change":"2023-11-24T08:04:11.762293+0000","last_active":"2023-11-24T08:04:14.177347+0000","last_peered":"2023-11-24T08:04:14.177347+0000","last_clean":"2023-11-24T08:04:14.177347+0000","last_became_active":"2023-11-24T08:04:11.762010+0000","last_became_peered":"2023-11-24T08:04:11.762010+0000","last_unstale":"2023-11-24T08:04:14.177347+0000","last_undegraded":"2023-11-24T08:04:14.177347+0000","last_fullsized":"2023-11-24T08:04:14.177347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:14.105245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T08:04:12.749389+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:04:12.749389+0000","last_peered":"2023-11-24T08:04:12.749389+0000","last_clean":"2023-11-24T08:04:12.749389+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:04:12.749389+0000","last_undegraded":"2023-11-24T08:04:12.749389+0000","last_fullsized":"2023-11-24T08:04:12.749389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366595+0000","last_change":"2023-11-24T08:04:12.755042+0000","last_active":"2023-11-24T08:04:14.366595+0000","last_peered":"2023-11-24T08:04:14.366595+0000","last_clean":"2023-11-24T08:04:14.366595+0000","last_became_active":"2023-11-24T08:04:12.754746+0000","last_became_peered":"2023-11-24T08:04:12.754746+0000","last_unstale":"2023-11-24T08:04:14.366595+0000","last_undegraded":"2023-11-24T08:04:14.366595+0000","last_fullsized":"2023-11-24T08:04:14.366595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:15.109662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.875943+0000","last_change":"2023-11-24T08:04:11.760961+0000","last_active":"2023-11-24T08:04:13.875943+0000","last_peered":"2023-11-24T08:04:13.875943+0000","last_clean":"2023-11-24T08:04:13.875943+0000","last_became_active":"2023-11-24T08:04:11.760601+0000","last_became_peered":"2023-11-24T08:04:11.760601+0000","last_unstale":"2023-11-24T08:04:13.875943+0000","last_undegraded":"2023-11-24T08:04:13.875943+0000","last_fullsized":"2023-11-24T08:04:13.875943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876405+0000","last_change":"2023-11-24T08:04:11.755227+0000","last_active":"2023-11-24T08:04:13.876405+0000","last_peered":"2023-11-24T08:04:13.876405+0000","last_clean":"2023-11-24T08:04:13.876405+0000","last_became_active":"2023-11-24T08:04:11.754941+0000","last_became_peered":"2023-11-24T08:04:11.754941+0000","last_unstale":"2023-11-24T08:04:13.876405+0000","last_undegraded":"2023-11-24T08:04:13.876405+0000","last_fullsized":"2023-11-24T08:04:13.876405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:42.565319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765594+0000","last_change":"2023-11-24T08:04:12.758793+0000","last_active":"2023-11-24T08:04:13.765594+0000","last_peered":"2023-11-24T08:04:13.765594+0000","last_clean":"2023-11-24T08:04:13.765594+0000","last_became_active":"2023-11-24T08:04:12.758047+0000","last_became_peered":"2023-11-24T08:04:12.758047+0000","last_unstale":"2023-11-24T08:04:13.765594+0000","last_undegraded":"2023-11-24T08:04:13.765594+0000","last_fullsized":"2023-11-24T08:04:13.765594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765668+0000","last_change":"2023-11-24T08:04:11.762149+0000","last_active":"2023-11-24T08:04:13.765668+0000","last_peered":"2023-11-24T08:04:13.765668+0000","last_clean":"2023-11-24T08:04:13.765668+0000","last_became_active":"2023-11-24T08:04:11.761849+0000","last_became_peered":"2023-11-24T08:04:11.761849+0000","last_unstale":"2023-11-24T08:04:13.765668+0000","last_undegraded":"2023-11-24T08:04:13.765668+0000","last_fullsized":"2023-11-24T08:04:13.765668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273373+0000","last_change":"2023-11-24T08:04:12.762149+0000","last_active":"2023-11-24T08:04:14.273373+0000","last_peered":"2023-11-24T08:04:14.273373+0000","last_clean":"2023-11-24T08:04:14.273373+0000","last_became_active":"2023-11-24T08:04:12.761859+0000","last_became_peered":"2023-11-24T08:04:12.761859+0000","last_unstale":"2023-11-24T08:04:14.273373+0000","last_undegraded":"2023-11-24T08:04:14.273373+0000","last_fullsized":"2023-11-24T08:04:14.273373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367333+0000","last_change":"2023-11-24T08:04:11.763616+0000","last_active":"2023-11-24T08:04:14.367333+0000","last_peered":"2023-11-24T08:04:14.367333+0000","last_clean":"2023-11-24T08:04:14.367333+0000","last_became_active":"2023-11-24T08:04:11.763330+0000","last_became_peered":"2023-11-24T08:04:11.763330+0000","last_unstale":"2023-11-24T08:04:14.367333+0000","last_undegraded":"2023-11-24T08:04:14.367333+0000","last_fullsized":"2023-11-24T08:04:14.367333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:52:58.082140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366794+0000","last_change":"2023-11-24T08:04:12.754815+0000","last_active":"2023-11-24T08:04:14.366794+0000","last_peered":"2023-11-24T08:04:14.366794+0000","last_clean":"2023-11-24T08:04:14.366794+0000","last_became_active":"2023-11-24T08:04:12.754517+0000","last_became_peered":"2023-11-24T08:04:12.754517+0000","last_unstale":"2023-11-24T08:04:14.366794+0000","last_undegraded":"2023-11-24T08:04:14.366794+0000","last_fullsized":"2023-11-24T08:04:14.366794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.875829+0000","last_change":"2023-11-24T08:04:11.759058+0000","last_active":"2023-11-24T08:04:13.875829+0000","last_peered":"2023-11-24T08:04:13.875829+0000","last_clean":"2023-11-24T08:04:13.875829+0000","last_became_active":"2023-11-24T08:04:11.758773+0000","last_became_peered":"2023-11-24T08:04:11.758773+0000","last_unstale":"2023-11-24T08:04:13.875829+0000","last_undegraded":"2023-11-24T08:04:13.875829+0000","last_fullsized":"2023-11-24T08:04:13.875829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:22.082092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768472+0000","last_change":"2023-11-24T08:04:12.759647+0000","last_active":"2023-11-24T08:04:13.768472+0000","last_peered":"2023-11-24T08:04:13.768472+0000","last_clean":"2023-11-24T08:04:13.768472+0000","last_became_active":"2023-11-24T08:04:12.758979+0000","last_became_peered":"2023-11-24T08:04:12.758979+0000","last_unstale":"2023-11-24T08:04:13.768472+0000","last_undegraded":"2023-11-24T08:04:13.768472+0000","last_fullsized":"2023-11-24T08:04:13.768472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:24.233200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765561+0000","last_change":"2023-11-24T08:04:11.752414+0000","last_active":"2023-11-24T08:04:13.765561+0000","last_peered":"2023-11-24T08:04:13.765561+0000","last_clean":"2023-11-24T08:04:13.765561+0000","last_became_active":"2023-11-24T08:04:11.752132+0000","last_became_peered":"2023-11-24T08:04:11.752132+0000","last_unstale":"2023-11-24T08:04:13.765561+0000","last_undegraded":"2023-11-24T08:04:13.765561+0000","last_fullsized":"2023-11-24T08:04:13.765561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:08.938467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273028+0000","last_change":"2023-11-24T08:04:12.760154+0000","last_active":"2023-11-24T08:04:14.273028+0000","last_peered":"2023-11-24T08:04:14.273028+0000","last_clean":"2023-11-24T08:04:14.273028+0000","last_became_active":"2023-11-24T08:04:12.759870+0000","last_became_peered":"2023-11-24T08:04:12.759870+0000","last_unstale":"2023-11-24T08:04:14.273028+0000","last_undegraded":"2023-11-24T08:04:14.273028+0000","last_fullsized":"2023-11-24T08:04:14.273028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765767+0000","last_change":"2023-11-24T08:04:11.763991+0000","last_active":"2023-11-24T08:04:13.765767+0000","last_peered":"2023-11-24T08:04:13.765767+0000","last_clean":"2023-11-24T08:04:13.765767+0000","last_became_active":"2023-11-24T08:04:11.763720+0000","last_became_peered":"2023-11-24T08:04:11.763720+0000","last_unstale":"2023-11-24T08:04:13.765767+0000","last_undegraded":"2023-11-24T08:04:13.765767+0000","last_fullsized":"2023-11-24T08:04:13.765767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273371+0000","last_change":"2023-11-24T08:04:12.759529+0000","last_active":"2023-11-24T08:04:14.273371+0000","last_peered":"2023-11-24T08:04:14.273371+0000","last_clean":"2023-11-24T08:04:14.273371+0000","last_became_active":"2023-11-24T08:04:12.758748+0000","last_became_peered":"2023-11-24T08:04:12.758748+0000","last_unstale":"2023-11-24T08:04:14.273371+0000","last_undegraded":"2023-11-24T08:04:14.273371+0000","last_fullsized":"2023-11-24T08:04:14.273371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876108+0000","last_change":"2023-11-24T08:04:11.760060+0000","last_active":"2023-11-24T08:04:13.876108+0000","last_peered":"2023-11-24T08:04:13.876108+0000","last_clean":"2023-11-24T08:04:13.876108+0000","last_became_active":"2023-11-24T08:04:11.759649+0000","last_became_peered":"2023-11-24T08:04:11.759649+0000","last_unstale":"2023-11-24T08:04:13.876108+0000","last_undegraded":"2023-11-24T08:04:13.876108+0000","last_fullsized":"2023-11-24T08:04:13.876108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367073+0000","last_change":"2023-11-24T08:04:12.754189+0000","last_active":"2023-11-24T08:04:14.367073+0000","last_peered":"2023-11-24T08:04:14.367073+0000","last_clean":"2023-11-24T08:04:14.367073+0000","last_became_active":"2023-11-24T08:04:12.753907+0000","last_became_peered":"2023-11-24T08:04:12.753907+0000","last_unstale":"2023-11-24T08:04:14.367073+0000","last_undegraded":"2023-11-24T08:04:14.367073+0000","last_fullsized":"2023-11-24T08:04:14.367073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366634+0000","last_change":"2023-11-24T08:04:11.762544+0000","last_active":"2023-11-24T08:04:14.366634+0000","last_peered":"2023-11-24T08:04:14.366634+0000","last_clean":"2023-11-24T08:04:14.366634+0000","last_became_active":"2023-11-24T08:04:11.762250+0000","last_became_peered":"2023-11-24T08:04:11.762250+0000","last_unstale":"2023-11-24T08:04:14.366634+0000","last_undegraded":"2023-11-24T08:04:14.366634+0000","last_fullsized":"2023-11-24T08:04:14.366634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:46.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876467+0000","last_change":"2023-11-24T08:04:12.765834+0000","last_active":"2023-11-24T08:04:13.876467+0000","last_peered":"2023-11-24T08:04:13.876467+0000","last_clean":"2023-11-24T08:04:13.876467+0000","last_became_active":"2023-11-24T08:04:12.765570+0000","last_became_peered":"2023-11-24T08:04:12.765570+0000","last_unstale":"2023-11-24T08:04:13.876467+0000","last_undegraded":"2023-11-24T08:04:13.876467+0000","last_fullsized":"2023-11-24T08:04:13.876467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:53:11.480855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765690+0000","last_change":"2023-11-24T08:04:11.755014+0000","last_active":"2023-11-24T08:04:13.765690+0000","last_peered":"2023-11-24T08:04:13.765690+0000","last_clean":"2023-11-24T08:04:13.765690+0000","last_became_active":"2023-11-24T08:04:11.754748+0000","last_became_peered":"2023-11-24T08:04:11.754748+0000","last_unstale":"2023-11-24T08:04:13.765690+0000","last_undegraded":"2023-11-24T08:04:13.765690+0000","last_fullsized":"2023-11-24T08:04:13.765690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177569+0000","last_change":"2023-11-24T08:04:12.771453+0000","last_active":"2023-11-24T08:04:14.177569+0000","last_peered":"2023-11-24T08:04:14.177569+0000","last_clean":"2023-11-24T08:04:14.177569+0000","last_became_active":"2023-11-24T08:04:12.770894+0000","last_became_peered":"2023-11-24T08:04:12.770894+0000","last_unstale":"2023-11-24T08:04:14.177569+0000","last_undegraded":"2023-11-24T08:04:14.177569+0000","last_fullsized":"2023-11-24T08:04:14.177569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:03.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366534+0000","last_change":"2023-11-24T08:04:11.764045+0000","last_active":"2023-11-24T08:04:14.366534+0000","last_peered":"2023-11-24T08:04:14.366534+0000","last_clean":"2023-11-24T08:04:14.366534+0000","last_became_active":"2023-11-24T08:04:11.763769+0000","last_became_peered":"2023-11-24T08:04:11.763769+0000","last_unstale":"2023-11-24T08:04:14.366534+0000","last_undegraded":"2023-11-24T08:04:14.366534+0000","last_fullsized":"2023-11-24T08:04:14.366534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:57.912213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876406+0000","last_change":"2023-11-24T08:04:12.769943+0000","last_active":"2023-11-24T08:04:13.876406+0000","last_peered":"2023-11-24T08:04:13.876406+0000","last_clean":"2023-11-24T08:04:13.876406+0000","last_became_active":"2023-11-24T08:04:12.768782+0000","last_became_peered":"2023-11-24T08:04:12.768782+0000","last_unstale":"2023-11-24T08:04:13.876406+0000","last_undegraded":"2023-11-24T08:04:13.876406+0000","last_fullsized":"2023-11-24T08:04:13.876406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:26.559888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366930+0000","last_change":"2023-11-24T08:04:12.756131+0000","last_active":"2023-11-24T08:04:14.366930+0000","last_peered":"2023-11-24T08:04:14.366930+0000","last_clean":"2023-11-24T08:04:14.366930+0000","last_became_active":"2023-11-24T08:04:12.755871+0000","last_became_peered":"2023-11-24T08:04:12.755871+0000","last_unstale":"2023-11-24T08:04:14.366930+0000","last_undegraded":"2023-11-24T08:04:14.366930+0000","last_fullsized":"2023-11-24T08:04:14.366930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:15.109662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366678+0000","last_change":"2023-11-24T08:04:12.763889+0000","last_active":"2023-11-24T08:04:14.366678+0000","last_peered":"2023-11-24T08:04:14.366678+0000","last_clean":"2023-11-24T08:04:14.366678+0000","last_became_active":"2023-11-24T08:04:12.763582+0000","last_became_peered":"2023-11-24T08:04:12.763582+0000","last_unstale":"2023-11-24T08:04:14.366678+0000","last_undegraded":"2023-11-24T08:04:14.366678+0000","last_fullsized":"2023-11-24T08:04:14.366678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:08:11.452166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177507+0000","last_change":"2023-11-24T08:04:12.773095+0000","last_active":"2023-11-24T08:04:14.177507+0000","last_peered":"2023-11-24T08:04:14.177507+0000","last_clean":"2023-11-24T08:04:14.177507+0000","last_became_active":"2023-11-24T08:04:12.772811+0000","last_became_peered":"2023-11-24T08:04:12.772811+0000","last_unstale":"2023-11-24T08:04:14.177507+0000","last_undegraded":"2023-11-24T08:04:14.177507+0000","last_fullsized":"2023-11-24T08:04:14.177507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366824+0000","last_change":"2023-11-24T08:04:12.760168+0000","last_active":"2023-11-24T08:04:14.366824+0000","last_peered":"2023-11-24T08:04:14.366824+0000","last_clean":"2023-11-24T08:04:14.366824+0000","last_became_active":"2023-11-24T08:04:12.759868+0000","last_became_peered":"2023-11-24T08:04:12.759868+0000","last_unstale":"2023-11-24T08:04:14.366824+0000","last_undegraded":"2023-11-24T08:04:14.366824+0000","last_fullsized":"2023-11-24T08:04:14.366824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273253+0000","last_change":"2023-11-24T08:04:12.756627+0000","last_active":"2023-11-24T08:04:14.273253+0000","last_peered":"2023-11-24T08:04:14.273253+0000","last_clean":"2023-11-24T08:04:14.273253+0000","last_became_active":"2023-11-24T08:04:12.756360+0000","last_became_peered":"2023-11-24T08:04:12.756360+0000","last_unstale":"2023-11-24T08:04:14.273253+0000","last_undegraded":"2023-11-24T08:04:14.273253+0000","last_fullsized":"2023-11-24T08:04:14.273253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765638+0000","last_change":"2023-11-24T08:04:12.759234+0000","last_active":"2023-11-24T08:04:13.765638+0000","last_peered":"2023-11-24T08:04:13.765638+0000","last_clean":"2023-11-24T08:04:13.765638+0000","last_became_active":"2023-11-24T08:04:12.758458+0000","last_became_peered":"2023-11-24T08:04:12.758458+0000","last_unstale":"2023-11-24T08:04:13.765638+0000","last_undegraded":"2023-11-24T08:04:13.765638+0000","last_fullsized":"2023-11-24T08:04:13.765638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367321+0000","last_change":"2023-11-24T08:04:12.755695+0000","last_active":"2023-11-24T08:04:14.367321+0000","last_peered":"2023-11-24T08:04:14.367321+0000","last_clean":"2023-11-24T08:04:14.367321+0000","last_became_active":"2023-11-24T08:04:12.755415+0000","last_became_peered":"2023-11-24T08:04:12.755415+0000","last_unstale":"2023-11-24T08:04:14.367321+0000","last_undegraded":"2023-11-24T08:04:14.367321+0000","last_fullsized":"2023-11-24T08:04:14.367321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273363+0000","last_change":"2023-11-24T08:04:12.761355+0000","last_active":"2023-11-24T08:04:14.273363+0000","last_peered":"2023-11-24T08:04:14.273363+0000","last_clean":"2023-11-24T08:04:14.273363+0000","last_became_active":"2023-11-24T08:04:12.761068+0000","last_became_peered":"2023-11-24T08:04:12.761068+0000","last_unstale":"2023-11-24T08:04:14.273363+0000","last_undegraded":"2023-11-24T08:04:14.273363+0000","last_fullsized":"2023-11-24T08:04:14.273363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177495+0000","last_change":"2023-11-24T08:04:12.764876+0000","last_active":"2023-11-24T08:04:14.177495+0000","last_peered":"2023-11-24T08:04:14.177495+0000","last_clean":"2023-11-24T08:04:14.177495+0000","last_became_active":"2023-11-24T08:04:12.764548+0000","last_became_peered":"2023-11-24T08:04:12.764548+0000","last_unstale":"2023-11-24T08:04:14.177495+0000","last_undegraded":"2023-11-24T08:04:14.177495+0000","last_fullsized":"2023-11-24T08:04:14.177495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.272974+0000","last_change":"2023-11-24T08:04:12.761400+0000","last_active":"2023-11-24T08:04:14.272974+0000","last_peered":"2023-11-24T08:04:14.272974+0000","last_clean":"2023-11-24T08:04:14.272974+0000","last_became_active":"2023-11-24T08:04:12.761102+0000","last_became_peered":"2023-11-24T08:04:12.761102+0000","last_unstale":"2023-11-24T08:04:14.272974+0000","last_undegraded":"2023-11-24T08:04:14.272974+0000","last_fullsized":"2023-11-24T08:04:14.272974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177430+0000","last_change":"2023-11-24T08:04:12.773448+0000","last_active":"2023-11-24T08:04:14.177430+0000","last_peered":"2023-11-24T08:04:14.177430+0000","last_clean":"2023-11-24T08:04:14.177430+0000","last_became_active":"2023-11-24T08:04:12.773121+0000","last_became_peered":"2023-11-24T08:04:12.773121+0000","last_unstale":"2023-11-24T08:04:14.177430+0000","last_undegraded":"2023-11-24T08:04:14.177430+0000","last_fullsized":"2023-11-24T08:04:14.177430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366803+0000","last_change":"2023-11-24T08:04:12.762494+0000","last_active":"2023-11-24T08:04:14.366803+0000","last_peered":"2023-11-24T08:04:14.366803+0000","last_clean":"2023-11-24T08:04:14.366803+0000","last_became_active":"2023-11-24T08:04:12.762095+0000","last_became_peered":"2023-11-24T08:04:12.762095+0000","last_unstale":"2023-11-24T08:04:14.366803+0000","last_undegraded":"2023-11-24T08:04:14.366803+0000","last_fullsized":"2023-11-24T08:04:14.366803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367122+0000","last_change":"2023-11-24T08:04:12.754219+0000","last_active":"2023-11-24T08:04:14.367122+0000","last_peered":"2023-11-24T08:04:14.367122+0000","last_clean":"2023-11-24T08:04:14.367122+0000","last_became_active":"2023-11-24T08:04:12.753940+0000","last_became_peered":"2023-11-24T08:04:12.753940+0000","last_unstale":"2023-11-24T08:04:14.367122+0000","last_undegraded":"2023-11-24T08:04:14.367122+0000","last_fullsized":"2023-11-24T08:04:14.367122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:04:17.251 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:04:17.252 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-24T08:04:17.252 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-24T08:04:17.252 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-24T08:04:17.252 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-24T08:04:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.406+0000 7f54923ac700 1 Processor -- start 2023-11-24T08:04:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.406+0000 7f54923ac700 1 -- start start 2023-11-24T08:04:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f54923ac700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158670 0x7f548c0622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f54923ac700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f548c158a50 0x7f548c0c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f54923ac700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c0cfff0 con 0x7f548c162a30 2023-11-24T08:04:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f54923ac700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c0cfd10 con 0x7f548c158a50 2023-11-24T08:04:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f54923ac700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c161f50 con 0x7f548c158670 2023-11-24T08:04:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f548c158a50 0x7f548c0c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f548c158a50 0x7f548c0c98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35428/0 (socket says 172.21.15.153:35428) 2023-11-24T08:04:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548b7fe700 1 -- 172.21.15.153:0/3655017545 learned_addr learned my addr 172.21.15.153:0/3655017545 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548bfff700 1 --2- 172.21.15.153:0/3655017545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158670 0x7f548c0622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548b7fe700 1 -- 172.21.15.153:0/3655017545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158670 msgr2=0x7f548c0622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548b7fe700 1 --2- 172.21.15.153:0/3655017545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158670 0x7f548c0622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548b7fe700 1 -- 172.21.15.153:0/3655017545 >> v1:172.21.15.164:6789/0 conn(0x7f548c162a30 legacy=0x7f548c0d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548b7fe700 1 -- 172.21.15.153:0/3655017545 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c162230 con 0x7f548c158a50 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548bfff700 1 --2- 172.21.15.153:0/3655017545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158670 0x7f548c0622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548b7fe700 1 --2- 172.21.15.153:0/3655017545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f548c158a50 0x7f548c0c98b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f548c06fb70 tx=0x7f5474009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a208878b341519 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548affd700 1 -- 172.21.15.153:0/3655017545 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474011830 con 0x7f548c158a50 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548affd700 1 -- 172.21.15.153:0/3655017545 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474011990 con 0x7f548c158a50 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.407+0000 7f548affd700 1 -- 172.21.15.153:0/3655017545 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474011d20 con 0x7f548c158a50 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.408+0000 7f54923ac700 1 -- 172.21.15.153:0/3655017545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f548c158a50 msgr2=0x7f548c0c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.408+0000 7f54923ac700 1 --2- 172.21.15.153:0/3655017545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f548c158a50 0x7f548c0c98b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f548c06fb70 tx=0x7f5474009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.408+0000 7f54923ac700 1 -- 172.21.15.153:0/3655017545 shutdown_connections 2023-11-24T08:04:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.408+0000 7f54923ac700 1 --2- 172.21.15.153:0/3655017545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158670 0x7f548c0622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.408+0000 7f54923ac700 1 --2- 172.21.15.153:0/3655017545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f548c158a50 0x7f548c0c98b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.408+0000 7f54923ac700 1 -- 172.21.15.153:0/3655017545 >> 172.21.15.153:0/3655017545 conn(0x7f548c0b57b0 msgr2=0x7f548c0b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.408+0000 7f54923ac700 1 -- 172.21.15.153:0/3655017545 shutdown_connections 2023-11-24T08:04:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.408+0000 7f54923ac700 1 -- 172.21.15.153:0/3655017545 wait complete. 2023-11-24T08:04:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.409+0000 7f54923ac700 1 Processor -- start 2023-11-24T08:04:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.410+0000 7f54923ac700 1 -- start start 2023-11-24T08:04:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.410+0000 7f54923ac700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f548c158670 0x7f548c1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f54923ac700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158a50 0x7f548c14b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f54923ac700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f548c162a30 0x7f548c0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f54923ac700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c14bc30 con 0x7f548c162a30 2023-11-24T08:04:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f54923ac700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0b3ed0 con 0x7f548c158670 2023-11-24T08:04:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f54923ac700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0b41b0 con 0x7f548c158a50 2023-11-24T08:04:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5490949700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f548c162a30 0x7f548c0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5490949700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f548c162a30 0x7f548c0b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35434/0 (socket says 172.21.15.153:35434) 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5490949700 1 -- 172.21.15.153:0/2972427737 learned_addr learned my addr 172.21.15.153:0/2972427737 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f548b7fe700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158a50 0x7f548c14b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f548bfff700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f548c158670 0x7f548c1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5490949700 1 -- 172.21.15.153:0/2972427737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158a50 msgr2=0x7f548c14b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5490949700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158a50 0x7f548c14b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5490949700 1 -- 172.21.15.153:0/2972427737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f548c158670 msgr2=0x7f548c1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5490949700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f548c158670 0x7f548c1557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5490949700 1 -- 172.21.15.153:0/2972427737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5474009550 con 0x7f548c162a30 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f548b7fe700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158a50 0x7f548c14b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5490949700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f548c162a30 0x7f548c0b3680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f548400b990 tx=0x7f548400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5488ff9700 1 -- 172.21.15.153:0/2972427737 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400c9d0 con 0x7f548c162a30 2023-11-24T08:04:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5488ff9700 1 -- 172.21.15.153:0/2972427737 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548400cb30 con 0x7f548c162a30 2023-11-24T08:04:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f54923ac700 1 -- 172.21.15.153:0/2972427737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c0b4490 con 0x7f548c162a30 2023-11-24T08:04:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f5488ff9700 1 -- 172.21.15.153:0/2972427737 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484014440 con 0x7f548c162a30 2023-11-24T08:04:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.411+0000 7f54923ac700 1 -- 172.21.15.153:0/2972427737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c0b4a50 con 0x7f548c162a30 2023-11-24T08:04:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.412+0000 7f54923ac700 1 -- 172.21.15.153:0/2972427737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c067f60 con 0x7f548c162a30 2023-11-24T08:04:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.413+0000 7f5488ff9700 1 -- 172.21.15.153:0/2972427737 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5484006d50 con 0x7f548c162a30 2023-11-24T08:04:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.413+0000 7f5488ff9700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f546c06aed0 0x7f546c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.413+0000 7f5488ff9700 1 -- 172.21.15.153:0/2972427737 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5484089040 con 0x7f548c162a30 2023-11-24T08:04:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.413+0000 7f548bfff700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f546c06aed0 0x7f546c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.413+0000 7f548bfff700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f546c06aed0 0x7f546c06d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f547c006fd0 tx=0x7f547c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.418+0000 7f5488ff9700 1 -- 172.21.15.153:0/2972427737 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5484054180 con 0x7f548c162a30 2023-11-24T08:04:17.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.663+0000 7f54923ac700 1 -- 172.21.15.153:0/2972427737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f548c074a20 con 0x7f548c162a30 2023-11-24T08:04:17.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.666+0000 7f5488ff9700 1 -- 172.21.15.153:0/2972427737 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171038 (secure 0 0 0) 0x7f54840577a0 con 0x7f548c162a30 2023-11-24T08:04:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:17.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 -- 172.21.15.153:0/2972427737 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f546c06aed0 msgr2=0x7f546c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f546c06aed0 0x7f546c06d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f547c006fd0 tx=0x7f547c008040 comp rx=0 tx=0).stop 2023-11-24T08:04:17.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 -- 172.21.15.153:0/2972427737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f548c162a30 msgr2=0x7f548c0b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f548c162a30 0x7f548c0b3680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f548400b990 tx=0x7f548400bd50 comp rx=0 tx=0).stop 2023-11-24T08:04:17.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 -- 172.21.15.153:0/2972427737 shutdown_connections 2023-11-24T08:04:17.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f546c06aed0 0x7f546c06d390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f548c162a30 0x7f548c0b3680 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f548c158670 0x7f548c1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 --2- 172.21.15.153:0/2972427737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f548c158a50 0x7f548c14b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 -- 172.21.15.153:0/2972427737 >> 172.21.15.153:0/2972427737 conn(0x7f548c0b57b0 msgr2=0x7f548c156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:17.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 -- 172.21.15.153:0/2972427737 shutdown_connections 2023-11-24T08:04:17.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.669+0000 7f54923ac700 1 -- 172.21.15.153:0/2972427737 wait complete. 2023-11-24T08:04:17.683 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4027560183},{"type":"v1","addr":"172.21.15.153:6833","nonce":4027560183}]},"active_addr":"172.21.15.153:6833/4027560183","active_change":"2023-11-24T08:04:00.033901+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":4252113178}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":585633543}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":2757577725}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":2941520416}]}]} 2023-11-24T08:04:17.686 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-24T08:04:17.686 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-24T08:04:17.686 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:17.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.807+0000 7f08acbd1700 1 Processor -- start 2023-11-24T08:04:17.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.807+0000 7f08acbd1700 1 -- start start 2023-11-24T08:04:17.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.808+0000 7f08acbd1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a815e080 0x7f08a80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.808+0000 7f08acbd1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a80ae430 con 0x7f08a806c710 2023-11-24T08:04:17.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.808+0000 7f08acbd1700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a80ae710 con 0x7f08a80af4d0 2023-11-24T08:04:17.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.808+0000 7f08acbd1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80af0b0 con 0x7f08a815e080 2023-11-24T08:04:17.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.808+0000 7f08a6d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f08a806c710 0x7f08a806e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41546/0 (socket says 172.21.15.153:41546) 2023-11-24T08:04:17.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.808+0000 7f08a6d9d700 1 -- 172.21.15.153:0/2286927375 learned_addr learned my addr 172.21.15.153:0/2286927375 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:17.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.808+0000 7f08a659c700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a815e080 0x7f08a80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.808+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823490478 0 0) 0x7f08a80ae430 con 0x7f08a806c710 2023-11-24T08:04:17.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.808+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08900035b0 con 0x7f08a806c710 2023-11-24T08:04:17.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2935345254 0 0) 0x7f08900035b0 con 0x7f08a806c710 2023-11-24T08:04:17.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a815e080 msgr2=0x7f08a80b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:17.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a815e080 0x7f08a80b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 >> v1:172.21.15.164:6789/0 conn(0x7f08a80af4d0 legacy=0x7f08a806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a80ae9f0 con 0x7f08a806c710 2023-11-24T08:04:17.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f08a00019f0 con 0x7f08a806c710 2023-11-24T08:04:17.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 >> v1:172.21.15.153:6789/0 conn(0x7f08a806c710 legacy=0x7f08a806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a815e080 0x7f0890003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0890003fb0 0x7f0890004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0890004d90 0x7f0890005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80af0b0 con 0x7f0890003fb0 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089000baf0 con 0x7f0890004d90 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089000bcb0 con 0x7f08a815e080 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a5d9b700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0890003fb0 0x7f0890004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a6d9d700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0890004d90 0x7f0890005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a659c700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a815e080 0x7f0890003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a5d9b700 1 -- 172.21.15.153:0/2286927375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a815e080 msgr2=0x7f0890003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a5d9b700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a815e080 0x7f0890003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a5d9b700 1 -- 172.21.15.153:0/2286927375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0890004d90 msgr2=0x7f0890005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a5d9b700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0890004d90 0x7f0890005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a5d9b700 1 -- 172.21.15.153:0/2286927375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08900035b0 con 0x7f0890003fb0 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a5d9b700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0890003fb0 0x7f0890004850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08a80af950 tx=0x7f0890005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524862c2d377b05e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08980052d0 con 0x7f0890003fb0 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0898005470 con 0x7f0890003fb0 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.809+0000 7f08a559a700 1 -- 172.21.15.153:0/2286927375 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08980038c0 con 0x7f0890003fb0 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.810+0000 7f08acbd1700 1 -- 172.21.15.153:0/2286927375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0890003fb0 msgr2=0x7f0890004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.810+0000 7f08acbd1700 1 --2- 172.21.15.153:0/2286927375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0890003fb0 0x7f0890004850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08a80af950 tx=0x7f0890005880 comp rx=0 tx=0).stop 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.810+0000 7f08a6d9d700 1 -- 172.21.15.153:0/2286927375 reap_dead start 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.810+0000 7f08acbd1700 1 -- 172.21.15.153:0/2286927375 shutdown_connections 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.810+0000 7f08acbd1700 1 -- 172.21.15.153:0/2286927375 >> 172.21.15.153:0/2286927375 conn(0x7f08a8071b90 msgr2=0x7f08a8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.810+0000 7f08acbd1700 1 -- 172.21.15.153:0/2286927375 shutdown_connections 2023-11-24T08:04:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.810+0000 7f08acbd1700 1 -- 172.21.15.153:0/2286927375 wait complete. 2023-11-24T08:04:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.811+0000 7f08acbd1700 1 Processor -- start 2023-11-24T08:04:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.811+0000 7f08acbd1700 1 -- start start 2023-11-24T08:04:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08acbd1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0890003fb0 0x7f08a8144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08acbd1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a8151760 0x7f08a80b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08acbd1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8141870 0x7f08a8141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08acbd1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a8158f40 con 0x7f08a8141870 2023-11-24T08:04:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08acbd1700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a8160b60 con 0x7f0890003fb0 2023-11-24T08:04:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08acbd1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a8142260 con 0x7f08a8151760 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8141870 0x7f08a8141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8141870 0x7f08a8141d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35454/0 (socket says 172.21.15.153:35454) 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a6d9d700 1 -- 172.21.15.153:0/3247652261 learned_addr learned my addr 172.21.15.153:0/3247652261 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a5d9b700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a8151760 0x7f08a80b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a659c700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0890003fb0 0x7f08a8144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a6d9d700 1 -- 172.21.15.153:0/3247652261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a8151760 msgr2=0x7f08a80b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a6d9d700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a8151760 0x7f08a80b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a6d9d700 1 -- 172.21.15.153:0/3247652261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0890003fb0 msgr2=0x7f08a8144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a6d9d700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0890003fb0 0x7f08a8144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a6d9d700 1 -- 172.21.15.153:0/3247652261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8161390 con 0x7f08a8141870 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a5d9b700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a8151760 0x7f08a80b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.812+0000 7f08a659c700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0890003fb0 0x7f08a8144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.813+0000 7f08a6d9d700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8141870 0x7f08a8141d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f08a0002230 tx=0x7f08a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.813+0000 7f0896ffd700 1 -- 172.21.15.153:0/3247652261 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a000ae50 con 0x7f08a8141870 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.813+0000 7f0896ffd700 1 -- 172.21.15.153:0/3247652261 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a00133f0 con 0x7f08a8141870 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.813+0000 7f08acbd1700 1 -- 172.21.15.153:0/3247652261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a81454e0 con 0x7f08a8141870 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.813+0000 7f0896ffd700 1 -- 172.21.15.153:0/3247652261 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a00137a0 con 0x7f08a8141870 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.813+0000 7f08acbd1700 1 -- 172.21.15.153:0/3247652261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a81610b0 con 0x7f08a8141870 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.814+0000 7f08acbd1700 1 -- 172.21.15.153:0/3247652261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a80753f0 con 0x7f08a8141870 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.815+0000 7f0896ffd700 1 -- 172.21.15.153:0/3247652261 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08a0013900 con 0x7f08a8141870 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.815+0000 7f0896ffd700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f088806aed0 0x7f088806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.815+0000 7f08a659c700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f088806aed0 0x7f088806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.815+0000 7f0896ffd700 1 -- 172.21.15.153:0/3247652261 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08a008aa60 con 0x7f08a8141870 2023-11-24T08:04:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.815+0000 7f08a659c700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f088806aed0 0x7f088806d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f08a8072d10 tx=0x7f089c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:17.819+0000 7f0896ffd700 1 -- 172.21.15.153:0/3247652261 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08a0055bf0 con 0x7f08a8141870 2023-11-24T08:04:17.959 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:17.963 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.011+0000 7f08acbd1700 1 -- 172.21.15.153:0/3247652261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08a8159080 con 0x7f08a8141870 2023-11-24T08:04:18.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.012+0000 7f0896ffd700 1 -- 172.21.15.153:0/3247652261 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f08a8159080 con 0x7f08a8141870 2023-11-24T08:04:18.014 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:18.015 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 -- 172.21.15.153:0/3247652261 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f088806aed0 msgr2=0x7f088806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f088806aed0 0x7f088806d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f08a8072d10 tx=0x7f089c008040 comp rx=0 tx=0).stop 2023-11-24T08:04:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 -- 172.21.15.153:0/3247652261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8141870 msgr2=0x7f08a8141d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8141870 0x7f08a8141d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f08a0002230 tx=0x7f08a000a620 comp rx=0 tx=0).stop 2023-11-24T08:04:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 -- 172.21.15.153:0/3247652261 shutdown_connections 2023-11-24T08:04:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f088806aed0 0x7f088806d390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8141870 0x7f08a8141d20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0890003fb0 0x7f08a8144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 --2- 172.21.15.153:0/3247652261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08a8151760 0x7f08a80b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 -- 172.21.15.153:0/3247652261 >> 172.21.15.153:0/3247652261 conn(0x7f08a8071b90 msgr2=0x7f08a815d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 -- 172.21.15.153:0/3247652261 shutdown_connections 2023-11-24T08:04:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.014+0000 7f08acbd1700 1 -- 172.21.15.153:0/3247652261 wait complete. 2023-11-24T08:04:18.029 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-24T08:04:18.029 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:18.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.188+0000 7f3dca9c6700 1 Processor -- start 2023-11-24T08:04:18.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.188+0000 7f3dca9c6700 1 -- start start 2023-11-24T08:04:18.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dca9c6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dc40b3370 0x7f3dc41604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dca9c6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc40b22d0 con 0x7f3dc40d1c70 2023-11-24T08:04:18.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dca9c6700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc40b25b0 con 0x7f3dc415bdd0 2023-11-24T08:04:18.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dca9c6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40b2f50 con 0x7f3dc40b3370 2023-11-24T08:04:18.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc8f63700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3dc40d1c70 0x7f3dc4165ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41566/0 (socket says 172.21.15.153:41566) 2023-11-24T08:04:18.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc8f63700 1 -- 172.21.15.153:0/3438651171 learned_addr learned my addr 172.21.15.153:0/3438651171 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:18.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc37fe700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dc40b3370 0x7f3dc41604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975612082 0 0) 0x7f3dc40b22d0 con 0x7f3dc40d1c70 2023-11-24T08:04:18.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dac0035b0 con 0x7f3dc40d1c70 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601787053 0 0) 0x7f3dc40b25b0 con 0x7f3dc415bdd0 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc40b22d0 con 0x7f3dc415bdd0 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3705278135 0 0) 0x7f3dac0035b0 con 0x7f3dc40d1c70 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dc40b3370 msgr2=0x7f3dc41604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dc40b3370 0x7f3dc41604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 >> v1:172.21.15.164:6789/0 conn(0x7f3dc415bdd0 legacy=0x7f3dc40b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40b2890 con 0x7f3dc40d1c70 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f3dbc0019f0 con 0x7f3dc40d1c70 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 >> v1:172.21.15.153:6789/0 conn(0x7f3dc40d1c70 legacy=0x7f3dc4165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac003bc0 0x7f3dac003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dc40b3370 0x7f3dac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dac004d90 0x7f3dac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40b2f50 con 0x7f3dac003bc0 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac00bac0 con 0x7f3dac004d90 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac00bc30 con 0x7f3dc40b3370 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.189+0000 7f3dc3fff700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac003bc0 0x7f3dac003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc37fe700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dc40b3370 0x7f3dac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc8f63700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dac004d90 0x7f3dac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc3fff700 1 -- 172.21.15.153:0/3438651171 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dc40b3370 msgr2=0x7f3dac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc3fff700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dc40b3370 0x7f3dac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc3fff700 1 -- 172.21.15.153:0/3438651171 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dac004d90 msgr2=0x7f3dac005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc3fff700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dac004d90 0x7f3dac005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc3fff700 1 -- 172.21.15.153:0/3438651171 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac0035b0 con 0x7f3dac003bc0 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc3fff700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac003bc0 0x7f3dac003fc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3db4001940 tx=0x7f3dac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bbcf020b3838a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4001430 con 0x7f3dac003bc0 2023-11-24T08:04:18.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4001d70 con 0x7f3dac003bc0 2023-11-24T08:04:18.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc2ffd700 1 -- 172.21.15.153:0/3438651171 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4005510 con 0x7f3dac003bc0 2023-11-24T08:04:18.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dca9c6700 1 -- 172.21.15.153:0/3438651171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac003bc0 msgr2=0x7f3dac003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dca9c6700 1 --2- 172.21.15.153:0/3438651171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac003bc0 0x7f3dac003fc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3db4001940 tx=0x7f3dac005880 comp rx=0 tx=0).stop 2023-11-24T08:04:18.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.190+0000 7f3dc8f63700 1 -- 172.21.15.153:0/3438651171 reap_dead start 2023-11-24T08:04:18.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.191+0000 7f3dca9c6700 1 -- 172.21.15.153:0/3438651171 shutdown_connections 2023-11-24T08:04:18.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.191+0000 7f3dca9c6700 1 -- 172.21.15.153:0/3438651171 >> 172.21.15.153:0/3438651171 conn(0x7f3dc40731a0 msgr2=0x7f3dc409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.191+0000 7f3dca9c6700 1 -- 172.21.15.153:0/3438651171 shutdown_connections 2023-11-24T08:04:18.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.191+0000 7f3dca9c6700 1 -- 172.21.15.153:0/3438651171 wait complete. 2023-11-24T08:04:18.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.192+0000 7f3dca9c6700 1 Processor -- start 2023-11-24T08:04:18.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.192+0000 7f3dca9c6700 1 -- start start 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dca9c6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dac003bc0 0x7f3dc415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dca9c6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dc4157140 0x7f3dc40ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dca9c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc40caa70 0x7f3dc40c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dca9c6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40caef0 con 0x7f3dc40caa70 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dca9c6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc406b4e0 con 0x7f3dc4157140 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dca9c6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40c9ae0 con 0x7f3dac003bc0 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc8f63700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc40caa70 0x7f3dc40c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc37fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dc4157140 0x7f3dc40ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc8f63700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc40caa70 0x7f3dc40c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35474/0 (socket says 172.21.15.153:35474) 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc8f63700 1 -- 172.21.15.153:0/1434786987 learned_addr learned my addr 172.21.15.153:0/1434786987 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc3fff700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dac003bc0 0x7f3dc415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc8f63700 1 -- 172.21.15.153:0/1434786987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dac003bc0 msgr2=0x7f3dc415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc8f63700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dac003bc0 0x7f3dc415cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc8f63700 1 -- 172.21.15.153:0/1434786987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dc4157140 msgr2=0x7f3dc40ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc8f63700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dc4157140 0x7f3dc40ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc8f63700 1 -- 172.21.15.153:0/1434786987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40c9dc0 con 0x7f3dc40caa70 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc8f63700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc40caa70 0x7f3dc40c8db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40d06d0 tx=0x7f3dbc00a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc0ff9700 1 -- 172.21.15.153:0/1434786987 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00ad80 con 0x7f3dc40caa70 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc0ff9700 1 -- 172.21.15.153:0/1434786987 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc0133f0 con 0x7f3dc40caa70 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dc0ff9700 1 -- 172.21.15.153:0/1434786987 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0137a0 con 0x7f3dc40caa70 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dca9c6700 1 -- 172.21.15.153:0/1434786987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc406b170 con 0x7f3dc40caa70 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.193+0000 7f3dca9c6700 1 -- 172.21.15.153:0/1434786987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc41577a0 con 0x7f3dc40caa70 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.194+0000 7f3dca9c6700 1 -- 172.21.15.153:0/1434786987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc40c9fb0 con 0x7f3dc40caa70 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.195+0000 7f3dc0ff9700 1 -- 172.21.15.153:0/1434786987 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3dbc013900 con 0x7f3dc40caa70 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.195+0000 7f3dc0ff9700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3db006aed0 0x7f3db006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.195+0000 7f3dc0ff9700 1 -- 172.21.15.153:0/1434786987 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3dbc089e80 con 0x7f3dc40caa70 2023-11-24T08:04:18.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.195+0000 7f3dc3fff700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3db006aed0 0x7f3db006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.196+0000 7f3dc3fff700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3db006aed0 0x7f3db006d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3db4015040 tx=0x7f3db400a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.200+0000 7f3dc0ff9700 1 -- 172.21.15.153:0/1434786987 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3dbc054f30 con 0x7f3dc40caa70 2023-11-24T08:04:18.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.392+0000 7f3dca9c6700 1 -- 172.21.15.153:0/1434786987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dc4067f60 con 0x7f3dc40caa70 2023-11-24T08:04:18.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.393+0000 7f3dc0ff9700 1 -- 172.21.15.153:0/1434786987 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f3dbc058550 con 0x7f3dc40caa70 2023-11-24T08:04:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:18.395 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:18.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 -- 172.21.15.153:0/1434786987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3db006aed0 msgr2=0x7f3db006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3db006aed0 0x7f3db006d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3db4015040 tx=0x7f3db400a000 comp rx=0 tx=0).stop 2023-11-24T08:04:18.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 -- 172.21.15.153:0/1434786987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc40caa70 msgr2=0x7f3dc40c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc40caa70 0x7f3dc40c8db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40d06d0 tx=0x7f3dbc00a5b0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 -- 172.21.15.153:0/1434786987 shutdown_connections 2023-11-24T08:04:18.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3db006aed0 0x7f3db006d390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dc40caa70 0x7f3dc40c8db0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dac003bc0 0x7f3dc415cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 --2- 172.21.15.153:0/1434786987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dc4157140 0x7f3dc40ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 -- 172.21.15.153:0/1434786987 >> 172.21.15.153:0/1434786987 conn(0x7f3dc40731a0 msgr2=0x7f3dc40b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 -- 172.21.15.153:0/1434786987 shutdown_connections 2023-11-24T08:04:18.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.395+0000 7f3dca9c6700 1 -- 172.21.15.153:0/1434786987 wait complete. 2023-11-24T08:04:18.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-24T08:04:18.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-24T08:04:18.411 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-24T08:04:18.411 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-24T08:04:18.411 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-24T08:04:18.412 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-24T08:04:18.412 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-24T08:04:18.413 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-24T08:04:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.603+0000 7f4040e23700 1 Processor -- start 2023-11-24T08:04:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.603+0000 7f4040e23700 1 -- start start 2023-11-24T08:04:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.604+0000 7f4040e23700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f403c16ae60 0x7f403c06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.604+0000 7f4040e23700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c072bb0 0x7f403c0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.604+0000 7f4040e23700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403c08bdb0 con 0x7f403c0b4090 2023-11-24T08:04:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.604+0000 7f4040e23700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403c0b4510 con 0x7f403c16ae60 2023-11-24T08:04:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.604+0000 7f4040e23700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403c06ce30 con 0x7f403c072bb0 2023-11-24T08:04:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.605+0000 7f403a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f403c16ae60 0x7f403c06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.605+0000 7f4039d9b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c072bb0 0x7f403c0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.605+0000 7f4039d9b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c072bb0 0x7f403c0b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47552/0 (socket says 172.21.15.153:47552) 2023-11-24T08:04:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.605+0000 7f4039d9b700 1 -- 172.21.15.153:0/3861611229 learned_addr learned my addr 172.21.15.153:0/3861611229 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.605+0000 7f403a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f403c16ae60 0x7f403c06efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35478/0 (socket says 172.21.15.153:35478) 2023-11-24T08:04:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.605+0000 7f403a59c700 1 -- 172.21.15.153:0/3861611229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c072bb0 msgr2=0x7f403c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.605+0000 7f403a59c700 1 --2- 172.21.15.153:0/3861611229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c072bb0 0x7f403c0b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.605+0000 7f403a59c700 1 -- 172.21.15.153:0/3861611229 >> v1:172.21.15.164:6789/0 conn(0x7f403c0b4090 legacy=0x7f403c16e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.605+0000 7f403a59c700 1 -- 172.21.15.153:0/3861611229 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c06d110 con 0x7f403c16ae60 2023-11-24T08:04:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.606+0000 7f4039d9b700 1 --2- 172.21.15.153:0/3861611229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c072bb0 0x7f403c0b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.606+0000 7f403a59c700 1 --2- 172.21.15.153:0/3861611229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c16ae60 0x7f403c06efc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4034009d90 tx=0x7f403400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c61bdb49855889f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.606+0000 7f403959a700 1 -- 172.21.15.153:0/3861611229 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400e070 con 0x7f403c16ae60 2023-11-24T08:04:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.606+0000 7f403959a700 1 -- 172.21.15.153:0/3861611229 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403400bae0 con 0x7f403c16ae60 2023-11-24T08:04:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.606+0000 7f403959a700 1 -- 172.21.15.153:0/3861611229 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400be70 con 0x7f403c16ae60 2023-11-24T08:04:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.607+0000 7f4040e23700 1 -- 172.21.15.153:0/3861611229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c16ae60 msgr2=0x7f403c06efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.607+0000 7f4040e23700 1 --2- 172.21.15.153:0/3861611229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c16ae60 0x7f403c06efc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4034009d90 tx=0x7f403400b330 comp rx=0 tx=0).stop 2023-11-24T08:04:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.608+0000 7f4040e23700 1 -- 172.21.15.153:0/3861611229 shutdown_connections 2023-11-24T08:04:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.608+0000 7f4040e23700 1 --2- 172.21.15.153:0/3861611229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c16ae60 0x7f403c06efc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.608+0000 7f4040e23700 1 --2- 172.21.15.153:0/3861611229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c072bb0 0x7f403c0b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.608+0000 7f4040e23700 1 -- 172.21.15.153:0/3861611229 >> 172.21.15.153:0/3861611229 conn(0x7f403c0cfa30 msgr2=0x7f403c0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.608+0000 7f4040e23700 1 -- 172.21.15.153:0/3861611229 shutdown_connections 2023-11-24T08:04:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.608+0000 7f4040e23700 1 -- 172.21.15.153:0/3861611229 wait complete. 2023-11-24T08:04:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.610+0000 7f4040e23700 1 Processor -- start 2023-11-24T08:04:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.610+0000 7f4040e23700 1 -- start start 2023-11-24T08:04:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.611+0000 7f4040e23700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c0b4090 0x7f403c163250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.611+0000 7f4040e23700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403c0aede0 0x7f403c1697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.611+0000 7f4040e23700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c225020 0x7f403c2254a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.611+0000 7f4040e23700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c163cc0 con 0x7f403c0b4090 2023-11-24T08:04:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.611+0000 7f4040e23700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c2259e0 con 0x7f403c0aede0 2023-11-24T08:04:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.611+0000 7f4040e23700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403c164520 con 0x7f403c225020 2023-11-24T08:04:18.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.611+0000 7f403a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c0b4090 0x7f403c163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.611+0000 7f403ad9d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c225020 0x7f403c2254a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.611+0000 7f403a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c0b4090 0x7f403c163250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35486/0 (socket says 172.21.15.153:35486) 2023-11-24T08:04:18.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.611+0000 7f403a59c700 1 -- 172.21.15.153:0/3990200612 learned_addr learned my addr 172.21.15.153:0/3990200612 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.612+0000 7f403ad9d700 1 -- 172.21.15.153:0/3990200612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403c0aede0 msgr2=0x7f403c1697c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:04:18.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.612+0000 7f403ad9d700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403c0aede0 0x7f403c1697c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.612+0000 7f403ad9d700 1 -- 172.21.15.153:0/3990200612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c0b4090 msgr2=0x7f403c163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.612+0000 7f403ad9d700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c0b4090 0x7f403c163250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.612+0000 7f403ad9d700 1 -- 172.21.15.153:0/3990200612 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300085d0 con 0x7f403c225020 2023-11-24T08:04:18.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.612+0000 7f403ad9d700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c225020 0x7f403c2254a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f402c00b410 tx=0x7f402c00b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.612+0000 7f402affd700 1 -- 172.21.15.153:0/3990200612 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c011830 con 0x7f403c225020 2023-11-24T08:04:18.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.612+0000 7f402affd700 1 -- 172.21.15.153:0/3990200612 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c011990 con 0x7f403c225020 2023-11-24T08:04:18.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.612+0000 7f402affd700 1 -- 172.21.15.153:0/3990200612 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c011d40 con 0x7f403c225020 2023-11-24T08:04:18.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.612+0000 7f4040e23700 1 -- 172.21.15.153:0/3990200612 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4034009a70 con 0x7f403c225020 2023-11-24T08:04:18.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.613+0000 7f4040e23700 1 -- 172.21.15.153:0/3990200612 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403c163ed0 con 0x7f403c225020 2023-11-24T08:04:18.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.615+0000 7f402affd700 1 -- 172.21.15.153:0/3990200612 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f402c01a400 con 0x7f403c225020 2023-11-24T08:04:18.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.615+0000 7f402affd700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f401c06afd0 0x7f401c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.615+0000 7f402affd700 1 -- 172.21.15.153:0/3990200612 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f402c0890b0 con 0x7f403c225020 2023-11-24T08:04:18.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.616+0000 7f4040e23700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] conn(0x7f40200015d0 0x7f4020003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.616+0000 7f4040e23700 1 -- 172.21.15.153:0/3990200612 --> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4020006bc0 con 0x7f40200015d0 2023-11-24T08:04:18.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.616+0000 7f403a59c700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f401c06afd0 0x7f401c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.617+0000 7f2b10fa3700 1 Processor -- start 2023-11-24T08:04:18.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.617+0000 7f2b10fa3700 1 -- start start 2023-11-24T08:04:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.618+0000 7f403a59c700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f401c06afd0 0x7f401c06d490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4034000f80 tx=0x7f4034011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.618+0000 7f2b10fa3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 0x7f2b0c0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.618+0000 7f2b10fa3700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2b0c0b4090 0x7f2b0c0714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.618+0000 7f2b10fa3700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c0720e0 con 0x7f2b0c0d0520 2023-11-24T08:04:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.618+0000 7f2b10fa3700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c072d60 con 0x7f2b0c0b4090 2023-11-24T08:04:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.618+0000 7f2b10fa3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c06de80 con 0x7f2b0c15d6a0 2023-11-24T08:04:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.618+0000 7f2b0ad9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2b0c0d0520 0x7f2b0c06d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41596/0 (socket says 172.21.15.153:41596) 2023-11-24T08:04:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.618+0000 7f2b0ad9d700 1 -- 172.21.15.153:0/4193678957 learned_addr learned my addr 172.21.15.153:0/4193678957 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.619+0000 7f4039d9b700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] conn(0x7f40200015d0 0x7f4020003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.619+0000 7f2b0a59c700 1 --2- 172.21.15.153:0/4193678957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 0x7f2b0c0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.619+0000 7f2b09d9b700 1 --2- 172.21.15.153:0/4193678957 >> v2:172.21.15.164:3300/0 conn(0x7f2b0c0b4090 0x7f2b0c0714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.619+0000 7f2b0a59c700 1 -- 172.21.15.153:0/4193678957 >> v2:172.21.15.164:3300/0 conn(0x7f2b0c0b4090 msgr2=0x7f2b0c0714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.619+0000 7f2b0a59c700 1 --2- 172.21.15.153:0/4193678957 >> v2:172.21.15.164:3300/0 conn(0x7f2b0c0b4090 0x7f2b0c0714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.619+0000 7f2b0a59c700 1 -- 172.21.15.153:0/4193678957 >> v1:172.21.15.153:6789/0 conn(0x7f2b0c0d0520 legacy=0x7f2b0c06d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.619+0000 7f2b0a59c700 1 -- 172.21.15.153:0/4193678957 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c0723c0 con 0x7f2b0c15d6a0 2023-11-24T08:04:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.620+0000 7f2b0a59c700 1 --2- 172.21.15.153:0/4193678957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 0x7f2b0c0b3b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009840 tx=0x7f2b00009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71cb29c6db1ca57e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.621+0000 7f4039d9b700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] conn(0x7f40200015d0 0x7f4020003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.622+0000 7f2b0959a700 1 -- 172.21.15.153:0/4193678957 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00011830 con 0x7f2b0c15d6a0 2023-11-24T08:04:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.622+0000 7f2b0959a700 1 -- 172.21.15.153:0/4193678957 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00011990 con 0x7f2b0c15d6a0 2023-11-24T08:04:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.622+0000 7f2b0959a700 1 -- 172.21.15.153:0/4193678957 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00011d20 con 0x7f2b0c15d6a0 2023-11-24T08:04:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.624+0000 7fdd01345700 1 Processor -- start 2023-11-24T08:04:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.622+0000 7f402affd700 1 -- 172.21.15.153:0/3990200612 <== osd.4 v2:172.21.15.164:6800/3824651650 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4020006bc0 con 0x7f40200015d0 2023-11-24T08:04:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.622+0000 7f2b10fa3700 1 -- 172.21.15.153:0/4193678957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 msgr2=0x7f2b0c0b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.622+0000 7f2b10fa3700 1 --2- 172.21.15.153:0/4193678957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 0x7f2b0c0b3b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009840 tx=0x7f2b00009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.622+0000 7f2b10fa3700 1 -- 172.21.15.153:0/4193678957 shutdown_connections 2023-11-24T08:04:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.622+0000 7f2b10fa3700 1 --2- 172.21.15.153:0/4193678957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 0x7f2b0c0b3b50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.622+0000 7f2b10fa3700 1 --2- 172.21.15.153:0/4193678957 >> v2:172.21.15.164:3300/0 conn(0x7f2b0c0b4090 0x7f2b0c0714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.622+0000 7f2b10fa3700 1 -- 172.21.15.153:0/4193678957 >> 172.21.15.153:0/4193678957 conn(0x7f2b0c0cfa30 msgr2=0x7f2b0c0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.625+0000 7f2b10fa3700 1 -- 172.21.15.153:0/4193678957 shutdown_connections 2023-11-24T08:04:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.625+0000 7f2b10fa3700 1 -- 172.21.15.153:0/4193678957 wait complete. 2023-11-24T08:04:18.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.624+0000 7fdd01345700 1 -- start start 2023-11-24T08:04:18.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.625+0000 7fdd01345700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdcfc15af10 0x7fdcfc15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.625+0000 7fdd01345700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdcfc15f630 0x7fdcfc06b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.625+0000 7fdd01345700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc1414c0 con 0x7fdcfc0ce140 2023-11-24T08:04:18.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.625+0000 7fdd01345700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc15c300 con 0x7fdcfc15f630 2023-11-24T08:04:18.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.625+0000 7fdd01345700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc0ce9f0 con 0x7fdcfc15af10 2023-11-24T08:04:18.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.625+0000 7fb976b14700 1 Processor -- start 2023-11-24T08:04:18.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.625+0000 7fdcfb7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdcfc15f630 0x7fdcfc06b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.626+0000 7fdcfb7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdcfc15f630 0x7fdcfc06b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35500/0 (socket says 172.21.15.153:35500) 2023-11-24T08:04:18.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.626+0000 7fdcfb7fe700 1 -- 172.21.15.153:0/3066578510 learned_addr learned my addr 172.21.15.153:0/3066578510 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.626+0000 7fdcfaffd700 1 --2- 172.21.15.153:0/3066578510 >> v2:172.21.15.164:3300/0 conn(0x7fdcfc15af10 0x7fdcfc15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.626+0000 7fdcfaffd700 1 -- 172.21.15.153:0/3066578510 >> v2:172.21.15.153:3300/0 conn(0x7fdcfc15f630 msgr2=0x7fdcfc06b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.626+0000 7fdcfaffd700 1 --2- 172.21.15.153:0/3066578510 >> v2:172.21.15.153:3300/0 conn(0x7fdcfc15f630 0x7fdcfc06b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.626+0000 7fdcfaffd700 1 -- 172.21.15.153:0/3066578510 >> v1:172.21.15.153:6789/0 conn(0x7fdcfc0ce140 legacy=0x7fdcfc15ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.626+0000 7fdcfaffd700 1 -- 172.21.15.153:0/3066578510 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0cecd0 con 0x7fdcfc15af10 2023-11-24T08:04:18.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.626+0000 7fb976b14700 1 -- start start 2023-11-24T08:04:18.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7f2b10fa3700 1 Processor -- start 2023-11-24T08:04:18.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.626+0000 7fdcfaffd700 1 --2- 172.21.15.153:0/3066578510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc15af10 0x7fdcfc15e9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc06d0c0 tx=0x7fdcf000bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a7955d23e27afe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.626+0000 7fdcf9ffb700 1 -- 172.21.15.153:0/3066578510 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000dc30 con 0x7fdcfc15af10 2023-11-24T08:04:18.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.626+0000 7fdcf9ffb700 1 -- 172.21.15.153:0/3066578510 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf000dd90 con 0x7fdcfc15af10 2023-11-24T08:04:18.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7fdcf9ffb700 1 -- 172.21.15.153:0/3066578510 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0004250 con 0x7fdcfc15af10 2023-11-24T08:04:18.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7fb976b14700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb97013df40 0x7fb970140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7fb976b14700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb970140ad0 0x7fb97015b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7fb976b14700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb970140f10 con 0x7fb97013db60 2023-11-24T08:04:18.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7fb976b14700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9700cf370 con 0x7fb97013df40 2023-11-24T08:04:18.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7fb976b14700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9700cf650 con 0x7fb970140ad0 2023-11-24T08:04:18.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7f2b10fa3700 1 -- start start 2023-11-24T08:04:18.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7f2b10fa3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b0c0b4090 0x7f2b0c0a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7f2b10fa3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2b0c0d0520 0x7f2b0c158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7f2b10fa3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 0x7f2b0c140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7f2b10fa3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c158a60 con 0x7f2b0c0b4090 2023-11-24T08:04:18.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7f2b10fa3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0aa500 con 0x7f2b0c0d0520 2023-11-24T08:04:18.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7f2b10fa3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0aa7e0 con 0x7f2b0c15d6a0 2023-11-24T08:04:18.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fb9748b0700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb97013db60 0x7fb9700d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41608/0 (socket says 172.21.15.153:41608) 2023-11-24T08:04:18.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fb9748b0700 1 -- 172.21.15.153:0/4234101929 learned_addr learned my addr 172.21.15.153:0/4234101929 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:18.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fb96ffff700 1 --2- 172.21.15.153:0/4234101929 >> v2:172.21.15.164:3300/0 conn(0x7fb97013df40 0x7fb970140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7fdd01345700 1 -- 172.21.15.153:0/3066578510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc15af10 msgr2=0x7fdcfc15e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.627+0000 7fdd01345700 1 --2- 172.21.15.153:0/3066578510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc15af10 0x7fdcfc15e9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc06d0c0 tx=0x7fdcf000bdc0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b0ad9d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 0x7f2b0c140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b0a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b0c0b4090 0x7f2b0c0a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b0ad9d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 0x7f2b0c140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47582/0 (socket says 172.21.15.153:47582) 2023-11-24T08:04:18.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b0ad9d700 1 -- 172.21.15.153:0/3095969875 learned_addr learned my addr 172.21.15.153:0/3095969875 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fdd01345700 1 -- 172.21.15.153:0/3066578510 shutdown_connections 2023-11-24T08:04:18.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fdd01345700 1 --2- 172.21.15.153:0/3066578510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc15af10 0x7fdcfc15e9e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fdd01345700 1 --2- 172.21.15.153:0/3066578510 >> v2:172.21.15.153:3300/0 conn(0x7fdcfc15f630 0x7fdcfc06b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fdd01345700 1 -- 172.21.15.153:0/3066578510 >> 172.21.15.153:0/3066578510 conn(0x7fdcfc0cd570 msgr2=0x7fdcfc0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fdd01345700 1 -- 172.21.15.153:0/3066578510 shutdown_connections 2023-11-24T08:04:18.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b09d9b700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2b0c0d0520 0x7f2b0c158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fb9750b1700 1 --2- 172.21.15.153:0/4234101929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb970140ad0 0x7fb97015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fb96ffff700 1 -- 172.21.15.153:0/4234101929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb970140ad0 msgr2=0x7fb97015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fb96ffff700 1 --2- 172.21.15.153:0/4234101929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb970140ad0 0x7fb97015b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fb96ffff700 1 -- 172.21.15.153:0/4234101929 >> v1:172.21.15.153:6789/0 conn(0x7fb97013db60 legacy=0x7fb9700d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fb96ffff700 1 -- 172.21.15.153:0/4234101929 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9700cf930 con 0x7fb97013df40 2023-11-24T08:04:18.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b0a59c700 1 -- 172.21.15.153:0/3095969875 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 msgr2=0x7f2b0c140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b0a59c700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 0x7f2b0c140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b0a59c700 1 -- 172.21.15.153:0/3095969875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2b0c0d0520 msgr2=0x7f2b0c158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b0a59c700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2b0c0d0520 0x7f2b0c158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b0a59c700 1 -- 172.21.15.153:0/3095969875 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b000094a0 con 0x7f2b0c0b4090 2023-11-24T08:04:18.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b0ad9d700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2b0c15d6a0 0x7f2b0c140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:18.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fdd01345700 1 -- 172.21.15.153:0/3066578510 wait complete. 2023-11-24T08:04:18.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7f2b0a59c700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b0c0b4090 0x7f2b0c0a9e70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009840 tx=0x7f2b00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.628+0000 7fb96ffff700 1 --2- 172.21.15.153:0/4234101929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97013df40 0x7fb970140590 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb968009840 tx=0x7fb968009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6b8b72d3724b8ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.629+0000 7fb96f7fe700 1 -- 172.21.15.153:0/4234101929 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968011830 con 0x7fb97013df40 2023-11-24T08:04:18.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.629+0000 7f2afaffd700 1 -- 172.21.15.153:0/3095969875 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00004510 con 0x7f2b0c0b4090 2023-11-24T08:04:18.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.629+0000 7f2afaffd700 1 -- 172.21.15.153:0/3095969875 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0001f070 con 0x7f2b0c0b4090 2023-11-24T08:04:18.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.629+0000 7f2afaffd700 1 -- 172.21.15.153:0/3095969875 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b000038c0 con 0x7f2b0c0b4090 2023-11-24T08:04:18.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.629+0000 7f2b10fa3700 1 -- 172.21.15.153:0/3095969875 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0c0aaac0 con 0x7f2b0c0b4090 2023-11-24T08:04:18.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.629+0000 7f2b10fa3700 1 -- 172.21.15.153:0/3095969875 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0c0ab080 con 0x7f2b0c0b4090 2023-11-24T08:04:18.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.629+0000 7fb96f7fe700 1 -- 172.21.15.153:0/4234101929 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb968011990 con 0x7fb97013df40 2023-11-24T08:04:18.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.629+0000 7fb96f7fe700 1 -- 172.21.15.153:0/4234101929 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968011d20 con 0x7fb97013df40 2023-11-24T08:04:18.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.630+0000 7fb976b14700 1 -- 172.21.15.153:0/4234101929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97013df40 msgr2=0x7fb970140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.630+0000 7fb976b14700 1 --2- 172.21.15.153:0/4234101929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97013df40 0x7fb970140590 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb968009840 tx=0x7fb968009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:18.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.630+0000 7fdd01345700 1 Processor -- start 2023-11-24T08:04:18.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.630+0000 7fb976b14700 1 -- 172.21.15.153:0/4234101929 shutdown_connections 2023-11-24T08:04:18.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.630+0000 7fb976b14700 1 --2- 172.21.15.153:0/4234101929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb970140ad0 0x7fb97015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.630+0000 7fb976b14700 1 --2- 172.21.15.153:0/4234101929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97013df40 0x7fb970140590 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.630+0000 7fb976b14700 1 -- 172.21.15.153:0/4234101929 >> 172.21.15.153:0/4234101929 conn(0x7fb970072a20 msgr2=0x7fb97006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.630+0000 7f2b10fa3700 1 -- 172.21.15.153:0/3095969875 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b0c072980 con 0x7f2b0c0b4090 2023-11-24T08:04:18.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.630+0000 7fdd01345700 1 -- start start 2023-11-24T08:04:18.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7fb976b14700 1 -- 172.21.15.153:0/4234101929 shutdown_connections 2023-11-24T08:04:18.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7fdd01345700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc0ce140 0x7fdcfc15df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7fdd01345700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc15af10 0x7fdcfc159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7fdd01345700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcfc13d600 0x7fdcfc0b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7fdd01345700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc15d570 con 0x7fdcfc13d600 2023-11-24T08:04:18.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7fdd01345700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc159f90 con 0x7fdcfc0ce140 2023-11-24T08:04:18.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7fdd01345700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0b5190 con 0x7fdcfc15af10 2023-11-24T08:04:18.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcfc13d600 0x7fdcfc0b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcfc13d600 0x7fdcfc0b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35516/0 (socket says 172.21.15.153:35516) 2023-11-24T08:04:18.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7fdcfb7fe700 1 -- 172.21.15.153:0/3283205505 learned_addr learned my addr 172.21.15.153:0/3283205505 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7f2afaffd700 1 -- 172.21.15.153:0/3095969875 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b00003a20 con 0x7f2b0c0b4090 2023-11-24T08:04:18.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.631+0000 7fdcfaffd700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc0ce140 0x7fdcfc15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fdcfb7fe700 1 -- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc15af10 msgr2=0x7fdcfc159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fdcfa7fc700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc15af10 0x7fdcfc159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7f2afaffd700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2af406b0b0 0x7f2af406d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fdcfb7fe700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc15af10 0x7fdcfc159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fdcfb7fe700 1 -- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc0ce140 msgr2=0x7fdcfc15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fdcfb7fe700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc0ce140 0x7fdcfc15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fdcfb7fe700 1 -- 172.21.15.153:0/3283205505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf000b740 con 0x7fdcfc13d600 2023-11-24T08:04:18.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fdcfaffd700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc0ce140 0x7fdcfc15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:18.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7f2afaffd700 1 -- 172.21.15.153:0/3095969875 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b00021070 con 0x7f2b0c0b4090 2023-11-24T08:04:18.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7f2afaffd700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] conn(0x7f2af40732d0 0x7f2af40756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7f2afaffd700 1 -- 172.21.15.153:0/3095969875 --> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2af4075da0 con 0x7f2af40732d0 2023-11-24T08:04:18.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7f2afaffd700 1 -- 172.21.15.153:0/3095969875 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b000554a0 con 0x7f2b0c0b4090 2023-11-24T08:04:18.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fdcfb7fe700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcfc13d600 0x7fdcfc0b48b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400efc0 tx=0x7fdcf400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fdce37fe700 1 -- 172.21.15.153:0/3283205505 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4003c20 con 0x7fdcfc13d600 2023-11-24T08:04:18.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fdce37fe700 1 -- 172.21.15.153:0/3283205505 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf400f040 con 0x7fdcfc13d600 2023-11-24T08:04:18.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fdd01345700 1 -- 172.21.15.153:0/3283205505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc0b5470 con 0x7fdcfc13d600 2023-11-24T08:04:18.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fb976b14700 1 -- 172.21.15.153:0/4234101929 wait complete. 2023-11-24T08:04:18.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.633+0000 7fdce37fe700 1 -- 172.21.15.153:0/3283205505 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4009e90 con 0x7fdcfc13d600 2023-11-24T08:04:18.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.633+0000 7fdd01345700 1 -- 172.21.15.153:0/3283205505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc15da30 con 0x7fdcfc13d600 2023-11-24T08:04:18.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.633+0000 7fdd01345700 1 -- 172.21.15.153:0/3283205505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdcfc0cefb0 con 0x7fdcfc13d600 2023-11-24T08:04:18.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.634+0000 7fb976b14700 1 Processor -- start 2023-11-24T08:04:18.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.634+0000 7fb976b14700 1 -- start start 2023-11-24T08:04:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.635+0000 7fb976b14700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97013db60 0x7fb9700b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.635+0000 7fb976b14700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb97013df40 0x7fb97015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.635+0000 7fb976b14700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb970140ad0 0x7fb9701f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.635+0000 7fb976b14700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9700b1b90 con 0x7fb970140ad0 2023-11-24T08:04:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.635+0000 7fb976b14700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9700b0fa0 con 0x7fb97013db60 2023-11-24T08:04:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.635+0000 7fb976b14700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9700b0cd0 con 0x7fb97013df40 2023-11-24T08:04:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.635+0000 7fb9748b0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97013db60 0x7fb9700b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.635+0000 7fb96ffff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb97013df40 0x7fb97015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.635+0000 7fb96ffff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb97013df40 0x7fb97015c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47604/0 (socket says 172.21.15.153:47604) 2023-11-24T08:04:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.635+0000 7fb96ffff700 1 -- 172.21.15.153:0/2579971479 learned_addr learned my addr 172.21.15.153:0/2579971479 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.636+0000 7fb9750b1700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb970140ad0 0x7fb9701f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.636+0000 7fb96ffff700 1 -- 172.21.15.153:0/2579971479 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97013db60 msgr2=0x7fb9700b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.636+0000 7fb96ffff700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97013db60 0x7fb9700b0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.636+0000 7fb96ffff700 1 -- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb970140ad0 msgr2=0x7fb9701f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.636+0000 7fb96ffff700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb970140ad0 0x7fb9701f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.636+0000 7fb96ffff700 1 -- 172.21.15.153:0/2579971479 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680094a0 con 0x7fb97013df40 2023-11-24T08:04:18.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.636+0000 7fb96ffff700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb97013df40 0x7fb97015c7a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb968009b90 tx=0x7fb968004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.636+0000 7f2b09d9b700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2af406b0b0 0x7f2af406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.637+0000 7f2b0ad9d700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] conn(0x7f2af40732d0 0x7f2af40756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.636+0000 7fb96d7fa700 1 -- 172.21.15.153:0/2579971479 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968004510 con 0x7fb97013df40 2023-11-24T08:04:18.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.636+0000 7fb96d7fa700 1 -- 172.21.15.153:0/2579971479 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96801f070 con 0x7fb97013df40 2023-11-24T08:04:18.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.637+0000 7fb96d7fa700 1 -- 172.21.15.153:0/2579971479 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680038e0 con 0x7fb97013df40 2023-11-24T08:04:18.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.637+0000 7f2b09d9b700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2af406b0b0 0x7f2af406d570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c157fa0 tx=0x7f2afc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.630+0000 7fd3949e1700 1 Processor -- start 2023-11-24T08:04:18.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.630+0000 7fd3949e1700 1 -- start start 2023-11-24T08:04:18.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fd3949e1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd39016ae60 0x7fd39006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fd3949e1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3900b4260 0x7fd390070d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fd3949e1700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39008bdb0 con 0x7fd390072bb0 2023-11-24T08:04:18.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fd3949e1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39006ce30 con 0x7fd39016ae60 2023-11-24T08:04:18.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fd3949e1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39006d110 con 0x7fd3900b4260 2023-11-24T08:04:18.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fd38e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd39016ae60 0x7fd39006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.637+0000 7fdce37fe700 1 -- 172.21.15.153:0/3283205505 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdcf400c930 con 0x7fdcfc13d600 2023-11-24T08:04:18.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.637+0000 7f2b0ad9d700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] conn(0x7f2af40732d0 0x7f2af40756f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fd38e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd39016ae60 0x7fd39006efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35528/0 (socket says 172.21.15.153:35528) 2023-11-24T08:04:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fd38e59c700 1 -- 172.21.15.153:0/647547624 learned_addr learned my addr 172.21.15.153:0/647547624 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.634+0000 7fd38d59a700 1 -- 172.21.15.153:0/647547624 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883293574 0 0) 0x7fd39008bdb0 con 0x7fd390072bb0 2023-11-24T08:04:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.637+0000 7fd38d59a700 1 -- 172.21.15.153:0/647547624 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3780057c0 con 0x7fd390072bb0 2023-11-24T08:04:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.632+0000 7fd38ed9d700 1 --2- 172.21.15.153:0/647547624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3900b4260 0x7fd390070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.638+0000 7fd38e59c700 1 -- 172.21.15.153:0/647547624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3900b4260 msgr2=0x7fd390070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.638+0000 7fd38e59c700 1 --2- 172.21.15.153:0/647547624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3900b4260 0x7fd390070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.638+0000 7fd38e59c700 1 -- 172.21.15.153:0/647547624 >> v1:172.21.15.164:6789/0 conn(0x7fd390072bb0 legacy=0x7fd3900b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.638+0000 7fd38e59c700 1 -- 172.21.15.153:0/647547624 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39006d3f0 con 0x7fd39016ae60 2023-11-24T08:04:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.638+0000 7fd38ed9d700 1 --2- 172.21.15.153:0/647547624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3900b4260 0x7fd390070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.638+0000 7fd38e59c700 1 --2- 172.21.15.153:0/647547624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd39016ae60 0x7fd39006efc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd380008970 tx=0x7fd3800082b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27ce244ffe57b38 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.637+0000 7fdce37fe700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdce806aed0 0x7fdce806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.637+0000 7fdce37fe700 1 -- 172.21.15.153:0/3283205505 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcf408a740 con 0x7fdcfc13d600 2023-11-24T08:04:18.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.637+0000 7fdce37fe700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] conn(0x7fdce8072f80 0x7fdce80753a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.637+0000 7fdce37fe700 1 -- 172.21.15.153:0/3283205505 --> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdce8075a50 con 0x7fdce8072f80 2023-11-24T08:04:18.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.637+0000 7fdce37fe700 1 -- 172.21.15.153:0/3283205505 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcf408aaf0 con 0x7fdcfc13d600 2023-11-24T08:04:18.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.638+0000 7fdcfaffd700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdce806aed0 0x7fdce806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.638+0000 7fdcfa7fc700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] conn(0x7fdce8072f80 0x7fdce80753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.638+0000 7fb976b14700 1 -- 172.21.15.153:0/2579971479 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9700b1260 con 0x7fb97013df40 2023-11-24T08:04:18.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.638+0000 7fb976b14700 1 -- 172.21.15.153:0/2579971479 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9700b1820 con 0x7fb97013df40 2023-11-24T08:04:18.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.638+0000 7fdcfaffd700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdce806aed0 0x7fdce806d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000be00 tx=0x7fdcf0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.639+0000 7f2afaffd700 1 -- 172.21.15.153:0/3095969875 <== osd.0 v2:172.21.15.153:6800/486972395 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2af4075da0 con 0x7f2af40732d0 2023-11-24T08:04:18.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.639+0000 7fb976b14700 1 -- 172.21.15.153:0/2579971479 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9700cfef0 con 0x7fb97013df40 2023-11-24T08:04:18.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.639+0000 7fdcfa7fc700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] conn(0x7fdce8072f80 0x7fdce80753a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.639+0000 7fd38d59a700 1 -- 172.21.15.153:0/647547624 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38000b9c0 con 0x7fd39016ae60 2023-11-24T08:04:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.639+0000 7fd38d59a700 1 -- 172.21.15.153:0/647547624 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38000bb20 con 0x7fd39016ae60 2023-11-24T08:04:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.639+0000 7fd38d59a700 1 -- 172.21.15.153:0/647547624 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38000be90 con 0x7fd39016ae60 2023-11-24T08:04:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.640+0000 7f13d5703700 1 Processor -- start 2023-11-24T08:04:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.640+0000 7f13d5703700 1 -- start start 2023-11-24T08:04:18.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.640+0000 7fd3949e1700 1 -- 172.21.15.153:0/647547624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd39016ae60 msgr2=0x7fd39006efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.640+0000 7fd3949e1700 1 --2- 172.21.15.153:0/647547624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd39016ae60 0x7fd39006efc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd380008970 tx=0x7fd3800082b0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.640+0000 7fdce37fe700 1 -- 172.21.15.153:0/3283205505 <== osd.5 v2:172.21.15.164:6801/2836417954 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fdce8075a50 con 0x7fdce8072f80 2023-11-24T08:04:18.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7fd3949e1700 1 -- 172.21.15.153:0/647547624 shutdown_connections 2023-11-24T08:04:18.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7fd3949e1700 1 --2- 172.21.15.153:0/647547624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3900b4260 0x7fd390070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7fd3949e1700 1 --2- 172.21.15.153:0/647547624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd39016ae60 0x7fd39006efc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7fd3949e1700 1 -- 172.21.15.153:0/647547624 >> 172.21.15.153:0/647547624 conn(0x7fd3900cfa30 msgr2=0x7fd3900cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7fb96d7fa700 1 -- 172.21.15.153:0/2579971479 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb968003a40 con 0x7fb97013df40 2023-11-24T08:04:18.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7fb96d7fa700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb95006af50 0x7fb95006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7fb96d7fa700 1 -- 172.21.15.153:0/2579971479 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb968021070 con 0x7fb97013df40 2023-11-24T08:04:18.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7fb96d7fa700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] conn(0x7fb950073170 0x7fb950075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7fb96d7fa700 1 -- 172.21.15.153:0/2579971479 --> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb950075c40 con 0x7fb950073170 2023-11-24T08:04:18.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7fb96d7fa700 1 -- 172.21.15.153:0/2579971479 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb96808b120 con 0x7fb97013df40 2023-11-24T08:04:18.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7f13d5703700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f13d01665a0 0x7f13d016d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.641+0000 7fd3949e1700 1 -- 172.21.15.153:0/647547624 shutdown_connections 2023-11-24T08:04:18.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.642+0000 7f13d5703700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d0072110 con 0x7f13d0070fd0 2023-11-24T08:04:18.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.644+0000 7f13ce7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f13d0070fd0 0x7f13d0165e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41648/0 (socket says 172.21.15.153:41648) 2023-11-24T08:04:18.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.644+0000 7f13ce7fc700 1 -- 172.21.15.153:0/2949918299 learned_addr learned my addr 172.21.15.153:0/2949918299 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:18.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.642+0000 7fd3949e1700 1 -- 172.21.15.153:0/647547624 wait complete. 2023-11-24T08:04:18.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.644+0000 7fd3949e1700 1 Processor -- start 2023-11-24T08:04:18.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.644+0000 7f13d5703700 1 -- 172.21.15.153:0/2949918299 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d0071500 con 0x7f13d00cf440 2023-11-24T08:04:18.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.644+0000 7f13d5703700 1 -- 172.21.15.153:0/2949918299 --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d00717e0 con 0x7f13d01665a0 2023-11-24T08:04:18.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.645+0000 7fb9748b0700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb95006af50 0x7fb95006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.645+0000 7fb9750b1700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] conn(0x7fb950073170 0x7fb950075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fb9750b1700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] conn(0x7fb950073170 0x7fb950075590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fb9748b0700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb95006af50 0x7fb95006d410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb958000f60 tx=0x7fb958007f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.644+0000 7fd3949e1700 1 -- start start 2023-11-24T08:04:18.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.645+0000 7fd3949e1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3900b4260 0x7fd390211d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.645+0000 7fd3949e1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3900c49b0 0x7fd3900c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.645+0000 7fd3949e1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3900c62f0 0x7fd390212940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.645+0000 7fd3949e1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900c6780 con 0x7fd3900c62f0 2023-11-24T08:04:18.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.645+0000 7fd3949e1700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39020b820 con 0x7fd3900c49b0 2023-11-24T08:04:18.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.645+0000 7fd3949e1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3902124b0 con 0x7fd3900b4260 2023-11-24T08:04:18.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3900c62f0 0x7fd390212940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3900c62f0 0x7fd390212940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35554/0 (socket says 172.21.15.153:35554) 2023-11-24T08:04:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38ed9d700 1 -- 172.21.15.153:0/1053713799 learned_addr learned my addr 172.21.15.153:0/1053713799 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38dd9b700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3900c49b0 0x7fd3900c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38e59c700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3900b4260 0x7fd390211d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38ed9d700 1 -- 172.21.15.153:0/1053713799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3900b4260 msgr2=0x7fd390211d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38ed9d700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3900b4260 0x7fd390211d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38ed9d700 1 -- 172.21.15.153:0/1053713799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3900c49b0 msgr2=0x7fd3900c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38ed9d700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3900c49b0 0x7fd3900c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38ed9d700 1 -- 172.21.15.153:0/1053713799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3800085d0 con 0x7fd3900c62f0 2023-11-24T08:04:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38dd9b700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3900c49b0 0x7fd3900c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:18.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7fd38ed9d700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3900c62f0 0x7fd390212940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd38800a920 tx=0x7fd38800ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911679730 0 0) 0x7f13d0072110 con 0x7f13d0070fd0 2023-11-24T08:04:18.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.646+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b80035b0 con 0x7f13d0070fd0 2023-11-24T08:04:18.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.647+0000 7f13cf7fe700 1 --2- 172.21.15.153:0/2949918299 >> v2:172.21.15.164:3300/0 conn(0x7f13d01665a0 0x7f13d016d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.647+0000 7fd37effd700 1 -- 172.21.15.153:0/1053713799 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388008900 con 0x7fd3900c62f0 2023-11-24T08:04:18.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.647+0000 7fd37effd700 1 -- 172.21.15.153:0/1053713799 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd388008a60 con 0x7fd3900c62f0 2023-11-24T08:04:18.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.647+0000 7fd37effd700 1 -- 172.21.15.153:0/1053713799 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388008e10 con 0x7fd3900c62f0 2023-11-24T08:04:18.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.647+0000 7fd3949e1700 1 -- 172.21.15.153:0/1053713799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3902122b0 con 0x7fd3900c62f0 2023-11-24T08:04:18.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.647+0000 7fd3949e1700 1 -- 172.21.15.153:0/1053713799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3900c5230 con 0x7fd3900c62f0 2023-11-24T08:04:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 263071097 0 0) 0x7f13b80035b0 con 0x7f13d0070fd0 2023-11-24T08:04:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 >> v2:172.21.15.164:3300/0 conn(0x7f13d01665a0 msgr2=0x7f13d016d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 --2- 172.21.15.153:0/2949918299 >> v2:172.21.15.164:3300/0 conn(0x7f13d01665a0 0x7f13d016d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 >> v1:172.21.15.164:6789/0 conn(0x7f13d00cf440 legacy=0x7f13d006e8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:04:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0071ac0 con 0x7f13d0070fd0 2023-11-24T08:04:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f13c0001670 con 0x7f13d0070fd0 2023-11-24T08:04:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 >> v1:172.21.15.153:6789/0 conn(0x7f13d0070fd0 legacy=0x7f13d0165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7fb96d7fa700 1 -- 172.21.15.153:0/2579971479 <== osd.1 v2:172.21.15.153:6809/3506833465 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb950075c40 con 0x7fb950073170 2023-11-24T08:04:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 --2- 172.21.15.153:0/2949918299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13b8003a00 0x7f13b8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 --2- 172.21.15.153:0/2949918299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13b8004850 0x7f13b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 --2- 172.21.15.153:0/2949918299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b8005210 0x7f13b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00717e0 con 0x7f13b8005210 2023-11-24T08:04:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b800c140 con 0x7f13b8003a00 2023-11-24T08:04:18.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b800c300 con 0x7f13b8004850 2023-11-24T08:04:18.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.648+0000 7fd3949e1700 1 -- 172.21.15.153:0/1053713799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd39006cac0 con 0x7fd3900c62f0 2023-11-24T08:04:18.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.650+0000 7fd37effd700 1 -- 172.21.15.153:0/1053713799 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd38800b040 con 0x7fd3900c62f0 2023-11-24T08:04:18.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.650+0000 7fd37effd700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd37006af20 0x7fd37006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.650+0000 7fd37effd700 1 -- 172.21.15.153:0/1053713799 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd38808ab60 con 0x7fd3900c62f0 2023-11-24T08:04:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.650+0000 7fd38e59c700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd37006af20 0x7fd37006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.650+0000 7fd37effd700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] conn(0x7fd370073140 0x7fd370075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.650+0000 7fd37effd700 1 -- 172.21.15.153:0/1053713799 --> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd370075c10 con 0x7fd370073140 2023-11-24T08:04:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.650+0000 7fd37effd700 1 -- 172.21.15.153:0/1053713799 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd38808b000 con 0x7fd3900c62f0 2023-11-24T08:04:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.651+0000 7fd38dd9b700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] conn(0x7fd370073140 0x7fd370075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.651+0000 7fd38e59c700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd37006af20 0x7fd37006d3e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd390214840 tx=0x7fd38000a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.651+0000 7fd38dd9b700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] conn(0x7fd370073140 0x7fd370075560 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.652+0000 7fd37effd700 1 -- 172.21.15.153:0/1053713799 <== osd.3 v2:172.21.15.153:6824/1489086647 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd370075c10 con 0x7fd370073140 2023-11-24T08:04:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.651+0000 7f4040e23700 1 -- 172.21.15.153:0/3990200612 --> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4020005ca0 con 0x7f40200015d0 2023-11-24T08:04:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.649+0000 7f13cf7fe700 1 --2- 172.21.15.153:0/2949918299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b8005210 0x7f13b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.649+0000 7f13ce7fc700 1 --2- 172.21.15.153:0/2949918299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13b8004850 0x7f13b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.649+0000 7f13cf7fe700 1 -- 172.21.15.153:0/2949918299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13b8004850 msgr2=0x7f13b8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.649+0000 7f13cf7fe700 1 --2- 172.21.15.153:0/2949918299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13b8004850 0x7f13b8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.649+0000 7f13cf7fe700 1 -- 172.21.15.153:0/2949918299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13b8003a00 msgr2=0x7f13b8003e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:04:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.649+0000 7f13cf7fe700 1 --2- 172.21.15.153:0/2949918299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13b8003a00 0x7f13b8003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.649+0000 7f13cf7fe700 1 -- 172.21.15.153:0/2949918299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0071ac0 con 0x7f13b8005210 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.649+0000 7f13cf7fe700 1 -- 172.21.15.153:0/2949918299 reap_dead start 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.649+0000 7f13cf7fe700 1 --2- 172.21.15.153:0/2949918299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b8005210 0x7f13b800ba10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13d01639d0 tx=0x7f13b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2300ed2199e5c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.650+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c400c070 con 0x7f13b8005210 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.650+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c4004220 con 0x7f13b8005210 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.650+0000 7f13cdffb700 1 -- 172.21.15.153:0/2949918299 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c40094a0 con 0x7f13b8005210 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.651+0000 7f13d5703700 1 -- 172.21.15.153:0/2949918299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b8005210 msgr2=0x7f13b800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.651+0000 7f13d5703700 1 --2- 172.21.15.153:0/2949918299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b8005210 0x7f13b800ba10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13d01639d0 tx=0x7f13b8005880 comp rx=0 tx=0).stop 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.653+0000 7f13d5703700 1 -- 172.21.15.153:0/2949918299 shutdown_connections 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.653+0000 7f13d5703700 1 --2- 172.21.15.153:0/2949918299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b8005210 0x7f13b800ba10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.653+0000 7f13d5703700 1 -- 172.21.15.153:0/2949918299 >> 172.21.15.153:0/2949918299 conn(0x7f13d00b1740 msgr2=0x7f13d00b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.659+0000 7f13d5703700 1 -- 172.21.15.153:0/2949918299 shutdown_connections 2023-11-24T08:04:18.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.659+0000 7f402affd700 1 -- 172.21.15.153:0/3990200612 <== osd.4 v2:172.21.15.164:6800/3824651650 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4020005ca0 con 0x7f40200015d0 2023-11-24T08:04:18.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.660+0000 7f996d3d2700 1 Processor -- start 2023-11-24T08:04:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.660+0000 7f4040e23700 1 -- 172.21.15.153:0/3990200612 >> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] conn(0x7f40200015d0 msgr2=0x7f4020003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.660+0000 7f4040e23700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] conn(0x7f40200015d0 0x7f4020003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.660+0000 7f4040e23700 1 -- 172.21.15.153:0/3990200612 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f401c06afd0 msgr2=0x7f401c06d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.660+0000 7f4040e23700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f401c06afd0 0x7f401c06d490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4034000f80 tx=0x7f4034011000 comp rx=0 tx=0).stop 2023-11-24T08:04:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.660+0000 7f4040e23700 1 -- 172.21.15.153:0/3990200612 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c225020 msgr2=0x7f403c2254a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.660+0000 7f4040e23700 1 --2- 172.21.15.153:0/3990200612 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403c225020 0x7f403c2254a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f402c00b410 tx=0x7f402c00b720 comp rx=0 tx=0).stop 2023-11-24T08:04:18.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.660+0000 7f996d3d2700 1 -- start start 2023-11-24T08:04:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.662+0000 7f996d3d2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9968070fd0 0x7f9968165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.662+0000 7f996d3d2700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9968072110 con 0x7f99681663d0 2023-11-24T08:04:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.662+0000 7f996d3d2700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9968071500 con 0x7f99680cf440 2023-11-24T08:04:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.662+0000 7f996d3d2700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9968166840 con 0x7f9968070fd0 2023-11-24T08:04:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.662+0000 7f99677fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f99681663d0 0x7f99680b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41672/0 (socket says 172.21.15.153:41672) 2023-11-24T08:04:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.662+0000 7f99677fe700 1 -- 172.21.15.153:0/763164031 learned_addr learned my addr 172.21.15.153:0/763164031 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.662+0000 7f99667fc700 1 --2- 172.21.15.153:0/763164031 >> v2:172.21.15.164:3300/0 conn(0x7f9968070fd0 0x7f9968165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.662+0000 7f9965ffb700 1 -- 172.21.15.153:0/763164031 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846691706 0 0) 0x7f9968072110 con 0x7f99681663d0 2023-11-24T08:04:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.662+0000 7f9965ffb700 1 -- 172.21.15.153:0/763164031 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99500035b0 con 0x7f99681663d0 2023-11-24T08:04:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.662+0000 7f9965ffb700 1 -- 172.21.15.153:0/763164031 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299583340 0 0) 0x7f9968071500 con 0x7f99680cf440 2023-11-24T08:04:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.662+0000 7f9965ffb700 1 -- 172.21.15.153:0/763164031 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9968072110 con 0x7f99680cf440 2023-11-24T08:04:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.663+0000 7f99667fc700 1 -- 172.21.15.153:0/763164031 >> v1:172.21.15.164:6789/0 conn(0x7f99680cf440 legacy=0x7f996806e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.663+0000 7f99667fc700 1 -- 172.21.15.153:0/763164031 >> v1:172.21.15.153:6789/0 conn(0x7f99681663d0 legacy=0x7f99680b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.663+0000 7f99667fc700 1 -- 172.21.15.153:0/763164031 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680717e0 con 0x7f9968070fd0 2023-11-24T08:04:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.663+0000 7f99667fc700 1 --2- 172.21.15.153:0/763164031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9968070fd0 0x7f9968165e90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f995c009840 tx=0x7f995c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d438af675a281498 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.663+0000 7f9965ffb700 1 -- 172.21.15.153:0/763164031 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c011830 con 0x7f9968070fd0 2023-11-24T08:04:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.663+0000 7f9965ffb700 1 -- 172.21.15.153:0/763164031 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c011990 con 0x7f9968070fd0 2023-11-24T08:04:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.663+0000 7f9965ffb700 1 -- 172.21.15.153:0/763164031 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c011d20 con 0x7f9968070fd0 2023-11-24T08:04:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7f13d5703700 1 -- 172.21.15.153:0/2949918299 wait complete. 2023-11-24T08:04:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7fdd01345700 1 -- 172.21.15.153:0/3283205505 --> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdcfc0b5660 con 0x7fdce8072f80 2023-11-24T08:04:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7f996d3d2700 1 -- 172.21.15.153:0/763164031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9968070fd0 msgr2=0x7f9968165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7f996d3d2700 1 --2- 172.21.15.153:0/763164031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9968070fd0 0x7f9968165e90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f995c009840 tx=0x7f995c009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7f996d3d2700 1 -- 172.21.15.153:0/763164031 shutdown_connections 2023-11-24T08:04:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7f996d3d2700 1 --2- 172.21.15.153:0/763164031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9968070fd0 0x7f9968165e90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7f996d3d2700 1 -- 172.21.15.153:0/763164031 >> 172.21.15.153:0/763164031 conn(0x7f99680b1740 msgr2=0x7f99680b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7f403ad9d700 1 -- 172.21.15.153:0/3990200612 reap_dead start 2023-11-24T08:04:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7f4040e23700 1 -- 172.21.15.153:0/3990200612 shutdown_connections 2023-11-24T08:04:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7f4040e23700 1 -- 172.21.15.153:0/3990200612 >> 172.21.15.153:0/3990200612 conn(0x7f403c0cfa30 msgr2=0x7f403c16d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7f4040e23700 1 -- 172.21.15.153:0/3990200612 shutdown_connections 2023-11-24T08:04:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.664+0000 7f4040e23700 1 -- 172.21.15.153:0/3990200612 wait complete. 2023-11-24T08:04:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.665+0000 7f13d5703700 1 Processor -- start 2023-11-24T08:04:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.665+0000 7fdce37fe700 1 -- 172.21.15.153:0/3283205505 <== osd.5 v2:172.21.15.164:6801/2836417954 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdcfc0b5660 con 0x7fdce8072f80 2023-11-24T08:04:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.666+0000 7f996d3d2700 1 -- 172.21.15.153:0/763164031 shutdown_connections 2023-11-24T08:04:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.666+0000 7f13d5703700 1 -- start start 2023-11-24T08:04:18.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.666+0000 7f13d5703700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13b8005210 0x7f13d015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.666+0000 7f13d5703700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d015f7f0 0x7f13d015fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.666+0000 7f13d5703700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13d0150370 0x7f13d0150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.666+0000 7f13d5703700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d015e550 con 0x7f13d015f7f0 2023-11-24T08:04:18.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.666+0000 7f13d5703700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d01601b0 con 0x7f13d0150370 2023-11-24T08:04:18.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.666+0000 7f13d5703700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d015da10 con 0x7f13b8005210 2023-11-24T08:04:18.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7fdd01345700 1 -- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] conn(0x7fdce8072f80 msgr2=0x7fdce80753a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7fdd01345700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] conn(0x7fdce8072f80 0x7fdce80753a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.666+0000 7f996d3d2700 1 -- 172.21.15.153:0/763164031 wait complete. 2023-11-24T08:04:18.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7f13ceffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13b8005210 0x7f13d015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7f13ceffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13b8005210 0x7f13d015f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47642/0 (socket says 172.21.15.153:47642) 2023-11-24T08:04:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7f13ceffd700 1 -- 172.21.15.153:0/325416103 learned_addr learned my addr 172.21.15.153:0/325416103 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7f13cf7fe700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13d0150370 0x7f13d0150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7f13ceffd700 1 -- 172.21.15.153:0/325416103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13d0150370 msgr2=0x7f13d0150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7f13ceffd700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13d0150370 0x7f13d0150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7f13ceffd700 1 -- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d015f7f0 msgr2=0x7f13d015fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7f13ceffd700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d015f7f0 0x7f13d015fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7f13ceffd700 1 -- 172.21.15.153:0/325416103 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d015dcb0 con 0x7f13b8005210 2023-11-24T08:04:18.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.667+0000 7fb817f13700 1 Processor -- start 2023-11-24T08:04:18.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.668+0000 7fb817f13700 1 -- start start 2023-11-24T08:04:18.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.668+0000 7f996d3d2700 1 Processor -- start 2023-11-24T08:04:18.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.668+0000 7fdd01345700 1 -- 172.21.15.153:0/3283205505 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdce806aed0 msgr2=0x7fdce806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.668+0000 7fdd01345700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdce806aed0 0x7fdce806d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000be00 tx=0x7fdcf0008040 comp rx=0 tx=0).stop 2023-11-24T08:04:18.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.668+0000 7fdd01345700 1 -- 172.21.15.153:0/3283205505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcfc13d600 msgr2=0x7fdcfc0b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.668+0000 7fdd01345700 1 --2- 172.21.15.153:0/3283205505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcfc13d600 0x7fdcfc0b48b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400efc0 tx=0x7fdcf400c3a0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7fdcfb7fe700 1 -- 172.21.15.153:0/3283205505 reap_dead start 2023-11-24T08:04:18.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7fdd01345700 1 -- 172.21.15.153:0/3283205505 shutdown_connections 2023-11-24T08:04:18.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7fdd01345700 1 -- 172.21.15.153:0/3283205505 >> 172.21.15.153:0/3283205505 conn(0x7fdcfc0cd570 msgr2=0x7fdcfc06ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7fb817f13700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb8100b4560 0x7fb81006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7fb817f13700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb8100b49e0 0x7fb81006d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7fb817f13700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81015c1d0 con 0x7fb81015b2e0 2023-11-24T08:04:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7fb817f13700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb810072ac0 con 0x7fb8100b49e0 2023-11-24T08:04:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7fb817f13700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb810071bd0 con 0x7fb8100b4560 2023-11-24T08:04:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7fb8164b0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb8100b49e0 0x7fb81006d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7fb8164b0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb8100b49e0 0x7fb81006d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35578/0 (socket says 172.21.15.153:35578) 2023-11-24T08:04:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7fb8164b0700 1 -- 172.21.15.153:0/3516171215 learned_addr learned my addr 172.21.15.153:0/3516171215 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.668+0000 7f996d3d2700 1 -- start start 2023-11-24T08:04:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7f996d3d2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9968070fd0 0x7f99681548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7f996d3d2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99680cf440 0x7f99680af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7f996d3d2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99681663d0 0x7f99680afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7f996d3d2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9968161e70 con 0x7f99681663d0 2023-11-24T08:04:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7f996d3d2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9968160fc0 con 0x7f99680cf440 2023-11-24T08:04:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7f996d3d2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9968161260 con 0x7f9968070fd0 2023-11-24T08:04:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.668+0000 7f2b10fa3700 1 -- 172.21.15.153:0/3095969875 --> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b0c0ab210 con 0x7f2af40732d0 2023-11-24T08:04:18.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7f99667fc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99680cf440 0x7f99680af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7f99667fc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99680cf440 0x7f99680af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57170/0 (socket says 172.21.15.153:57170) 2023-11-24T08:04:18.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.669+0000 7f99667fc700 1 -- 172.21.15.153:0/1521591257 learned_addr learned my addr 172.21.15.153:0/1521591257 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7fb8164b0700 1 -- 172.21.15.153:0/3516171215 >> v2:172.21.15.164:3300/0 conn(0x7fb8100b4560 msgr2=0x7fb81006cac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:04:18.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7fb8164b0700 1 --2- 172.21.15.153:0/3516171215 >> v2:172.21.15.164:3300/0 conn(0x7fb8100b4560 0x7fb81006cac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7fb8164b0700 1 -- 172.21.15.153:0/3516171215 >> v1:172.21.15.153:6789/0 conn(0x7fb81015b2e0 legacy=0x7fb81015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7fb8164b0700 1 -- 172.21.15.153:0/3516171215 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810071eb0 con 0x7fb8100b49e0 2023-11-24T08:04:18.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f9966ffd700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9968070fd0 0x7f99681548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f99677fe700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99681663d0 0x7f99680afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7fb8164b0700 1 --2- 172.21.15.153:0/3516171215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8100b49e0 0x7fb81006d000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb8100d0b30 tx=0x7fb80800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63de87c43dce3957 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f99667fc700 1 -- 172.21.15.153:0/1521591257 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9968070fd0 msgr2=0x7f99681548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f99667fc700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9968070fd0 0x7f99681548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f99667fc700 1 -- 172.21.15.153:0/1521591257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99681663d0 msgr2=0x7f99680afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f99667fc700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99681663d0 0x7f99680afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f99667fc700 1 -- 172.21.15.153:0/1521591257 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c0094a0 con 0x7f99680cf440 2023-11-24T08:04:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f2afaffd700 1 -- 172.21.15.153:0/3095969875 <== osd.0 v2:172.21.15.153:6800/486972395 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2b0c0ab210 con 0x7f2af40732d0 2023-11-24T08:04:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f99667fc700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99680cf440 0x7f99680af720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f995c0090b0 tx=0x7f995c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7fdd01345700 1 -- 172.21.15.153:0/3283205505 shutdown_connections 2023-11-24T08:04:18.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f994f7fe700 1 -- 172.21.15.153:0/1521591257 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c01a6e0 con 0x7f99680cf440 2023-11-24T08:04:18.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f994f7fe700 1 -- 172.21.15.153:0/1521591257 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c01a840 con 0x7f99680cf440 2023-11-24T08:04:18.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f996d3d2700 1 -- 172.21.15.153:0/1521591257 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9968161540 con 0x7f99680cf440 2023-11-24T08:04:18.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f994f7fe700 1 -- 172.21.15.153:0/1521591257 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c01abb0 con 0x7f99680cf440 2023-11-24T08:04:18.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7f996d3d2700 1 -- 172.21.15.153:0/1521591257 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9968161b00 con 0x7f99680cf440 2023-11-24T08:04:18.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7fb814cad700 1 -- 172.21.15.153:0/3516171215 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800e070 con 0x7fb8100b49e0 2023-11-24T08:04:18.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7fb814cad700 1 -- 172.21.15.153:0/3516171215 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80800b9c0 con 0x7fb8100b49e0 2023-11-24T08:04:18.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.670+0000 7fb814cad700 1 -- 172.21.15.153:0/3516171215 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800bd70 con 0x7fb8100b49e0 2023-11-24T08:04:18.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7f2b10fa3700 1 -- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] conn(0x7f2af40732d0 msgr2=0x7f2af40756f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7f2b10fa3700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] conn(0x7f2af40732d0 0x7f2af40756f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7f2b10fa3700 1 -- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2af406b0b0 msgr2=0x7f2af406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7f2b10fa3700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2af406b0b0 0x7f2af406d570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c157fa0 tx=0x7f2afc008040 comp rx=0 tx=0).stop 2023-11-24T08:04:18.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7f2b10fa3700 1 -- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b0c0b4090 msgr2=0x7f2b0c0a9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7f2b10fa3700 1 --2- 172.21.15.153:0/3095969875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b0c0b4090 0x7f2b0c0a9e70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009840 tx=0x7f2b00004750 comp rx=0 tx=0).stop 2023-11-24T08:04:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7f2b0ad9d700 1 -- 172.21.15.153:0/3095969875 reap_dead start 2023-11-24T08:04:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7f2b10fa3700 1 -- 172.21.15.153:0/3095969875 shutdown_connections 2023-11-24T08:04:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7f2b10fa3700 1 -- 172.21.15.153:0/3095969875 >> 172.21.15.153:0/3095969875 conn(0x7f2b0c0cfa30 msgr2=0x7f2b0c0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7f2b10fa3700 1 -- 172.21.15.153:0/3095969875 shutdown_connections 2023-11-24T08:04:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7f2b10fa3700 1 -- 172.21.15.153:0/3095969875 wait complete. 2023-11-24T08:04:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7fb817f13700 1 -- 172.21.15.153:0/3516171215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8100b49e0 msgr2=0x7fb81006d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.671+0000 7fb817f13700 1 --2- 172.21.15.153:0/3516171215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8100b49e0 0x7fb81006d000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb8100d0b30 tx=0x7fb80800b330 comp rx=0 tx=0).stop 2023-11-24T08:04:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.672+0000 7fdd01345700 1 -- 172.21.15.153:0/3283205505 wait complete. 2023-11-24T08:04:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.672+0000 7fb817f13700 1 -- 172.21.15.153:0/3516171215 shutdown_connections 2023-11-24T08:04:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.672+0000 7fb817f13700 1 --2- 172.21.15.153:0/3516171215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8100b49e0 0x7fb81006d000 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.672+0000 7fb817f13700 1 --2- 172.21.15.153:0/3516171215 >> v2:172.21.15.164:3300/0 conn(0x7fb8100b4560 0x7fb81006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.672+0000 7fb817f13700 1 -- 172.21.15.153:0/3516171215 >> 172.21.15.153:0/3516171215 conn(0x7fb8100cfa30 msgr2=0x7fb8100cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.672+0000 7f994f7fe700 1 -- 172.21.15.153:0/1521591257 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f995c022070 con 0x7f99680cf440 2023-11-24T08:04:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.673+0000 7f994f7fe700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f995406aed0 0x7f995406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.673+0000 7f994f7fe700 1 -- 172.21.15.153:0/1521591257 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f995c08a540 con 0x7f99680cf440 2023-11-24T08:04:18.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.673+0000 7f9966ffd700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f995406aed0 0x7f995406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.673+0000 7f9966ffd700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f995406aed0 0x7f995406d390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9958000f60 tx=0x7f9958009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.675+0000 7f13ceffd700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13b8005210 0x7f13d015f2b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13c800bab0 tx=0x7f13c800be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.675+0000 7fb817f13700 1 -- 172.21.15.153:0/3516171215 shutdown_connections 2023-11-24T08:04:18.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.675+0000 7f13b77fe700 1 -- 172.21.15.153:0/325416103 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800ca30 con 0x7f13b8005210 2023-11-24T08:04:18.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.675+0000 7f13b77fe700 1 -- 172.21.15.153:0/325416103 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800cb90 con 0x7f13b8005210 2023-11-24T08:04:18.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.675+0000 7f13b77fe700 1 -- 172.21.15.153:0/325416103 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8014440 con 0x7f13b8005210 2023-11-24T08:04:18.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.675+0000 7f13d5703700 1 -- 172.21.15.153:0/325416103 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d015df90 con 0x7f13b8005210 2023-11-24T08:04:18.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.675+0000 7f13d5703700 1 -- 172.21.15.153:0/325416103 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d0150d60 con 0x7f13b8005210 2023-11-24T08:04:18.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.676+0000 7f13d5703700 1 -- 172.21.15.153:0/325416103 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13d0166c90 con 0x7f13b8005210 2023-11-24T08:04:18.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.677+0000 7f13b77fe700 1 -- 172.21.15.153:0/325416103 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13c801d3b0 con 0x7f13b8005210 2023-11-24T08:04:18.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.678+0000 7f13b77fe700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f13bc06aed0 0x7f13bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.678+0000 7f13b77fe700 1 -- 172.21.15.153:0/325416103 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13c8089a00 con 0x7f13b8005210 2023-11-24T08:04:18.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.678+0000 7fb976b14700 1 -- 172.21.15.153:0/2579971479 --> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9700b1d00 con 0x7fb950073170 2023-11-24T08:04:18.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.678+0000 7f13b77fe700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] conn(0x7f13bc073070 0x7f13bc075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.678+0000 7f13ce7fc700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f13bc06aed0 0x7f13bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.678+0000 7f13b77fe700 1 -- 172.21.15.153:0/325416103 --> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13bc075b40 con 0x7f13bc073070 2023-11-24T08:04:18.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.678+0000 7f13b77fe700 1 -- 172.21.15.153:0/325416103 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13c8089d70 con 0x7f13b8005210 2023-11-24T08:04:18.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.678+0000 7f13ce7fc700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f13bc06aed0 0x7f13bc06d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13d0156640 tx=0x7f13c0000f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.678+0000 7fb96d7fa700 1 -- 172.21.15.153:0/2579971479 <== osd.1 v2:172.21.15.153:6809/3506833465 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb9700b1d00 con 0x7fb950073170 2023-11-24T08:04:18.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.679+0000 7fb817f13700 1 -- 172.21.15.153:0/3516171215 wait complete. 2023-11-24T08:04:18.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.679+0000 7fb976b14700 1 -- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] conn(0x7fb950073170 msgr2=0x7fb950075590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.679+0000 7fb976b14700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] conn(0x7fb950073170 0x7fb950075590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.679+0000 7fb976b14700 1 -- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb95006af50 msgr2=0x7fb95006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.679+0000 7fb976b14700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb95006af50 0x7fb95006d410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb958000f60 tx=0x7fb958007f10 comp rx=0 tx=0).stop 2023-11-24T08:04:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.679+0000 7fb976b14700 1 -- 172.21.15.153:0/2579971479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb97013df40 msgr2=0x7fb97015c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.679+0000 7fb976b14700 1 --2- 172.21.15.153:0/2579971479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb97013df40 0x7fb97015c7a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb968009b90 tx=0x7fb968004750 comp rx=0 tx=0).stop 2023-11-24T08:04:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.679+0000 7fd3949e1700 1 -- 172.21.15.153:0/1053713799 --> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd39006d9b0 con 0x7fd370073140 2023-11-24T08:04:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.679+0000 7fb9750b1700 1 -- 172.21.15.153:0/2579971479 reap_dead start 2023-11-24T08:04:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.680+0000 7fb976b14700 1 -- 172.21.15.153:0/2579971479 shutdown_connections 2023-11-24T08:04:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.680+0000 7fb976b14700 1 -- 172.21.15.153:0/2579971479 >> 172.21.15.153:0/2579971479 conn(0x7fb970072a20 msgr2=0x7fb970132000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.680+0000 7fb976b14700 1 -- 172.21.15.153:0/2579971479 shutdown_connections 2023-11-24T08:04:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.680+0000 7fb976b14700 1 -- 172.21.15.153:0/2579971479 wait complete. 2023-11-24T08:04:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.680+0000 7fb817f13700 1 Processor -- start 2023-11-24T08:04:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.680+0000 7fb817f13700 1 -- start start 2023-11-24T08:04:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.681+0000 7fb817f13700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8100b4560 0x7fb8101f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.681+0000 7fb817f13700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8100b49e0 0x7fb810141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.681+0000 7fb817f13700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81015b2e0 0x7fb8101584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.681+0000 7fb817f13700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb810140ca0 con 0x7fb8100b4560 2023-11-24T08:04:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.681+0000 7fb817f13700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8101403e0 con 0x7fb81015b2e0 2023-11-24T08:04:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.681+0000 7fb817f13700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb810140650 con 0x7fb8100b49e0 2023-11-24T08:04:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fd37effd700 1 -- 172.21.15.153:0/1053713799 <== osd.3 v2:172.21.15.153:6824/1489086647 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd3840014f0 con 0x7fd370073140 2023-11-24T08:04:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fb8154ae700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8100b49e0 0x7fb810141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fb8154ae700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8100b49e0 0x7fb810141130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47668/0 (socket says 172.21.15.153:47668) 2023-11-24T08:04:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fb8154ae700 1 -- 172.21.15.153:0/1103246528 learned_addr learned my addr 172.21.15.153:0/1103246528 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fb8154ae700 1 -- 172.21.15.153:0/1103246528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81015b2e0 msgr2=0x7fb8101584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fb8154ae700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81015b2e0 0x7fb8101584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fb8154ae700 1 -- 172.21.15.153:0/1103246528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8100b4560 msgr2=0x7fb8101f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fb8154ae700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8100b4560 0x7fb8101f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fb8154ae700 1 -- 172.21.15.153:0/1103246528 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb808009b30 con 0x7fb8100b49e0 2023-11-24T08:04:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fd3949e1700 1 -- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] conn(0x7fd370073140 msgr2=0x7fd370075560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fd3949e1700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] conn(0x7fd370073140 0x7fd370075560 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fd3949e1700 1 -- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd37006af20 msgr2=0x7fd37006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fd3949e1700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd37006af20 0x7fd37006d3e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd390214840 tx=0x7fd38000a000 comp rx=0 tx=0).stop 2023-11-24T08:04:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fd3949e1700 1 -- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3900c62f0 msgr2=0x7fd390212940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fd3949e1700 1 --2- 172.21.15.153:0/1053713799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3900c62f0 0x7fd390212940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd38800a920 tx=0x7fd38800ace0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fd38ed9d700 1 -- 172.21.15.153:0/1053713799 reap_dead start 2023-11-24T08:04:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.682+0000 7fb8154ae700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8100b49e0 0x7fb810141130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb80000b470 tx=0x7fb80000b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.683+0000 7fd3949e1700 1 -- 172.21.15.153:0/1053713799 shutdown_connections 2023-11-24T08:04:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.683+0000 7fd3949e1700 1 -- 172.21.15.153:0/1053713799 >> 172.21.15.153:0/1053713799 conn(0x7fd3900cfa30 msgr2=0x7fd3900b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.683+0000 7fd3949e1700 1 -- 172.21.15.153:0/1053713799 shutdown_connections 2023-11-24T08:04:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.683+0000 7fd3949e1700 1 -- 172.21.15.153:0/1053713799 wait complete. 2023-11-24T08:04:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.685+0000 7f13cf7fe700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] conn(0x7f13bc073070 0x7f13bc075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.676+0000 7f996d3d2700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] conn(0x7f99480015d0 0x7f9948003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.676+0000 7f996d3d2700 1 -- 172.21.15.153:0/1521591257 --> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9948006bc0 con 0x7f99480015d0 2023-11-24T08:04:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.685+0000 7f99677fe700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] conn(0x7f99480015d0 0x7f9948003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.685+0000 7f99677fe700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] conn(0x7f99480015d0 0x7f9948003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.685+0000 7f13cf7fe700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] conn(0x7f13bc073070 0x7f13bc075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.686+0000 7f994f7fe700 1 -- 172.21.15.153:0/1521591257 <== osd.6 v2:172.21.15.164:6824/1534902913 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9948006bc0 con 0x7f99480015d0 2023-11-24T08:04:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.687+0000 7f13b77fe700 1 -- 172.21.15.153:0/325416103 <== osd.2 v2:172.21.15.153:6808/3697118367 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f13bc075b40 con 0x7f13bc073070 2023-11-24T08:04:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.687+0000 7fb8067fc700 1 -- 172.21.15.153:0/1103246528 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800011830 con 0x7fb8100b49e0 2023-11-24T08:04:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.687+0000 7fb8067fc700 1 -- 172.21.15.153:0/1103246528 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8000119b0 con 0x7fb8100b49e0 2023-11-24T08:04:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.687+0000 7fb8067fc700 1 -- 172.21.15.153:0/1103246528 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800011d60 con 0x7fb8100b49e0 2023-11-24T08:04:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.687+0000 7fb817f13700 1 -- 172.21.15.153:0/1103246528 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb810140930 con 0x7fb8100b49e0 2023-11-24T08:04:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.687+0000 7fb817f13700 1 -- 172.21.15.153:0/1103246528 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8101f7ed0 con 0x7fb8100b49e0 2023-11-24T08:04:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.689+0000 7fb8067fc700 1 -- 172.21.15.153:0/1103246528 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb80001a400 con 0x7fb8100b49e0 2023-11-24T08:04:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.690+0000 7fb8067fc700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb7fc06b060 0x7fb7fc06d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.690+0000 7fb8067fc700 1 -- 172.21.15.153:0/1103246528 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8000895b0 con 0x7fb8100b49e0 2023-11-24T08:04:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.690+0000 7fb815caf700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb7fc06b060 0x7fb7fc06d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.690+0000 7fb815caf700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb7fc06b060 0x7fb7fc06d520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb80c000f60 tx=0x7fb80c007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.716 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-11-24T08:04:18.717 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T08:04:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.697+0000 7fb817f13700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] conn(0x7fb7f80015d0 0x7fb7f8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.697+0000 7fb817f13700 1 -- 172.21.15.153:0/1103246528 --> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7f8006bc0 con 0x7fb7f80015d0 2023-11-24T08:04:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.698+0000 7fb8164b0700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] conn(0x7fb7f80015d0 0x7fb7f8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.698+0000 7fb8164b0700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] conn(0x7fb7f80015d0 0x7fb7f8003a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.719 INFO:teuthology.orchestra.run.smithi153.stdout:55834574853 2023-11-24T08:04:18.719 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T08:04:18.720 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-11-24T08:04:18.720 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T08:04:18.721 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-11-24T08:04:18.721 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T08:04:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.699+0000 7fb8067fc700 1 -- 172.21.15.153:0/1103246528 <== osd.7 v2:172.21.15.164:6816/525702944 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb7f8006bc0 con 0x7fb7f80015d0 2023-11-24T08:04:18.723 INFO:teuthology.orchestra.run.smithi153.stdout:55834574853 2023-11-24T08:04:18.723 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T08:04:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.710+0000 7f13d5703700 1 -- 172.21.15.153:0/325416103 --> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f13d00b47d0 con 0x7f13bc073070 2023-11-24T08:04:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13b77fe700 1 -- 172.21.15.153:0/325416103 <== osd.2 v2:172.21.15.153:6808/3697118367 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f13d00b47d0 con 0x7f13bc073070 2023-11-24T08:04:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13d5703700 1 -- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] conn(0x7f13bc073070 msgr2=0x7f13bc075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13d5703700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] conn(0x7f13bc073070 0x7f13bc075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13d5703700 1 -- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f13bc06aed0 msgr2=0x7f13bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13d5703700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f13bc06aed0 0x7f13bc06d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13d0156640 tx=0x7f13c0000f50 comp rx=0 tx=0).stop 2023-11-24T08:04:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f996d3d2700 1 -- 172.21.15.153:0/1521591257 --> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9948005ca0 con 0x7f99480015d0 2023-11-24T08:04:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13d5703700 1 -- 172.21.15.153:0/325416103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13b8005210 msgr2=0x7f13d015f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13d5703700 1 --2- 172.21.15.153:0/325416103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13b8005210 0x7f13d015f2b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13c800bab0 tx=0x7f13c800be70 comp rx=0 tx=0).stop 2023-11-24T08:04:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13cf7fe700 1 -- 172.21.15.153:0/325416103 reap_dead start 2023-11-24T08:04:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13d5703700 1 -- 172.21.15.153:0/325416103 shutdown_connections 2023-11-24T08:04:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13d5703700 1 -- 172.21.15.153:0/325416103 >> 172.21.15.153:0/325416103 conn(0x7f13d00b1740 msgr2=0x7f13d006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13d5703700 1 -- 172.21.15.153:0/325416103 shutdown_connections 2023-11-24T08:04:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.711+0000 7f13d5703700 1 -- 172.21.15.153:0/325416103 wait complete. 2023-11-24T08:04:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f994f7fe700 1 -- 172.21.15.153:0/1521591257 <== osd.6 v2:172.21.15.164:6824/1534902913 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9948005ca0 con 0x7f99480015d0 2023-11-24T08:04:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f996d3d2700 1 -- 172.21.15.153:0/1521591257 >> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] conn(0x7f99480015d0 msgr2=0x7f9948003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f996d3d2700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] conn(0x7f99480015d0 0x7f9948003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f996d3d2700 1 -- 172.21.15.153:0/1521591257 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f995406aed0 msgr2=0x7f995406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f996d3d2700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f995406aed0 0x7f995406d390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9958000f60 tx=0x7f9958009040 comp rx=0 tx=0).stop 2023-11-24T08:04:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f996d3d2700 1 -- 172.21.15.153:0/1521591257 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99680cf440 msgr2=0x7f99680af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f996d3d2700 1 --2- 172.21.15.153:0/1521591257 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99680cf440 0x7f99680af720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f995c0090b0 tx=0x7f995c004750 comp rx=0 tx=0).stop 2023-11-24T08:04:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f99677fe700 1 -- 172.21.15.153:0/1521591257 reap_dead start 2023-11-24T08:04:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f996d3d2700 1 -- 172.21.15.153:0/1521591257 shutdown_connections 2023-11-24T08:04:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f996d3d2700 1 -- 172.21.15.153:0/1521591257 >> 172.21.15.153:0/1521591257 conn(0x7f99680b1740 msgr2=0x7f996815c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f996d3d2700 1 -- 172.21.15.153:0/1521591257 shutdown_connections 2023-11-24T08:04:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.712+0000 7f996d3d2700 1 -- 172.21.15.153:0/1521591257 wait complete. 2023-11-24T08:04:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.720+0000 7fb817f13700 1 -- 172.21.15.153:0/1103246528 --> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7f8005c40 con 0x7fb7f80015d0 2023-11-24T08:04:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.720+0000 7fb8067fc700 1 -- 172.21.15.153:0/1103246528 <== osd.7 v2:172.21.15.164:6816/525702944 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7f8005c40 con 0x7fb7f80015d0 2023-11-24T08:04:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.721+0000 7fb817f13700 1 -- 172.21.15.153:0/1103246528 >> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] conn(0x7fb7f80015d0 msgr2=0x7fb7f8003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.721+0000 7fb817f13700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] conn(0x7fb7f80015d0 0x7fb7f8003a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.721+0000 7fb817f13700 1 -- 172.21.15.153:0/1103246528 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb7fc06b060 msgr2=0x7fb7fc06d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.721+0000 7fb817f13700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb7fc06b060 0x7fb7fc06d520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb80c000f60 tx=0x7fb80c007a40 comp rx=0 tx=0).stop 2023-11-24T08:04:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.721+0000 7fb817f13700 1 -- 172.21.15.153:0/1103246528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8100b49e0 msgr2=0x7fb810141130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.721+0000 7fb817f13700 1 --2- 172.21.15.153:0/1103246528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8100b49e0 0x7fb810141130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb80000b470 tx=0x7fb80000b830 comp rx=0 tx=0).stop 2023-11-24T08:04:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.721+0000 7fb8164b0700 1 -- 172.21.15.153:0/1103246528 reap_dead start 2023-11-24T08:04:18.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.721+0000 7fb817f13700 1 -- 172.21.15.153:0/1103246528 shutdown_connections 2023-11-24T08:04:18.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.721+0000 7fb817f13700 1 -- 172.21.15.153:0/1103246528 >> 172.21.15.153:0/1103246528 conn(0x7fb8100cfa30 msgr2=0x7fb81015d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.721+0000 7fb817f13700 1 -- 172.21.15.153:0/1103246528 shutdown_connections 2023-11-24T08:04:18.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.721+0000 7fb817f13700 1 -- 172.21.15.153:0/1103246528 wait complete. 2023-11-24T08:04:18.733 INFO:teuthology.orchestra.run.smithi153.stdout:55834574852 2023-11-24T08:04:18.733 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T08:04:18.735 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-11-24T08:04:18.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T08:04:18.739 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-11-24T08:04:18.740 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T08:04:18.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.906+0000 7ff553eee700 1 Processor -- start 2023-11-24T08:04:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.907+0000 7ff553eee700 1 -- start start 2023-11-24T08:04:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.908+0000 7ff553eee700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff54c0cf440 0x7ff54c06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.908+0000 7ff553eee700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff54c070fd0 0x7ff54c165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.908+0000 7ff553eee700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff54c072110 con 0x7ff54c1663d0 2023-11-24T08:04:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.908+0000 7ff553eee700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54c166860 con 0x7ff54c0cf440 2023-11-24T08:04:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.908+0000 7ff553eee700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54c06ee00 con 0x7ff54c070fd0 2023-11-24T08:04:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.908+0000 7ff551489700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff54c070fd0 0x7ff54c165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.908+0000 7ff551c8a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff54c0cf440 0x7ff54c06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.908+0000 7ff551489700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff54c070fd0 0x7ff54c165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57194/0 (socket says 172.21.15.153:57194) 2023-11-24T08:04:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.908+0000 7ff551489700 1 -- 172.21.15.153:0/577838262 learned_addr learned my addr 172.21.15.153:0/577838262 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.909+0000 7ff551c8a700 1 -- 172.21.15.153:0/577838262 >> v2:172.21.15.164:3300/0 conn(0x7ff54c070fd0 msgr2=0x7ff54c165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.909+0000 7ff551c8a700 1 --2- 172.21.15.153:0/577838262 >> v2:172.21.15.164:3300/0 conn(0x7ff54c070fd0 0x7ff54c165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.909+0000 7ff551c8a700 1 -- 172.21.15.153:0/577838262 >> v1:172.21.15.164:6789/0 conn(0x7ff54c1663d0 legacy=0x7ff54c1628a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.909+0000 7ff551c8a700 1 -- 172.21.15.153:0/577838262 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c071500 con 0x7ff54c0cf440 2023-11-24T08:04:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.909+0000 7ff551c8a700 1 --2- 172.21.15.153:0/577838262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff54c0cf440 0x7ff54c06e8c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff54c04fca0 tx=0x7ff53c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4304806ead37f1b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.910+0000 7f167ff75700 1 Processor -- start 2023-11-24T08:04:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.910+0000 7ff550c88700 1 -- 172.21.15.153:0/577838262 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c011830 con 0x7ff54c0cf440 2023-11-24T08:04:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.910+0000 7ff550c88700 1 -- 172.21.15.153:0/577838262 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c011990 con 0x7ff54c0cf440 2023-11-24T08:04:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.910+0000 7ff550c88700 1 -- 172.21.15.153:0/577838262 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c011d20 con 0x7ff54c0cf440 2023-11-24T08:04:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.911+0000 7ff553eee700 1 -- 172.21.15.153:0/577838262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff54c0cf440 msgr2=0x7ff54c06e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.911+0000 7ff553eee700 1 --2- 172.21.15.153:0/577838262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff54c0cf440 0x7ff54c06e8c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff54c04fca0 tx=0x7ff53c009b20 comp rx=0 tx=0).stop 2023-11-24T08:04:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.910+0000 7f167ff75700 1 -- start start 2023-11-24T08:04:18.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167ff75700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1678070fd0 0x7f1678165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167ff75700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16781663d0 0x7f16780b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167ff75700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1678072110 con 0x7f16780cf440 2023-11-24T08:04:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167ff75700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1678166840 con 0x7f16781663d0 2023-11-24T08:04:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167ff75700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1678071500 con 0x7f1678070fd0 2023-11-24T08:04:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167e512700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16781663d0 0x7f16780b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167dd11700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f16780cf440 0x7f167806e8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:49398/0 (socket says 172.21.15.153:49398) 2023-11-24T08:04:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167dd11700 1 -- 172.21.15.153:0/2100630430 learned_addr learned my addr 172.21.15.153:0/2100630430 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167d510700 1 --2- 172.21.15.153:0/2100630430 >> v2:172.21.15.164:3300/0 conn(0x7f1678070fd0 0x7f1678165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167cd0f700 1 -- 172.21.15.153:0/2100630430 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607379923 0 0) 0x7f1678072110 con 0x7f16780cf440 2023-11-24T08:04:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167cd0f700 1 -- 172.21.15.153:0/2100630430 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16640035b0 con 0x7f16780cf440 2023-11-24T08:04:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167e512700 1 -- 172.21.15.153:0/2100630430 >> v2:172.21.15.164:3300/0 conn(0x7f1678070fd0 msgr2=0x7f1678165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167e512700 1 --2- 172.21.15.153:0/2100630430 >> v2:172.21.15.164:3300/0 conn(0x7f1678070fd0 0x7f1678165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167e512700 1 -- 172.21.15.153:0/2100630430 >> v1:172.21.15.164:6789/0 conn(0x7f16780cf440 legacy=0x7f167806e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.912+0000 7f167e512700 1 -- 172.21.15.153:0/2100630430 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16780717e0 con 0x7f16781663d0 2023-11-24T08:04:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.913+0000 7f167e512700 1 --2- 172.21.15.153:0/2100630430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16781663d0 0x7f16780b2a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1678072770 tx=0x7f167000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ebcb6569440b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.913+0000 7f167cd0f700 1 -- 172.21.15.153:0/2100630430 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167000e070 con 0x7f16781663d0 2023-11-24T08:04:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.913+0000 7f167cd0f700 1 -- 172.21.15.153:0/2100630430 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167000bb20 con 0x7f16781663d0 2023-11-24T08:04:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.913+0000 7f167cd0f700 1 -- 172.21.15.153:0/2100630430 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670012430 con 0x7f16781663d0 2023-11-24T08:04:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.914+0000 7f167ff75700 1 -- 172.21.15.153:0/2100630430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16781663d0 msgr2=0x7f16780b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.914+0000 7f167ff75700 1 --2- 172.21.15.153:0/2100630430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16781663d0 0x7f16780b2a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1678072770 tx=0x7f167000b330 comp rx=0 tx=0).stop 2023-11-24T08:04:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.914+0000 7f167ff75700 1 -- 172.21.15.153:0/2100630430 shutdown_connections 2023-11-24T08:04:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.914+0000 7f167ff75700 1 --2- 172.21.15.153:0/2100630430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16781663d0 0x7f16780b2a40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.914+0000 7f167ff75700 1 --2- 172.21.15.153:0/2100630430 >> v2:172.21.15.164:3300/0 conn(0x7f1678070fd0 0x7f1678165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.914+0000 7f167ff75700 1 -- 172.21.15.153:0/2100630430 >> 172.21.15.153:0/2100630430 conn(0x7f16780b1740 msgr2=0x7f16780b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.914+0000 7f167ff75700 1 -- 172.21.15.153:0/2100630430 shutdown_connections 2023-11-24T08:04:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.914+0000 7f167ff75700 1 -- 172.21.15.153:0/2100630430 wait complete. 2023-11-24T08:04:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.916+0000 7f167ff75700 1 Processor -- start 2023-11-24T08:04:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f0426de0700 1 Processor -- start 2023-11-24T08:04:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.917+0000 7f167ff75700 1 -- start start 2023-11-24T08:04:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f167ff75700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1678070fd0 0x7f167815a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f167ff75700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16780cf440 0x7f1678143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f167ff75700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16781663d0 0x7f16781471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f167ff75700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1678144460 con 0x7f16780cf440 2023-11-24T08:04:18.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f167ff75700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16781476e0 con 0x7f16781663d0 2023-11-24T08:04:18.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f167ff75700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167815aa70 con 0x7f1678070fd0 2023-11-24T08:04:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f167d510700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16780cf440 0x7f1678143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f167d510700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16780cf440 0x7f1678143f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35618/0 (socket says 172.21.15.153:35618) 2023-11-24T08:04:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f167d510700 1 -- 172.21.15.153:0/3352614221 learned_addr learned my addr 172.21.15.153:0/3352614221 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f167e512700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16781663d0 0x7f16781471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f167dd11700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1678070fd0 0x7f167815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f167dd11700 1 -- 172.21.15.153:0/3352614221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16781663d0 msgr2=0x7f16781471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f167dd11700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16781663d0 0x7f16781471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f167dd11700 1 -- 172.21.15.153:0/3352614221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16780cf440 msgr2=0x7f1678143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f167dd11700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16780cf440 0x7f1678143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f167dd11700 1 -- 172.21.15.153:0/3352614221 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1670009a70 con 0x7f1678070fd0 2023-11-24T08:04:18.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f167dd11700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1678070fd0 0x7f167815a390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f166800c490 tx=0x7f166800c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.918+0000 7f0426de0700 1 -- start start 2023-11-24T08:04:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f0426de0700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f042015ddf0 0x7f04200b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f0426de0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0420072df0 0x7f04200cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f0426de0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04200ccde0 con 0x7f04200b0230 2023-11-24T08:04:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f0426de0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04200cd0c0 con 0x7f0420072df0 2023-11-24T08:04:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f0426de0700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04200cd3a0 con 0x7f042015ddf0 2023-11-24T08:04:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f042537d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0420072df0 0x7f04200cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f0424b7c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f042015ddf0 0x7f04200b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f0424b7c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f042015ddf0 0x7f04200b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57210/0 (socket says 172.21.15.153:57210) 2023-11-24T08:04:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f0424b7c700 1 -- 172.21.15.153:0/3337228025 learned_addr learned my addr 172.21.15.153:0/3337228025 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.919+0000 7f042537d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0420072df0 0x7f04200cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35626/0 (socket says 172.21.15.153:35626) 2023-11-24T08:04:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.920+0000 7f0424b7c700 1 -- 172.21.15.153:0/3337228025 >> v2:172.21.15.153:3300/0 conn(0x7f0420072df0 msgr2=0x7f04200cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.920+0000 7f0424b7c700 1 --2- 172.21.15.153:0/3337228025 >> v2:172.21.15.153:3300/0 conn(0x7f0420072df0 0x7f04200cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.920+0000 7f0424b7c700 1 -- 172.21.15.153:0/3337228025 >> v1:172.21.15.153:6789/0 conn(0x7f04200b0230 legacy=0x7f04200726e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:04:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.920+0000 7f0424b7c700 1 -- 172.21.15.153:0/3337228025 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04200cd680 con 0x7f042015ddf0 2023-11-24T08:04:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.920+0000 7f0424b7c700 1 --2- 172.21.15.153:0/3337228025 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f042015ddf0 0x7f04200b1320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04200b64d0 tx=0x7f041800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f90f3feccc266be server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.921+0000 7f166e7fc700 1 -- 172.21.15.153:0/3352614221 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668005d70 con 0x7f1678070fd0 2023-11-24T08:04:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.916+0000 7ff553eee700 1 -- 172.21.15.153:0/577838262 shutdown_connections 2023-11-24T08:04:18.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.916+0000 7ff553eee700 1 --2- 172.21.15.153:0/577838262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff54c0cf440 0x7ff54c06e8c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.916+0000 7ff553eee700 1 --2- 172.21.15.153:0/577838262 >> v2:172.21.15.164:3300/0 conn(0x7ff54c070fd0 0x7ff54c165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.916+0000 7ff553eee700 1 -- 172.21.15.153:0/577838262 >> 172.21.15.153:0/577838262 conn(0x7ff54c0b1740 msgr2=0x7ff54c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.921+0000 7f166e7fc700 1 -- 172.21.15.153:0/3352614221 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16680070d0 con 0x7f1678070fd0 2023-11-24T08:04:18.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.921+0000 7f166e7fc700 1 -- 172.21.15.153:0/3352614221 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668007440 con 0x7f1678070fd0 2023-11-24T08:04:18.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.921+0000 7f167ff75700 1 -- 172.21.15.153:0/3352614221 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167815ad50 con 0x7f1678070fd0 2023-11-24T08:04:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.921+0000 7f167ff75700 1 -- 172.21.15.153:0/3352614221 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167815b310 con 0x7f1678070fd0 2023-11-24T08:04:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.923+0000 7f166e7fc700 1 -- 172.21.15.153:0/3352614221 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16680075a0 con 0x7f1678070fd0 2023-11-24T08:04:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.923+0000 7f167ff75700 1 -- 172.21.15.153:0/3352614221 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16600052e0 con 0x7f1678070fd0 2023-11-24T08:04:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.923+0000 7ff553eee700 1 -- 172.21.15.153:0/577838262 shutdown_connections 2023-11-24T08:04:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.923+0000 7f166e7fc700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f165c06af20 0x7f165c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.923+0000 7f166e7fc700 1 -- 172.21.15.153:0/3352614221 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1668088790 con 0x7f1678070fd0 2023-11-24T08:04:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.923+0000 7f167d510700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f165c06af20 0x7f165c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.924+0000 7f167d510700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f165c06af20 0x7f165c06d3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f167815fb70 tx=0x7f1674008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.923+0000 7ff553eee700 1 -- 172.21.15.153:0/577838262 wait complete. 2023-11-24T08:04:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.925+0000 7ff553eee700 1 Processor -- start 2023-11-24T08:04:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.925+0000 7ff553eee700 1 -- start start 2023-11-24T08:04:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.926+0000 7ff553eee700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff54c070fd0 0x7ff54c155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.926+0000 7ff553eee700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff54c0cf440 0x7ff54c154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.926+0000 7ff553eee700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff54c1663d0 0x7ff54c13f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.926+0000 7ff553eee700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c1589b0 con 0x7ff54c0cf440 2023-11-24T08:04:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.926+0000 7ff553eee700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c1553f0 con 0x7ff54c070fd0 2023-11-24T08:04:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.926+0000 7ff553eee700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c158330 con 0x7ff54c1663d0 2023-11-24T08:04:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.926+0000 7ff551489700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff54c0cf440 0x7ff54c154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.926+0000 7ff55248b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff54c1663d0 0x7ff54c13f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.927+0000 7ff551489700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff54c0cf440 0x7ff54c154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35632/0 (socket says 172.21.15.153:35632) 2023-11-24T08:04:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.927+0000 7ff55248b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff54c1663d0 0x7ff54c13f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47704/0 (socket says 172.21.15.153:47704) 2023-11-24T08:04:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.927+0000 7ff551489700 1 -- 172.21.15.153:0/2553609035 learned_addr learned my addr 172.21.15.153:0/2553609035 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.927+0000 7ff551489700 1 -- 172.21.15.153:0/2553609035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff54c1663d0 msgr2=0x7ff54c13f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.927+0000 7ff551489700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff54c1663d0 0x7ff54c13f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.927+0000 7ff551489700 1 -- 172.21.15.153:0/2553609035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff54c070fd0 msgr2=0x7ff54c155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.927+0000 7ff551489700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff54c070fd0 0x7ff54c155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.927+0000 7ff551489700 1 -- 172.21.15.153:0/2553609035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0094a0 con 0x7ff54c0cf440 2023-11-24T08:04:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.927+0000 7ff551489700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff54c0cf440 0x7ff54c154eb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff54800e7e0 tx=0x7ff54800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7ff5427fc700 1 -- 172.21.15.153:0/2553609035 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548013610 con 0x7ff54c0cf440 2023-11-24T08:04:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7ff5427fc700 1 -- 172.21.15.153:0/2553609035 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548013770 con 0x7ff54c0cf440 2023-11-24T08:04:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7ff5427fc700 1 -- 172.21.15.153:0/2553609035 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548013b00 con 0x7ff54c0cf440 2023-11-24T08:04:18.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.931+0000 7f166e7fc700 1 -- 172.21.15.153:0/3352614221 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16680539d0 con 0x7f1678070fd0 2023-11-24T08:04:18.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.926+0000 7f041f7fe700 1 -- 172.21.15.153:0/3337228025 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418003a20 con 0x7f042015ddf0 2023-11-24T08:04:18.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.926+0000 7f041f7fe700 1 -- 172.21.15.153:0/3337228025 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0418003b80 con 0x7f042015ddf0 2023-11-24T08:04:18.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.927+0000 7f041f7fe700 1 -- 172.21.15.153:0/3337228025 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800b8d0 con 0x7f042015ddf0 2023-11-24T08:04:18.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7f0426de0700 1 -- 172.21.15.153:0/3337228025 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f042015ddf0 msgr2=0x7f04200b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7f0426de0700 1 --2- 172.21.15.153:0/3337228025 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f042015ddf0 0x7f04200b1320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04200b64d0 tx=0x7f041800b330 comp rx=0 tx=0).stop 2023-11-24T08:04:18.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7f0426de0700 1 -- 172.21.15.153:0/3337228025 shutdown_connections 2023-11-24T08:04:18.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7f0426de0700 1 --2- 172.21.15.153:0/3337228025 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f042015ddf0 0x7f04200b1320 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04200b64d0 tx=0x7f041800b330 comp rx=0 tx=0).stop 2023-11-24T08:04:18.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7f0426de0700 1 --2- 172.21.15.153:0/3337228025 >> v2:172.21.15.153:3300/0 conn(0x7f0420072df0 0x7f04200cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7f0426de0700 1 -- 172.21.15.153:0/3337228025 >> 172.21.15.153:0/3337228025 conn(0x7f04200b57b0 msgr2=0x7f04200b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7f0426de0700 1 -- 172.21.15.153:0/3337228025 shutdown_connections 2023-11-24T08:04:18.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7f0426de0700 1 -- 172.21.15.153:0/3337228025 wait complete. 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.930+0000 7f0426de0700 1 Processor -- start 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.930+0000 7f0426de0700 1 -- start start 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.931+0000 7f0426de0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0420072df0 0x7f0420153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.931+0000 7f0426de0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04200b0230 0x7f04200ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.931+0000 7f0426de0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f042006dda0 0x7f042006e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.931+0000 7f0426de0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042006e790 con 0x7f04200b0230 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.931+0000 7f0426de0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042015a1b0 con 0x7f0420072df0 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.931+0000 7f0426de0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04200af220 con 0x7f042006dda0 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.932+0000 7f041ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04200b0230 0x7f04200ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.932+0000 7f041ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04200b0230 0x7f04200ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35640/0 (socket says 172.21.15.153:35640) 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.932+0000 7f041ffff700 1 -- 172.21.15.153:0/1625131569 learned_addr learned my addr 172.21.15.153:0/1625131569 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.932+0000 7f042537d700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f042006dda0 0x7f042006e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7ff553eee700 1 -- 172.21.15.153:0/2553609035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54c155620 con 0x7ff54c0cf440 2023-11-24T08:04:18.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.928+0000 7ff553eee700 1 -- 172.21.15.153:0/2553609035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54c155900 con 0x7ff54c0cf440 2023-11-24T08:04:18.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.929+0000 7ff553eee700 1 -- 172.21.15.153:0/2553609035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54c158190 con 0x7ff54c0cf440 2023-11-24T08:04:18.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.935+0000 7f1469af5700 1 Processor -- start 2023-11-24T08:04:18.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.935+0000 7f1469af5700 1 -- start start 2023-11-24T08:04:18.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.936+0000 7ff5427fc700 1 -- 172.21.15.153:0/2553609035 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff548013c60 con 0x7ff54c0cf440 2023-11-24T08:04:18.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.936+0000 7ff5427fc700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff53006aed0 0x7ff53006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.936+0000 7ff5427fc700 1 -- 172.21.15.153:0/2553609035 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5480894a0 con 0x7ff54c0cf440 2023-11-24T08:04:18.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.936+0000 7f1469af5700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f14640b4260 0x7f146416abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.936+0000 7f1469af5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1464070d00 0x7f14640711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.936+0000 7f1469af5700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146406f410 con 0x7f1464072bb0 2023-11-24T08:04:18.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.936+0000 7f1469af5700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146406ce30 con 0x7f14640b4260 2023-11-24T08:04:18.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.936+0000 7f1469af5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146406d110 con 0x7f1464070d00 2023-11-24T08:04:18.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.936+0000 7ff551c8a700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff53006aed0 0x7ff53006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f1463fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1464070d00 0x7f14640711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f1463fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1464070d00 0x7f14640711b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47714/0 (socket says 172.21.15.153:47714) 2023-11-24T08:04:18.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f1463fff700 1 -- 172.21.15.153:0/1611602622 learned_addr learned my addr 172.21.15.153:0/1611602622 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f1462ffd700 1 --2- 172.21.15.153:0/1611602622 >> v2:172.21.15.164:3300/0 conn(0x7f14640b4260 0x7f146416abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f1463fff700 1 -- 172.21.15.153:0/1611602622 >> v2:172.21.15.164:3300/0 conn(0x7f14640b4260 msgr2=0x7f146416abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f1463fff700 1 --2- 172.21.15.153:0/1611602622 >> v2:172.21.15.164:3300/0 conn(0x7f14640b4260 0x7f146416abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f1463fff700 1 -- 172.21.15.153:0/1611602622 >> v1:172.21.15.164:6789/0 conn(0x7f1464072bb0 legacy=0x7f14640b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f1463fff700 1 -- 172.21.15.153:0/1611602622 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146416b130 con 0x7f1464070d00 2023-11-24T08:04:18.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7ff551c8a700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff53006aed0 0x7ff53006d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009fd0 tx=0x7ff53c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f1463fff700 1 --2- 172.21.15.153:0/1611602622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1464070d00 0x7f14640711b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f145c007a60 tx=0x7f145c010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1de2479f6e0fb2e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.932+0000 7f0424b7c700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0420072df0 0x7f0420153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.932+0000 7f041ffff700 1 -- 172.21.15.153:0/1625131569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f042006dda0 msgr2=0x7f042006e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.932+0000 7f041ffff700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f042006dda0 0x7f042006e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.932+0000 7f041ffff700 1 -- 172.21.15.153:0/1625131569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0420072df0 msgr2=0x7f0420153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.932+0000 7f041ffff700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0420072df0 0x7f0420153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.932+0000 7f041ffff700 1 -- 172.21.15.153:0/1625131569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418009b30 con 0x7f04200b0230 2023-11-24T08:04:18.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.932+0000 7f041ffff700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04200b0230 0x7f04200ae150 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f041400d910 tx=0x7f041400dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f14627fc700 1 -- 172.21.15.153:0/1611602622 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c010270 con 0x7f1464070d00 2023-11-24T08:04:18.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f14627fc700 1 -- 172.21.15.153:0/1611602622 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c019a60 con 0x7f1464070d00 2023-11-24T08:04:18.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.937+0000 7f14627fc700 1 -- 172.21.15.153:0/1611602622 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c019e10 con 0x7f1464070d00 2023-11-24T08:04:18.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.939+0000 7f1469af5700 1 -- 172.21.15.153:0/1611602622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1464070d00 msgr2=0x7f14640711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.939+0000 7f1469af5700 1 --2- 172.21.15.153:0/1611602622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1464070d00 0x7f14640711b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f145c007a60 tx=0x7f145c010800 comp rx=0 tx=0).stop 2023-11-24T08:04:18.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7f1469af5700 1 -- 172.21.15.153:0/1611602622 shutdown_connections 2023-11-24T08:04:18.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7f1469af5700 1 --2- 172.21.15.153:0/1611602622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1464070d00 0x7f14640711b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7f1469af5700 1 --2- 172.21.15.153:0/1611602622 >> v2:172.21.15.164:3300/0 conn(0x7f14640b4260 0x7f146416abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7f1469af5700 1 -- 172.21.15.153:0/1611602622 >> 172.21.15.153:0/1611602622 conn(0x7f14640cfa30 msgr2=0x7f14640cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7f1469af5700 1 -- 172.21.15.153:0/1611602622 shutdown_connections 2023-11-24T08:04:18.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7f1469af5700 1 -- 172.21.15.153:0/1611602622 wait complete. 2023-11-24T08:04:18.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7f041d7fa700 1 -- 172.21.15.153:0/1625131569 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400eb90 con 0x7f04200b0230 2023-11-24T08:04:18.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7f041d7fa700 1 -- 172.21.15.153:0/1625131569 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041400ecf0 con 0x7f04200b0230 2023-11-24T08:04:18.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7f041d7fa700 1 -- 172.21.15.153:0/1625131569 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414016640 con 0x7f04200b0230 2023-11-24T08:04:18.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7f0426de0700 1 -- 172.21.15.153:0/1625131569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04200ae980 con 0x7f04200b0230 2023-11-24T08:04:18.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7f0426de0700 1 -- 172.21.15.153:0/1625131569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04200aef40 con 0x7f04200b0230 2023-11-24T08:04:18.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f041d7fa700 1 -- 172.21.15.153:0/1625131569 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f041401f3e0 con 0x7f04200b0230 2023-11-24T08:04:18.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f041d7fa700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f040c06f2e0 0x7f040c0717a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f041d7fa700 1 -- 172.21.15.153:0/1625131569 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04140892d0 con 0x7f04200b0230 2023-11-24T08:04:18.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.944+0000 7f0424b7c700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f040c06f2e0 0x7f040c0717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.944+0000 7f0426de0700 1 -- 172.21.15.153:0/1625131569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04000052e0 con 0x7f04200b0230 2023-11-24T08:04:18.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.941+0000 7f1469af5700 1 Processor -- start 2023-11-24T08:04:18.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.942+0000 7f1469af5700 1 -- start start 2023-11-24T08:04:18.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1469af5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1464070d00 0x7f14641607e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1469af5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14640b4260 0x7f1464200750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1469af5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14641618a0 0x7f1464161d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1469af5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1464160d20 con 0x7f14640b4260 2023-11-24T08:04:18.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1469af5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146416b2c0 con 0x7f1464070d00 2023-11-24T08:04:18.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1469af5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1464162360 con 0x7f14641618a0 2023-11-24T08:04:18.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f14637fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1464070d00 0x7f14641607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f14637fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1464070d00 0x7f14641607e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57236/0 (socket says 172.21.15.153:57236) 2023-11-24T08:04:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f14637fe700 1 -- 172.21.15.153:0/386234336 learned_addr learned my addr 172.21.15.153:0/386234336 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1462ffd700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14640b4260 0x7f1464200750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1462ffd700 1 -- 172.21.15.153:0/386234336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14641618a0 msgr2=0x7f1464161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1462ffd700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14641618a0 0x7f1464161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1462ffd700 1 -- 172.21.15.153:0/386234336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1464070d00 msgr2=0x7f14641607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1462ffd700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1464070d00 0x7f14641607e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.943+0000 7f1462ffd700 1 -- 172.21.15.153:0/386234336 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c007790 con 0x7f14640b4260 2023-11-24T08:04:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.944+0000 7f1462ffd700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14640b4260 0x7f1464200750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f145400c7f0 tx=0x7f145400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.940+0000 7ff5427fc700 1 -- 172.21.15.153:0/2553609035 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff548054540 con 0x7ff54c0cf440 2023-11-24T08:04:18.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.948+0000 7f0424b7c700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f040c06f2e0 0x7f040c0717a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0420071720 tx=0x7f0418009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.949+0000 7f041d7fa700 1 -- 172.21.15.153:0/1625131569 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04140543a0 con 0x7f04200b0230 2023-11-24T08:04:18.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.952+0000 7f144bfff700 1 -- 172.21.15.153:0/386234336 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1454004220 con 0x7f14640b4260 2023-11-24T08:04:18.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.952+0000 7f144bfff700 1 -- 172.21.15.153:0/386234336 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1454004380 con 0x7f14640b4260 2023-11-24T08:04:18.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.952+0000 7f144bfff700 1 -- 172.21.15.153:0/386234336 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14540036a0 con 0x7f14640b4260 2023-11-24T08:04:18.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.953+0000 7f1469af5700 1 -- 172.21.15.153:0/386234336 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146416b510 con 0x7f14640b4260 2023-11-24T08:04:18.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.953+0000 7f1469af5700 1 -- 172.21.15.153:0/386234336 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146416bad0 con 0x7f14640b4260 2023-11-24T08:04:18.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.956+0000 7f144bfff700 1 -- 172.21.15.153:0/386234336 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1454003800 con 0x7f14640b4260 2023-11-24T08:04:18.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.956+0000 7f144bfff700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f145006af20 0x7f145006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.957+0000 7f144bfff700 1 -- 172.21.15.153:0/386234336 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14540890c0 con 0x7f14640b4260 2023-11-24T08:04:18.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.958+0000 7f14637fe700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f145006af20 0x7f145006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.959+0000 7f3ae49d4700 1 Processor -- start 2023-11-24T08:04:18.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.959+0000 7f3ae49d4700 1 -- start start 2023-11-24T08:04:18.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.960+0000 7f1469af5700 1 -- 172.21.15.153:0/386234336 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146416bcf0 con 0x7f14640b4260 2023-11-24T08:04:18.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.960+0000 7f3ae49d4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 0x7f3ae00b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.960+0000 7f3ae49d4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3ae00b4090 0x7f3ae00714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.960+0000 7f3ae49d4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae0071e70 con 0x7f3ae0071a10 2023-11-24T08:04:18.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.960+0000 7f3ae49d4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae0072d60 con 0x7f3ae00b4090 2023-11-24T08:04:18.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.960+0000 7f3ae49d4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae006de80 con 0x7f3ae015d6a0 2023-11-24T08:04:18.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.961+0000 7f14637fe700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f145006af20 0x7f145006d3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f146416ee50 tx=0x7f1458009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.961+0000 7f3ade59c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 0x7f3ae00b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.961+0000 7f3ade59c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 0x7f3ae00b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47730/0 (socket says 172.21.15.153:47730) 2023-11-24T08:04:18.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.961+0000 7f3ade59c700 1 -- 172.21.15.153:0/1503753249 learned_addr learned my addr 172.21.15.153:0/1503753249 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.963+0000 7f3addd9b700 1 --2- 172.21.15.153:0/1503753249 >> v2:172.21.15.153:3300/0 conn(0x7f3ae00b4090 0x7f3ae00714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.964+0000 7f3addd9b700 1 -- 172.21.15.153:0/1503753249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 msgr2=0x7f3ae00b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:18.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.964+0000 7f3addd9b700 1 --2- 172.21.15.153:0/1503753249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 0x7f3ae00b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.964+0000 7f3addd9b700 1 -- 172.21.15.153:0/1503753249 >> v1:172.21.15.153:6789/0 conn(0x7f3ae0071a10 legacy=0x7f3ae006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.964+0000 7f3addd9b700 1 -- 172.21.15.153:0/1503753249 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00720e0 con 0x7f3ae00b4090 2023-11-24T08:04:18.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.964+0000 7f3addd9b700 1 --2- 172.21.15.153:0/1503753249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae00b4090 0x7f3ae00714d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400bb10 tx=0x7f3ad400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232bf61aa9a55a89 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.970+0000 7f3add59a700 1 -- 172.21.15.153:0/1503753249 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad400db20 con 0x7f3ae00b4090 2023-11-24T08:04:18.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.970+0000 7f3add59a700 1 -- 172.21.15.153:0/1503753249 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad400dc80 con 0x7f3ae00b4090 2023-11-24T08:04:18.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.970+0000 7f3add59a700 1 -- 172.21.15.153:0/1503753249 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4017410 con 0x7f3ae00b4090 2023-11-24T08:04:18.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.971+0000 7f144bfff700 1 -- 172.21.15.153:0/386234336 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1454054160 con 0x7f14640b4260 2023-11-24T08:04:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.971+0000 7f3ae49d4700 1 -- 172.21.15.153:0/1503753249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae00b4090 msgr2=0x7f3ae00714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.971+0000 7f3ae49d4700 1 --2- 172.21.15.153:0/1503753249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae00b4090 0x7f3ae00714d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400bb10 tx=0x7f3ad400be20 comp rx=0 tx=0).stop 2023-11-24T08:04:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.972+0000 7f3ae49d4700 1 -- 172.21.15.153:0/1503753249 shutdown_connections 2023-11-24T08:04:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.972+0000 7f3ae49d4700 1 --2- 172.21.15.153:0/1503753249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 0x7f3ae00b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.972+0000 7f3ae49d4700 1 --2- 172.21.15.153:0/1503753249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae00b4090 0x7f3ae00714d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.972+0000 7f3ae49d4700 1 -- 172.21.15.153:0/1503753249 >> 172.21.15.153:0/1503753249 conn(0x7f3ae00cfa30 msgr2=0x7f3ae00cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.972+0000 7f3ae49d4700 1 -- 172.21.15.153:0/1503753249 shutdown_connections 2023-11-24T08:04:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.972+0000 7f3ae49d4700 1 -- 172.21.15.153:0/1503753249 wait complete. 2023-11-24T08:04:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.974+0000 7f3ae49d4700 1 Processor -- start 2023-11-24T08:04:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.974+0000 7f3ae49d4700 1 -- start start 2023-11-24T08:04:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.975+0000 7f3ae49d4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ae0071a10 0x7f3ae01371c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.975+0000 7f3ae49d4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae00b4090 0x7f3ae00aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.975+0000 7f3ae49d4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 0x7f3ae00aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.975+0000 7f3ae49d4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00a9460 con 0x7f3ae00b4090 2023-11-24T08:04:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.975+0000 7f3ae49d4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00a9670 con 0x7f3ae0071a10 2023-11-24T08:04:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.975+0000 7f3ae49d4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00a9950 con 0x7f3ae015d6a0 2023-11-24T08:04:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.976+0000 7f3aded9d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 0x7f3ae00aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.976+0000 7f3aded9d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 0x7f3ae00aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47736/0 (socket says 172.21.15.153:47736) 2023-11-24T08:04:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.976+0000 7f3aded9d700 1 -- 172.21.15.153:0/4130117385 learned_addr learned my addr 172.21.15.153:0/4130117385 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.976+0000 7f3addd9b700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae00b4090 0x7f3ae00aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.977+0000 7f3addd9b700 1 -- 172.21.15.153:0/4130117385 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 msgr2=0x7f3ae00aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.977+0000 7f3addd9b700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 0x7f3ae00aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.977+0000 7f3addd9b700 1 -- 172.21.15.153:0/4130117385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ae0071a10 msgr2=0x7f3ae01371c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:04:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.977+0000 7f3addd9b700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ae0071a10 0x7f3ae01371c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.977+0000 7f3addd9b700 1 -- 172.21.15.153:0/4130117385 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad400b740 con 0x7f3ae00b4090 2023-11-24T08:04:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.977+0000 7f3addd9b700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae00b4090 0x7f3ae00aa430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4018000 tx=0x7f3ad4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.979+0000 7f3aceffd700 1 -- 172.21.15.153:0/4130117385 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4025070 con 0x7f3ae00b4090 2023-11-24T08:04:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.979+0000 7f3aceffd700 1 -- 172.21.15.153:0/4130117385 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad400db10 con 0x7f3ae00b4090 2023-11-24T08:04:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.979+0000 7f3aceffd700 1 -- 172.21.15.153:0/4130117385 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4009040 con 0x7f3ae00b4090 2023-11-24T08:04:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.980+0000 7f3ae49d4700 1 -- 172.21.15.153:0/4130117385 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae00a9c30 con 0x7f3ae00b4090 2023-11-24T08:04:18.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.980+0000 7f3ae49d4700 1 -- 172.21.15.153:0/4130117385 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae0137700 con 0x7f3ae00b4090 2023-11-24T08:04:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.983+0000 7f3aceffd700 1 -- 172.21.15.153:0/4130117385 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ad4015070 con 0x7f3ae00b4090 2023-11-24T08:04:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.983+0000 7f3aceffd700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ac006afa0 0x7f3ac006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.983+0000 7f3aceffd700 1 -- 172.21.15.153:0/4130117385 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ad408a700 con 0x7f3ae00b4090 2023-11-24T08:04:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.985+0000 7f3ade59c700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ac006afa0 0x7f3ac006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.985+0000 7f3ade59c700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ac006afa0 0x7f3ac006d460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0071450 tx=0x7f3ad800c110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.988+0000 7f3ae49d4700 1 -- 172.21.15.153:0/4130117385 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac40052e0 con 0x7f3ae00b4090 2023-11-24T08:04:19.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:18.997+0000 7f3aceffd700 1 -- 172.21.15.153:0/4130117385 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3ad4055820 con 0x7f3ae00b4090 2023-11-24T08:04:19.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.007+0000 7fecb2c55700 1 Processor -- start 2023-11-24T08:04:19.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.007+0000 7fecb2c55700 1 -- start start 2023-11-24T08:04:19.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.009+0000 7fecb2c55700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fecac15d6a0 0x7fecac0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.009+0000 7fecb2c55700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 0x7fecac140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.009+0000 7fecb2c55700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecac0720e0 con 0x7fecac0b4090 2023-11-24T08:04:19.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.009+0000 7fecb2c55700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecac072d60 con 0x7fecac15d6a0 2023-11-24T08:04:19.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.009+0000 7fecb2c55700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecac06de80 con 0x7fecac071be0 2023-11-24T08:04:19.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.009+0000 7fecabfff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fecac0b4090 0x7fecac0714d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:49460/0 (socket says 172.21.15.153:49460) 2023-11-24T08:04:19.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.009+0000 7fecabfff700 1 -- 172.21.15.153:0/1362807078 learned_addr learned my addr 172.21.15.153:0/1362807078 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:19.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.009+0000 7fecb11f2700 1 --2- 172.21.15.153:0/1362807078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 0x7fecac140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.010+0000 7fecab7fe700 1 -- 172.21.15.153:0/1362807078 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965225382 0 0) 0x7fecac0720e0 con 0x7fecac0b4090 2023-11-24T08:04:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.010+0000 7fecb09f1700 1 --2- 172.21.15.153:0/1362807078 >> v2:172.21.15.164:3300/0 conn(0x7fecac15d6a0 0x7fecac0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.010+0000 7fecab7fe700 1 -- 172.21.15.153:0/1362807078 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec940034d0 con 0x7fecac0b4090 2023-11-24T08:04:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.010+0000 7fecb11f2700 1 -- 172.21.15.153:0/1362807078 >> v2:172.21.15.164:3300/0 conn(0x7fecac15d6a0 msgr2=0x7fecac0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.010+0000 7fecb11f2700 1 --2- 172.21.15.153:0/1362807078 >> v2:172.21.15.164:3300/0 conn(0x7fecac15d6a0 0x7fecac0b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.010+0000 7fecb11f2700 1 -- 172.21.15.153:0/1362807078 >> v1:172.21.15.164:6789/0 conn(0x7fecac0b4090 legacy=0x7fecac0714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.010+0000 7fecb11f2700 1 -- 172.21.15.153:0/1362807078 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac0723c0 con 0x7fecac071be0 2023-11-24T08:04:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.011+0000 7fecb11f2700 1 --2- 172.21.15.153:0/1362807078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 0x7fecac140fd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feca0009840 tx=0x7feca0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f8a284f5090b77c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.011+0000 7fecab7fe700 1 -- 172.21.15.153:0/1362807078 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0011830 con 0x7fecac071be0 2023-11-24T08:04:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.011+0000 7fecab7fe700 1 -- 172.21.15.153:0/1362807078 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca0011990 con 0x7fecac071be0 2023-11-24T08:04:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.011+0000 7fecab7fe700 1 -- 172.21.15.153:0/1362807078 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0011d00 con 0x7fecac071be0 2023-11-24T08:04:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.012+0000 7fecb2c55700 1 -- 172.21.15.153:0/1362807078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 msgr2=0x7fecac140fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.012+0000 7fecb2c55700 1 --2- 172.21.15.153:0/1362807078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 0x7fecac140fd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feca0009840 tx=0x7feca0009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:19.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.017+0000 7fecb2c55700 1 -- 172.21.15.153:0/1362807078 shutdown_connections 2023-11-24T08:04:19.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.017+0000 7fecb2c55700 1 --2- 172.21.15.153:0/1362807078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 0x7fecac140fd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.017+0000 7fecb2c55700 1 --2- 172.21.15.153:0/1362807078 >> v2:172.21.15.164:3300/0 conn(0x7fecac15d6a0 0x7fecac0b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.017+0000 7fecb2c55700 1 -- 172.21.15.153:0/1362807078 >> 172.21.15.153:0/1362807078 conn(0x7fecac0cfa30 msgr2=0x7fecac0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.019+0000 7f7025d95700 1 Processor -- start 2023-11-24T08:04:19.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.019+0000 7f7025d95700 1 -- start start 2023-11-24T08:04:19.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.020+0000 7fecb2c55700 1 -- 172.21.15.153:0/1362807078 shutdown_connections 2023-11-24T08:04:19.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.021+0000 7f7025d95700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f70200cf440 0x7f702006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.021+0000 7f7025d95700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f70201665a0 0x7f70200b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.021+0000 7f7025d95700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7020072110 con 0x7f7020070fd0 2023-11-24T08:04:19.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.021+0000 7f7025d95700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702006ee00 con 0x7f70201665a0 2023-11-24T08:04:19.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.021+0000 7f7025d95700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7020071500 con 0x7f70200cf440 2023-11-24T08:04:19.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.020+0000 7fecb2c55700 1 -- 172.21.15.153:0/1362807078 wait complete. 2023-11-24T08:04:19.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.021+0000 7f7016ffd700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f7020070fd0 0x7f7020165e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:49464/0 (socket says 172.21.15.153:49464) 2023-11-24T08:04:19.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.021+0000 7f7016ffd700 1 -- 172.21.15.153:0/2679715042 learned_addr learned my addr 172.21.15.153:0/2679715042 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:19.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.022+0000 7f701ffff700 1 --2- 172.21.15.153:0/2679715042 >> v2:172.21.15.153:3300/0 conn(0x7f70201665a0 0x7f70200b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.022+0000 7fecb2c55700 1 Processor -- start 2023-11-24T08:04:19.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.022+0000 7f701ffff700 1 -- 172.21.15.153:0/2679715042 >> v2:172.21.15.164:3300/0 conn(0x7f70200cf440 msgr2=0x7f702006e8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:04:19.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.022+0000 7f701ffff700 1 --2- 172.21.15.153:0/2679715042 >> v2:172.21.15.164:3300/0 conn(0x7f70200cf440 0x7f702006e8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.022+0000 7f701ffff700 1 -- 172.21.15.153:0/2679715042 >> v1:172.21.15.164:6789/0 conn(0x7f7020070fd0 legacy=0x7f7020165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:19.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.022+0000 7f701ffff700 1 -- 172.21.15.153:0/2679715042 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70200717e0 con 0x7f70201665a0 2023-11-24T08:04:19.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.022+0000 7fecb2c55700 1 -- start start 2023-11-24T08:04:19.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.023+0000 7f701ffff700 1 --2- 172.21.15.153:0/2679715042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70201665a0 0x7f70200b2a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70200b5cb0 tx=0x7f701800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3726846f26e8129a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7f701effd700 1 -- 172.21.15.153:0/2679715042 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701800e070 con 0x7f70201665a0 2023-11-24T08:04:19.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7f701effd700 1 -- 172.21.15.153:0/2679715042 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701800bb90 con 0x7f70201665a0 2023-11-24T08:04:19.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7f701effd700 1 -- 172.21.15.153:0/2679715042 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018003a20 con 0x7f70201665a0 2023-11-24T08:04:19.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7fecb2c55700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 0x7fecac1f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7fecb2c55700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecac0b4090 0x7fecac154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7fecb2c55700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecac15d6a0 0x7fecac13f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7fecb2c55700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac140b50 con 0x7fecac15d6a0 2023-11-24T08:04:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7fecb2c55700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac156f80 con 0x7fecac0b4090 2023-11-24T08:04:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7fecb2c55700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecac157260 con 0x7fecac071be0 2023-11-24T08:04:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7fecb11f2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecac15d6a0 0x7fecac13f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7fecb11f2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecac15d6a0 0x7fecac13f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35686/0 (socket says 172.21.15.153:35686) 2023-11-24T08:04:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.024+0000 7fecb11f2700 1 -- 172.21.15.153:0/2040545922 learned_addr learned my addr 172.21.15.153:0/2040545922 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7fecb11f2700 1 -- 172.21.15.153:0/2040545922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 msgr2=0x7fecac1f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7fecb09f1700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 0x7fecac1f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7fecabfff700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecac0b4090 0x7fecac154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7f7025d95700 1 -- 172.21.15.153:0/2679715042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70201665a0 msgr2=0x7f70200b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7f7025d95700 1 --2- 172.21.15.153:0/2679715042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70201665a0 0x7f70200b2a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70200b5cb0 tx=0x7f701800b330 comp rx=0 tx=0).stop 2023-11-24T08:04:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7fecb11f2700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 0x7fecac1f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7fecb11f2700 1 -- 172.21.15.153:0/2040545922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecac0b4090 msgr2=0x7fecac154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7fecb11f2700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecac0b4090 0x7fecac154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7fecb11f2700 1 -- 172.21.15.153:0/2040545922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca00094a0 con 0x7fecac15d6a0 2023-11-24T08:04:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7fecb09f1700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 0x7fecac1f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7fecb11f2700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecac15d6a0 0x7fecac13f9a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feca00090b0 tx=0x7feca0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7feca97fa700 1 -- 172.21.15.153:0/2040545922 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00036a0 con 0x7fecac15d6a0 2023-11-24T08:04:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7feca97fa700 1 -- 172.21.15.153:0/2040545922 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca001f070 con 0x7fecac15d6a0 2023-11-24T08:04:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7feca97fa700 1 -- 172.21.15.153:0/2040545922 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0003a40 con 0x7fecac15d6a0 2023-11-24T08:04:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.025+0000 7fecb2c55700 1 -- 172.21.15.153:0/2040545922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecac157540 con 0x7fecac15d6a0 2023-11-24T08:04:19.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.027+0000 7fecb2c55700 1 -- 172.21.15.153:0/2040545922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecac155280 con 0x7fecac15d6a0 2023-11-24T08:04:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.029+0000 7f7025d95700 1 -- 172.21.15.153:0/2679715042 shutdown_connections 2023-11-24T08:04:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.029+0000 7f7025d95700 1 --2- 172.21.15.153:0/2679715042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70201665a0 0x7f70200b2a40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.029+0000 7f7025d95700 1 --2- 172.21.15.153:0/2679715042 >> v2:172.21.15.164:3300/0 conn(0x7f70200cf440 0x7f702006e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.029+0000 7f7025d95700 1 -- 172.21.15.153:0/2679715042 >> 172.21.15.153:0/2679715042 conn(0x7f70200b1740 msgr2=0x7f70200b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.029+0000 7f7025d95700 1 -- 172.21.15.153:0/2679715042 shutdown_connections 2023-11-24T08:04:19.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.029+0000 7f7025d95700 1 -- 172.21.15.153:0/2679715042 wait complete. 2023-11-24T08:04:19.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.031+0000 7f7025d95700 1 Processor -- start 2023-11-24T08:04:19.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.031+0000 7f7025d95700 1 -- start start 2023-11-24T08:04:19.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.032+0000 7f7025d95700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7020070fd0 0x7f70200a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.032+0000 7f7025d95700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70200cf440 0x7f702014aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.032+0000 7f7025d95700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70201665a0 0x7f7020147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.032+0000 7f7025d95700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702014df70 con 0x7f70201665a0 2023-11-24T08:04:19.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.032+0000 7f7025d95700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70201fcae0 con 0x7f7020070fd0 2023-11-24T08:04:19.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.032+0000 7f7025d95700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702014afe0 con 0x7f70200cf440 2023-11-24T08:04:19.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.031+0000 7ff9dc752700 1 Processor -- start 2023-11-24T08:04:19.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.031+0000 7ff9dc752700 1 -- start start 2023-11-24T08:04:19.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7fecb2c55700 1 -- 172.21.15.153:0/2040545922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecac1573a0 con 0x7fecac15d6a0 2023-11-24T08:04:19.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9dc752700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff9d406ebb0 0x7ff9d4140c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9dc752700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d4140680 0x7ff9d40b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9dc752700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d406d550 con 0x7ff9d40b4280 2023-11-24T08:04:19.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9dc752700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d40b47c0 con 0x7ff9d406ebb0 2023-11-24T08:04:19.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9dc752700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d406cc60 con 0x7ff9d4140680 2023-11-24T08:04:19.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9da4ee700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff9d406ebb0 0x7ff9d4140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9d9ced700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d4140680 0x7ff9d40b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9da4ee700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff9d406ebb0 0x7ff9d4140c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57286/0 (socket says 172.21.15.153:57286) 2023-11-24T08:04:19.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9da4ee700 1 -- 172.21.15.153:0/3485451796 learned_addr learned my addr 172.21.15.153:0/3485451796 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:19.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9d9ced700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d4140680 0x7ff9d40b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47768/0 (socket says 172.21.15.153:47768) 2023-11-24T08:04:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7f701ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70201665a0 0x7f7020147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7f701ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70201665a0 0x7f7020147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35694/0 (socket says 172.21.15.153:35694) 2023-11-24T08:04:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7f701ffff700 1 -- 172.21.15.153:0/836720744 learned_addr learned my addr 172.21.15.153:0/836720744 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7f7016ffd700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70200cf440 0x7f702014aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.034+0000 7f701f7fe700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7020070fd0 0x7f70200a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.034+0000 7f701ffff700 1 -- 172.21.15.153:0/836720744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70200cf440 msgr2=0x7f702014aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.034+0000 7f701ffff700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70200cf440 0x7f702014aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.034+0000 7f701ffff700 1 -- 172.21.15.153:0/836720744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7020070fd0 msgr2=0x7f70200a95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.034+0000 7f701ffff700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7020070fd0 0x7f70200a95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.034+0000 7f701ffff700 1 -- 172.21.15.153:0/836720744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7018009a70 con 0x7f70201665a0 2023-11-24T08:04:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9da4ee700 1 -- 172.21.15.153:0/3485451796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d4140680 msgr2=0x7ff9d40b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9da4ee700 1 --2- 172.21.15.153:0/3485451796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d4140680 0x7ff9d40b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9da4ee700 1 -- 172.21.15.153:0/3485451796 >> v1:172.21.15.153:6789/0 conn(0x7ff9d40b4280 legacy=0x7ff9d4070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.033+0000 7ff9da4ee700 1 -- 172.21.15.153:0/3485451796 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d406cf00 con 0x7ff9d406ebb0 2023-11-24T08:04:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.034+0000 7ff9da4ee700 1 --2- 172.21.15.153:0/3485451796 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9d406ebb0 0x7ff9d4140c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40098f0 tx=0x7ff9c4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf74021b349f8006 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.034+0000 7ff9d9ced700 1 --2- 172.21.15.153:0/3485451796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d4140680 0x7ff9d40b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:19.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.034+0000 7f701ffff700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70201665a0 0x7f7020147810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7018004000 tx=0x7f7018004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.035+0000 7feca97fa700 1 -- 172.21.15.153:0/2040545922 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feca0003ba0 con 0x7fecac15d6a0 2023-11-24T08:04:19.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.036+0000 7feca97fa700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fec9406b370 0x7fec9406d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.036+0000 7feca97fa700 1 -- 172.21.15.153:0/2040545922 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feca0021070 con 0x7fecac15d6a0 2023-11-24T08:04:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.037+0000 7fecb09f1700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fec9406b370 0x7fec9406d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.037+0000 7fecb09f1700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fec9406b370 0x7fec9406d830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec9c006fd0 tx=0x7fec9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.041+0000 7ff9d94ec700 1 -- 172.21.15.153:0/3485451796 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4004230 con 0x7ff9d406ebb0 2023-11-24T08:04:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.042+0000 7ff9d94ec700 1 -- 172.21.15.153:0/3485451796 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4004390 con 0x7ff9d406ebb0 2023-11-24T08:04:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.042+0000 7ff9d94ec700 1 -- 172.21.15.153:0/3485451796 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40036a0 con 0x7ff9d406ebb0 2023-11-24T08:04:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.042+0000 7ff9dc752700 1 -- 172.21.15.153:0/3485451796 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9d406ebb0 msgr2=0x7ff9d4140c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.042+0000 7ff9dc752700 1 --2- 172.21.15.153:0/3485451796 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9d406ebb0 0x7ff9d4140c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40098f0 tx=0x7ff9c4009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.044+0000 7f701cff9700 1 -- 172.21.15.153:0/836720744 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018012630 con 0x7f70201665a0 2023-11-24T08:04:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.044+0000 7f701cff9700 1 -- 172.21.15.153:0/836720744 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7018012790 con 0x7f70201665a0 2023-11-24T08:04:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.044+0000 7f701cff9700 1 -- 172.21.15.153:0/836720744 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018012b00 con 0x7f70201665a0 2023-11-24T08:04:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.045+0000 7ff9dc752700 1 -- 172.21.15.153:0/3485451796 shutdown_connections 2023-11-24T08:04:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.045+0000 7ff9dc752700 1 --2- 172.21.15.153:0/3485451796 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9d406ebb0 0x7ff9d4140c80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.045+0000 7ff9dc752700 1 --2- 172.21.15.153:0/3485451796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d4140680 0x7ff9d40b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.045+0000 7ff9dc752700 1 -- 172.21.15.153:0/3485451796 >> 172.21.15.153:0/3485451796 conn(0x7ff9d40b1740 msgr2=0x7ff9d40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.045+0000 7feca97fa700 1 -- 172.21.15.153:0/2040545922 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feca00560b0 con 0x7fecac15d6a0 2023-11-24T08:04:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.046+0000 7f7025d95700 1 -- 172.21.15.153:0/836720744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7020147d50 con 0x7f70201665a0 2023-11-24T08:04:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.046+0000 7f7025d95700 1 -- 172.21.15.153:0/836720744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70201fc1b0 con 0x7f70201665a0 2023-11-24T08:04:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.047+0000 7ff9dc752700 1 -- 172.21.15.153:0/3485451796 shutdown_connections 2023-11-24T08:04:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.047+0000 7ff9dc752700 1 -- 172.21.15.153:0/3485451796 wait complete. 2023-11-24T08:04:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.049+0000 7ff9dc752700 1 Processor -- start 2023-11-24T08:04:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.051+0000 7f701cff9700 1 -- 172.21.15.153:0/836720744 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7018012c60 con 0x7f70201665a0 2023-11-24T08:04:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.052+0000 7f701cff9700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f700006afa0 0x7f700006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.052+0000 7f701cff9700 1 -- 172.21.15.153:0/836720744 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f701808bf20 con 0x7f70201665a0 2023-11-24T08:04:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.052+0000 7ff9dc752700 1 -- start start 2023-11-24T08:04:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9dc752700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9d406ebb0 0x7ff9d415e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9dc752700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d40b4280 0x7ff9d4156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9dc752700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d4140680 0x7ff9d413eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9dc752700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40abce0 con 0x7ff9d4140680 2023-11-24T08:04:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9dc752700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40acb40 con 0x7ff9d406ebb0 2023-11-24T08:04:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9dc752700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40abf30 con 0x7ff9d40b4280 2023-11-24T08:04:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9dacef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d4140680 0x7ff9d413eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7f701f7fe700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f700006afa0 0x7f700006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9dacef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d4140680 0x7ff9d413eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35708/0 (socket says 172.21.15.153:35708) 2023-11-24T08:04:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9dacef700 1 -- 172.21.15.153:0/2244166072 learned_addr learned my addr 172.21.15.153:0/2244166072 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9d9ced700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d40b4280 0x7ff9d4156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9da4ee700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9d406ebb0 0x7ff9d415e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9d9ced700 1 -- 172.21.15.153:0/2244166072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9d406ebb0 msgr2=0x7ff9d415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9d9ced700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9d406ebb0 0x7ff9d415e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9d9ced700 1 -- 172.21.15.153:0/2244166072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d4140680 msgr2=0x7ff9d413eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9d9ced700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d4140680 0x7ff9d413eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.054+0000 7ff9d9ced700 1 -- 172.21.15.153:0/2244166072 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00094a0 con 0x7ff9d40b4280 2023-11-24T08:04:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.055+0000 7ff9d9ced700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d40b4280 0x7ff9d4156ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000e9e0 tx=0x7ff9d000eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.055+0000 7ff9caffd700 1 -- 172.21.15.153:0/2244166072 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000c850 con 0x7ff9d40b4280 2023-11-24T08:04:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.055+0000 7ff9caffd700 1 -- 172.21.15.153:0/2244166072 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d000c9b0 con 0x7ff9d40b4280 2023-11-24T08:04:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.055+0000 7ff9caffd700 1 -- 172.21.15.153:0/2244166072 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000cd40 con 0x7ff9d40b4280 2023-11-24T08:04:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.055+0000 7ff9dc752700 1 -- 172.21.15.153:0/2244166072 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c4009550 con 0x7ff9d40b4280 2023-11-24T08:04:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.055+0000 7ff9dc752700 1 -- 172.21.15.153:0/2244166072 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d40ac4f0 con 0x7ff9d40b4280 2023-11-24T08:04:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.055+0000 7ff9da4ee700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9d406ebb0 0x7ff9d415e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.057+0000 7ff9caffd700 1 -- 172.21.15.153:0/2244166072 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9d0013470 con 0x7ff9d40b4280 2023-11-24T08:04:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.058+0000 7ff9caffd700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff9b806aed0 0x7ff9b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.058+0000 7ff9caffd700 1 -- 172.21.15.153:0/2244166072 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9d0089410 con 0x7ff9d40b4280 2023-11-24T08:04:19.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.057+0000 7f7025d95700 1 -- 172.21.15.153:0/836720744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70200751e0 con 0x7f70201665a0 2023-11-24T08:04:19.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.063+0000 7ff9dacef700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d4140680 0x7ff9d413eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:19.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.063+0000 7f701f7fe700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f700006afa0 0x7f700006d460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7008009910 tx=0x7f7008008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.063+0000 7ff9da4ee700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff9b806aed0 0x7ff9b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.063+0000 7ff9dc752700 1 -- 172.21.15.153:0/2244166072 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d40b0dd0 con 0x7ff9d40b4280 2023-11-24T08:04:19.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.064+0000 7ff9da4ee700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff9b806aed0 0x7ff9b806d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4000c00 tx=0x7ff9c4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.067+0000 7f701cff9700 1 -- 172.21.15.153:0/836720744 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7018057040 con 0x7f70201665a0 2023-11-24T08:04:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.072+0000 7ff9caffd700 1 -- 172.21.15.153:0/2244166072 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9d0054420 con 0x7ff9d40b4280 2023-11-24T08:04:19.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.329+0000 7f0426de0700 1 -- 172.21.15.153:0/1625131569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0400005150 con 0x7f04200b0230 2023-11-24T08:04:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.329+0000 7f041d7fa700 1 -- 172.21.15.153:0/1625131569 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f041401b020 con 0x7f04200b0230 2023-11-24T08:04:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.329+0000 7ff553eee700 1 -- 172.21.15.153:0/2553609035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff54c158190 con 0x7ff54c0cf440 2023-11-24T08:04:19.332 INFO:teuthology.orchestra.run.smithi153.stdout:55834574852 2023-11-24T08:04:19.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.333+0000 7f0426de0700 1 -- 172.21.15.153:0/1625131569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f040c06f2e0 msgr2=0x7f040c0717a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.333+0000 7f0426de0700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f040c06f2e0 0x7f040c0717a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0420071720 tx=0x7f0418009000 comp rx=0 tx=0).stop 2023-11-24T08:04:19.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.333+0000 7f0426de0700 1 -- 172.21.15.153:0/1625131569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04200b0230 msgr2=0x7f04200ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.333+0000 7f0426de0700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04200b0230 0x7f04200ae150 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f041400d910 tx=0x7f041400dcd0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.333+0000 7ff5427fc700 1 -- 172.21.15.153:0/2553609035 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff548021020 con 0x7ff54c0cf440 2023-11-24T08:04:19.336 INFO:teuthology.orchestra.run.smithi153.stdout:55834574853 2023-11-24T08:04:19.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.334+0000 7f0426de0700 1 -- 172.21.15.153:0/1625131569 shutdown_connections 2023-11-24T08:04:19.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.334+0000 7f0426de0700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f042006dda0 0x7f042006e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.334+0000 7f0426de0700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0420072df0 0x7f0420153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.334+0000 7f0426de0700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f040c06f2e0 0x7f040c0717a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.334+0000 7f0426de0700 1 --2- 172.21.15.153:0/1625131569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04200b0230 0x7f04200ae150 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.334+0000 7f0426de0700 1 -- 172.21.15.153:0/1625131569 >> 172.21.15.153:0/1625131569 conn(0x7f04200b57b0 msgr2=0x7f0420099860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.335+0000 7f0426de0700 1 -- 172.21.15.153:0/1625131569 shutdown_connections 2023-11-24T08:04:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.335+0000 7f0426de0700 1 -- 172.21.15.153:0/1625131569 wait complete. 2023-11-24T08:04:19.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.338+0000 7ff553eee700 1 -- 172.21.15.153:0/2553609035 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff53006aed0 msgr2=0x7ff53006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.338+0000 7ff553eee700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff53006aed0 0x7ff53006d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009fd0 tx=0x7ff53c010000 comp rx=0 tx=0).stop 2023-11-24T08:04:19.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.338+0000 7ff553eee700 1 -- 172.21.15.153:0/2553609035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff54c0cf440 msgr2=0x7ff54c154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.338+0000 7ff553eee700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff54c0cf440 0x7ff54c154eb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff54800e7e0 tx=0x7ff54800eaf0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.338+0000 7ff553eee700 1 -- 172.21.15.153:0/2553609035 shutdown_connections 2023-11-24T08:04:19.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.338+0000 7ff553eee700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff54c1663d0 0x7ff54c13f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.338+0000 7ff553eee700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff54c070fd0 0x7ff54c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.338+0000 7ff553eee700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff53006aed0 0x7ff53006d390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.338+0000 7ff553eee700 1 --2- 172.21.15.153:0/2553609035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff54c0cf440 0x7ff54c154eb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.338+0000 7ff553eee700 1 -- 172.21.15.153:0/2553609035 >> 172.21.15.153:0/2553609035 conn(0x7ff54c0b1740 msgr2=0x7ff54c1649d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.339+0000 7ff553eee700 1 -- 172.21.15.153:0/2553609035 shutdown_connections 2023-11-24T08:04:19.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.339+0000 7ff553eee700 1 -- 172.21.15.153:0/2553609035 wait complete. 2023-11-24T08:04:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.347+0000 7f167ff75700 1 -- 172.21.15.153:0/3352614221 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1660005860 con 0x7f1678070fd0 2023-11-24T08:04:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.347+0000 7f166e7fc700 1 -- 172.21.15.153:0/3352614221 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1668017020 con 0x7f1678070fd0 2023-11-24T08:04:19.353 INFO:teuthology.orchestra.run.smithi153.stdout:55834574853 2023-11-24T08:04:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.352+0000 7f167ff75700 1 -- 172.21.15.153:0/3352614221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f165c06af20 msgr2=0x7f165c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.352+0000 7f167ff75700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f165c06af20 0x7f165c06d3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f167815fb70 tx=0x7f1674008040 comp rx=0 tx=0).stop 2023-11-24T08:04:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.352+0000 7f167ff75700 1 -- 172.21.15.153:0/3352614221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1678070fd0 msgr2=0x7f167815a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.352+0000 7f167ff75700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1678070fd0 0x7f167815a390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f166800c490 tx=0x7f166800c7a0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.352+0000 7f167ff75700 1 -- 172.21.15.153:0/3352614221 shutdown_connections 2023-11-24T08:04:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.352+0000 7f167ff75700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16781663d0 0x7f16781471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.352+0000 7f167ff75700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1678070fd0 0x7f167815a390 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.352+0000 7f167ff75700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f165c06af20 0x7f165c06d3e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.352+0000 7f167ff75700 1 --2- 172.21.15.153:0/3352614221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16780cf440 0x7f1678143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.352+0000 7f167ff75700 1 -- 172.21.15.153:0/3352614221 >> 172.21.15.153:0/3352614221 conn(0x7f16780b1740 msgr2=0x7f167806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.353+0000 7f167ff75700 1 -- 172.21.15.153:0/3352614221 shutdown_connections 2023-11-24T08:04:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.353+0000 7f167ff75700 1 -- 172.21.15.153:0/3352614221 wait complete. 2023-11-24T08:04:19.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-11-24T08:04:19.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-24T08:04:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.364+0000 7f1469af5700 1 -- 172.21.15.153:0/386234336 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f14640751e0 con 0x7f14640b4260 2023-11-24T08:04:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.364+0000 7f144bfff700 1 -- 172.21.15.153:0/386234336 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f145401e030 con 0x7f14640b4260 2023-11-24T08:04:19.366 INFO:teuthology.orchestra.run.smithi153.stdout:55834574853 2023-11-24T08:04:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 -- 172.21.15.153:0/386234336 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f145006af20 msgr2=0x7f145006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f145006af20 0x7f145006d3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f146416ee50 tx=0x7f1458009040 comp rx=0 tx=0).stop 2023-11-24T08:04:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 -- 172.21.15.153:0/386234336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14640b4260 msgr2=0x7f1464200750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14640b4260 0x7f1464200750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f145400c7f0 tx=0x7f145400cb00 comp rx=0 tx=0).stop 2023-11-24T08:04:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 -- 172.21.15.153:0/386234336 shutdown_connections 2023-11-24T08:04:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14641618a0 0x7f1464161d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1464070d00 0x7f14641607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f145006af20 0x7f145006d3e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 --2- 172.21.15.153:0/386234336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14640b4260 0x7f1464200750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 -- 172.21.15.153:0/386234336 >> 172.21.15.153:0/386234336 conn(0x7f14640cfa30 msgr2=0x7f14640b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 -- 172.21.15.153:0/386234336 shutdown_connections 2023-11-24T08:04:19.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.368+0000 7f1469af5700 1 -- 172.21.15.153:0/386234336 wait complete. 2023-11-24T08:04:19.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-24T08:04:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.381+0000 7f3ae49d4700 1 -- 172.21.15.153:0/4130117385 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ac4005590 con 0x7f3ae00b4090 2023-11-24T08:04:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.382+0000 7f3aceffd700 1 -- 172.21.15.153:0/4130117385 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ad4058e40 con 0x7f3ae00b4090 2023-11-24T08:04:19.384 INFO:teuthology.orchestra.run.smithi153.stdout:55834574852 2023-11-24T08:04:19.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-11-24T08:04:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.386+0000 7f3ae49d4700 1 -- 172.21.15.153:0/4130117385 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ac006afa0 msgr2=0x7f3ac006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.386+0000 7f3ae49d4700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ac006afa0 0x7f3ac006d460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0071450 tx=0x7f3ad800c110 comp rx=0 tx=0).stop 2023-11-24T08:04:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.386+0000 7f3ae49d4700 1 -- 172.21.15.153:0/4130117385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae00b4090 msgr2=0x7f3ae00aa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.386+0000 7f3ae49d4700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae00b4090 0x7f3ae00aa430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4018000 tx=0x7f3ad4004750 comp rx=0 tx=0).stop 2023-11-24T08:04:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.387+0000 7f3ae49d4700 1 -- 172.21.15.153:0/4130117385 shutdown_connections 2023-11-24T08:04:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.387+0000 7f3ae49d4700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ae015d6a0 0x7f3ae00aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.387+0000 7f3ae49d4700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ae0071a10 0x7f3ae01371c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.387+0000 7f3ae49d4700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ac006afa0 0x7f3ac006d460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.387+0000 7f3ae49d4700 1 --2- 172.21.15.153:0/4130117385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae00b4090 0x7f3ae00aa430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.387+0000 7f3ae49d4700 1 -- 172.21.15.153:0/4130117385 >> 172.21.15.153:0/4130117385 conn(0x7f3ae00cfa30 msgr2=0x7f3ae00b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.387+0000 7f3ae49d4700 1 -- 172.21.15.153:0/4130117385 shutdown_connections 2023-11-24T08:04:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.387+0000 7f3ae49d4700 1 -- 172.21.15.153:0/4130117385 wait complete. 2023-11-24T08:04:19.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-11-24T08:04:19.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.413+0000 7fecb2c55700 1 -- 172.21.15.153:0/2040545922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fecac1573a0 con 0x7fecac15d6a0 2023-11-24T08:04:19.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.414+0000 7feca97fa700 1 -- 172.21.15.153:0/2040545922 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feca002b020 con 0x7fecac15d6a0 2023-11-24T08:04:19.416 INFO:teuthology.orchestra.run.smithi153.stdout:55834574853 2023-11-24T08:04:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 -- 172.21.15.153:0/2040545922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fec9406b370 msgr2=0x7fec9406d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fec9406b370 0x7fec9406d830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec9c006fd0 tx=0x7fec9c008040 comp rx=0 tx=0).stop 2023-11-24T08:04:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 -- 172.21.15.153:0/2040545922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecac15d6a0 msgr2=0x7fecac13f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecac15d6a0 0x7fecac13f9a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feca00090b0 tx=0x7feca0004750 comp rx=0 tx=0).stop 2023-11-24T08:04:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 -- 172.21.15.153:0/2040545922 shutdown_connections 2023-11-24T08:04:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fec9406b370 0x7fec9406d830 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecac15d6a0 0x7fecac13f9a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecac071be0 0x7fecac1f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 --2- 172.21.15.153:0/2040545922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecac0b4090 0x7fecac154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 -- 172.21.15.153:0/2040545922 >> 172.21.15.153:0/2040545922 conn(0x7fecac0cfa30 msgr2=0x7fecac0aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 -- 172.21.15.153:0/2040545922 shutdown_connections 2023-11-24T08:04:19.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.416+0000 7fecb2c55700 1 -- 172.21.15.153:0/2040545922 wait complete. 2023-11-24T08:04:19.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.422+0000 7f7025d95700 1 -- 172.21.15.153:0/836720744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f70201fcc20 con 0x7f70201665a0 2023-11-24T08:04:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.422+0000 7f701cff9700 1 -- 172.21.15.153:0/836720744 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f701805a660 con 0x7f70201665a0 2023-11-24T08:04:19.424 INFO:teuthology.orchestra.run.smithi153.stdout:55834574851 2023-11-24T08:04:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.424+0000 7f7025d95700 1 -- 172.21.15.153:0/836720744 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f700006afa0 msgr2=0x7f700006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.424+0000 7f7025d95700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f700006afa0 0x7f700006d460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7008009910 tx=0x7f7008008040 comp rx=0 tx=0).stop 2023-11-24T08:04:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.424+0000 7f7025d95700 1 -- 172.21.15.153:0/836720744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70201665a0 msgr2=0x7f7020147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.424+0000 7f7025d95700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70201665a0 0x7f7020147810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7018004000 tx=0x7f7018004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.424+0000 7f7025d95700 1 -- 172.21.15.153:0/836720744 shutdown_connections 2023-11-24T08:04:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.425+0000 7f7025d95700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f700006afa0 0x7f700006d460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.425+0000 7f7025d95700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70201665a0 0x7f7020147810 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.425+0000 7f7025d95700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7020070fd0 0x7f70200a95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.425+0000 7f7025d95700 1 --2- 172.21.15.153:0/836720744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70200cf440 0x7f702014aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.425+0000 7f7025d95700 1 -- 172.21.15.153:0/836720744 >> 172.21.15.153:0/836720744 conn(0x7f70200b1740 msgr2=0x7f7020160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.425+0000 7f7025d95700 1 -- 172.21.15.153:0/836720744 shutdown_connections 2023-11-24T08:04:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.425+0000 7f7025d95700 1 -- 172.21.15.153:0/836720744 wait complete. 2023-11-24T08:04:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.427+0000 7ff9dc752700 1 -- 172.21.15.153:0/2244166072 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff9d416aad0 con 0x7ff9d40b4280 2023-11-24T08:04:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.428+0000 7ff9caffd700 1 -- 172.21.15.153:0/2244166072 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9d0017020 con 0x7ff9d40b4280 2023-11-24T08:04:19.429 INFO:teuthology.orchestra.run.smithi153.stdout:55834574853 2023-11-24T08:04:19.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-11-24T08:04:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 -- 172.21.15.153:0/2244166072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff9b806aed0 msgr2=0x7ff9b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff9b806aed0 0x7ff9b806d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4000c00 tx=0x7ff9c4008030 comp rx=0 tx=0).stop 2023-11-24T08:04:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 -- 172.21.15.153:0/2244166072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d40b4280 msgr2=0x7ff9d4156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d40b4280 0x7ff9d4156ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000e9e0 tx=0x7ff9d000eda0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 -- 172.21.15.153:0/2244166072 shutdown_connections 2023-11-24T08:04:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff9b806aed0 0x7ff9b806d390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d4140680 0x7ff9d413eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9d406ebb0 0x7ff9d415e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 --2- 172.21.15.153:0/2244166072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9d40b4280 0x7ff9d4156ae0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 -- 172.21.15.153:0/2244166072 >> 172.21.15.153:0/2244166072 conn(0x7ff9d40b1740 msgr2=0x7ff9d40a9870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 -- 172.21.15.153:0/2244166072 shutdown_connections 2023-11-24T08:04:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:19.431+0000 7ff9dc752700 1 -- 172.21.15.153:0/2244166072 wait complete. 2023-11-24T08:04:19.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2023-11-24T08:04:19.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-11-24T08:04:20.358 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T08:04:20.362 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T08:04:20.377 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T08:04:20.388 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T08:04:20.406 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T08:04:20.431 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T08:04:20.441 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T08:04:20.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T08:04:20.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.542+0000 7f841310d700 1 Processor -- start 2023-11-24T08:04:20.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.542+0000 7f841310d700 1 -- start start 2023-11-24T08:04:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.543+0000 7f841310d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f840c0cc8a0 0x7f840c0ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.543+0000 7f841310d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f840c071430 0x7f840c0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.543+0000 7f841310d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840c0719a0 con 0x7f840c070ac0 2023-11-24T08:04:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.543+0000 7f841310d700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c15e660 con 0x7f840c0cc8a0 2023-11-24T08:04:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.543+0000 7f841310d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c072650 con 0x7f840c071430 2023-11-24T08:04:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.544+0000 7f840bfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f840c071430 0x7f840c0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.544+0000 7f840bfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f840c071430 0x7f840c0cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47784/0 (socket says 172.21.15.153:47784) 2023-11-24T08:04:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.544+0000 7f840bfff700 1 -- 172.21.15.153:0/102763536 learned_addr learned my addr 172.21.15.153:0/102763536 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.544+0000 7f8410ea9700 1 --2- 172.21.15.153:0/102763536 >> v2:172.21.15.164:3300/0 conn(0x7f840c0cc8a0 0x7f840c0ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.544+0000 7f8410ea9700 1 -- 172.21.15.153:0/102763536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f840c071430 msgr2=0x7f840c0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.544+0000 7f8410ea9700 1 --2- 172.21.15.153:0/102763536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f840c071430 0x7f840c0cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.544+0000 7f8410ea9700 1 -- 172.21.15.153:0/102763536 >> v1:172.21.15.153:6789/0 conn(0x7f840c070ac0 legacy=0x7f840c0b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.544+0000 7f84116aa700 1 --1- 172.21.15.153:0/102763536 >> v1:172.21.15.153:6789/0 conn(0x7f840c070ac0 0x7f840c0b3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41822/0 (socket says 172.21.15.153:41822) 2023-11-24T08:04:20.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.551+0000 7f8410ea9700 1 -- 172.21.15.153:0/102763536 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0cd1c0 con 0x7f840c0cc8a0 2023-11-24T08:04:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.552+0000 7f7831ea6700 1 Processor -- start 2023-11-24T08:04:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.552+0000 7f7831ea6700 1 -- start start 2023-11-24T08:04:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.554+0000 7f8410ea9700 1 --2- 172.21.15.153:0/102763536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f840c0cc8a0 0x7f840c0ccc80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8400009840 tx=0x7f8400009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b4464b1214cafe7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.554+0000 7f7831ea6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f782c162220 0x7f782c0b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.554+0000 7f7831ea6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c071910 con 0x7f782c0af6d0 2023-11-24T08:04:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.554+0000 7f7831ea6700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0afb60 con 0x7f782c166660 2023-11-24T08:04:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.554+0000 7f7831ea6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c070fe0 con 0x7f782c162220 2023-11-24T08:04:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.554+0000 7f782b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f782c162220 0x7f782c0b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.554+0000 7f782b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f782c162220 0x7f782c0b5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35720/0 (socket says 172.21.15.153:35720) 2023-11-24T08:04:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.554+0000 7f782b7fe700 1 -- 172.21.15.153:0/3126022271 learned_addr learned my addr 172.21.15.153:0/3126022271 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.555+0000 7f840b7fe700 1 -- 172.21.15.153:0/102763536 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400004230 con 0x7f840c0cc8a0 2023-11-24T08:04:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.555+0000 7f840b7fe700 1 -- 172.21.15.153:0/102763536 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8400004390 con 0x7f840c0cc8a0 2023-11-24T08:04:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.555+0000 7f840b7fe700 1 -- 172.21.15.153:0/102763536 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84000036a0 con 0x7f840c0cc8a0 2023-11-24T08:04:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.555+0000 7f782b7fe700 1 -- 172.21.15.153:0/3126022271 >> v1:172.21.15.164:6789/0 conn(0x7f782c166660 legacy=0x7f782c071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.555+0000 7f782b7fe700 1 -- 172.21.15.153:0/3126022271 >> v1:172.21.15.153:6789/0 conn(0x7f782c0af6d0 legacy=0x7f782c165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.555+0000 7f782b7fe700 1 -- 172.21.15.153:0/3126022271 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0712c0 con 0x7f782c162220 2023-11-24T08:04:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.555+0000 7f782b7fe700 1 --2- 172.21.15.153:0/3126022271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782c162220 0x7f782c0b5190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f78200098f0 tx=0x7f7820009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9782b8ff30769f50 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.556+0000 7f841310d700 1 -- 172.21.15.153:0/102763536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f840c0cc8a0 msgr2=0x7f840c0ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.556+0000 7f841310d700 1 --2- 172.21.15.153:0/102763536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f840c0cc8a0 0x7f840c0ccc80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8400009840 tx=0x7f8400009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.556+0000 7f782a7fc700 1 -- 172.21.15.153:0/3126022271 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820004230 con 0x7f782c162220 2023-11-24T08:04:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.556+0000 7f782a7fc700 1 -- 172.21.15.153:0/3126022271 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7820004390 con 0x7f782c162220 2023-11-24T08:04:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.556+0000 7f782a7fc700 1 -- 172.21.15.153:0/3126022271 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78200036a0 con 0x7f782c162220 2023-11-24T08:04:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.556+0000 7f841310d700 1 -- 172.21.15.153:0/102763536 shutdown_connections 2023-11-24T08:04:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.556+0000 7f841310d700 1 --2- 172.21.15.153:0/102763536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f840c0cc8a0 0x7f840c0ccc80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.556+0000 7f841310d700 1 --2- 172.21.15.153:0/102763536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f840c071430 0x7f840c0cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.556+0000 7f841310d700 1 -- 172.21.15.153:0/102763536 >> 172.21.15.153:0/102763536 conn(0x7f840c06aff0 msgr2=0x7f840c06b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.557+0000 7f7831ea6700 1 -- 172.21.15.153:0/3126022271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782c162220 msgr2=0x7f782c0b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.557+0000 7f7831ea6700 1 --2- 172.21.15.153:0/3126022271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782c162220 0x7f782c0b5190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f78200098f0 tx=0x7f7820009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.557+0000 7f7831ea6700 1 -- 172.21.15.153:0/3126022271 shutdown_connections 2023-11-24T08:04:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.557+0000 7f7831ea6700 1 --2- 172.21.15.153:0/3126022271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782c162220 0x7f782c0b5190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.557+0000 7f7831ea6700 1 -- 172.21.15.153:0/3126022271 >> 172.21.15.153:0/3126022271 conn(0x7f782c06cec0 msgr2=0x7f782c06d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.557+0000 7f7831ea6700 1 -- 172.21.15.153:0/3126022271 shutdown_connections 2023-11-24T08:04:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.557+0000 7f7831ea6700 1 -- 172.21.15.153:0/3126022271 wait complete. 2023-11-24T08:04:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.558+0000 7f841310d700 1 -- 172.21.15.153:0/102763536 shutdown_connections 2023-11-24T08:04:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.559+0000 7f7831ea6700 1 Processor -- start 2023-11-24T08:04:20.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.560+0000 7f7831ea6700 1 -- start start 2023-11-24T08:04:20.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.562+0000 7f7831ea6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782c0af6d0 0x7f782c159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.562+0000 7f7831ea6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f782c162220 0x7f782c159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.562+0000 7f7831ea6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f782c166660 0x7f782c1561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.562+0000 7f7831ea6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c158d30 con 0x7f782c0af6d0 2023-11-24T08:04:20.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.562+0000 7f7831ea6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c1583f0 con 0x7f782c162220 2023-11-24T08:04:20.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.562+0000 7f7831ea6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c1f8f60 con 0x7f782c166660 2023-11-24T08:04:20.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.562+0000 7f782b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782c0af6d0 0x7f782c159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.562+0000 7f782b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782c0af6d0 0x7f782c159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35726/0 (socket says 172.21.15.153:35726) 2023-11-24T08:04:20.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.562+0000 7f782b7fe700 1 -- 172.21.15.153:0/2578141333 learned_addr learned my addr 172.21.15.153:0/2578141333 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.562+0000 7f782affd700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f782c162220 0x7f782c159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f782affd700 1 -- 172.21.15.153:0/2578141333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f782c166660 msgr2=0x7f782c1561e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T08:04:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f782affd700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f782c166660 0x7f782c1561e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f782affd700 1 -- 172.21.15.153:0/2578141333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782c0af6d0 msgr2=0x7f782c159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f782affd700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782c0af6d0 0x7f782c159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f782affd700 1 -- 172.21.15.153:0/2578141333 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7820009550 con 0x7f782c162220 2023-11-24T08:04:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f782affd700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f782c162220 0x7f782c159150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f781c00c400 tx=0x7f781c00c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f7813fff700 1 -- 172.21.15.153:0/2578141333 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c011790 con 0x7f782c162220 2023-11-24T08:04:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f7813fff700 1 -- 172.21.15.153:0/2578141333 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c0118f0 con 0x7f782c162220 2023-11-24T08:04:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f7831ea6700 1 -- 172.21.15.153:0/2578141333 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c158670 con 0x7f782c162220 2023-11-24T08:04:20.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f7831ea6700 1 -- 172.21.15.153:0/2578141333 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c15a410 con 0x7f782c162220 2023-11-24T08:04:20.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.564+0000 7f7813fff700 1 -- 172.21.15.153:0/2578141333 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c011c80 con 0x7f782c162220 2023-11-24T08:04:20.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.566+0000 7f7831ea6700 1 -- 172.21.15.153:0/2578141333 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c0052e0 con 0x7f782c162220 2023-11-24T08:04:20.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.567+0000 7f7813fff700 1 -- 172.21.15.153:0/2578141333 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f781c01c460 con 0x7f782c162220 2023-11-24T08:04:20.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.567+0000 7f7813fff700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f781806af20 0x7f781806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.567+0000 7f7813fff700 1 -- 172.21.15.153:0/2578141333 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f781c089270 con 0x7f782c162220 2023-11-24T08:04:20.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.567+0000 7f782b7fe700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f781806af20 0x7f781806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.568+0000 7f782b7fe700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f781806af20 0x7f781806d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7820004720 tx=0x7f7820008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.558+0000 7f841310d700 1 -- 172.21.15.153:0/102763536 wait complete. 2023-11-24T08:04:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.560+0000 7f841310d700 1 Processor -- start 2023-11-24T08:04:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.562+0000 7f841310d700 1 -- start start 2023-11-24T08:04:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f841310d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f840c070ac0 0x7f840c150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f841310d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f840c071430 0x7f840c0b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f841310d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f840c0cc8a0 0x7f840c146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f841310d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c15ce60 con 0x7f840c0cc8a0 2023-11-24T08:04:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f841310d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c150c60 con 0x7f840c071430 2023-11-24T08:04:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.563+0000 7f841310d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c152550 con 0x7f840c070ac0 2023-11-24T08:04:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.564+0000 7f840bfff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f840c071430 0x7f840c0b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.564+0000 7f840bfff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f840c071430 0x7f840c0b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57318/0 (socket says 172.21.15.153:57318) 2023-11-24T08:04:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.564+0000 7f840bfff700 1 -- 172.21.15.153:0/468087557 learned_addr learned my addr 172.21.15.153:0/468087557 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.564+0000 7f840bfff700 1 -- 172.21.15.153:0/468087557 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f840c070ac0 msgr2=0x7f840c150720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:04:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.564+0000 7f840bfff700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f840c070ac0 0x7f840c150720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.564+0000 7f840bfff700 1 -- 172.21.15.153:0/468087557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f840c0cc8a0 msgr2=0x7f840c146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.564+0000 7f840bfff700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f840c0cc8a0 0x7f840c146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.564+0000 7f840bfff700 1 -- 172.21.15.153:0/468087557 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000094a0 con 0x7f840c071430 2023-11-24T08:04:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.564+0000 7f840bfff700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f840c071430 0x7f840c0b1720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f840400b300 tx=0x7f840400b6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.565+0000 7f84097fa700 1 -- 172.21.15.153:0/468087557 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404010040 con 0x7f840c071430 2023-11-24T08:04:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.565+0000 7f84097fa700 1 -- 172.21.15.153:0/468087557 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8404013750 con 0x7f840c071430 2023-11-24T08:04:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.565+0000 7f841310d700 1 -- 172.21.15.153:0/468087557 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c152df0 con 0x7f840c071430 2023-11-24T08:04:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.565+0000 7f84097fa700 1 -- 172.21.15.153:0/468087557 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404013ac0 con 0x7f840c071430 2023-11-24T08:04:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.565+0000 7f841310d700 1 -- 172.21.15.153:0/468087557 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c1527a0 con 0x7f840c071430 2023-11-24T08:04:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.568+0000 7f84097fa700 1 -- 172.21.15.153:0/468087557 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8404013c20 con 0x7f840c071430 2023-11-24T08:04:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.568+0000 7f84097fa700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f83f80aeee0 0x7f83f80b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.569+0000 7f84097fa700 1 -- 172.21.15.153:0/468087557 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8404089910 con 0x7f840c071430 2023-11-24T08:04:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.569+0000 7f8410ea9700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f83f80aeee0 0x7f83f80b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.569+0000 7f841310d700 1 -- 172.21.15.153:0/468087557 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ec0052e0 con 0x7f840c071430 2023-11-24T08:04:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.569+0000 7f8410ea9700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f83f80aeee0 0x7f83f80b13a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84000090b0 tx=0x7f8400010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.572+0000 7f7813fff700 1 -- 172.21.15.153:0/2578141333 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f781c0543b0 con 0x7f782c162220 2023-11-24T08:04:20.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.577+0000 7f84097fa700 1 -- 172.21.15.153:0/468087557 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f840401b080 con 0x7f840c071430 2023-11-24T08:04:20.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.608+0000 7fc523774700 1 Processor -- start 2023-11-24T08:04:20.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.608+0000 7fc523774700 1 -- start start 2023-11-24T08:04:20.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.609+0000 7fc523774700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc51c072850 0x7fc51c0cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.609+0000 7fc523774700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51c06ecd0 con 0x7fc51c0cc3c0 2023-11-24T08:04:20.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.609+0000 7fc523774700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51c06f4e0 con 0x7fc51c1456b0 2023-11-24T08:04:20.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.609+0000 7fc523774700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51c145a90 con 0x7fc51c072850 2023-11-24T08:04:20.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.609+0000 7fc521510700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc51c1456b0 0x7fc51c0b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:49526/0 (socket says 172.21.15.153:49526) 2023-11-24T08:04:20.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.609+0000 7fc521510700 1 -- 172.21.15.153:0/3385273461 learned_addr learned my addr 172.21.15.153:0/3385273461 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:20.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.609+0000 7f4dcdc6e700 1 Processor -- start 2023-11-24T08:04:20.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.609+0000 7fc513fff700 1 -- 172.21.15.153:0/3385273461 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591087313 0 0) 0x7fc51c06f4e0 con 0x7fc51c1456b0 2023-11-24T08:04:20.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.609+0000 7fc513fff700 1 -- 172.21.15.153:0/3385273461 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5080035b0 con 0x7fc51c1456b0 2023-11-24T08:04:20.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.610+0000 7fc521d11700 1 --2- 172.21.15.153:0/3385273461 >> v2:172.21.15.153:3300/0 conn(0x7fc51c072850 0x7fc51c0cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.610+0000 7fc521d11700 1 -- 172.21.15.153:0/3385273461 >> v1:172.21.15.164:6789/0 conn(0x7fc51c1456b0 legacy=0x7fc51c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.610+0000 7fc521d11700 1 -- 172.21.15.153:0/3385273461 >> v1:172.21.15.153:6789/0 conn(0x7fc51c0cc3c0 legacy=0x7fc51c0b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.610+0000 7fc521d11700 1 -- 172.21.15.153:0/3385273461 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c0cc8c0 con 0x7fc51c072850 2023-11-24T08:04:20.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.609+0000 7f4dcdc6e700 1 -- start start 2023-11-24T08:04:20.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.610+0000 7f4dcdc6e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4dc815d6a0 0x7f4dc80b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.610+0000 7f4dcdc6e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4dc80b4090 0x7f4dc80714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.610+0000 7f4dcdc6e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc80720e0 con 0x7f4dc80d0520 2023-11-24T08:04:20.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.610+0000 7f4dcdc6e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc8072d60 con 0x7f4dc80b4090 2023-11-24T08:04:20.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.610+0000 7f4dcdc6e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc806de80 con 0x7f4dc815d6a0 2023-11-24T08:04:20.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.610+0000 7fc521d11700 1 --2- 172.21.15.153:0/3385273461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc51c072850 0x7fc51c0cef40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0097c0 tx=0x7fc50c009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77a5ef1a7f917f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7f4dc6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4dc80b4090 0x7f4dc80714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7f4dc6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4dc80b4090 0x7f4dc80714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35746/0 (socket says 172.21.15.153:35746) 2023-11-24T08:04:20.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7f4dc6ffd700 1 -- 172.21.15.153:0/3395574160 learned_addr learned my addr 172.21.15.153:0/3395574160 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7f4dc77fe700 1 --2- 172.21.15.153:0/3395574160 >> v2:172.21.15.164:3300/0 conn(0x7f4dc815d6a0 0x7f4dc80b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7fc513fff700 1 -- 172.21.15.153:0/3385273461 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5140019f0 con 0x7fc51c072850 2023-11-24T08:04:20.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7fc513fff700 1 -- 172.21.15.153:0/3385273461 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c004030 con 0x7fc51c072850 2023-11-24T08:04:20.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7fc513fff700 1 -- 172.21.15.153:0/3385273461 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0043c0 con 0x7fc51c072850 2023-11-24T08:04:20.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7f4dc6ffd700 1 -- 172.21.15.153:0/3395574160 >> v2:172.21.15.164:3300/0 conn(0x7f4dc815d6a0 msgr2=0x7f4dc80b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:20.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7f4dc6ffd700 1 --2- 172.21.15.153:0/3395574160 >> v2:172.21.15.164:3300/0 conn(0x7f4dc815d6a0 0x7f4dc80b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7f4dc6ffd700 1 -- 172.21.15.153:0/3395574160 >> v1:172.21.15.164:6789/0 conn(0x7f4dc80d0520 legacy=0x7f4dc806cac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:04:20.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7f4dc6ffd700 1 -- 172.21.15.153:0/3395574160 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc80723c0 con 0x7f4dc80b4090 2023-11-24T08:04:20.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7f4dc6ffd700 1 --2- 172.21.15.153:0/3395574160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc80b4090 0x7f4dc80714d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80cfa00 tx=0x7f4db8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9784b992b7564475 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7fd746c09700 1 Processor -- start 2023-11-24T08:04:20.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.611+0000 7fd746c09700 1 -- start start 2023-11-24T08:04:20.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.612+0000 7fd746c09700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740140680 0x7fd740140c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.612+0000 7fd746c09700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7400b3d40 0x7fd7400b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.612+0000 7fd746c09700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74006d550 con 0x7fd740070d60 2023-11-24T08:04:20.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.612+0000 7fd746c09700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7400b47c0 con 0x7fd7400b3d40 2023-11-24T08:04:20.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.612+0000 7fd746c09700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74006cc60 con 0x7fd740140680 2023-11-24T08:04:20.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fd7449a5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740140680 0x7fd740140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fd7449a5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740140680 0x7fd740140c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47822/0 (socket says 172.21.15.153:47822) 2023-11-24T08:04:20.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fd7449a5700 1 -- 172.21.15.153:0/2616279816 learned_addr learned my addr 172.21.15.153:0/2616279816 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.612+0000 7fc523774700 1 -- 172.21.15.153:0/3385273461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc51c072850 msgr2=0x7fc51c0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.612+0000 7fc523774700 1 --2- 172.21.15.153:0/3385273461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc51c072850 0x7fc51c0cef40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0097c0 tx=0x7fc50c009ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fc523774700 1 -- 172.21.15.153:0/3385273461 shutdown_connections 2023-11-24T08:04:20.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fc523774700 1 --2- 172.21.15.153:0/3385273461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc51c072850 0x7fc51c0cef40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fc523774700 1 -- 172.21.15.153:0/3385273461 >> 172.21.15.153:0/3385273461 conn(0x7fc51c0cfa30 msgr2=0x7fc51c0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.612+0000 7f4dc67fc700 1 -- 172.21.15.153:0/3395574160 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8004230 con 0x7f4dc80b4090 2023-11-24T08:04:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.612+0000 7f4dc67fc700 1 -- 172.21.15.153:0/3395574160 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8004390 con 0x7f4dc80b4090 2023-11-24T08:04:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.612+0000 7f4dc67fc700 1 -- 172.21.15.153:0/3395574160 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db80036a0 con 0x7f4dc80b4090 2023-11-24T08:04:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/3395574160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc80b4090 msgr2=0x7f4dc80714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7f4dcdc6e700 1 --2- 172.21.15.153:0/3395574160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc80b4090 0x7f4dc80714d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80cfa00 tx=0x7f4db8009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fc523774700 1 -- 172.21.15.153:0/3385273461 shutdown_connections 2023-11-24T08:04:20.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fc523774700 1 -- 172.21.15.153:0/3385273461 wait complete. 2023-11-24T08:04:20.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/3395574160 shutdown_connections 2023-11-24T08:04:20.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7f4dcdc6e700 1 --2- 172.21.15.153:0/3395574160 >> v2:172.21.15.164:3300/0 conn(0x7f4dc815d6a0 0x7f4dc80b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7f4dcdc6e700 1 --2- 172.21.15.153:0/3395574160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc80b4090 0x7f4dc80714d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/3395574160 >> 172.21.15.153:0/3395574160 conn(0x7f4dc80cfa30 msgr2=0x7f4dc80cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.614+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/3395574160 shutdown_connections 2023-11-24T08:04:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.614+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/3395574160 wait complete. 2023-11-24T08:04:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.615+0000 7fc523774700 1 Processor -- start 2023-11-24T08:04:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fd73ffff700 1 --2- 172.21.15.153:0/2616279816 >> v2:172.21.15.153:3300/0 conn(0x7fd7400b3d40 0x7fd7400b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fd73ffff700 1 -- 172.21.15.153:0/2616279816 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740140680 msgr2=0x7fd740140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fd73ffff700 1 --2- 172.21.15.153:0/2616279816 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740140680 0x7fd740140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fd73ffff700 1 -- 172.21.15.153:0/2616279816 >> v1:172.21.15.164:6789/0 conn(0x7fd740070d60 legacy=0x7fd74006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fd73ffff700 1 -- 172.21.15.153:0/2616279816 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74006cf00 con 0x7fd7400b3d40 2023-11-24T08:04:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.613+0000 7fd73ffff700 1 --2- 172.21.15.153:0/2616279816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7400b3d40 0x7fd7400b41a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd73400bb40 tx=0x7fd73400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65685f5db9317de server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.614+0000 7fd73f7fe700 1 -- 172.21.15.153:0/2616279816 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734011030 con 0x7fd7400b3d40 2023-11-24T08:04:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.614+0000 7fd73f7fe700 1 -- 172.21.15.153:0/2616279816 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73400dd30 con 0x7fd7400b3d40 2023-11-24T08:04:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.614+0000 7fd73f7fe700 1 -- 172.21.15.153:0/2616279816 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400dea0 con 0x7fd7400b3d40 2023-11-24T08:04:20.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.614+0000 7fd746c09700 1 -- 172.21.15.153:0/2616279816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7400b3d40 msgr2=0x7fd7400b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.614+0000 7fd746c09700 1 --2- 172.21.15.153:0/2616279816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7400b3d40 0x7fd7400b41a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd73400bb40 tx=0x7fd73400be50 comp rx=0 tx=0).stop 2023-11-24T08:04:20.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7f4dcdc6e700 1 Processor -- start 2023-11-24T08:04:20.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7fd746c09700 1 -- 172.21.15.153:0/2616279816 shutdown_connections 2023-11-24T08:04:20.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7fd746c09700 1 --2- 172.21.15.153:0/2616279816 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740140680 0x7fd740140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7fd746c09700 1 --2- 172.21.15.153:0/2616279816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7400b3d40 0x7fd7400b41a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7fd746c09700 1 -- 172.21.15.153:0/2616279816 >> 172.21.15.153:0/2616279816 conn(0x7fd7400b1740 msgr2=0x7fd7400b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:20.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.615+0000 7fc523774700 1 -- start start 2023-11-24T08:04:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7fc523774700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc51c072850 0x7fc51c144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7fc523774700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc51c0cc3c0 0x7fc51c140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7fc523774700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc51c1456b0 0x7fc51c140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7fc523774700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c137ab0 con 0x7fc51c0cc3c0 2023-11-24T08:04:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7fc523774700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c144a50 con 0x7fc51c1456b0 2023-11-24T08:04:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7fc523774700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c1419b0 con 0x7fc51c072850 2023-11-24T08:04:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7fc521d11700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc51c1456b0 0x7fc51c140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7fc521d11700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc51c1456b0 0x7fc51c140c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57346/0 (socket says 172.21.15.153:57346) 2023-11-24T08:04:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7fc521d11700 1 -- 172.21.15.153:0/2421320243 learned_addr learned my addr 172.21.15.153:0/2421320243 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7fc521510700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc51c072850 0x7fc51c144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7fc520d0f700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc51c0cc3c0 0x7fc51c140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7fc521510700 1 -- 172.21.15.153:0/2421320243 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc51c1456b0 msgr2=0x7fc51c140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7fc521510700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc51c1456b0 0x7fc51c140c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7fc521510700 1 -- 172.21.15.153:0/2421320243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc51c0cc3c0 msgr2=0x7fc51c140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7fc521510700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc51c0cc3c0 0x7fc51c140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7fc521510700 1 -- 172.21.15.153:0/2421320243 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c0094a0 con 0x7fc51c072850 2023-11-24T08:04:20.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.616+0000 7f4dcdc6e700 1 -- start start 2023-11-24T08:04:20.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7f4dcdc6e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc80b4090 0x7f4dc80ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7f4dcdc6e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4dc80d0520 0x7f4dc80a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7f4dcdc6e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4dc815d6a0 0x7f4dc813f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7f4dcdc6e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80cd590 con 0x7f4dc80b4090 2023-11-24T08:04:20.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7f4dcdc6e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80cd870 con 0x7f4dc815d6a0 2023-11-24T08:04:20.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7f4dcdc6e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80cdb50 con 0x7f4dc80d0520 2023-11-24T08:04:20.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7f4dc6ffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4dc80d0520 0x7f4dc80a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7f4dc6ffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4dc80d0520 0x7f4dc80a97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47834/0 (socket says 172.21.15.153:47834) 2023-11-24T08:04:20.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7f4dc6ffd700 1 -- 172.21.15.153:0/2012435587 learned_addr learned my addr 172.21.15.153:0/2012435587 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7f4dc7fff700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4dc815d6a0 0x7f4dc813f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.617+0000 7f4dc77fe700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc80b4090 0x7f4dc80ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.618+0000 7fc521510700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc51c072850 0x7fc51c144510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc51400ccd0 tx=0x7fc51400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.618+0000 7f4dc77fe700 1 -- 172.21.15.153:0/2012435587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4dc80d0520 msgr2=0x7f4dc80a97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.618+0000 7f4dc77fe700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4dc80d0520 0x7f4dc80a97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.618+0000 7f4dc77fe700 1 -- 172.21.15.153:0/2012435587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4dc815d6a0 msgr2=0x7f4dc813f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.618+0000 7f4dc77fe700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4dc815d6a0 0x7f4dc813f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.618+0000 7f4dc77fe700 1 -- 172.21.15.153:0/2012435587 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8009550 con 0x7f4dc80b4090 2023-11-24T08:04:20.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.618+0000 7fc511ffb700 1 -- 172.21.15.153:0/2421320243 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400abe0 con 0x7fc51c072850 2023-11-24T08:04:20.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.618+0000 7fc511ffb700 1 -- 172.21.15.153:0/2421320243 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51400ad60 con 0x7fc51c072850 2023-11-24T08:04:20.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.618+0000 7fc511ffb700 1 -- 172.21.15.153:0/2421320243 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514007310 con 0x7fc51c072850 2023-11-24T08:04:20.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.618+0000 7fc523774700 1 -- 172.21.15.153:0/2421320243 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51c157b50 con 0x7fc51c072850 2023-11-24T08:04:20.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.619+0000 7fc523774700 1 -- 172.21.15.153:0/2421320243 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51c144230 con 0x7fc51c072850 2023-11-24T08:04:20.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.618+0000 7f4dc77fe700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc80b4090 0x7f4dc80ccf70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0007d80 tx=0x7f4dc000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.620+0000 7f4daffff700 1 -- 172.21.15.153:0/2012435587 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000ede0 con 0x7f4dc80b4090 2023-11-24T08:04:20.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.620+0000 7f4daffff700 1 -- 172.21.15.153:0/2012435587 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc0014420 con 0x7f4dc80b4090 2023-11-24T08:04:20.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.620+0000 7f4daffff700 1 -- 172.21.15.153:0/2012435587 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc00147b0 con 0x7f4dc80b4090 2023-11-24T08:04:20.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.620+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/2012435587 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc80cde30 con 0x7f4dc80b4090 2023-11-24T08:04:20.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.620+0000 7fc523774700 1 -- 172.21.15.153:0/2421320243 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51c141d20 con 0x7fc51c072850 2023-11-24T08:04:20.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.620+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/2012435587 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc80a9cf0 con 0x7f4dc80b4090 2023-11-24T08:04:20.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.622+0000 7fd746c09700 1 -- 172.21.15.153:0/2616279816 shutdown_connections 2023-11-24T08:04:20.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.622+0000 7fd746c09700 1 -- 172.21.15.153:0/2616279816 wait complete. 2023-11-24T08:04:20.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.623+0000 7fc511ffb700 1 -- 172.21.15.153:0/2421320243 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc514007470 con 0x7fc51c072850 2023-11-24T08:04:20.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.624+0000 7fc511ffb700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc50006afa0 0x7fc50006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.624+0000 7fc511ffb700 1 -- 172.21.15.153:0/2421320243 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc514089a90 con 0x7fc51c072850 2023-11-24T08:04:20.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.624+0000 7fd746c09700 1 Processor -- start 2023-11-24T08:04:20.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.623+0000 7f4daffff700 1 -- 172.21.15.153:0/2012435587 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4dc0014910 con 0x7f4dc80b4090 2023-11-24T08:04:20.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.624+0000 7f4daffff700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4db406af20 0x7f4db406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.624+0000 7f4daffff700 1 -- 172.21.15.153:0/2012435587 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4dc0089b80 con 0x7f4dc80b4090 2023-11-24T08:04:20.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.624+0000 7fd746c09700 1 -- start start 2023-11-24T08:04:20.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.626+0000 7fd746c09700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740070d60 0x7fd7400a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.626+0000 7fd746c09700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7400b3d40 0x7fd7400af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.626+0000 7fd746c09700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd74015bc40 0x7fd74015c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.626+0000 7fd746c09700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74015b7b0 con 0x7fd7400b3d40 2023-11-24T08:04:20.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.626+0000 7fd746c09700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74015a990 con 0x7fd74015bc40 2023-11-24T08:04:20.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.626+0000 7fd746c09700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74015a3d0 con 0x7fd740070d60 2023-11-24T08:04:20.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.626+0000 7fd7449a5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740070d60 0x7fd7400a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.626+0000 7fd73ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7400b3d40 0x7fd7400af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.626+0000 7fd73ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7400b3d40 0x7fd7400af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35774/0 (socket says 172.21.15.153:35774) 2023-11-24T08:04:20.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.626+0000 7fd73ffff700 1 -- 172.21.15.153:0/2167635000 learned_addr learned my addr 172.21.15.153:0/2167635000 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.626+0000 7fd7451a6700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd74015bc40 0x7fd74015c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.627+0000 7fd73ffff700 1 -- 172.21.15.153:0/2167635000 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740070d60 msgr2=0x7fd7400a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.627+0000 7fd73ffff700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740070d60 0x7fd7400a9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.627+0000 7fd73ffff700 1 -- 172.21.15.153:0/2167635000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd74015bc40 msgr2=0x7fd74015c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.627+0000 7fd73ffff700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd74015bc40 0x7fd74015c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.627+0000 7fd73ffff700 1 -- 172.21.15.153:0/2167635000 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73400b740 con 0x7fd7400b3d40 2023-11-24T08:04:20.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.627+0000 7fd7449a5700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740070d60 0x7fd7400a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:20.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.627+0000 7fd73ffff700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7400b3d40 0x7fd7400af900 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd734012040 tx=0x7fd734004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.624+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/2012435587 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da80052e0 con 0x7f4dc80b4090 2023-11-24T08:04:20.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.627+0000 7fc520d0f700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc50006afa0 0x7fc50006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.627+0000 7fc511ffb700 1 -- 172.21.15.153:0/2421320243 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc514054bb0 con 0x7fc51c072850 2023-11-24T08:04:20.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.628+0000 7fc520d0f700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc50006afa0 0x7fc50006d460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0b4980 tx=0x7fc518009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.629+0000 7f4dc6ffd700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4db406af20 0x7f4db406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.630+0000 7f4dc6ffd700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4db406af20 0x7f4db406d3e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4dc815bdd0 tx=0x7f4db8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.634+0000 7fd73d7fa700 1 -- 172.21.15.153:0/2167635000 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73401d3f0 con 0x7fd7400b3d40 2023-11-24T08:04:20.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.634+0000 7fd73d7fa700 1 -- 172.21.15.153:0/2167635000 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73401d550 con 0x7fd7400b3d40 2023-11-24T08:04:20.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.634+0000 7fd73d7fa700 1 -- 172.21.15.153:0/2167635000 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73401d8e0 con 0x7fd7400b3d40 2023-11-24T08:04:20.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.635+0000 7fd746c09700 1 -- 172.21.15.153:0/2167635000 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74015a6b0 con 0x7fd7400b3d40 2023-11-24T08:04:20.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.635+0000 7fd746c09700 1 -- 172.21.15.153:0/2167635000 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7400aa3b0 con 0x7fd7400b3d40 2023-11-24T08:04:20.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.635+0000 7f4daffff700 1 -- 172.21.15.153:0/2012435587 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4dc0089e60 con 0x7f4dc80b4090 2023-11-24T08:04:20.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.639+0000 7fd746c09700 1 -- 172.21.15.153:0/2167635000 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c0052e0 con 0x7fd7400b3d40 2023-11-24T08:04:20.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.650+0000 7fd73d7fa700 1 -- 172.21.15.153:0/2167635000 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd73401a070 con 0x7fd7400b3d40 2023-11-24T08:04:20.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.650+0000 7fd73d7fa700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd72406afa0 0x7fd72406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.650+0000 7fd73d7fa700 1 -- 172.21.15.153:0/2167635000 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd734012070 con 0x7fd7400b3d40 2023-11-24T08:04:20.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.651+0000 7fd7449a5700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd72406afa0 0x7fd72406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.652+0000 7fd7449a5700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd72406afa0 0x7fd72406d460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd74004fca0 tx=0x7fd730008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.653+0000 7fd73d7fa700 1 -- 172.21.15.153:0/2167635000 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd734055470 con 0x7fd7400b3d40 2023-11-24T08:04:20.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.681+0000 7fcfecd5d700 1 Processor -- start 2023-11-24T08:04:20.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.682+0000 7fcfecd5d700 1 -- start start 2023-11-24T08:04:20.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfecd5d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcfe81512b0 0x7fcfe806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfecd5d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfe80b4af0 0x7fcfe806d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfecd5d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe8070ed0 con 0x7fcfe8151690 2023-11-24T08:04:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfecd5d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe815ad30 con 0x7fcfe81512b0 2023-11-24T08:04:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfecd5d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe806dc70 con 0x7fcfe80b4af0 2023-11-24T08:04:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfe659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcfe81512b0 0x7fcfe806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfe659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcfe81512b0 0x7fcfe806d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35782/0 (socket says 172.21.15.153:35782) 2023-11-24T08:04:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfe659c700 1 -- 172.21.15.153:0/2185168276 learned_addr learned my addr 172.21.15.153:0/2185168276 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfe6d9d700 1 --2- 172.21.15.153:0/2185168276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfe80b4af0 0x7fcfe806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfe659c700 1 -- 172.21.15.153:0/2185168276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfe80b4af0 msgr2=0x7fcfe806d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:20.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfe659c700 1 --2- 172.21.15.153:0/2185168276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfe80b4af0 0x7fcfe806d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfe659c700 1 -- 172.21.15.153:0/2185168276 >> v1:172.21.15.164:6789/0 conn(0x7fcfe8151690 legacy=0x7fcfe80b43e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:04:20.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.683+0000 7fcfe659c700 1 -- 172.21.15.153:0/2185168276 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe806df50 con 0x7fcfe81512b0 2023-11-24T08:04:20.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.684+0000 7fabf7081700 1 Processor -- start 2023-11-24T08:04:20.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.684+0000 7fabf7081700 1 -- start start 2023-11-24T08:04:20.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.685+0000 7fcfe659c700 1 --2- 172.21.15.153:0/2185168276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe81512b0 0x7fcfe806d100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80098f0 tx=0x7fcfd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e846ac055034f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.685+0000 7fabf7081700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fabf00d0520 0x7fabf00b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.685+0000 7fabf7081700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fabf0071be0 0x7fabf00b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.685+0000 7fabf7081700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf00720e0 con 0x7fabf015d6a0 2023-11-24T08:04:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.685+0000 7fabf7081700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf0072d60 con 0x7fabf0071be0 2023-11-24T08:04:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.685+0000 7fabf7081700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf006de80 con 0x7fabf00d0520 2023-11-24T08:04:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.685+0000 7fabf4e1d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fabf00d0520 0x7fabf00b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.685+0000 7fabf4e1d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fabf00d0520 0x7fabf00b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57374/0 (socket says 172.21.15.153:57374) 2023-11-24T08:04:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.685+0000 7fabf4e1d700 1 -- 172.21.15.153:0/2156442518 learned_addr learned my addr 172.21.15.153:0/2156442518 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.685+0000 7fabf561e700 1 --2- 172.21.15.153:0/2156442518 >> v2:172.21.15.153:3300/0 conn(0x7fabf0071be0 0x7fabf00b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.685+0000 7fabf4e1d700 1 -- 172.21.15.153:0/2156442518 >> v2:172.21.15.153:3300/0 conn(0x7fabf0071be0 msgr2=0x7fabf00b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.686+0000 7fcfe559a700 1 -- 172.21.15.153:0/2185168276 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8004230 con 0x7fcfe81512b0 2023-11-24T08:04:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.686+0000 7fcfe559a700 1 -- 172.21.15.153:0/2185168276 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd8004390 con 0x7fcfe81512b0 2023-11-24T08:04:20.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.686+0000 7fcfe559a700 1 -- 172.21.15.153:0/2185168276 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80036a0 con 0x7fcfe81512b0 2023-11-24T08:04:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.686+0000 7fabf4e1d700 1 --2- 172.21.15.153:0/2156442518 >> v2:172.21.15.153:3300/0 conn(0x7fabf0071be0 0x7fabf00b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.686+0000 7fabf4e1d700 1 -- 172.21.15.153:0/2156442518 >> v1:172.21.15.164:6789/0 conn(0x7fabf015d6a0 legacy=0x7fabf00714d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:04:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.686+0000 7fabf4e1d700 1 -- 172.21.15.153:0/2156442518 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00723c0 con 0x7fabf00d0520 2023-11-24T08:04:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.686+0000 7fabf561e700 1 --2- 172.21.15.153:0/2156442518 >> v2:172.21.15.153:3300/0 conn(0x7fabf0071be0 0x7fabf00b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.687+0000 7fcfecd5d700 1 -- 172.21.15.153:0/2185168276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe81512b0 msgr2=0x7fcfe806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.687+0000 7fcfecd5d700 1 --2- 172.21.15.153:0/2185168276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe81512b0 0x7fcfe806d100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80098f0 tx=0x7fcfd8009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.687+0000 7fabf4e1d700 1 --2- 172.21.15.153:0/2156442518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf00d0520 0x7fabf00b3b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fabf00cfa00 tx=0x7fabe4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de2fa7f31cbb9b49 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.687+0000 7fcfecd5d700 1 -- 172.21.15.153:0/2185168276 shutdown_connections 2023-11-24T08:04:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.687+0000 7fcfecd5d700 1 --2- 172.21.15.153:0/2185168276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfe80b4af0 0x7fcfe806d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.687+0000 7fcfecd5d700 1 --2- 172.21.15.153:0/2185168276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe81512b0 0x7fcfe806d100 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.687+0000 7fcfecd5d700 1 -- 172.21.15.153:0/2185168276 >> 172.21.15.153:0/2185168276 conn(0x7fcfe80cfa30 msgr2=0x7fcfe80cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:20.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.687+0000 7fcfecd5d700 1 -- 172.21.15.153:0/2185168276 shutdown_connections 2023-11-24T08:04:20.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.687+0000 7fcfecd5d700 1 -- 172.21.15.153:0/2185168276 wait complete. 2023-11-24T08:04:20.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.690+0000 7fcfecd5d700 1 Processor -- start 2023-11-24T08:04:20.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.690+0000 7fcfecd5d700 1 -- start start 2023-11-24T08:04:20.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.690+0000 7fabef7fe700 1 -- 172.21.15.153:0/2156442518 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe4004230 con 0x7fabf00d0520 2023-11-24T08:04:20.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fabef7fe700 1 -- 172.21.15.153:0/2156442518 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe4004390 con 0x7fabf00d0520 2023-11-24T08:04:20.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fabef7fe700 1 -- 172.21.15.153:0/2156442518 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe40036a0 con 0x7fabf00d0520 2023-11-24T08:04:20.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fcfecd5d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfe80b4af0 0x7fcfe814ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fcfecd5d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe81512b0 0x7fcfe81fba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fcfecd5d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfe8151690 0x7fcfe815da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fcfecd5d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81fc350 con 0x7fcfe81512b0 2023-11-24T08:04:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fcfecd5d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81fc630 con 0x7fcfe8151690 2023-11-24T08:04:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fcfecd5d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80cd650 con 0x7fcfe80b4af0 2023-11-24T08:04:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fcfe5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe81512b0 0x7fcfe81fba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fcfe5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe81512b0 0x7fcfe81fba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35792/0 (socket says 172.21.15.153:35792) 2023-11-24T08:04:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fcfe5d9b700 1 -- 172.21.15.153:0/1414914236 learned_addr learned my addr 172.21.15.153:0/1414914236 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.691+0000 7fcfe6d9d700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfe8151690 0x7fcfe815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fcfe5d9b700 1 -- 172.21.15.153:0/1414914236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfe80b4af0 msgr2=0x7fcfe814ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fcfe5d9b700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfe80b4af0 0x7fcfe814ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fcfe5d9b700 1 -- 172.21.15.153:0/1414914236 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfe8151690 msgr2=0x7fcfe815da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fcfe5d9b700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfe8151690 0x7fcfe815da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fcfe5d9b700 1 -- 172.21.15.153:0/1414914236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd8009550 con 0x7fcfe81512b0 2023-11-24T08:04:20.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fabf7081700 1 -- 172.21.15.153:0/2156442518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf00d0520 msgr2=0x7fabf00b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fabf7081700 1 --2- 172.21.15.153:0/2156442518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf00d0520 0x7fabf00b3b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fabf00cfa00 tx=0x7fabe4009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fabf7081700 1 -- 172.21.15.153:0/2156442518 shutdown_connections 2023-11-24T08:04:20.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fabf7081700 1 --2- 172.21.15.153:0/2156442518 >> v2:172.21.15.153:3300/0 conn(0x7fabf0071be0 0x7fabf00b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fabf7081700 1 --2- 172.21.15.153:0/2156442518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf00d0520 0x7fabf00b3b50 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fabf00cfa00 tx=0x7fabe4009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fabf7081700 1 -- 172.21.15.153:0/2156442518 >> 172.21.15.153:0/2156442518 conn(0x7fabf00cfa30 msgr2=0x7fabf00cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:20.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fcfe5d9b700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe81512b0 0x7fcfe81fba50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00b470 tx=0x7fcfdc00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fabf7081700 1 -- 172.21.15.153:0/2156442518 shutdown_connections 2023-11-24T08:04:20.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.692+0000 7fabf7081700 1 -- 172.21.15.153:0/2156442518 wait complete. 2023-11-24T08:04:20.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.694+0000 7fabf7081700 1 Processor -- start 2023-11-24T08:04:20.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.695+0000 7fcfd6ffd700 1 -- 172.21.15.153:0/1414914236 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc011830 con 0x7fcfe81512b0 2023-11-24T08:04:20.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.695+0000 7fcfd6ffd700 1 -- 172.21.15.153:0/1414914236 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc011990 con 0x7fcfe81512b0 2023-11-24T08:04:20.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.695+0000 7fcfd6ffd700 1 -- 172.21.15.153:0/1414914236 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc011d40 con 0x7fcfe81512b0 2023-11-24T08:04:20.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.694+0000 7fabf7081700 1 -- start start 2023-11-24T08:04:20.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.695+0000 7fabf7081700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf0071be0 0x7fabf0169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.695+0000 7fabf7081700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015d6a0 0x7fabf0158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.695+0000 7fabf7081700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabf0140660 0x7fabf0143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.695+0000 7fabf7081700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf016a0a0 con 0x7fabf015d6a0 2023-11-24T08:04:20.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.695+0000 7fabf7081700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0158a60 con 0x7fabf0071be0 2023-11-24T08:04:20.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.695+0000 7fabf7081700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf016a2a0 con 0x7fabf0140660 2023-11-24T08:04:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.696+0000 7fabf561e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabf0140660 0x7fabf0143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.696+0000 7fabf4e1d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf0071be0 0x7fabf0169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.696+0000 7fabf561e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabf0140660 0x7fabf0143190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47870/0 (socket says 172.21.15.153:47870) 2023-11-24T08:04:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.696+0000 7fabf561e700 1 -- 172.21.15.153:0/64390642 learned_addr learned my addr 172.21.15.153:0/64390642 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.695+0000 7fcfecd5d700 1 -- 172.21.15.153:0/1414914236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe80cd930 con 0x7fcfe81512b0 2023-11-24T08:04:20.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.695+0000 7fcfecd5d700 1 -- 172.21.15.153:0/1414914236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe814f210 con 0x7fcfe81512b0 2023-11-24T08:04:20.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.697+0000 7fcfd6ffd700 1 -- 172.21.15.153:0/1414914236 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcfdc01a400 con 0x7fcfe81512b0 2023-11-24T08:04:20.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.697+0000 7fcfd6ffd700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcfc806af20 0x7fcfc806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.698+0000 7fcfd6ffd700 1 -- 172.21.15.153:0/1414914236 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfdc0894f0 con 0x7fcfe81512b0 2023-11-24T08:04:20.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.698+0000 7fcfe659c700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcfc806af20 0x7fcfc806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.699+0000 7fcfe659c700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcfc806af20 0x7fcfc806d3e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009c40 tx=0x7fcfd8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.696+0000 7fabeffff700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015d6a0 0x7fabf0158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.697+0000 7fabeffff700 1 -- 172.21.15.153:0/64390642 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabf0140660 msgr2=0x7fabf0143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.697+0000 7fabeffff700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabf0140660 0x7fabf0143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.697+0000 7fabeffff700 1 -- 172.21.15.153:0/64390642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf0071be0 msgr2=0x7fabf0169b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.697+0000 7fabeffff700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf0071be0 0x7fabf0169b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.697+0000 7fabeffff700 1 -- 172.21.15.153:0/64390642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe4009550 con 0x7fabf015d6a0 2023-11-24T08:04:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.698+0000 7fabeffff700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015d6a0 0x7fabf0158520 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009fd0 tx=0x7fabdc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.698+0000 7fabed7fa700 1 -- 172.21.15.153:0/64390642 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc011620 con 0x7fabf015d6a0 2023-11-24T08:04:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.698+0000 7fabed7fa700 1 -- 172.21.15.153:0/64390642 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc0117a0 con 0x7fabf015d6a0 2023-11-24T08:04:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.698+0000 7fabed7fa700 1 -- 172.21.15.153:0/64390642 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc011b50 con 0x7fabf015d6a0 2023-11-24T08:04:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.698+0000 7fabf7081700 1 -- 172.21.15.153:0/64390642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf016a580 con 0x7fabf015d6a0 2023-11-24T08:04:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.698+0000 7fabf7081700 1 -- 172.21.15.153:0/64390642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf016ab40 con 0x7fabf015d6a0 2023-11-24T08:04:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.699+0000 7fabf7081700 1 -- 172.21.15.153:0/64390642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf00751e0 con 0x7fabf015d6a0 2023-11-24T08:04:20.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.701+0000 7fabed7fa700 1 -- 172.21.15.153:0/64390642 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fabdc011cb0 con 0x7fabf015d6a0 2023-11-24T08:04:20.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.702+0000 7fabed7fa700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabd406aed0 0x7fabd406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.702+0000 7fabed7fa700 1 -- 172.21.15.153:0/64390642 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabdc0898c0 con 0x7fabf015d6a0 2023-11-24T08:04:20.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.703+0000 7fabf4e1d700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabd406aed0 0x7fabd406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.705+0000 7fabed7fa700 1 -- 172.21.15.153:0/64390642 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fabdc054ae0 con 0x7fabf015d6a0 2023-11-24T08:04:20.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.706+0000 7fabf4e1d700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabd406aed0 0x7fabd406d390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fabf0062c70 tx=0x7fabe4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.706+0000 7fcfecd5d700 1 -- 172.21.15.153:0/1414914236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc0052e0 con 0x7fcfe81512b0 2023-11-24T08:04:20.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.716+0000 7fcfd6ffd700 1 -- 172.21.15.153:0/1414914236 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcfdc054710 con 0x7fcfe81512b0 2023-11-24T08:04:20.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.714+0000 7f69b29dc700 1 Processor -- start 2023-11-24T08:04:20.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.714+0000 7f69b29dc700 1 -- start start 2023-11-24T08:04:20.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.715+0000 7f69b29dc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac16ae60 0x7f69ac06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.715+0000 7f69b29dc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f69ac0b4260 0x7f69ac070d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.715+0000 7f69b29dc700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ac08bdb0 con 0x7f69ac072bb0 2023-11-24T08:04:20.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.715+0000 7f69b29dc700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ac06ce30 con 0x7f69ac0b4260 2023-11-24T08:04:20.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.715+0000 7f69b29dc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac06d110 con 0x7f69ac16ae60 2023-11-24T08:04:20.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.716+0000 7f69abfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac16ae60 0x7f69ac06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.716+0000 7f69abfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac16ae60 0x7f69ac06efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:47878/0 (socket says 172.21.15.153:47878) 2023-11-24T08:04:20.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.716+0000 7f69abfff700 1 -- 172.21.15.153:0/1955955502 learned_addr learned my addr 172.21.15.153:0/1955955502 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.723+0000 7f69abfff700 1 -- 172.21.15.153:0/1955955502 >> v2:172.21.15.153:3300/0 conn(0x7f69ac0b4260 msgr2=0x7f69ac070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:20.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.725+0000 7f69aaffd700 1 -- 172.21.15.153:0/1955955502 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594767558 0 0) 0x7f69ac08bdb0 con 0x7f69ac072bb0 2023-11-24T08:04:20.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.717+0000 7f69b0f79700 1 --2- 172.21.15.153:0/1955955502 >> v2:172.21.15.153:3300/0 conn(0x7f69ac0b4260 0x7f69ac070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.728+0000 7f69abfff700 1 --2- 172.21.15.153:0/1955955502 >> v2:172.21.15.153:3300/0 conn(0x7f69ac0b4260 0x7f69ac070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.728+0000 7f69abfff700 1 -- 172.21.15.153:0/1955955502 >> v1:172.21.15.164:6789/0 conn(0x7f69ac072bb0 legacy=0x7f69ac0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.728+0000 7f69abfff700 1 -- 172.21.15.153:0/1955955502 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac06d3f0 con 0x7f69ac16ae60 2023-11-24T08:04:20.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.728+0000 7f69abfff700 1 --2- 172.21.15.153:0/1955955502 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac16ae60 0x7f69ac06efc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f69a4007eb0 tx=0x7f69a400d480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23aec511bf5d9375 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.728+0000 7f69aaffd700 1 -- 172.21.15.153:0/1955955502 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4012440 con 0x7f69ac16ae60 2023-11-24T08:04:20.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.728+0000 7f69aaffd700 1 -- 172.21.15.153:0/1955955502 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a40125a0 con 0x7f69ac16ae60 2023-11-24T08:04:20.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.728+0000 7f69aaffd700 1 -- 172.21.15.153:0/1955955502 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4012910 con 0x7f69ac16ae60 2023-11-24T08:04:20.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.729+0000 7f69b29dc700 1 -- 172.21.15.153:0/1955955502 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac16ae60 msgr2=0x7f69ac06efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.729+0000 7f69b29dc700 1 --2- 172.21.15.153:0/1955955502 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac16ae60 0x7f69ac06efc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f69a4007eb0 tx=0x7f69a400d480 comp rx=0 tx=0).stop 2023-11-24T08:04:20.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.730+0000 7f69b0f79700 1 --2- 172.21.15.153:0/1955955502 >> v2:172.21.15.153:3300/0 conn(0x7f69ac0b4260 0x7f69ac070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:20.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.730+0000 7f69b29dc700 1 -- 172.21.15.153:0/1955955502 shutdown_connections 2023-11-24T08:04:20.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.730+0000 7f69b29dc700 1 --2- 172.21.15.153:0/1955955502 >> v2:172.21.15.153:3300/0 conn(0x7f69ac0b4260 0x7f69ac070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.730+0000 7f69b29dc700 1 --2- 172.21.15.153:0/1955955502 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac16ae60 0x7f69ac06efc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.730+0000 7f69b29dc700 1 -- 172.21.15.153:0/1955955502 >> 172.21.15.153:0/1955955502 conn(0x7f69ac0cfa30 msgr2=0x7f69ac0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:20.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.730+0000 7f69b29dc700 1 -- 172.21.15.153:0/1955955502 shutdown_connections 2023-11-24T08:04:20.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.730+0000 7f69b29dc700 1 -- 172.21.15.153:0/1955955502 wait complete. 2023-11-24T08:04:20.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.732+0000 7f69b29dc700 1 Processor -- start 2023-11-24T08:04:20.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.732+0000 7f69b29dc700 1 -- start start 2023-11-24T08:04:20.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.733+0000 7f69b29dc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ac0b4260 0x7f69ac08b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.733+0000 7f69b29dc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69ac204520 0x7f69ac155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.734+0000 7f69b29dc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac2049a0 0x7f69ac0addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.734+0000 7f69b29dc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0a9500 con 0x7f69ac0b4260 2023-11-24T08:04:20.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.734+0000 7f69b29dc700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0a97e0 con 0x7f69ac204520 2023-11-24T08:04:20.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.734+0000 7f69b29dc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0a9ac0 con 0x7f69ac2049a0 2023-11-24T08:04:20.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.734+0000 7f69ab7fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69ac204520 0x7f69ac155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.735+0000 7f69b0f79700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac2049a0 0x7f69ac0addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.735+0000 7f69abfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ac0b4260 0x7f69ac08b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.735+0000 7f69abfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ac0b4260 0x7f69ac08b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35818/0 (socket says 172.21.15.153:35818) 2023-11-24T08:04:20.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.735+0000 7f69abfff700 1 -- 172.21.15.153:0/4243855939 learned_addr learned my addr 172.21.15.153:0/4243855939 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:20.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.735+0000 7f69abfff700 1 -- 172.21.15.153:0/4243855939 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac2049a0 msgr2=0x7f69ac0addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.735+0000 7f69abfff700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac2049a0 0x7f69ac0addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.735+0000 7f69abfff700 1 -- 172.21.15.153:0/4243855939 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69ac204520 msgr2=0x7f69ac155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.735+0000 7f69abfff700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69ac204520 0x7f69ac155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.735+0000 7f69abfff700 1 -- 172.21.15.153:0/4243855939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a4007b10 con 0x7f69ac0b4260 2023-11-24T08:04:20.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.736+0000 7f69abfff700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ac0b4260 0x7f69ac08b520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f69a4015040 tx=0x7f69a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.736+0000 7f69a8ff9700 1 -- 172.21.15.153:0/4243855939 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4003e30 con 0x7f69ac0b4260 2023-11-24T08:04:20.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.736+0000 7f69a8ff9700 1 -- 172.21.15.153:0/4243855939 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a4020070 con 0x7f69ac0b4260 2023-11-24T08:04:20.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.736+0000 7f69a8ff9700 1 -- 172.21.15.153:0/4243855939 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4004240 con 0x7f69ac0b4260 2023-11-24T08:04:20.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.736+0000 7f69b29dc700 1 -- 172.21.15.153:0/4243855939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ac0a9da0 con 0x7f69ac0b4260 2023-11-24T08:04:20.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.736+0000 7f69b29dc700 1 -- 172.21.15.153:0/4243855939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ac203e10 con 0x7f69ac0b4260 2023-11-24T08:04:20.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.740+0000 7f69a8ff9700 1 -- 172.21.15.153:0/4243855939 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f69a4010070 con 0x7f69ac0b4260 2023-11-24T08:04:20.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.741+0000 7f69a8ff9700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f699406b0e0 0x7f699406d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:20.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.741+0000 7f69a8ff9700 1 -- 172.21.15.153:0/4243855939 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69a4022070 con 0x7f69ac0b4260 2023-11-24T08:04:20.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.741+0000 7f69ab7fe700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f699406b0e0 0x7f699406d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:20.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.742+0000 7f69ab7fe700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f699406b0e0 0x7f699406d5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0b0760 tx=0x7f69a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:20.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.743+0000 7f69b29dc700 1 -- 172.21.15.153:0/4243855939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c0052e0 con 0x7f69ac0b4260 2023-11-24T08:04:20.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.753+0000 7f69a8ff9700 1 -- 172.21.15.153:0/4243855939 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f69a40569c0 con 0x7f69ac0b4260 2023-11-24T08:04:20.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.967+0000 7f7831ea6700 1 -- 172.21.15.153:0/2578141333 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f780c005860 con 0x7f782c162220 2023-11-24T08:04:20.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.968+0000 7f7813fff700 1 -- 172.21.15.153:0/2578141333 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f781c0579d0 con 0x7f782c162220 2023-11-24T08:04:20.972 INFO:teuthology.orchestra.run.smithi153.stdout:55834574853 2023-11-24T08:04:20.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.974+0000 7f7831ea6700 1 -- 172.21.15.153:0/2578141333 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f781806af20 msgr2=0x7f781806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.974+0000 7f7831ea6700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f781806af20 0x7f781806d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7820004720 tx=0x7f7820008030 comp rx=0 tx=0).stop 2023-11-24T08:04:20.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.974+0000 7f7831ea6700 1 -- 172.21.15.153:0/2578141333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f782c162220 msgr2=0x7f782c159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.974+0000 7f7831ea6700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f782c162220 0x7f782c159150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f781c00c400 tx=0x7f781c00c7c0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.975+0000 7f7831ea6700 1 -- 172.21.15.153:0/2578141333 shutdown_connections 2023-11-24T08:04:20.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.975+0000 7f7831ea6700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f782c166660 0x7f782c1561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.975+0000 7f7831ea6700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f781806af20 0x7f781806d3e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.975+0000 7f7831ea6700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f782c0af6d0 0x7f782c159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.975+0000 7f7831ea6700 1 --2- 172.21.15.153:0/2578141333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f782c162220 0x7f782c159150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.975+0000 7f7831ea6700 1 -- 172.21.15.153:0/2578141333 >> 172.21.15.153:0/2578141333 conn(0x7f782c06cec0 msgr2=0x7f782c071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:20.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.976+0000 7f7831ea6700 1 -- 172.21.15.153:0/2578141333 shutdown_connections 2023-11-24T08:04:20.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.976+0000 7f841310d700 1 -- 172.21.15.153:0/468087557 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f83ec005860 con 0x7f840c071430 2023-11-24T08:04:20.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.976+0000 7f7831ea6700 1 -- 172.21.15.153:0/2578141333 wait complete. 2023-11-24T08:04:20.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.976+0000 7f84097fa700 1 -- 172.21.15.153:0/468087557 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8404054a50 con 0x7f840c071430 2023-11-24T08:04:20.991 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-11-24T08:04:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.989+0000 7f841310d700 1 -- 172.21.15.153:0/468087557 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f83f80aeee0 msgr2=0x7f83f80b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.989+0000 7f841310d700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f83f80aeee0 0x7f83f80b13a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84000090b0 tx=0x7f8400010000 comp rx=0 tx=0).stop 2023-11-24T08:04:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.989+0000 7f841310d700 1 -- 172.21.15.153:0/468087557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f840c071430 msgr2=0x7f840c0b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.989+0000 7f841310d700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f840c071430 0x7f840c0b1720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f840400b300 tx=0x7f840400b6c0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.990+0000 7f841310d700 1 -- 172.21.15.153:0/468087557 shutdown_connections 2023-11-24T08:04:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.990+0000 7f841310d700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f83f80aeee0 0x7f83f80b13a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.990+0000 7f841310d700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f840c0cc8a0 0x7f840c146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.990+0000 7f841310d700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f840c070ac0 0x7f840c150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.990+0000 7f841310d700 1 --2- 172.21.15.153:0/468087557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f840c071430 0x7f840c0b1720 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f840400b300 tx=0x7f840400b6c0 comp rx=0 tx=0).stop 2023-11-24T08:04:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.990+0000 7f841310d700 1 -- 172.21.15.153:0/468087557 >> 172.21.15.153:0/468087557 conn(0x7f840c06aff0 msgr2=0x7f840c0b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:20.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.990+0000 7f841310d700 1 -- 172.21.15.153:0/468087557 shutdown_connections 2023-11-24T08:04:20.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:20.990+0000 7f841310d700 1 -- 172.21.15.153:0/468087557 wait complete. 2023-11-24T08:04:21.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-11-24T08:04:21.004 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:21.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-11-24T08:04:21.011 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:21.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.017+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/2012435587 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4da8005860 con 0x7f4dc80b4090 2023-11-24T08:04:21.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.018+0000 7f4daffff700 1 -- 172.21.15.153:0/2012435587 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4dc0054c90 con 0x7f4dc80b4090 2023-11-24T08:04:21.020 INFO:teuthology.orchestra.run.smithi153.stdout:55834574853 2023-11-24T08:04:21.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/2012435587 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4db406af20 msgr2=0x7f4db406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4db406af20 0x7f4db406d3e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4dc815bdd0 tx=0x7f4db8008030 comp rx=0 tx=0).stop 2023-11-24T08:04:21.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/2012435587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc80b4090 msgr2=0x7f4dc80ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc80b4090 0x7f4dc80ccf70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0007d80 tx=0x7f4dc000e3c0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/2012435587 shutdown_connections 2023-11-24T08:04:21.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4dc815d6a0 0x7f4dc813f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4db406af20 0x7f4db406d3e0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4dc815bdd0 tx=0x7f4db8008030 comp rx=0 tx=0).stop 2023-11-24T08:04:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc80b4090 0x7f4dc80ccf70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 --2- 172.21.15.153:0/2012435587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4dc80d0520 0x7f4dc80a97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/2012435587 >> 172.21.15.153:0/2012435587 conn(0x7f4dc80cfa30 msgr2=0x7f4dc81401e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/2012435587 shutdown_connections 2023-11-24T08:04:21.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.020+0000 7f4dcdc6e700 1 -- 172.21.15.153:0/2012435587 wait complete. 2023-11-24T08:04:21.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.029+0000 7fc523774700 1 -- 172.21.15.153:0/2421320243 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc51c0751e0 con 0x7fc51c072850 2023-11-24T08:04:21.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.030+0000 7fc511ffb700 1 -- 172.21.15.153:0/2421320243 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc514018020 con 0x7fc51c072850 2023-11-24T08:04:21.031 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-11-24T08:04:21.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.032+0000 7fd746c09700 1 -- 172.21.15.153:0/2167635000 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd71c005860 con 0x7fd7400b3d40 2023-11-24T08:04:21.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.032+0000 7fd73d7fa700 1 -- 172.21.15.153:0/2167635000 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd734058a90 con 0x7fd7400b3d40 2023-11-24T08:04:21.034 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-11-24T08:04:21.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.033+0000 7fc523774700 1 -- 172.21.15.153:0/2421320243 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc50006afa0 msgr2=0x7fc50006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.033+0000 7fc523774700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc50006afa0 0x7fc50006d460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0b4980 tx=0x7fc518009040 comp rx=0 tx=0).stop 2023-11-24T08:04:21.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.033+0000 7fc523774700 1 -- 172.21.15.153:0/2421320243 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc51c072850 msgr2=0x7fc51c144510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.033+0000 7fc523774700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc51c072850 0x7fc51c144510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc51400ccd0 tx=0x7fc51400a060 comp rx=0 tx=0).stop 2023-11-24T08:04:21.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.036+0000 7fc523774700 1 -- 172.21.15.153:0/2421320243 shutdown_connections 2023-11-24T08:04:21.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.036+0000 7fc523774700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc51c1456b0 0x7fc51c140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.036+0000 7fc523774700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc51c072850 0x7fc51c144510 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.036+0000 7fc523774700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc50006afa0 0x7fc50006d460 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.036+0000 7fc523774700 1 --2- 172.21.15.153:0/2421320243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc51c0cc3c0 0x7fc51c140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.036+0000 7fc523774700 1 -- 172.21.15.153:0/2421320243 >> 172.21.15.153:0/2421320243 conn(0x7fc51c0cfa30 msgr2=0x7fc51c0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.036+0000 7fd746c09700 1 -- 172.21.15.153:0/2167635000 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd72406afa0 msgr2=0x7fd72406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.036+0000 7fd746c09700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd72406afa0 0x7fd72406d460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd74004fca0 tx=0x7fd730008040 comp rx=0 tx=0).stop 2023-11-24T08:04:21.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.036+0000 7fd746c09700 1 -- 172.21.15.153:0/2167635000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7400b3d40 msgr2=0x7fd7400af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.036+0000 7fd746c09700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7400b3d40 0x7fd7400af900 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd734012040 tx=0x7fd734004750 comp rx=0 tx=0).stop 2023-11-24T08:04:21.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.036+0000 7fc523774700 1 -- 172.21.15.153:0/2421320243 shutdown_connections 2023-11-24T08:04:21.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.037+0000 7fc523774700 1 -- 172.21.15.153:0/2421320243 wait complete. 2023-11-24T08:04:21.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.039+0000 7fd746c09700 1 -- 172.21.15.153:0/2167635000 shutdown_connections 2023-11-24T08:04:21.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.039+0000 7fd746c09700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd74015bc40 0x7fd74015c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.039+0000 7fd746c09700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd740070d60 0x7fd7400a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.039+0000 7fd746c09700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd72406afa0 0x7fd72406d460 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.039+0000 7fd746c09700 1 --2- 172.21.15.153:0/2167635000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7400b3d40 0x7fd7400af900 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.039+0000 7fd746c09700 1 -- 172.21.15.153:0/2167635000 >> 172.21.15.153:0/2167635000 conn(0x7fd7400b1740 msgr2=0x7fd740143590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.039+0000 7fd746c09700 1 -- 172.21.15.153:0/2167635000 shutdown_connections 2023-11-24T08:04:21.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.039+0000 7fd746c09700 1 -- 172.21.15.153:0/2167635000 wait complete. 2023-11-24T08:04:21.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-11-24T08:04:21.045 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:21.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-11-24T08:04:21.053 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:21.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-11-24T08:04:21.055 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:21.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.078+0000 7fcfecd5d700 1 -- 172.21.15.153:0/1414914236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fcfcc005860 con 0x7fcfe81512b0 2023-11-24T08:04:21.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.078+0000 7fcfd6ffd700 1 -- 172.21.15.153:0/1414914236 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfdc015030 con 0x7fcfe81512b0 2023-11-24T08:04:21.080 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-11-24T08:04:21.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 -- 172.21.15.153:0/1414914236 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcfc806af20 msgr2=0x7fcfc806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcfc806af20 0x7fcfc806d3e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009c40 tx=0x7fcfd8010000 comp rx=0 tx=0).stop 2023-11-24T08:04:21.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 -- 172.21.15.153:0/1414914236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe81512b0 msgr2=0x7fcfe81fba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe81512b0 0x7fcfe81fba50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00b470 tx=0x7fcfdc00b830 comp rx=0 tx=0).stop 2023-11-24T08:04:21.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 -- 172.21.15.153:0/1414914236 shutdown_connections 2023-11-24T08:04:21.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfe8151690 0x7fcfe815da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfe80b4af0 0x7fcfe814ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcfc806af20 0x7fcfc806d3e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 --2- 172.21.15.153:0/1414914236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe81512b0 0x7fcfe81fba50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 -- 172.21.15.153:0/1414914236 >> 172.21.15.153:0/1414914236 conn(0x7fcfe80cfa30 msgr2=0x7fcfe81585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 -- 172.21.15.153:0/1414914236 shutdown_connections 2023-11-24T08:04:21.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.080+0000 7fcfecd5d700 1 -- 172.21.15.153:0/1414914236 wait complete. 2023-11-24T08:04:21.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.088+0000 7fabf7081700 1 -- 172.21.15.153:0/64390642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fabf015cec0 con 0x7fabf015d6a0 2023-11-24T08:04:21.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.089+0000 7fabed7fa700 1 -- 172.21.15.153:0/64390642 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabdc058100 con 0x7fabf015d6a0 2023-11-24T08:04:21.090 INFO:teuthology.orchestra.run.smithi153.stdout:55834574852 2023-11-24T08:04:21.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 -- 172.21.15.153:0/64390642 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabd406aed0 msgr2=0x7fabd406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabd406aed0 0x7fabd406d390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fabf0062c70 tx=0x7fabe4008030 comp rx=0 tx=0).stop 2023-11-24T08:04:21.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 -- 172.21.15.153:0/64390642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015d6a0 msgr2=0x7fabf0158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015d6a0 0x7fabf0158520 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009fd0 tx=0x7fabdc00b6c0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 -- 172.21.15.153:0/64390642 shutdown_connections 2023-11-24T08:04:21.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabf0140660 0x7fabf0143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf0071be0 0x7fabf0169b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabd406aed0 0x7fabd406d390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 --2- 172.21.15.153:0/64390642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015d6a0 0x7fabf0158520 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 -- 172.21.15.153:0/64390642 >> 172.21.15.153:0/64390642 conn(0x7fabf00cfa30 msgr2=0x7fabf01419b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 -- 172.21.15.153:0/64390642 shutdown_connections 2023-11-24T08:04:21.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.091+0000 7fabf7081700 1 -- 172.21.15.153:0/64390642 wait complete. 2023-11-24T08:04:21.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-11-24T08:04:21.096 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:21.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2023-11-24T08:04:21.106 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:21.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.121+0000 7f69b29dc700 1 -- 172.21.15.153:0/4243855939 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f698c005590 con 0x7f69ac0b4260 2023-11-24T08:04:21.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.121+0000 7f69a8ff9700 1 -- 172.21.15.153:0/4243855939 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69a4059fe0 con 0x7f69ac0b4260 2023-11-24T08:04:21.123 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-11-24T08:04:21.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 -- 172.21.15.153:0/4243855939 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f699406b0e0 msgr2=0x7f699406d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f699406b0e0 0x7f699406d5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0b0760 tx=0x7f69a0009040 comp rx=0 tx=0).stop 2023-11-24T08:04:21.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 -- 172.21.15.153:0/4243855939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ac0b4260 msgr2=0x7f69ac08b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ac0b4260 0x7f69ac08b520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f69a4015040 tx=0x7f69a4004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 -- 172.21.15.153:0/4243855939 shutdown_connections 2023-11-24T08:04:21.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69ac2049a0 0x7f69ac0addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f699406b0e0 0x7f699406d5a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ac0b4260 0x7f69ac08b520 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 --2- 172.21.15.153:0/4243855939 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69ac204520 0x7f69ac155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 -- 172.21.15.153:0/4243855939 >> 172.21.15.153:0/4243855939 conn(0x7f69ac0cfa30 msgr2=0x7f69ac0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 -- 172.21.15.153:0/4243855939 shutdown_connections 2023-11-24T08:04:21.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.123+0000 7f69b29dc700 1 -- 172.21.15.153:0/4243855939 wait complete. 2023-11-24T08:04:21.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-11-24T08:04:21.137 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:21.138 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T08:04:21.138 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:04:21.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.297+0000 7fa336aa2700 1 Processor -- start 2023-11-24T08:04:21.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.297+0000 7fa336aa2700 1 -- start start 2023-11-24T08:04:21.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa336aa2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3300b0ba0 0x7fa3300af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa336aa2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa33015ee90 0x7fa33015b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa336aa2700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3300b2bd0 con 0x7fa3300b0f80 2023-11-24T08:04:21.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa336aa2700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3300b1fc0 con 0x7fa33015ee90 2023-11-24T08:04:21.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa336aa2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3300b22a0 con 0x7fa3300b0ba0 2023-11-24T08:04:21.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa33503f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa33015ee90 0x7fa33015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa33503f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa33015ee90 0x7fa33015b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35826/0 (socket says 172.21.15.153:35826) 2023-11-24T08:04:21.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa33503f700 1 -- 172.21.15.153:0/471515328 learned_addr learned my addr 172.21.15.153:0/471515328 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa33483e700 1 --2- 172.21.15.153:0/471515328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3300b0ba0 0x7fa3300af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa33503f700 1 -- 172.21.15.153:0/471515328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3300b0ba0 msgr2=0x7fa3300af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa33503f700 1 --2- 172.21.15.153:0/471515328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3300b0ba0 0x7fa3300af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa33503f700 1 -- 172.21.15.153:0/471515328 >> v1:172.21.15.164:6789/0 conn(0x7fa3300b0f80 legacy=0x7fa3300cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa33503f700 1 -- 172.21.15.153:0/471515328 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3300b2580 con 0x7fa33015ee90 2023-11-24T08:04:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa33503f700 1 --2- 172.21.15.153:0/471515328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa33015ee90 0x7fa33015b450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa32800d150 tx=0x7fa32800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d8a237bfa2ece5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa32f7fe700 1 -- 172.21.15.153:0/471515328 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328010070 con 0x7fa33015ee90 2023-11-24T08:04:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa32f7fe700 1 -- 172.21.15.153:0/471515328 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32800ddc0 con 0x7fa33015ee90 2023-11-24T08:04:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.298+0000 7fa32f7fe700 1 -- 172.21.15.153:0/471515328 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32800b310 con 0x7fa33015ee90 2023-11-24T08:04:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.299+0000 7fa336aa2700 1 -- 172.21.15.153:0/471515328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa33015ee90 msgr2=0x7fa33015b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.299+0000 7fa336aa2700 1 --2- 172.21.15.153:0/471515328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa33015ee90 0x7fa33015b450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa32800d150 tx=0x7fa32800d460 comp rx=0 tx=0).stop 2023-11-24T08:04:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.299+0000 7fa336aa2700 1 -- 172.21.15.153:0/471515328 shutdown_connections 2023-11-24T08:04:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.299+0000 7fa336aa2700 1 --2- 172.21.15.153:0/471515328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa33015ee90 0x7fa33015b450 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.299+0000 7fa336aa2700 1 --2- 172.21.15.153:0/471515328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3300b0ba0 0x7fa3300af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.299+0000 7fa336aa2700 1 -- 172.21.15.153:0/471515328 >> 172.21.15.153:0/471515328 conn(0x7fa3300b57b0 msgr2=0x7fa3300b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.299+0000 7fa336aa2700 1 -- 172.21.15.153:0/471515328 shutdown_connections 2023-11-24T08:04:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.299+0000 7fa336aa2700 1 -- 172.21.15.153:0/471515328 wait complete. 2023-11-24T08:04:21.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.300+0000 7fa336aa2700 1 Processor -- start 2023-11-24T08:04:21.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.300+0000 7fa336aa2700 1 -- start start 2023-11-24T08:04:21.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa336aa2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3300b0ba0 0x7fa3301f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa336aa2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3300b0f80 0x7fa3300d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa336aa2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa33015ee90 0x7fa3300ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa336aa2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3301f39b0 con 0x7fa3300b0ba0 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa336aa2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33009b010 con 0x7fa3300b0f80 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa336aa2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3301f0800 con 0x7fa33015ee90 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa33483e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3300b0ba0 0x7fa3301f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa33483e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3300b0ba0 0x7fa3301f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35828/0 (socket says 172.21.15.153:35828) 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa33483e700 1 -- 172.21.15.153:0/94703001 learned_addr learned my addr 172.21.15.153:0/94703001 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa33483e700 1 -- 172.21.15.153:0/94703001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa33015ee90 msgr2=0x7fa3300ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa33483e700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa33015ee90 0x7fa3300ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa33483e700 1 -- 172.21.15.153:0/94703001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3300b0f80 msgr2=0x7fa3300d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa32ffff700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3300b0f80 0x7fa3300d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa33483e700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3300b0f80 0x7fa3300d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.301+0000 7fa33483e700 1 -- 172.21.15.153:0/94703001 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32800bd40 con 0x7fa3300b0ba0 2023-11-24T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.302+0000 7fa33483e700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3300b0ba0 0x7fa3301f3dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa32400e810 tx=0x7fa32400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.302+0000 7fa32d7fa700 1 -- 172.21.15.153:0/94703001 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324013610 con 0x7fa3300b0ba0 2023-11-24T08:04:21.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.302+0000 7fa32d7fa700 1 -- 172.21.15.153:0/94703001 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa324013770 con 0x7fa3300b0ba0 2023-11-24T08:04:21.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.302+0000 7fa336aa2700 1 -- 172.21.15.153:0/94703001 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3301f0ae0 con 0x7fa3300b0ba0 2023-11-24T08:04:21.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.302+0000 7fa32d7fa700 1 -- 172.21.15.153:0/94703001 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324013b00 con 0x7fa3300b0ba0 2023-11-24T08:04:21.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.302+0000 7fa336aa2700 1 -- 172.21.15.153:0/94703001 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3301f35d0 con 0x7fa3300b0ba0 2023-11-24T08:04:21.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.303+0000 7fa336aa2700 1 -- 172.21.15.153:0/94703001 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3301f3c20 con 0x7fa3300b0ba0 2023-11-24T08:04:21.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.303+0000 7fa32d7fa700 1 -- 172.21.15.153:0/94703001 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa324013c60 con 0x7fa3300b0ba0 2023-11-24T08:04:21.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.304+0000 7fa32d7fa700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa31406aed0 0x7fa31406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.304+0000 7fa32d7fa700 1 -- 172.21.15.153:0/94703001 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa324089310 con 0x7fa3300b0ba0 2023-11-24T08:04:21.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.304+0000 7fa32ffff700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa31406aed0 0x7fa31406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.304+0000 7fa32ffff700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa31406aed0 0x7fa31406d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa3300d0eb0 tx=0x7fa31c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.308+0000 7fa32d7fa700 1 -- 172.21.15.153:0/94703001 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa3240543d0 con 0x7fa3300b0ba0 2023-11-24T08:04:21.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.497+0000 7fa336aa2700 1 -- 172.21.15.153:0/94703001 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa330067f60 con 0x7fa31406aed0 2023-11-24T08:04:21.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.504+0000 7fa32d7fa700 1 -- 172.21.15.153:0/94703001 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264562 (secure 0 0 0) 0x7fa330067f60 con 0x7fa31406aed0 2023-11-24T08:04:21.509 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:21.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 -- 172.21.15.153:0/94703001 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa31406aed0 msgr2=0x7fa31406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa31406aed0 0x7fa31406d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa3300d0eb0 tx=0x7fa31c009040 comp rx=0 tx=0).stop 2023-11-24T08:04:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 -- 172.21.15.153:0/94703001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3300b0ba0 msgr2=0x7fa3301f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3300b0ba0 0x7fa3301f3dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa32400e810 tx=0x7fa32400ebd0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 -- 172.21.15.153:0/94703001 shutdown_connections 2023-11-24T08:04:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa33015ee90 0x7fa3300ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa31406aed0 0x7fa31406d390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3300b0ba0 0x7fa3301f3dd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 --2- 172.21.15.153:0/94703001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3300b0f80 0x7fa3300d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 -- 172.21.15.153:0/94703001 >> 172.21.15.153:0/94703001 conn(0x7fa3300b57b0 msgr2=0x7fa3300ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 -- 172.21.15.153:0/94703001 shutdown_connections 2023-11-24T08:04:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.507+0000 7fa336aa2700 1 -- 172.21.15.153:0/94703001 wait complete. 2023-11-24T08:04:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:04:21.521 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-24T08:04:20.043222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2887680,"data_stored":1751817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001811"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876573+0000","last_change":"2023-11-24T08:04:12.770599+0000","last_active":"2023-11-24T08:04:13.876573+0000","last_peered":"2023-11-24T08:04:13.876573+0000","last_clean":"2023-11-24T08:04:13.876573+0000","last_became_active":"2023-11-24T08:04:12.770351+0000","last_became_peered":"2023-11-24T08:04:12.770351+0000","last_unstale":"2023-11-24T08:04:13.876573+0000","last_undegraded":"2023-11-24T08:04:13.876573+0000","last_fullsized":"2023-11-24T08:04:13.876573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:02.788396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765876+0000","last_change":"2023-11-24T08:04:12.763019+0000","last_active":"2023-11-24T08:04:13.765876+0000","last_peered":"2023-11-24T08:04:13.765876+0000","last_clean":"2023-11-24T08:04:13.765876+0000","last_became_active":"2023-11-24T08:04:12.757900+0000","last_became_peered":"2023-11-24T08:04:12.757900+0000","last_unstale":"2023-11-24T08:04:13.765876+0000","last_undegraded":"2023-11-24T08:04:13.765876+0000","last_fullsized":"2023-11-24T08:04:13.765876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366717+0000","last_change":"2023-11-24T08:04:12.758286+0000","last_active":"2023-11-24T08:04:14.366717+0000","last_peered":"2023-11-24T08:04:14.366717+0000","last_clean":"2023-11-24T08:04:14.366717+0000","last_became_active":"2023-11-24T08:04:12.758023+0000","last_became_peered":"2023-11-24T08:04:12.758023+0000","last_unstale":"2023-11-24T08:04:14.366717+0000","last_undegraded":"2023-11-24T08:04:14.366717+0000","last_fullsized":"2023-11-24T08:04:14.366717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177733+0000","last_change":"2023-11-24T08:04:12.772929+0000","last_active":"2023-11-24T08:04:14.177733+0000","last_peered":"2023-11-24T08:04:14.177733+0000","last_clean":"2023-11-24T08:04:14.177733+0000","last_became_active":"2023-11-24T08:04:12.772279+0000","last_became_peered":"2023-11-24T08:04:12.772279+0000","last_unstale":"2023-11-24T08:04:14.177733+0000","last_undegraded":"2023-11-24T08:04:14.177733+0000","last_fullsized":"2023-11-24T08:04:14.177733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:26.559888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876184+0000","last_change":"2023-11-24T08:04:12.758540+0000","last_active":"2023-11-24T08:04:13.876184+0000","last_peered":"2023-11-24T08:04:13.876184+0000","last_clean":"2023-11-24T08:04:13.876184+0000","last_became_active":"2023-11-24T08:04:12.758277+0000","last_became_peered":"2023-11-24T08:04:12.758277+0000","last_unstale":"2023-11-24T08:04:13.876184+0000","last_undegraded":"2023-11-24T08:04:13.876184+0000","last_fullsized":"2023-11-24T08:04:13.876184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177333+0000","last_change":"2023-11-24T08:04:12.773276+0000","last_active":"2023-11-24T08:04:14.177333+0000","last_peered":"2023-11-24T08:04:14.177333+0000","last_clean":"2023-11-24T08:04:14.177333+0000","last_became_active":"2023-11-24T08:04:12.772869+0000","last_became_peered":"2023-11-24T08:04:12.772869+0000","last_unstale":"2023-11-24T08:04:14.177333+0000","last_undegraded":"2023-11-24T08:04:14.177333+0000","last_fullsized":"2023-11-24T08:04:14.177333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876172+0000","last_change":"2023-11-24T08:04:12.755259+0000","last_active":"2023-11-24T08:04:13.876172+0000","last_peered":"2023-11-24T08:04:13.876172+0000","last_clean":"2023-11-24T08:04:13.876172+0000","last_became_active":"2023-11-24T08:04:12.754963+0000","last_became_peered":"2023-11-24T08:04:12.754963+0000","last_unstale":"2023-11-24T08:04:13.876172+0000","last_undegraded":"2023-11-24T08:04:13.876172+0000","last_fullsized":"2023-11-24T08:04:13.876172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.272910+0000","last_change":"2023-11-24T08:04:12.766658+0000","last_active":"2023-11-24T08:04:14.272910+0000","last_peered":"2023-11-24T08:04:14.272910+0000","last_clean":"2023-11-24T08:04:14.272910+0000","last_became_active":"2023-11-24T08:04:12.765918+0000","last_became_peered":"2023-11-24T08:04:12.765918+0000","last_unstale":"2023-11-24T08:04:14.272910+0000","last_undegraded":"2023-11-24T08:04:14.272910+0000","last_fullsized":"2023-11-24T08:04:14.272910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876569+0000","last_change":"2023-11-24T08:04:12.769707+0000","last_active":"2023-11-24T08:04:13.876569+0000","last_peered":"2023-11-24T08:04:13.876569+0000","last_clean":"2023-11-24T08:04:13.876569+0000","last_became_active":"2023-11-24T08:04:12.767682+0000","last_became_peered":"2023-11-24T08:04:12.767682+0000","last_unstale":"2023-11-24T08:04:13.876569+0000","last_undegraded":"2023-11-24T08:04:13.876569+0000","last_fullsized":"2023-11-24T08:04:13.876569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.914874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367340+0000","last_change":"2023-11-24T08:04:12.765821+0000","last_active":"2023-11-24T08:04:14.367340+0000","last_peered":"2023-11-24T08:04:14.367340+0000","last_clean":"2023-11-24T08:04:14.367340+0000","last_became_active":"2023-11-24T08:04:12.765549+0000","last_became_peered":"2023-11-24T08:04:12.765549+0000","last_unstale":"2023-11-24T08:04:14.367340+0000","last_undegraded":"2023-11-24T08:04:14.367340+0000","last_fullsized":"2023-11-24T08:04:14.367340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367063+0000","last_change":"2023-11-24T08:04:12.765436+0000","last_active":"2023-11-24T08:04:14.367063+0000","last_peered":"2023-11-24T08:04:14.367063+0000","last_clean":"2023-11-24T08:04:14.367063+0000","last_became_active":"2023-11-24T08:04:12.765117+0000","last_became_peered":"2023-11-24T08:04:12.765117+0000","last_unstale":"2023-11-24T08:04:14.367063+0000","last_undegraded":"2023-11-24T08:04:14.367063+0000","last_fullsized":"2023-11-24T08:04:14.367063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768755+0000","last_change":"2023-11-24T08:04:12.753974+0000","last_active":"2023-11-24T08:04:13.768755+0000","last_peered":"2023-11-24T08:04:13.768755+0000","last_clean":"2023-11-24T08:04:13.768755+0000","last_became_active":"2023-11-24T08:04:12.753656+0000","last_became_peered":"2023-11-24T08:04:12.753656+0000","last_unstale":"2023-11-24T08:04:13.768755+0000","last_undegraded":"2023-11-24T08:04:13.768755+0000","last_fullsized":"2023-11-24T08:04:13.768755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:12.285221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273087+0000","last_change":"2023-11-24T08:04:12.764978+0000","last_active":"2023-11-24T08:04:14.273087+0000","last_peered":"2023-11-24T08:04:14.273087+0000","last_clean":"2023-11-24T08:04:14.273087+0000","last_became_active":"2023-11-24T08:04:12.764683+0000","last_became_peered":"2023-11-24T08:04:12.764683+0000","last_unstale":"2023-11-24T08:04:14.273087+0000","last_undegraded":"2023-11-24T08:04:14.273087+0000","last_fullsized":"2023-11-24T08:04:14.273087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366598+0000","last_change":"2023-11-24T08:04:12.759358+0000","last_active":"2023-11-24T08:04:14.366598+0000","last_peered":"2023-11-24T08:04:14.366598+0000","last_clean":"2023-11-24T08:04:14.366598+0000","last_became_active":"2023-11-24T08:04:12.757744+0000","last_became_peered":"2023-11-24T08:04:12.757744+0000","last_unstale":"2023-11-24T08:04:14.366598+0000","last_undegraded":"2023-11-24T08:04:14.366598+0000","last_fullsized":"2023-11-24T08:04:14.366598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:20.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765466+0000","last_change":"2023-11-24T08:04:12.760210+0000","last_active":"2023-11-24T08:04:13.765466+0000","last_peered":"2023-11-24T08:04:13.765466+0000","last_clean":"2023-11-24T08:04:13.765466+0000","last_became_active":"2023-11-24T08:04:12.759781+0000","last_became_peered":"2023-11-24T08:04:12.759781+0000","last_unstale":"2023-11-24T08:04:13.765466+0000","last_undegraded":"2023-11-24T08:04:13.765466+0000","last_fullsized":"2023-11-24T08:04:13.765466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177285+0000","last_change":"2023-11-24T08:04:12.766373+0000","last_active":"2023-11-24T08:04:14.177285+0000","last_peered":"2023-11-24T08:04:14.177285+0000","last_clean":"2023-11-24T08:04:14.177285+0000","last_became_active":"2023-11-24T08:04:12.766108+0000","last_became_peered":"2023-11-24T08:04:12.766108+0000","last_unstale":"2023-11-24T08:04:14.177285+0000","last_undegraded":"2023-11-24T08:04:14.177285+0000","last_fullsized":"2023-11-24T08:04:14.177285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177881+0000","last_change":"2023-11-24T08:04:12.765327+0000","last_active":"2023-11-24T08:04:14.177881+0000","last_peered":"2023-11-24T08:04:14.177881+0000","last_clean":"2023-11-24T08:04:14.177881+0000","last_became_active":"2023-11-24T08:04:12.765017+0000","last_became_peered":"2023-11-24T08:04:12.765017+0000","last_unstale":"2023-11-24T08:04:14.177881+0000","last_undegraded":"2023-11-24T08:04:14.177881+0000","last_fullsized":"2023-11-24T08:04:14.177881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.914874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366457+0000","last_change":"2023-11-24T08:04:12.765919+0000","last_active":"2023-11-24T08:04:14.366457+0000","last_peered":"2023-11-24T08:04:14.366457+0000","last_clean":"2023-11-24T08:04:14.366457+0000","last_became_active":"2023-11-24T08:04:12.765641+0000","last_became_peered":"2023-11-24T08:04:12.765641+0000","last_unstale":"2023-11-24T08:04:14.366457+0000","last_undegraded":"2023-11-24T08:04:14.366457+0000","last_fullsized":"2023-11-24T08:04:14.366457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:58.975401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876303+0000","last_change":"2023-11-24T08:04:12.760146+0000","last_active":"2023-11-24T08:04:13.876303+0000","last_peered":"2023-11-24T08:04:13.876303+0000","last_clean":"2023-11-24T08:04:13.876303+0000","last_became_active":"2023-11-24T08:04:12.759741+0000","last_became_peered":"2023-11-24T08:04:12.759741+0000","last_unstale":"2023-11-24T08:04:13.876303+0000","last_undegraded":"2023-11-24T08:04:13.876303+0000","last_fullsized":"2023-11-24T08:04:13.876303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366921+0000","last_change":"2023-11-24T08:04:11.759390+0000","last_active":"2023-11-24T08:04:14.366921+0000","last_peered":"2023-11-24T08:04:14.366921+0000","last_clean":"2023-11-24T08:04:14.366921+0000","last_became_active":"2023-11-24T08:04:11.759120+0000","last_became_peered":"2023-11-24T08:04:11.759120+0000","last_unstale":"2023-11-24T08:04:14.366921+0000","last_undegraded":"2023-11-24T08:04:14.366921+0000","last_fullsized":"2023-11-24T08:04:14.366921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:05.082044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273176+0000","last_change":"2023-11-24T08:04:12.756765+0000","last_active":"2023-11-24T08:04:14.273176+0000","last_peered":"2023-11-24T08:04:14.273176+0000","last_clean":"2023-11-24T08:04:14.273176+0000","last_became_active":"2023-11-24T08:04:12.756478+0000","last_became_peered":"2023-11-24T08:04:12.756478+0000","last_unstale":"2023-11-24T08:04:14.273176+0000","last_undegraded":"2023-11-24T08:04:14.273176+0000","last_fullsized":"2023-11-24T08:04:14.273176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273275+0000","last_change":"2023-11-24T08:04:11.766651+0000","last_active":"2023-11-24T08:04:14.273275+0000","last_peered":"2023-11-24T08:04:14.273275+0000","last_clean":"2023-11-24T08:04:14.273275+0000","last_became_active":"2023-11-24T08:04:11.766382+0000","last_became_peered":"2023-11-24T08:04:11.766382+0000","last_unstale":"2023-11-24T08:04:14.273275+0000","last_undegraded":"2023-11-24T08:04:14.273275+0000","last_fullsized":"2023-11-24T08:04:14.273275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:08:10.447749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366718+0000","last_change":"2023-11-24T08:04:12.763132+0000","last_active":"2023-11-24T08:04:14.366718+0000","last_peered":"2023-11-24T08:04:14.366718+0000","last_clean":"2023-11-24T08:04:14.366718+0000","last_became_active":"2023-11-24T08:04:12.762841+0000","last_became_peered":"2023-11-24T08:04:12.762841+0000","last_unstale":"2023-11-24T08:04:14.366718+0000","last_undegraded":"2023-11-24T08:04:14.366718+0000","last_fullsized":"2023-11-24T08:04:14.366718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876511+0000","last_change":"2023-11-24T08:04:11.764101+0000","last_active":"2023-11-24T08:04:13.876511+0000","last_peered":"2023-11-24T08:04:13.876511+0000","last_clean":"2023-11-24T08:04:13.876511+0000","last_became_active":"2023-11-24T08:04:11.763785+0000","last_became_peered":"2023-11-24T08:04:11.763785+0000","last_unstale":"2023-11-24T08:04:13.876511+0000","last_undegraded":"2023-11-24T08:04:13.876511+0000","last_fullsized":"2023-11-24T08:04:13.876511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:20.626156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177450+0000","last_change":"2023-11-24T08:04:12.771603+0000","last_active":"2023-11-24T08:04:14.177450+0000","last_peered":"2023-11-24T08:04:14.177450+0000","last_clean":"2023-11-24T08:04:14.177450+0000","last_became_active":"2023-11-24T08:04:12.771221+0000","last_became_peered":"2023-11-24T08:04:12.771221+0000","last_unstale":"2023-11-24T08:04:14.177450+0000","last_undegraded":"2023-11-24T08:04:14.177450+0000","last_fullsized":"2023-11-24T08:04:14.177450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876124+0000","last_change":"2023-11-24T08:04:11.764690+0000","last_active":"2023-11-24T08:04:13.876124+0000","last_peered":"2023-11-24T08:04:13.876124+0000","last_clean":"2023-11-24T08:04:13.876124+0000","last_became_active":"2023-11-24T08:04:11.764316+0000","last_became_peered":"2023-11-24T08:04:11.764316+0000","last_unstale":"2023-11-24T08:04:13.876124+0000","last_undegraded":"2023-11-24T08:04:13.876124+0000","last_fullsized":"2023-11-24T08:04:13.876124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177790+0000","last_change":"2023-11-24T08:04:12.771927+0000","last_active":"2023-11-24T08:04:14.177790+0000","last_peered":"2023-11-24T08:04:14.177790+0000","last_clean":"2023-11-24T08:04:14.177790+0000","last_became_active":"2023-11-24T08:04:12.770523+0000","last_became_peered":"2023-11-24T08:04:12.770523+0000","last_unstale":"2023-11-24T08:04:14.177790+0000","last_undegraded":"2023-11-24T08:04:14.177790+0000","last_fullsized":"2023-11-24T08:04:14.177790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:53:11.480855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273404+0000","last_change":"2023-11-24T08:04:11.764289+0000","last_active":"2023-11-24T08:04:14.273404+0000","last_peered":"2023-11-24T08:04:14.273404+0000","last_clean":"2023-11-24T08:04:14.273404+0000","last_became_active":"2023-11-24T08:04:11.763993+0000","last_became_peered":"2023-11-24T08:04:11.763993+0000","last_unstale":"2023-11-24T08:04:14.273404+0000","last_undegraded":"2023-11-24T08:04:14.273404+0000","last_fullsized":"2023-11-24T08:04:14.273404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:05.082044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768270+0000","last_change":"2023-11-24T08:04:12.759447+0000","last_active":"2023-11-24T08:04:13.768270+0000","last_peered":"2023-11-24T08:04:13.768270+0000","last_clean":"2023-11-24T08:04:13.768270+0000","last_became_active":"2023-11-24T08:04:12.759147+0000","last_became_peered":"2023-11-24T08:04:12.759147+0000","last_unstale":"2023-11-24T08:04:13.768270+0000","last_undegraded":"2023-11-24T08:04:13.768270+0000","last_fullsized":"2023-11-24T08:04:13.768270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:03:32.465127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366918+0000","last_change":"2023-11-24T08:04:11.768035+0000","last_active":"2023-11-24T08:04:14.366918+0000","last_peered":"2023-11-24T08:04:14.366918+0000","last_clean":"2023-11-24T08:04:14.366918+0000","last_became_active":"2023-11-24T08:04:11.767674+0000","last_became_peered":"2023-11-24T08:04:11.767674+0000","last_unstale":"2023-11-24T08:04:14.366918+0000","last_undegraded":"2023-11-24T08:04:14.366918+0000","last_fullsized":"2023-11-24T08:04:14.366918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366939+0000","last_change":"2023-11-24T08:04:12.755036+0000","last_active":"2023-11-24T08:04:14.366939+0000","last_peered":"2023-11-24T08:04:14.366939+0000","last_clean":"2023-11-24T08:04:14.366939+0000","last_became_active":"2023-11-24T08:04:12.754766+0000","last_became_peered":"2023-11-24T08:04:12.754766+0000","last_unstale":"2023-11-24T08:04:14.366939+0000","last_undegraded":"2023-11-24T08:04:14.366939+0000","last_fullsized":"2023-11-24T08:04:14.366939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273015+0000","last_change":"2023-11-24T08:04:11.764114+0000","last_active":"2023-11-24T08:04:14.273015+0000","last_peered":"2023-11-24T08:04:14.273015+0000","last_clean":"2023-11-24T08:04:14.273015+0000","last_became_active":"2023-11-24T08:04:11.763825+0000","last_became_peered":"2023-11-24T08:04:11.763825+0000","last_unstale":"2023-11-24T08:04:14.273015+0000","last_undegraded":"2023-11-24T08:04:14.273015+0000","last_fullsized":"2023-11-24T08:04:14.273015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273198+0000","last_change":"2023-11-24T08:04:12.756326+0000","last_active":"2023-11-24T08:04:14.273198+0000","last_peered":"2023-11-24T08:04:14.273198+0000","last_clean":"2023-11-24T08:04:14.273198+0000","last_became_active":"2023-11-24T08:04:12.755997+0000","last_became_peered":"2023-11-24T08:04:12.755997+0000","last_unstale":"2023-11-24T08:04:14.273198+0000","last_undegraded":"2023-11-24T08:04:14.273198+0000","last_fullsized":"2023-11-24T08:04:14.273198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177300+0000","last_change":"2023-11-24T08:04:11.767935+0000","last_active":"2023-11-24T08:04:14.177300+0000","last_peered":"2023-11-24T08:04:14.177300+0000","last_clean":"2023-11-24T08:04:14.177300+0000","last_became_active":"2023-11-24T08:04:11.767619+0000","last_became_peered":"2023-11-24T08:04:11.767619+0000","last_unstale":"2023-11-24T08:04:14.177300+0000","last_undegraded":"2023-11-24T08:04:14.177300+0000","last_fullsized":"2023-11-24T08:04:14.177300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:54.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765652+0000","last_change":"2023-11-24T08:04:12.760472+0000","last_active":"2023-11-24T08:04:13.765652+0000","last_peered":"2023-11-24T08:04:13.765652+0000","last_clean":"2023-11-24T08:04:13.765652+0000","last_became_active":"2023-11-24T08:04:12.759672+0000","last_became_peered":"2023-11-24T08:04:12.759672+0000","last_unstale":"2023-11-24T08:04:13.765652+0000","last_undegraded":"2023-11-24T08:04:13.765652+0000","last_fullsized":"2023-11-24T08:04:13.765652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367355+0000","last_change":"2023-11-24T08:04:11.763764+0000","last_active":"2023-11-24T08:04:14.367355+0000","last_peered":"2023-11-24T08:04:14.367355+0000","last_clean":"2023-11-24T08:04:14.367355+0000","last_became_active":"2023-11-24T08:04:11.763483+0000","last_became_peered":"2023-11-24T08:04:11.763483+0000","last_unstale":"2023-11-24T08:04:14.367355+0000","last_undegraded":"2023-11-24T08:04:14.367355+0000","last_fullsized":"2023-11-24T08:04:14.367355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177975+0000","last_change":"2023-11-24T08:04:12.761020+0000","last_active":"2023-11-24T08:04:14.177975+0000","last_peered":"2023-11-24T08:04:14.177975+0000","last_clean":"2023-11-24T08:04:14.177975+0000","last_became_active":"2023-11-24T08:04:12.760701+0000","last_became_peered":"2023-11-24T08:04:12.760701+0000","last_unstale":"2023-11-24T08:04:14.177975+0000","last_undegraded":"2023-11-24T08:04:14.177975+0000","last_fullsized":"2023-11-24T08:04:14.177975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:58:32.049664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177726+0000","last_change":"2023-11-24T08:04:11.762776+0000","last_active":"2023-11-24T08:04:14.177726+0000","last_peered":"2023-11-24T08:04:14.177726+0000","last_clean":"2023-11-24T08:04:14.177726+0000","last_became_active":"2023-11-24T08:04:11.762480+0000","last_became_peered":"2023-11-24T08:04:11.762480+0000","last_unstale":"2023-11-24T08:04:14.177726+0000","last_undegraded":"2023-11-24T08:04:14.177726+0000","last_fullsized":"2023-11-24T08:04:14.177726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366882+0000","last_change":"2023-11-24T08:04:12.766040+0000","last_active":"2023-11-24T08:04:14.366882+0000","last_peered":"2023-11-24T08:04:14.366882+0000","last_clean":"2023-11-24T08:04:14.366882+0000","last_became_active":"2023-11-24T08:04:12.765772+0000","last_became_peered":"2023-11-24T08:04:12.765772+0000","last_unstale":"2023-11-24T08:04:14.366882+0000","last_undegraded":"2023-11-24T08:04:14.366882+0000","last_fullsized":"2023-11-24T08:04:14.366882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765732+0000","last_change":"2023-11-24T08:04:11.765479+0000","last_active":"2023-11-24T08:04:13.765732+0000","last_peered":"2023-11-24T08:04:13.765732+0000","last_clean":"2023-11-24T08:04:13.765732+0000","last_became_active":"2023-11-24T08:04:11.765216+0000","last_became_peered":"2023-11-24T08:04:11.765216+0000","last_unstale":"2023-11-24T08:04:13.765732+0000","last_undegraded":"2023-11-24T08:04:13.765732+0000","last_fullsized":"2023-11-24T08:04:13.765732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768676+0000","last_change":"2023-11-24T08:04:12.755487+0000","last_active":"2023-11-24T08:04:13.768676+0000","last_peered":"2023-11-24T08:04:13.768676+0000","last_clean":"2023-11-24T08:04:13.768676+0000","last_became_active":"2023-11-24T08:04:12.755113+0000","last_became_peered":"2023-11-24T08:04:12.755113+0000","last_unstale":"2023-11-24T08:04:13.768676+0000","last_undegraded":"2023-11-24T08:04:13.768676+0000","last_fullsized":"2023-11-24T08:04:13.768676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:58.916630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367128+0000","last_change":"2023-11-24T08:04:11.765679+0000","last_active":"2023-11-24T08:04:14.367128+0000","last_peered":"2023-11-24T08:04:14.367128+0000","last_clean":"2023-11-24T08:04:14.367128+0000","last_became_active":"2023-11-24T08:04:11.764903+0000","last_became_peered":"2023-11-24T08:04:11.764903+0000","last_unstale":"2023-11-24T08:04:14.367128+0000","last_undegraded":"2023-11-24T08:04:14.367128+0000","last_fullsized":"2023-11-24T08:04:14.367128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:46.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876321+0000","last_change":"2023-11-24T08:04:12.761708+0000","last_active":"2023-11-24T08:04:13.876321+0000","last_peered":"2023-11-24T08:04:13.876321+0000","last_clean":"2023-11-24T08:04:13.876321+0000","last_became_active":"2023-11-24T08:04:12.761352+0000","last_became_peered":"2023-11-24T08:04:12.761352+0000","last_unstale":"2023-11-24T08:04:13.876321+0000","last_undegraded":"2023-11-24T08:04:13.876321+0000","last_fullsized":"2023-11-24T08:04:13.876321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:03.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366917+0000","last_change":"2023-11-24T08:04:11.761027+0000","last_active":"2023-11-24T08:04:14.366917+0000","last_peered":"2023-11-24T08:04:14.366917+0000","last_clean":"2023-11-24T08:04:14.366917+0000","last_became_active":"2023-11-24T08:04:11.759840+0000","last_became_peered":"2023-11-24T08:04:11.759840+0000","last_unstale":"2023-11-24T08:04:14.366917+0000","last_undegraded":"2023-11-24T08:04:14.366917+0000","last_fullsized":"2023-11-24T08:04:14.366917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366442+0000","last_change":"2023-11-24T08:04:12.761170+0000","last_active":"2023-11-24T08:04:14.366442+0000","last_peered":"2023-11-24T08:04:14.366442+0000","last_clean":"2023-11-24T08:04:14.366442+0000","last_became_active":"2023-11-24T08:04:12.760886+0000","last_became_peered":"2023-11-24T08:04:12.760886+0000","last_unstale":"2023-11-24T08:04:14.366442+0000","last_undegraded":"2023-11-24T08:04:14.366442+0000","last_fullsized":"2023-11-24T08:04:14.366442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:09.942884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177767+0000","last_change":"2023-11-24T08:04:11.764401+0000","last_active":"2023-11-24T08:04:14.177767+0000","last_peered":"2023-11-24T08:04:14.177767+0000","last_clean":"2023-11-24T08:04:14.177767+0000","last_became_active":"2023-11-24T08:04:11.764134+0000","last_became_peered":"2023-11-24T08:04:11.764134+0000","last_unstale":"2023-11-24T08:04:14.177767+0000","last_undegraded":"2023-11-24T08:04:14.177767+0000","last_fullsized":"2023-11-24T08:04:14.177767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:20.626156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876305+0000","last_change":"2023-11-24T08:04:12.768388+0000","last_active":"2023-11-24T08:04:13.876305+0000","last_peered":"2023-11-24T08:04:13.876305+0000","last_clean":"2023-11-24T08:04:13.876305+0000","last_became_active":"2023-11-24T08:04:12.768067+0000","last_became_peered":"2023-11-24T08:04:12.768067+0000","last_unstale":"2023-11-24T08:04:13.876305+0000","last_undegraded":"2023-11-24T08:04:13.876305+0000","last_fullsized":"2023-11-24T08:04:13.876305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366915+0000","last_change":"2023-11-24T08:04:11.755395+0000","last_active":"2023-11-24T08:04:14.366915+0000","last_peered":"2023-11-24T08:04:14.366915+0000","last_clean":"2023-11-24T08:04:14.366915+0000","last_became_active":"2023-11-24T08:04:11.755135+0000","last_became_peered":"2023-11-24T08:04:11.755135+0000","last_unstale":"2023-11-24T08:04:14.366915+0000","last_undegraded":"2023-11-24T08:04:14.366915+0000","last_fullsized":"2023-11-24T08:04:14.366915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366928+0000","last_change":"2023-11-24T08:04:12.756222+0000","last_active":"2023-11-24T08:04:14.366928+0000","last_peered":"2023-11-24T08:04:14.366928+0000","last_clean":"2023-11-24T08:04:14.366928+0000","last_became_active":"2023-11-24T08:04:12.755930+0000","last_became_peered":"2023-11-24T08:04:12.755930+0000","last_unstale":"2023-11-24T08:04:14.366928+0000","last_undegraded":"2023-11-24T08:04:14.366928+0000","last_fullsized":"2023-11-24T08:04:14.366928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:20.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366287+0000","last_change":"2023-11-24T08:04:11.760945+0000","last_active":"2023-11-24T08:04:14.366287+0000","last_peered":"2023-11-24T08:04:14.366287+0000","last_clean":"2023-11-24T08:04:14.366287+0000","last_became_active":"2023-11-24T08:04:11.760661+0000","last_became_peered":"2023-11-24T08:04:11.760661+0000","last_unstale":"2023-11-24T08:04:14.366287+0000","last_undegraded":"2023-11-24T08:04:14.366287+0000","last_fullsized":"2023-11-24T08:04:14.366287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876042+0000","last_change":"2023-11-24T08:04:12.762670+0000","last_active":"2023-11-24T08:04:13.876042+0000","last_peered":"2023-11-24T08:04:13.876042+0000","last_clean":"2023-11-24T08:04:13.876042+0000","last_became_active":"2023-11-24T08:04:12.762385+0000","last_became_peered":"2023-11-24T08:04:12.762385+0000","last_unstale":"2023-11-24T08:04:13.876042+0000","last_undegraded":"2023-11-24T08:04:13.876042+0000","last_fullsized":"2023-11-24T08:04:13.876042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768772+0000","last_change":"2023-11-24T08:04:11.765361+0000","last_active":"2023-11-24T08:04:13.768772+0000","last_peered":"2023-11-24T08:04:13.768772+0000","last_clean":"2023-11-24T08:04:13.768772+0000","last_became_active":"2023-11-24T08:04:11.760138+0000","last_became_peered":"2023-11-24T08:04:11.760138+0000","last_unstale":"2023-11-24T08:04:13.768772+0000","last_undegraded":"2023-11-24T08:04:13.768772+0000","last_fullsized":"2023-11-24T08:04:13.768772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:59:09.945020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876616+0000","last_change":"2023-11-24T08:04:12.770971+0000","last_active":"2023-11-24T08:04:13.876616+0000","last_peered":"2023-11-24T08:04:13.876616+0000","last_clean":"2023-11-24T08:04:13.876616+0000","last_became_active":"2023-11-24T08:04:12.768881+0000","last_became_peered":"2023-11-24T08:04:12.768881+0000","last_unstale":"2023-11-24T08:04:13.876616+0000","last_undegraded":"2023-11-24T08:04:13.876616+0000","last_fullsized":"2023-11-24T08:04:13.876616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:58:32.049664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765677+0000","last_change":"2023-11-24T08:04:11.758492+0000","last_active":"2023-11-24T08:04:13.765677+0000","last_peered":"2023-11-24T08:04:13.765677+0000","last_clean":"2023-11-24T08:04:13.765677+0000","last_became_active":"2023-11-24T08:04:11.758227+0000","last_became_peered":"2023-11-24T08:04:11.758227+0000","last_unstale":"2023-11-24T08:04:13.765677+0000","last_undegraded":"2023-11-24T08:04:13.765677+0000","last_fullsized":"2023-11-24T08:04:13.765677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177844+0000","last_change":"2023-11-24T08:04:12.762628+0000","last_active":"2023-11-24T08:04:14.177844+0000","last_peered":"2023-11-24T08:04:14.177844+0000","last_clean":"2023-11-24T08:04:14.177844+0000","last_became_active":"2023-11-24T08:04:12.762342+0000","last_became_peered":"2023-11-24T08:04:12.762342+0000","last_unstale":"2023-11-24T08:04:14.177844+0000","last_undegraded":"2023-11-24T08:04:14.177844+0000","last_fullsized":"2023-11-24T08:04:14.177844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:02.788396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177560+0000","last_change":"2023-11-24T08:04:11.763677+0000","last_active":"2023-11-24T08:04:14.177560+0000","last_peered":"2023-11-24T08:04:14.177560+0000","last_clean":"2023-11-24T08:04:14.177560+0000","last_became_active":"2023-11-24T08:04:11.763410+0000","last_became_peered":"2023-11-24T08:04:11.763410+0000","last_unstale":"2023-11-24T08:04:14.177560+0000","last_undegraded":"2023-11-24T08:04:14.177560+0000","last_fullsized":"2023-11-24T08:04:14.177560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:06.394632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768313+0000","last_change":"2023-11-24T08:04:12.758637+0000","last_active":"2023-11-24T08:04:13.768313+0000","last_peered":"2023-11-24T08:04:13.768313+0000","last_clean":"2023-11-24T08:04:13.768313+0000","last_became_active":"2023-11-24T08:04:12.758149+0000","last_became_peered":"2023-11-24T08:04:12.758149+0000","last_unstale":"2023-11-24T08:04:13.768313+0000","last_undegraded":"2023-11-24T08:04:13.768313+0000","last_fullsized":"2023-11-24T08:04:13.768313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:23.086508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765399+0000","last_change":"2023-11-24T08:04:12.762936+0000","last_active":"2023-11-24T08:04:13.765399+0000","last_peered":"2023-11-24T08:04:13.765399+0000","last_clean":"2023-11-24T08:04:13.765399+0000","last_became_active":"2023-11-24T08:04:12.758492+0000","last_became_peered":"2023-11-24T08:04:12.758492+0000","last_unstale":"2023-11-24T08:04:13.765399+0000","last_undegraded":"2023-11-24T08:04:13.765399+0000","last_fullsized":"2023-11-24T08:04:13.765399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366780+0000","last_change":"2023-11-24T08:04:11.764139+0000","last_active":"2023-11-24T08:04:14.366780+0000","last_peered":"2023-11-24T08:04:14.366780+0000","last_clean":"2023-11-24T08:04:14.366780+0000","last_became_active":"2023-11-24T08:04:11.763864+0000","last_became_peered":"2023-11-24T08:04:11.763864+0000","last_unstale":"2023-11-24T08:04:14.366780+0000","last_undegraded":"2023-11-24T08:04:14.366780+0000","last_fullsized":"2023-11-24T08:04:14.366780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:22.082092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273173+0000","last_change":"2023-11-24T08:04:12.774072+0000","last_active":"2023-11-24T08:04:14.273173+0000","last_peered":"2023-11-24T08:04:14.273173+0000","last_clean":"2023-11-24T08:04:14.273173+0000","last_became_active":"2023-11-24T08:04:12.773801+0000","last_became_peered":"2023-11-24T08:04:12.773801+0000","last_unstale":"2023-11-24T08:04:14.273173+0000","last_undegraded":"2023-11-24T08:04:14.273173+0000","last_fullsized":"2023-11-24T08:04:14.273173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177347+0000","last_change":"2023-11-24T08:04:11.762293+0000","last_active":"2023-11-24T08:04:14.177347+0000","last_peered":"2023-11-24T08:04:14.177347+0000","last_clean":"2023-11-24T08:04:14.177347+0000","last_became_active":"2023-11-24T08:04:11.762010+0000","last_became_peered":"2023-11-24T08:04:11.762010+0000","last_unstale":"2023-11-24T08:04:14.177347+0000","last_undegraded":"2023-11-24T08:04:14.177347+0000","last_fullsized":"2023-11-24T08:04:14.177347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:14.105245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T08:04:12.749389+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:04:12.749389+0000","last_peered":"2023-11-24T08:04:12.749389+0000","last_clean":"2023-11-24T08:04:12.749389+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:04:12.749389+0000","last_undegraded":"2023-11-24T08:04:12.749389+0000","last_fullsized":"2023-11-24T08:04:12.749389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366595+0000","last_change":"2023-11-24T08:04:12.755042+0000","last_active":"2023-11-24T08:04:14.366595+0000","last_peered":"2023-11-24T08:04:14.366595+0000","last_clean":"2023-11-24T08:04:14.366595+0000","last_became_active":"2023-11-24T08:04:12.754746+0000","last_became_peered":"2023-11-24T08:04:12.754746+0000","last_unstale":"2023-11-24T08:04:14.366595+0000","last_undegraded":"2023-11-24T08:04:14.366595+0000","last_fullsized":"2023-11-24T08:04:14.366595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:15.109662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.875943+0000","last_change":"2023-11-24T08:04:11.760961+0000","last_active":"2023-11-24T08:04:13.875943+0000","last_peered":"2023-11-24T08:04:13.875943+0000","last_clean":"2023-11-24T08:04:13.875943+0000","last_became_active":"2023-11-24T08:04:11.760601+0000","last_became_peered":"2023-11-24T08:04:11.760601+0000","last_unstale":"2023-11-24T08:04:13.875943+0000","last_undegraded":"2023-11-24T08:04:13.875943+0000","last_fullsized":"2023-11-24T08:04:13.875943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876405+0000","last_change":"2023-11-24T08:04:11.755227+0000","last_active":"2023-11-24T08:04:13.876405+0000","last_peered":"2023-11-24T08:04:13.876405+0000","last_clean":"2023-11-24T08:04:13.876405+0000","last_became_active":"2023-11-24T08:04:11.754941+0000","last_became_peered":"2023-11-24T08:04:11.754941+0000","last_unstale":"2023-11-24T08:04:13.876405+0000","last_undegraded":"2023-11-24T08:04:13.876405+0000","last_fullsized":"2023-11-24T08:04:13.876405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:42.565319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765594+0000","last_change":"2023-11-24T08:04:12.758793+0000","last_active":"2023-11-24T08:04:13.765594+0000","last_peered":"2023-11-24T08:04:13.765594+0000","last_clean":"2023-11-24T08:04:13.765594+0000","last_became_active":"2023-11-24T08:04:12.758047+0000","last_became_peered":"2023-11-24T08:04:12.758047+0000","last_unstale":"2023-11-24T08:04:13.765594+0000","last_undegraded":"2023-11-24T08:04:13.765594+0000","last_fullsized":"2023-11-24T08:04:13.765594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:15.134374+0000","last_change":"2023-11-24T08:04:11.762149+0000","last_active":"2023-11-24T08:04:15.134374+0000","last_peered":"2023-11-24T08:04:15.134374+0000","last_clean":"2023-11-24T08:04:15.134374+0000","last_became_active":"2023-11-24T08:04:11.761849+0000","last_became_peered":"2023-11-24T08:04:11.761849+0000","last_unstale":"2023-11-24T08:04:15.134374+0000","last_undegraded":"2023-11-24T08:04:15.134374+0000","last_fullsized":"2023-11-24T08:04:15.134374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273373+0000","last_change":"2023-11-24T08:04:12.762149+0000","last_active":"2023-11-24T08:04:14.273373+0000","last_peered":"2023-11-24T08:04:14.273373+0000","last_clean":"2023-11-24T08:04:14.273373+0000","last_became_active":"2023-11-24T08:04:12.761859+0000","last_became_peered":"2023-11-24T08:04:12.761859+0000","last_unstale":"2023-11-24T08:04:14.273373+0000","last_undegraded":"2023-11-24T08:04:14.273373+0000","last_fullsized":"2023-11-24T08:04:14.273373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367333+0000","last_change":"2023-11-24T08:04:11.763616+0000","last_active":"2023-11-24T08:04:14.367333+0000","last_peered":"2023-11-24T08:04:14.367333+0000","last_clean":"2023-11-24T08:04:14.367333+0000","last_became_active":"2023-11-24T08:04:11.763330+0000","last_became_peered":"2023-11-24T08:04:11.763330+0000","last_unstale":"2023-11-24T08:04:14.367333+0000","last_undegraded":"2023-11-24T08:04:14.367333+0000","last_fullsized":"2023-11-24T08:04:14.367333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:52:58.082140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366794+0000","last_change":"2023-11-24T08:04:12.754815+0000","last_active":"2023-11-24T08:04:14.366794+0000","last_peered":"2023-11-24T08:04:14.366794+0000","last_clean":"2023-11-24T08:04:14.366794+0000","last_became_active":"2023-11-24T08:04:12.754517+0000","last_became_peered":"2023-11-24T08:04:12.754517+0000","last_unstale":"2023-11-24T08:04:14.366794+0000","last_undegraded":"2023-11-24T08:04:14.366794+0000","last_fullsized":"2023-11-24T08:04:14.366794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.875829+0000","last_change":"2023-11-24T08:04:11.759058+0000","last_active":"2023-11-24T08:04:13.875829+0000","last_peered":"2023-11-24T08:04:13.875829+0000","last_clean":"2023-11-24T08:04:13.875829+0000","last_became_active":"2023-11-24T08:04:11.758773+0000","last_became_peered":"2023-11-24T08:04:11.758773+0000","last_unstale":"2023-11-24T08:04:13.875829+0000","last_undegraded":"2023-11-24T08:04:13.875829+0000","last_fullsized":"2023-11-24T08:04:13.875829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:22.082092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768472+0000","last_change":"2023-11-24T08:04:12.759647+0000","last_active":"2023-11-24T08:04:13.768472+0000","last_peered":"2023-11-24T08:04:13.768472+0000","last_clean":"2023-11-24T08:04:13.768472+0000","last_became_active":"2023-11-24T08:04:12.758979+0000","last_became_peered":"2023-11-24T08:04:12.758979+0000","last_unstale":"2023-11-24T08:04:13.768472+0000","last_undegraded":"2023-11-24T08:04:13.768472+0000","last_fullsized":"2023-11-24T08:04:13.768472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:24.233200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765561+0000","last_change":"2023-11-24T08:04:11.752414+0000","last_active":"2023-11-24T08:04:13.765561+0000","last_peered":"2023-11-24T08:04:13.765561+0000","last_clean":"2023-11-24T08:04:13.765561+0000","last_became_active":"2023-11-24T08:04:11.752132+0000","last_became_peered":"2023-11-24T08:04:11.752132+0000","last_unstale":"2023-11-24T08:04:13.765561+0000","last_undegraded":"2023-11-24T08:04:13.765561+0000","last_fullsized":"2023-11-24T08:04:13.765561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:08.938467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273028+0000","last_change":"2023-11-24T08:04:12.760154+0000","last_active":"2023-11-24T08:04:14.273028+0000","last_peered":"2023-11-24T08:04:14.273028+0000","last_clean":"2023-11-24T08:04:14.273028+0000","last_became_active":"2023-11-24T08:04:12.759870+0000","last_became_peered":"2023-11-24T08:04:12.759870+0000","last_unstale":"2023-11-24T08:04:14.273028+0000","last_undegraded":"2023-11-24T08:04:14.273028+0000","last_fullsized":"2023-11-24T08:04:14.273028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765767+0000","last_change":"2023-11-24T08:04:11.763991+0000","last_active":"2023-11-24T08:04:13.765767+0000","last_peered":"2023-11-24T08:04:13.765767+0000","last_clean":"2023-11-24T08:04:13.765767+0000","last_became_active":"2023-11-24T08:04:11.763720+0000","last_became_peered":"2023-11-24T08:04:11.763720+0000","last_unstale":"2023-11-24T08:04:13.765767+0000","last_undegraded":"2023-11-24T08:04:13.765767+0000","last_fullsized":"2023-11-24T08:04:13.765767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273371+0000","last_change":"2023-11-24T08:04:12.759529+0000","last_active":"2023-11-24T08:04:14.273371+0000","last_peered":"2023-11-24T08:04:14.273371+0000","last_clean":"2023-11-24T08:04:14.273371+0000","last_became_active":"2023-11-24T08:04:12.758748+0000","last_became_peered":"2023-11-24T08:04:12.758748+0000","last_unstale":"2023-11-24T08:04:14.273371+0000","last_undegraded":"2023-11-24T08:04:14.273371+0000","last_fullsized":"2023-11-24T08:04:14.273371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876108+0000","last_change":"2023-11-24T08:04:11.760060+0000","last_active":"2023-11-24T08:04:13.876108+0000","last_peered":"2023-11-24T08:04:13.876108+0000","last_clean":"2023-11-24T08:04:13.876108+0000","last_became_active":"2023-11-24T08:04:11.759649+0000","last_became_peered":"2023-11-24T08:04:11.759649+0000","last_unstale":"2023-11-24T08:04:13.876108+0000","last_undegraded":"2023-11-24T08:04:13.876108+0000","last_fullsized":"2023-11-24T08:04:13.876108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367073+0000","last_change":"2023-11-24T08:04:12.754189+0000","last_active":"2023-11-24T08:04:14.367073+0000","last_peered":"2023-11-24T08:04:14.367073+0000","last_clean":"2023-11-24T08:04:14.367073+0000","last_became_active":"2023-11-24T08:04:12.753907+0000","last_became_peered":"2023-11-24T08:04:12.753907+0000","last_unstale":"2023-11-24T08:04:14.367073+0000","last_undegraded":"2023-11-24T08:04:14.367073+0000","last_fullsized":"2023-11-24T08:04:14.367073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366634+0000","last_change":"2023-11-24T08:04:11.762544+0000","last_active":"2023-11-24T08:04:14.366634+0000","last_peered":"2023-11-24T08:04:14.366634+0000","last_clean":"2023-11-24T08:04:14.366634+0000","last_became_active":"2023-11-24T08:04:11.762250+0000","last_became_peered":"2023-11-24T08:04:11.762250+0000","last_unstale":"2023-11-24T08:04:14.366634+0000","last_undegraded":"2023-11-24T08:04:14.366634+0000","last_fullsized":"2023-11-24T08:04:14.366634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:46.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876467+0000","last_change":"2023-11-24T08:04:12.765834+0000","last_active":"2023-11-24T08:04:13.876467+0000","last_peered":"2023-11-24T08:04:13.876467+0000","last_clean":"2023-11-24T08:04:13.876467+0000","last_became_active":"2023-11-24T08:04:12.765570+0000","last_became_peered":"2023-11-24T08:04:12.765570+0000","last_unstale":"2023-11-24T08:04:13.876467+0000","last_undegraded":"2023-11-24T08:04:13.876467+0000","last_fullsized":"2023-11-24T08:04:13.876467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:53:11.480855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765690+0000","last_change":"2023-11-24T08:04:11.755014+0000","last_active":"2023-11-24T08:04:13.765690+0000","last_peered":"2023-11-24T08:04:13.765690+0000","last_clean":"2023-11-24T08:04:13.765690+0000","last_became_active":"2023-11-24T08:04:11.754748+0000","last_became_peered":"2023-11-24T08:04:11.754748+0000","last_unstale":"2023-11-24T08:04:13.765690+0000","last_undegraded":"2023-11-24T08:04:13.765690+0000","last_fullsized":"2023-11-24T08:04:13.765690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177569+0000","last_change":"2023-11-24T08:04:12.771453+0000","last_active":"2023-11-24T08:04:14.177569+0000","last_peered":"2023-11-24T08:04:14.177569+0000","last_clean":"2023-11-24T08:04:14.177569+0000","last_became_active":"2023-11-24T08:04:12.770894+0000","last_became_peered":"2023-11-24T08:04:12.770894+0000","last_unstale":"2023-11-24T08:04:14.177569+0000","last_undegraded":"2023-11-24T08:04:14.177569+0000","last_fullsized":"2023-11-24T08:04:14.177569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:03.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366534+0000","last_change":"2023-11-24T08:04:11.764045+0000","last_active":"2023-11-24T08:04:14.366534+0000","last_peered":"2023-11-24T08:04:14.366534+0000","last_clean":"2023-11-24T08:04:14.366534+0000","last_became_active":"2023-11-24T08:04:11.763769+0000","last_became_peered":"2023-11-24T08:04:11.763769+0000","last_unstale":"2023-11-24T08:04:14.366534+0000","last_undegraded":"2023-11-24T08:04:14.366534+0000","last_fullsized":"2023-11-24T08:04:14.366534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:57.912213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876406+0000","last_change":"2023-11-24T08:04:12.769943+0000","last_active":"2023-11-24T08:04:13.876406+0000","last_peered":"2023-11-24T08:04:13.876406+0000","last_clean":"2023-11-24T08:04:13.876406+0000","last_became_active":"2023-11-24T08:04:12.768782+0000","last_became_peered":"2023-11-24T08:04:12.768782+0000","last_unstale":"2023-11-24T08:04:13.876406+0000","last_undegraded":"2023-11-24T08:04:13.876406+0000","last_fullsized":"2023-11-24T08:04:13.876406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:26.559888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366930+0000","last_change":"2023-11-24T08:04:12.756131+0000","last_active":"2023-11-24T08:04:14.366930+0000","last_peered":"2023-11-24T08:04:14.366930+0000","last_clean":"2023-11-24T08:04:14.366930+0000","last_became_active":"2023-11-24T08:04:12.755871+0000","last_became_peered":"2023-11-24T08:04:12.755871+0000","last_unstale":"2023-11-24T08:04:14.366930+0000","last_undegraded":"2023-11-24T08:04:14.366930+0000","last_fullsized":"2023-11-24T08:04:14.366930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:15.109662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366678+0000","last_change":"2023-11-24T08:04:12.763889+0000","last_active":"2023-11-24T08:04:14.366678+0000","last_peered":"2023-11-24T08:04:14.366678+0000","last_clean":"2023-11-24T08:04:14.366678+0000","last_became_active":"2023-11-24T08:04:12.763582+0000","last_became_peered":"2023-11-24T08:04:12.763582+0000","last_unstale":"2023-11-24T08:04:14.366678+0000","last_undegraded":"2023-11-24T08:04:14.366678+0000","last_fullsized":"2023-11-24T08:04:14.366678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:08:11.452166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177507+0000","last_change":"2023-11-24T08:04:12.773095+0000","last_active":"2023-11-24T08:04:14.177507+0000","last_peered":"2023-11-24T08:04:14.177507+0000","last_clean":"2023-11-24T08:04:14.177507+0000","last_became_active":"2023-11-24T08:04:12.772811+0000","last_became_peered":"2023-11-24T08:04:12.772811+0000","last_unstale":"2023-11-24T08:04:14.177507+0000","last_undegraded":"2023-11-24T08:04:14.177507+0000","last_fullsized":"2023-11-24T08:04:14.177507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366824+0000","last_change":"2023-11-24T08:04:12.760168+0000","last_active":"2023-11-24T08:04:14.366824+0000","last_peered":"2023-11-24T08:04:14.366824+0000","last_clean":"2023-11-24T08:04:14.366824+0000","last_became_active":"2023-11-24T08:04:12.759868+0000","last_became_peered":"2023-11-24T08:04:12.759868+0000","last_unstale":"2023-11-24T08:04:14.366824+0000","last_undegraded":"2023-11-24T08:04:14.366824+0000","last_fullsized":"2023-11-24T08:04:14.366824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273253+0000","last_change":"2023-11-24T08:04:12.756627+0000","last_active":"2023-11-24T08:04:14.273253+0000","last_peered":"2023-11-24T08:04:14.273253+0000","last_clean":"2023-11-24T08:04:14.273253+0000","last_became_active":"2023-11-24T08:04:12.756360+0000","last_became_peered":"2023-11-24T08:04:12.756360+0000","last_unstale":"2023-11-24T08:04:14.273253+0000","last_undegraded":"2023-11-24T08:04:14.273253+0000","last_fullsized":"2023-11-24T08:04:14.273253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765638+0000","last_change":"2023-11-24T08:04:12.759234+0000","last_active":"2023-11-24T08:04:13.765638+0000","last_peered":"2023-11-24T08:04:13.765638+0000","last_clean":"2023-11-24T08:04:13.765638+0000","last_became_active":"2023-11-24T08:04:12.758458+0000","last_became_peered":"2023-11-24T08:04:12.758458+0000","last_unstale":"2023-11-24T08:04:13.765638+0000","last_undegraded":"2023-11-24T08:04:13.765638+0000","last_fullsized":"2023-11-24T08:04:13.765638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367321+0000","last_change":"2023-11-24T08:04:12.755695+0000","last_active":"2023-11-24T08:04:14.367321+0000","last_peered":"2023-11-24T08:04:14.367321+0000","last_clean":"2023-11-24T08:04:14.367321+0000","last_became_active":"2023-11-24T08:04:12.755415+0000","last_became_peered":"2023-11-24T08:04:12.755415+0000","last_unstale":"2023-11-24T08:04:14.367321+0000","last_undegraded":"2023-11-24T08:04:14.367321+0000","last_fullsized":"2023-11-24T08:04:14.367321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273363+0000","last_change":"2023-11-24T08:04:12.761355+0000","last_active":"2023-11-24T08:04:14.273363+0000","last_peered":"2023-11-24T08:04:14.273363+0000","last_clean":"2023-11-24T08:04:14.273363+0000","last_became_active":"2023-11-24T08:04:12.761068+0000","last_became_peered":"2023-11-24T08:04:12.761068+0000","last_unstale":"2023-11-24T08:04:14.273363+0000","last_undegraded":"2023-11-24T08:04:14.273363+0000","last_fullsized":"2023-11-24T08:04:14.273363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177495+0000","last_change":"2023-11-24T08:04:12.764876+0000","last_active":"2023-11-24T08:04:14.177495+0000","last_peered":"2023-11-24T08:04:14.177495+0000","last_clean":"2023-11-24T08:04:14.177495+0000","last_became_active":"2023-11-24T08:04:12.764548+0000","last_became_peered":"2023-11-24T08:04:12.764548+0000","last_unstale":"2023-11-24T08:04:14.177495+0000","last_undegraded":"2023-11-24T08:04:14.177495+0000","last_fullsized":"2023-11-24T08:04:14.177495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.272974+0000","last_change":"2023-11-24T08:04:12.761400+0000","last_active":"2023-11-24T08:04:14.272974+0000","last_peered":"2023-11-24T08:04:14.272974+0000","last_clean":"2023-11-24T08:04:14.272974+0000","last_became_active":"2023-11-24T08:04:12.761102+0000","last_became_peered":"2023-11-24T08:04:12.761102+0000","last_unstale":"2023-11-24T08:04:14.272974+0000","last_undegraded":"2023-11-24T08:04:14.272974+0000","last_fullsized":"2023-11-24T08:04:14.272974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177430+0000","last_change":"2023-11-24T08:04:12.773448+0000","last_active":"2023-11-24T08:04:14.177430+0000","last_peered":"2023-11-24T08:04:14.177430+0000","last_clean":"2023-11-24T08:04:14.177430+0000","last_became_active":"2023-11-24T08:04:12.773121+0000","last_became_peered":"2023-11-24T08:04:12.773121+0000","last_unstale":"2023-11-24T08:04:14.177430+0000","last_undegraded":"2023-11-24T08:04:14.177430+0000","last_fullsized":"2023-11-24T08:04:14.177430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366803+0000","last_change":"2023-11-24T08:04:12.762494+0000","last_active":"2023-11-24T08:04:14.366803+0000","last_peered":"2023-11-24T08:04:14.366803+0000","last_clean":"2023-11-24T08:04:14.366803+0000","last_became_active":"2023-11-24T08:04:12.762095+0000","last_became_peered":"2023-11-24T08:04:12.762095+0000","last_unstale":"2023-11-24T08:04:14.366803+0000","last_undegraded":"2023-11-24T08:04:14.366803+0000","last_fullsized":"2023-11-24T08:04:14.366803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367122+0000","last_change":"2023-11-24T08:04:12.754219+0000","last_active":"2023-11-24T08:04:14.367122+0000","last_peered":"2023-11-24T08:04:14.367122+0000","last_clean":"2023-11-24T08:04:14.367122+0000","last_became_active":"2023-11-24T08:04:12.753940+0000","last_became_peered":"2023-11-24T08:04:12.753940+0000","last_unstale":"2023-11-24T08:04:14.367122+0000","last_undegraded":"2023-11-24T08:04:14.367122+0000","last_fullsized":"2023-11-24T08:04:14.367122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.089}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:04:21.525 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:04:21.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.680+0000 7fe6e5f1a700 1 Processor -- start 2023-11-24T08:04:21.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.680+0000 7fe6e5f1a700 1 -- start start 2023-11-24T08:04:21.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.681+0000 7fe6e5f1a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e015bdd0 0x7fe6e01604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.681+0000 7fe6e5f1a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe6e00b3370 0x7fe6e00b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.681+0000 7fe6e5f1a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e00b2030 con 0x7fe6e00d1c70 2023-11-24T08:04:21.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.681+0000 7fe6e5f1a700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e00b2f50 con 0x7fe6e00b3370 2023-11-24T08:04:21.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.681+0000 7fe6e5f1a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00b22d0 con 0x7fe6e015bdd0 2023-11-24T08:04:21.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.681+0000 7fe6dffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe6e00d1c70 0x7fe6e00ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41944/0 (socket says 172.21.15.153:41944) 2023-11-24T08:04:21.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.681+0000 7fe6dffff700 1 -- 172.21.15.153:0/638525897 learned_addr learned my addr 172.21.15.153:0/638525897 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:21.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6df7fe700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e015bdd0 0x7fe6e01604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6deffd700 1 --2- 172.21.15.153:0/638525897 >> v2:172.21.15.164:3300/0 conn(0x7fe6e00b3370 0x7fe6e00b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880082698 0 0) 0x7fe6e00b2030 con 0x7fe6e00d1c70 2023-11-24T08:04:21.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c80035b0 con 0x7fe6e00d1c70 2023-11-24T08:04:21.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 550217860 0 0) 0x7fe6c80035b0 con 0x7fe6e00d1c70 2023-11-24T08:04:21.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e015bdd0 msgr2=0x7fe6e01604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:21.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e015bdd0 0x7fe6e01604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 >> v2:172.21.15.164:3300/0 conn(0x7fe6e00b3370 msgr2=0x7fe6e00b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:21.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 --2- 172.21.15.153:0/638525897 >> v2:172.21.15.164:3300/0 conn(0x7fe6e00b3370 0x7fe6e00b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e00b25b0 con 0x7fe6e00d1c70 2023-11-24T08:04:21.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fe6d80019f0 con 0x7fe6e00d1c70 2023-11-24T08:04:21.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 >> v1:172.21.15.153:6789/0 conn(0x7fe6e00d1c70 legacy=0x7fe6e00ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c8003a00 0x7fe6c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c8004850 0x7fe6c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c8005210 0x7fe6c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00b2f50 con 0x7fe6c8005210 2023-11-24T08:04:21.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00b22d0 con 0x7fe6c8003a00 2023-11-24T08:04:21.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c800bf50 con 0x7fe6c8004850 2023-11-24T08:04:21.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6deffd700 1 --2- 172.21.15.153:0/638525897 >> v2:172.21.15.164:3300/0 conn(0x7fe6e00b3370 0x7fe6e00b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:21.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6df7fe700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e015bdd0 0x7fe6e01604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:21.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6dffff700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c8005210 0x7fe6c800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6deffd700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c8004850 0x7fe6c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6df7fe700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c8003a00 0x7fe6c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6dffff700 1 -- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c8004850 msgr2=0x7fe6c8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:21.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6dffff700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c8004850 0x7fe6c8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6dffff700 1 -- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c8003a00 msgr2=0x7fe6c8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:21.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6dffff700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c8003a00 0x7fe6c8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6dffff700 1 -- 172.21.15.153:0/638525897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c80035b0 con 0x7fe6c8005210 2023-11-24T08:04:21.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.682+0000 7fe6df7fe700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c8003a00 0x7fe6c8003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:21.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.683+0000 7fe6dffff700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c8005210 0x7fe6c800ba10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800a890 tx=0x7fe6c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20bdde889ffe91f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.683+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8012600 con 0x7fe6c8005210 2023-11-24T08:04:21.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.683+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d8012780 con 0x7fe6c8005210 2023-11-24T08:04:21.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.683+0000 7fe6de7fc700 1 -- 172.21.15.153:0/638525897 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8012b30 con 0x7fe6c8005210 2023-11-24T08:04:21.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.683+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/638525897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c8005210 msgr2=0x7fe6c800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.683+0000 7fe6e5f1a700 1 --2- 172.21.15.153:0/638525897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c8005210 0x7fe6c800ba10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800a890 tx=0x7fe6c8005880 comp rx=0 tx=0).stop 2023-11-24T08:04:21.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.683+0000 7fe6dffff700 1 -- 172.21.15.153:0/638525897 reap_dead start 2023-11-24T08:04:21.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.683+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/638525897 shutdown_connections 2023-11-24T08:04:21.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.683+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/638525897 >> 172.21.15.153:0/638525897 conn(0x7fe6e00731a0 msgr2=0x7fe6e009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.683+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/638525897 shutdown_connections 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.683+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/638525897 wait complete. 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.684+0000 7fe6e5f1a700 1 Processor -- start 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.685+0000 7fe6e5f1a700 1 -- start start 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.685+0000 7fe6e5f1a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e01568a0 0x7fe6e01575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.685+0000 7fe6e5f1a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e00c6b10 0x7fe6e00c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.685+0000 7fe6e5f1a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e00cd710 0x7fe6e00cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.685+0000 7fe6e5f1a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00ce100 con 0x7fe6e00cd710 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.685+0000 7fe6e5f1a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00b64f0 con 0x7fe6e00c6b10 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.685+0000 7fe6e5f1a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00c70d0 con 0x7fe6e01568a0 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.685+0000 7fe6dffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e00cd710 0x7fe6e00cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.685+0000 7fe6dffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e00cd710 0x7fe6e00cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35852/0 (socket says 172.21.15.153:35852) 2023-11-24T08:04:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.685+0000 7fe6dffff700 1 -- 172.21.15.153:0/2651805644 learned_addr learned my addr 172.21.15.153:0/2651805644 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.685+0000 7fe6df7fe700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e01568a0 0x7fe6e01575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6deffd700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e00c6b10 0x7fe6e00c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6dffff700 1 -- 172.21.15.153:0/2651805644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e01568a0 msgr2=0x7fe6e01575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6dffff700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e01568a0 0x7fe6e01575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6dffff700 1 -- 172.21.15.153:0/2651805644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e00c6b10 msgr2=0x7fe6e00c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6dffff700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e00c6b10 0x7fe6e00c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6dffff700 1 -- 172.21.15.153:0/2651805644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e00c73b0 con 0x7fe6e00cd710 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6dffff700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e00cd710 0x7fe6e00cdbc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8015040 tx=0x7fe6d8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6c7fff700 1 -- 172.21.15.153:0/2651805644 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d801e630 con 0x7fe6e00cd710 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6c7fff700 1 -- 172.21.15.153:0/2651805644 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d801e790 con 0x7fe6e00cd710 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6c7fff700 1 -- 172.21.15.153:0/2651805644 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d801eb40 con 0x7fe6e00cd710 2023-11-24T08:04:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/2651805644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e00c7690 con 0x7fe6e00cd710 2023-11-24T08:04:21.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.686+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/2651805644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e00c7c50 con 0x7fe6e00cd710 2023-11-24T08:04:21.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.687+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/2651805644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e0067f60 con 0x7fe6e00cd710 2023-11-24T08:04:21.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.687+0000 7fe6c7fff700 1 -- 172.21.15.153:0/2651805644 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6d801eca0 con 0x7fe6e00cd710 2023-11-24T08:04:21.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.688+0000 7fe6c7fff700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 0x7fe6cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.688+0000 7fe6c7fff700 1 -- 172.21.15.153:0/2651805644 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6d808b100 con 0x7fe6e00cd710 2023-11-24T08:04:21.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.688+0000 7fe6df7fe700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 0x7fe6cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.688+0000 7fe6df7fe700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 0x7fe6cc06d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009470 tx=0x7fe6d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.692+0000 7fe6c7fff700 1 -- 172.21.15.153:0/2651805644 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6d8056360 con 0x7fe6e00cd710 2023-11-24T08:04:21.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.878+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/2651805644 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6e00b2b70 con 0x7fe6cc06aed0 2023-11-24T08:04:21.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.885+0000 7fe6c7fff700 1 -- 172.21.15.153:0/2651805644 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264562 (secure 0 0 0) 0x7fe6d4004240 con 0x7fe6cc06aed0 2023-11-24T08:04:21.890 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:21.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.888+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/2651805644 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 msgr2=0x7fe6cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.888+0000 7fe6e5f1a700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 0x7fe6cc06d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009470 tx=0x7fe6d4008040 comp rx=0 tx=0).stop 2023-11-24T08:04:21.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.888+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/2651805644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e00cd710 msgr2=0x7fe6e00cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.888+0000 7fe6e5f1a700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e00cd710 0x7fe6e00cdbc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8015040 tx=0x7fe6d8001d80 comp rx=0 tx=0).stop 2023-11-24T08:04:21.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.888+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/2651805644 shutdown_connections 2023-11-24T08:04:21.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.888+0000 7fe6e5f1a700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 0x7fe6cc06d390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.888+0000 7fe6e5f1a700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e00cd710 0x7fe6e00cdbc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.888+0000 7fe6e5f1a700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e01568a0 0x7fe6e01575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.888+0000 7fe6e5f1a700 1 --2- 172.21.15.153:0/2651805644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e00c6b10 0x7fe6e00c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.888+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/2651805644 >> 172.21.15.153:0/2651805644 conn(0x7fe6e00731a0 msgr2=0x7fe6e015a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.889+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/2651805644 shutdown_connections 2023-11-24T08:04:21.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:21.889+0000 7fe6e5f1a700 1 -- 172.21.15.153:0/2651805644 wait complete. 2023-11-24T08:04:21.894 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:04:21.902 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-24T08:04:20.043222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2887680,"data_stored":1751817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001811"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876573+0000","last_change":"2023-11-24T08:04:12.770599+0000","last_active":"2023-11-24T08:04:13.876573+0000","last_peered":"2023-11-24T08:04:13.876573+0000","last_clean":"2023-11-24T08:04:13.876573+0000","last_became_active":"2023-11-24T08:04:12.770351+0000","last_became_peered":"2023-11-24T08:04:12.770351+0000","last_unstale":"2023-11-24T08:04:13.876573+0000","last_undegraded":"2023-11-24T08:04:13.876573+0000","last_fullsized":"2023-11-24T08:04:13.876573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:02.788396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765876+0000","last_change":"2023-11-24T08:04:12.763019+0000","last_active":"2023-11-24T08:04:13.765876+0000","last_peered":"2023-11-24T08:04:13.765876+0000","last_clean":"2023-11-24T08:04:13.765876+0000","last_became_active":"2023-11-24T08:04:12.757900+0000","last_became_peered":"2023-11-24T08:04:12.757900+0000","last_unstale":"2023-11-24T08:04:13.765876+0000","last_undegraded":"2023-11-24T08:04:13.765876+0000","last_fullsized":"2023-11-24T08:04:13.765876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366717+0000","last_change":"2023-11-24T08:04:12.758286+0000","last_active":"2023-11-24T08:04:14.366717+0000","last_peered":"2023-11-24T08:04:14.366717+0000","last_clean":"2023-11-24T08:04:14.366717+0000","last_became_active":"2023-11-24T08:04:12.758023+0000","last_became_peered":"2023-11-24T08:04:12.758023+0000","last_unstale":"2023-11-24T08:04:14.366717+0000","last_undegraded":"2023-11-24T08:04:14.366717+0000","last_fullsized":"2023-11-24T08:04:14.366717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177733+0000","last_change":"2023-11-24T08:04:12.772929+0000","last_active":"2023-11-24T08:04:14.177733+0000","last_peered":"2023-11-24T08:04:14.177733+0000","last_clean":"2023-11-24T08:04:14.177733+0000","last_became_active":"2023-11-24T08:04:12.772279+0000","last_became_peered":"2023-11-24T08:04:12.772279+0000","last_unstale":"2023-11-24T08:04:14.177733+0000","last_undegraded":"2023-11-24T08:04:14.177733+0000","last_fullsized":"2023-11-24T08:04:14.177733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:26.559888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876184+0000","last_change":"2023-11-24T08:04:12.758540+0000","last_active":"2023-11-24T08:04:13.876184+0000","last_peered":"2023-11-24T08:04:13.876184+0000","last_clean":"2023-11-24T08:04:13.876184+0000","last_became_active":"2023-11-24T08:04:12.758277+0000","last_became_peered":"2023-11-24T08:04:12.758277+0000","last_unstale":"2023-11-24T08:04:13.876184+0000","last_undegraded":"2023-11-24T08:04:13.876184+0000","last_fullsized":"2023-11-24T08:04:13.876184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177333+0000","last_change":"2023-11-24T08:04:12.773276+0000","last_active":"2023-11-24T08:04:14.177333+0000","last_peered":"2023-11-24T08:04:14.177333+0000","last_clean":"2023-11-24T08:04:14.177333+0000","last_became_active":"2023-11-24T08:04:12.772869+0000","last_became_peered":"2023-11-24T08:04:12.772869+0000","last_unstale":"2023-11-24T08:04:14.177333+0000","last_undegraded":"2023-11-24T08:04:14.177333+0000","last_fullsized":"2023-11-24T08:04:14.177333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876172+0000","last_change":"2023-11-24T08:04:12.755259+0000","last_active":"2023-11-24T08:04:13.876172+0000","last_peered":"2023-11-24T08:04:13.876172+0000","last_clean":"2023-11-24T08:04:13.876172+0000","last_became_active":"2023-11-24T08:04:12.754963+0000","last_became_peered":"2023-11-24T08:04:12.754963+0000","last_unstale":"2023-11-24T08:04:13.876172+0000","last_undegraded":"2023-11-24T08:04:13.876172+0000","last_fullsized":"2023-11-24T08:04:13.876172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.272910+0000","last_change":"2023-11-24T08:04:12.766658+0000","last_active":"2023-11-24T08:04:14.272910+0000","last_peered":"2023-11-24T08:04:14.272910+0000","last_clean":"2023-11-24T08:04:14.272910+0000","last_became_active":"2023-11-24T08:04:12.765918+0000","last_became_peered":"2023-11-24T08:04:12.765918+0000","last_unstale":"2023-11-24T08:04:14.272910+0000","last_undegraded":"2023-11-24T08:04:14.272910+0000","last_fullsized":"2023-11-24T08:04:14.272910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876569+0000","last_change":"2023-11-24T08:04:12.769707+0000","last_active":"2023-11-24T08:04:13.876569+0000","last_peered":"2023-11-24T08:04:13.876569+0000","last_clean":"2023-11-24T08:04:13.876569+0000","last_became_active":"2023-11-24T08:04:12.767682+0000","last_became_peered":"2023-11-24T08:04:12.767682+0000","last_unstale":"2023-11-24T08:04:13.876569+0000","last_undegraded":"2023-11-24T08:04:13.876569+0000","last_fullsized":"2023-11-24T08:04:13.876569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.914874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367340+0000","last_change":"2023-11-24T08:04:12.765821+0000","last_active":"2023-11-24T08:04:14.367340+0000","last_peered":"2023-11-24T08:04:14.367340+0000","last_clean":"2023-11-24T08:04:14.367340+0000","last_became_active":"2023-11-24T08:04:12.765549+0000","last_became_peered":"2023-11-24T08:04:12.765549+0000","last_unstale":"2023-11-24T08:04:14.367340+0000","last_undegraded":"2023-11-24T08:04:14.367340+0000","last_fullsized":"2023-11-24T08:04:14.367340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367063+0000","last_change":"2023-11-24T08:04:12.765436+0000","last_active":"2023-11-24T08:04:14.367063+0000","last_peered":"2023-11-24T08:04:14.367063+0000","last_clean":"2023-11-24T08:04:14.367063+0000","last_became_active":"2023-11-24T08:04:12.765117+0000","last_became_peered":"2023-11-24T08:04:12.765117+0000","last_unstale":"2023-11-24T08:04:14.367063+0000","last_undegraded":"2023-11-24T08:04:14.367063+0000","last_fullsized":"2023-11-24T08:04:14.367063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768755+0000","last_change":"2023-11-24T08:04:12.753974+0000","last_active":"2023-11-24T08:04:13.768755+0000","last_peered":"2023-11-24T08:04:13.768755+0000","last_clean":"2023-11-24T08:04:13.768755+0000","last_became_active":"2023-11-24T08:04:12.753656+0000","last_became_peered":"2023-11-24T08:04:12.753656+0000","last_unstale":"2023-11-24T08:04:13.768755+0000","last_undegraded":"2023-11-24T08:04:13.768755+0000","last_fullsized":"2023-11-24T08:04:13.768755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:12.285221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273087+0000","last_change":"2023-11-24T08:04:12.764978+0000","last_active":"2023-11-24T08:04:14.273087+0000","last_peered":"2023-11-24T08:04:14.273087+0000","last_clean":"2023-11-24T08:04:14.273087+0000","last_became_active":"2023-11-24T08:04:12.764683+0000","last_became_peered":"2023-11-24T08:04:12.764683+0000","last_unstale":"2023-11-24T08:04:14.273087+0000","last_undegraded":"2023-11-24T08:04:14.273087+0000","last_fullsized":"2023-11-24T08:04:14.273087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366598+0000","last_change":"2023-11-24T08:04:12.759358+0000","last_active":"2023-11-24T08:04:14.366598+0000","last_peered":"2023-11-24T08:04:14.366598+0000","last_clean":"2023-11-24T08:04:14.366598+0000","last_became_active":"2023-11-24T08:04:12.757744+0000","last_became_peered":"2023-11-24T08:04:12.757744+0000","last_unstale":"2023-11-24T08:04:14.366598+0000","last_undegraded":"2023-11-24T08:04:14.366598+0000","last_fullsized":"2023-11-24T08:04:14.366598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:20.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765466+0000","last_change":"2023-11-24T08:04:12.760210+0000","last_active":"2023-11-24T08:04:13.765466+0000","last_peered":"2023-11-24T08:04:13.765466+0000","last_clean":"2023-11-24T08:04:13.765466+0000","last_became_active":"2023-11-24T08:04:12.759781+0000","last_became_peered":"2023-11-24T08:04:12.759781+0000","last_unstale":"2023-11-24T08:04:13.765466+0000","last_undegraded":"2023-11-24T08:04:13.765466+0000","last_fullsized":"2023-11-24T08:04:13.765466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177285+0000","last_change":"2023-11-24T08:04:12.766373+0000","last_active":"2023-11-24T08:04:14.177285+0000","last_peered":"2023-11-24T08:04:14.177285+0000","last_clean":"2023-11-24T08:04:14.177285+0000","last_became_active":"2023-11-24T08:04:12.766108+0000","last_became_peered":"2023-11-24T08:04:12.766108+0000","last_unstale":"2023-11-24T08:04:14.177285+0000","last_undegraded":"2023-11-24T08:04:14.177285+0000","last_fullsized":"2023-11-24T08:04:14.177285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177881+0000","last_change":"2023-11-24T08:04:12.765327+0000","last_active":"2023-11-24T08:04:14.177881+0000","last_peered":"2023-11-24T08:04:14.177881+0000","last_clean":"2023-11-24T08:04:14.177881+0000","last_became_active":"2023-11-24T08:04:12.765017+0000","last_became_peered":"2023-11-24T08:04:12.765017+0000","last_unstale":"2023-11-24T08:04:14.177881+0000","last_undegraded":"2023-11-24T08:04:14.177881+0000","last_fullsized":"2023-11-24T08:04:14.177881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.914874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366457+0000","last_change":"2023-11-24T08:04:12.765919+0000","last_active":"2023-11-24T08:04:14.366457+0000","last_peered":"2023-11-24T08:04:14.366457+0000","last_clean":"2023-11-24T08:04:14.366457+0000","last_became_active":"2023-11-24T08:04:12.765641+0000","last_became_peered":"2023-11-24T08:04:12.765641+0000","last_unstale":"2023-11-24T08:04:14.366457+0000","last_undegraded":"2023-11-24T08:04:14.366457+0000","last_fullsized":"2023-11-24T08:04:14.366457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:58.975401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876303+0000","last_change":"2023-11-24T08:04:12.760146+0000","last_active":"2023-11-24T08:04:13.876303+0000","last_peered":"2023-11-24T08:04:13.876303+0000","last_clean":"2023-11-24T08:04:13.876303+0000","last_became_active":"2023-11-24T08:04:12.759741+0000","last_became_peered":"2023-11-24T08:04:12.759741+0000","last_unstale":"2023-11-24T08:04:13.876303+0000","last_undegraded":"2023-11-24T08:04:13.876303+0000","last_fullsized":"2023-11-24T08:04:13.876303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366921+0000","last_change":"2023-11-24T08:04:11.759390+0000","last_active":"2023-11-24T08:04:14.366921+0000","last_peered":"2023-11-24T08:04:14.366921+0000","last_clean":"2023-11-24T08:04:14.366921+0000","last_became_active":"2023-11-24T08:04:11.759120+0000","last_became_peered":"2023-11-24T08:04:11.759120+0000","last_unstale":"2023-11-24T08:04:14.366921+0000","last_undegraded":"2023-11-24T08:04:14.366921+0000","last_fullsized":"2023-11-24T08:04:14.366921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:05.082044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273176+0000","last_change":"2023-11-24T08:04:12.756765+0000","last_active":"2023-11-24T08:04:14.273176+0000","last_peered":"2023-11-24T08:04:14.273176+0000","last_clean":"2023-11-24T08:04:14.273176+0000","last_became_active":"2023-11-24T08:04:12.756478+0000","last_became_peered":"2023-11-24T08:04:12.756478+0000","last_unstale":"2023-11-24T08:04:14.273176+0000","last_undegraded":"2023-11-24T08:04:14.273176+0000","last_fullsized":"2023-11-24T08:04:14.273176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:02.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273275+0000","last_change":"2023-11-24T08:04:11.766651+0000","last_active":"2023-11-24T08:04:14.273275+0000","last_peered":"2023-11-24T08:04:14.273275+0000","last_clean":"2023-11-24T08:04:14.273275+0000","last_became_active":"2023-11-24T08:04:11.766382+0000","last_became_peered":"2023-11-24T08:04:11.766382+0000","last_unstale":"2023-11-24T08:04:14.273275+0000","last_undegraded":"2023-11-24T08:04:14.273275+0000","last_fullsized":"2023-11-24T08:04:14.273275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:08:10.447749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366718+0000","last_change":"2023-11-24T08:04:12.763132+0000","last_active":"2023-11-24T08:04:14.366718+0000","last_peered":"2023-11-24T08:04:14.366718+0000","last_clean":"2023-11-24T08:04:14.366718+0000","last_became_active":"2023-11-24T08:04:12.762841+0000","last_became_peered":"2023-11-24T08:04:12.762841+0000","last_unstale":"2023-11-24T08:04:14.366718+0000","last_undegraded":"2023-11-24T08:04:14.366718+0000","last_fullsized":"2023-11-24T08:04:14.366718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876511+0000","last_change":"2023-11-24T08:04:11.764101+0000","last_active":"2023-11-24T08:04:13.876511+0000","last_peered":"2023-11-24T08:04:13.876511+0000","last_clean":"2023-11-24T08:04:13.876511+0000","last_became_active":"2023-11-24T08:04:11.763785+0000","last_became_peered":"2023-11-24T08:04:11.763785+0000","last_unstale":"2023-11-24T08:04:13.876511+0000","last_undegraded":"2023-11-24T08:04:13.876511+0000","last_fullsized":"2023-11-24T08:04:13.876511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:20.626156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177450+0000","last_change":"2023-11-24T08:04:12.771603+0000","last_active":"2023-11-24T08:04:14.177450+0000","last_peered":"2023-11-24T08:04:14.177450+0000","last_clean":"2023-11-24T08:04:14.177450+0000","last_became_active":"2023-11-24T08:04:12.771221+0000","last_became_peered":"2023-11-24T08:04:12.771221+0000","last_unstale":"2023-11-24T08:04:14.177450+0000","last_undegraded":"2023-11-24T08:04:14.177450+0000","last_fullsized":"2023-11-24T08:04:14.177450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876124+0000","last_change":"2023-11-24T08:04:11.764690+0000","last_active":"2023-11-24T08:04:13.876124+0000","last_peered":"2023-11-24T08:04:13.876124+0000","last_clean":"2023-11-24T08:04:13.876124+0000","last_became_active":"2023-11-24T08:04:11.764316+0000","last_became_peered":"2023-11-24T08:04:11.764316+0000","last_unstale":"2023-11-24T08:04:13.876124+0000","last_undegraded":"2023-11-24T08:04:13.876124+0000","last_fullsized":"2023-11-24T08:04:13.876124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177790+0000","last_change":"2023-11-24T08:04:12.771927+0000","last_active":"2023-11-24T08:04:14.177790+0000","last_peered":"2023-11-24T08:04:14.177790+0000","last_clean":"2023-11-24T08:04:14.177790+0000","last_became_active":"2023-11-24T08:04:12.770523+0000","last_became_peered":"2023-11-24T08:04:12.770523+0000","last_unstale":"2023-11-24T08:04:14.177790+0000","last_undegraded":"2023-11-24T08:04:14.177790+0000","last_fullsized":"2023-11-24T08:04:14.177790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:53:11.480855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273404+0000","last_change":"2023-11-24T08:04:11.764289+0000","last_active":"2023-11-24T08:04:14.273404+0000","last_peered":"2023-11-24T08:04:14.273404+0000","last_clean":"2023-11-24T08:04:14.273404+0000","last_became_active":"2023-11-24T08:04:11.763993+0000","last_became_peered":"2023-11-24T08:04:11.763993+0000","last_unstale":"2023-11-24T08:04:14.273404+0000","last_undegraded":"2023-11-24T08:04:14.273404+0000","last_fullsized":"2023-11-24T08:04:14.273404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:05.082044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768270+0000","last_change":"2023-11-24T08:04:12.759447+0000","last_active":"2023-11-24T08:04:13.768270+0000","last_peered":"2023-11-24T08:04:13.768270+0000","last_clean":"2023-11-24T08:04:13.768270+0000","last_became_active":"2023-11-24T08:04:12.759147+0000","last_became_peered":"2023-11-24T08:04:12.759147+0000","last_unstale":"2023-11-24T08:04:13.768270+0000","last_undegraded":"2023-11-24T08:04:13.768270+0000","last_fullsized":"2023-11-24T08:04:13.768270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:03:32.465127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366918+0000","last_change":"2023-11-24T08:04:11.768035+0000","last_active":"2023-11-24T08:04:14.366918+0000","last_peered":"2023-11-24T08:04:14.366918+0000","last_clean":"2023-11-24T08:04:14.366918+0000","last_became_active":"2023-11-24T08:04:11.767674+0000","last_became_peered":"2023-11-24T08:04:11.767674+0000","last_unstale":"2023-11-24T08:04:14.366918+0000","last_undegraded":"2023-11-24T08:04:14.366918+0000","last_fullsized":"2023-11-24T08:04:14.366918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366939+0000","last_change":"2023-11-24T08:04:12.755036+0000","last_active":"2023-11-24T08:04:14.366939+0000","last_peered":"2023-11-24T08:04:14.366939+0000","last_clean":"2023-11-24T08:04:14.366939+0000","last_became_active":"2023-11-24T08:04:12.754766+0000","last_became_peered":"2023-11-24T08:04:12.754766+0000","last_unstale":"2023-11-24T08:04:14.366939+0000","last_undegraded":"2023-11-24T08:04:14.366939+0000","last_fullsized":"2023-11-24T08:04:14.366939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273015+0000","last_change":"2023-11-24T08:04:11.764114+0000","last_active":"2023-11-24T08:04:14.273015+0000","last_peered":"2023-11-24T08:04:14.273015+0000","last_clean":"2023-11-24T08:04:14.273015+0000","last_became_active":"2023-11-24T08:04:11.763825+0000","last_became_peered":"2023-11-24T08:04:11.763825+0000","last_unstale":"2023-11-24T08:04:14.273015+0000","last_undegraded":"2023-11-24T08:04:14.273015+0000","last_fullsized":"2023-11-24T08:04:14.273015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273198+0000","last_change":"2023-11-24T08:04:12.756326+0000","last_active":"2023-11-24T08:04:14.273198+0000","last_peered":"2023-11-24T08:04:14.273198+0000","last_clean":"2023-11-24T08:04:14.273198+0000","last_became_active":"2023-11-24T08:04:12.755997+0000","last_became_peered":"2023-11-24T08:04:12.755997+0000","last_unstale":"2023-11-24T08:04:14.273198+0000","last_undegraded":"2023-11-24T08:04:14.273198+0000","last_fullsized":"2023-11-24T08:04:14.273198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177300+0000","last_change":"2023-11-24T08:04:11.767935+0000","last_active":"2023-11-24T08:04:14.177300+0000","last_peered":"2023-11-24T08:04:14.177300+0000","last_clean":"2023-11-24T08:04:14.177300+0000","last_became_active":"2023-11-24T08:04:11.767619+0000","last_became_peered":"2023-11-24T08:04:11.767619+0000","last_unstale":"2023-11-24T08:04:14.177300+0000","last_undegraded":"2023-11-24T08:04:14.177300+0000","last_fullsized":"2023-11-24T08:04:14.177300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:54.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765652+0000","last_change":"2023-11-24T08:04:12.760472+0000","last_active":"2023-11-24T08:04:13.765652+0000","last_peered":"2023-11-24T08:04:13.765652+0000","last_clean":"2023-11-24T08:04:13.765652+0000","last_became_active":"2023-11-24T08:04:12.759672+0000","last_became_peered":"2023-11-24T08:04:12.759672+0000","last_unstale":"2023-11-24T08:04:13.765652+0000","last_undegraded":"2023-11-24T08:04:13.765652+0000","last_fullsized":"2023-11-24T08:04:13.765652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367355+0000","last_change":"2023-11-24T08:04:11.763764+0000","last_active":"2023-11-24T08:04:14.367355+0000","last_peered":"2023-11-24T08:04:14.367355+0000","last_clean":"2023-11-24T08:04:14.367355+0000","last_became_active":"2023-11-24T08:04:11.763483+0000","last_became_peered":"2023-11-24T08:04:11.763483+0000","last_unstale":"2023-11-24T08:04:14.367355+0000","last_undegraded":"2023-11-24T08:04:14.367355+0000","last_fullsized":"2023-11-24T08:04:14.367355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177975+0000","last_change":"2023-11-24T08:04:12.761020+0000","last_active":"2023-11-24T08:04:14.177975+0000","last_peered":"2023-11-24T08:04:14.177975+0000","last_clean":"2023-11-24T08:04:14.177975+0000","last_became_active":"2023-11-24T08:04:12.760701+0000","last_became_peered":"2023-11-24T08:04:12.760701+0000","last_unstale":"2023-11-24T08:04:14.177975+0000","last_undegraded":"2023-11-24T08:04:14.177975+0000","last_fullsized":"2023-11-24T08:04:14.177975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:58:32.049664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177726+0000","last_change":"2023-11-24T08:04:11.762776+0000","last_active":"2023-11-24T08:04:14.177726+0000","last_peered":"2023-11-24T08:04:14.177726+0000","last_clean":"2023-11-24T08:04:14.177726+0000","last_became_active":"2023-11-24T08:04:11.762480+0000","last_became_peered":"2023-11-24T08:04:11.762480+0000","last_unstale":"2023-11-24T08:04:14.177726+0000","last_undegraded":"2023-11-24T08:04:14.177726+0000","last_fullsized":"2023-11-24T08:04:14.177726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366882+0000","last_change":"2023-11-24T08:04:12.766040+0000","last_active":"2023-11-24T08:04:14.366882+0000","last_peered":"2023-11-24T08:04:14.366882+0000","last_clean":"2023-11-24T08:04:14.366882+0000","last_became_active":"2023-11-24T08:04:12.765772+0000","last_became_peered":"2023-11-24T08:04:12.765772+0000","last_unstale":"2023-11-24T08:04:14.366882+0000","last_undegraded":"2023-11-24T08:04:14.366882+0000","last_fullsized":"2023-11-24T08:04:14.366882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:43.569736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765732+0000","last_change":"2023-11-24T08:04:11.765479+0000","last_active":"2023-11-24T08:04:13.765732+0000","last_peered":"2023-11-24T08:04:13.765732+0000","last_clean":"2023-11-24T08:04:13.765732+0000","last_became_active":"2023-11-24T08:04:11.765216+0000","last_became_peered":"2023-11-24T08:04:11.765216+0000","last_unstale":"2023-11-24T08:04:13.765732+0000","last_undegraded":"2023-11-24T08:04:13.765732+0000","last_fullsized":"2023-11-24T08:04:13.765732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768676+0000","last_change":"2023-11-24T08:04:12.755487+0000","last_active":"2023-11-24T08:04:13.768676+0000","last_peered":"2023-11-24T08:04:13.768676+0000","last_clean":"2023-11-24T08:04:13.768676+0000","last_became_active":"2023-11-24T08:04:12.755113+0000","last_became_peered":"2023-11-24T08:04:12.755113+0000","last_unstale":"2023-11-24T08:04:13.768676+0000","last_undegraded":"2023-11-24T08:04:13.768676+0000","last_fullsized":"2023-11-24T08:04:13.768676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:58.916630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367128+0000","last_change":"2023-11-24T08:04:11.765679+0000","last_active":"2023-11-24T08:04:14.367128+0000","last_peered":"2023-11-24T08:04:14.367128+0000","last_clean":"2023-11-24T08:04:14.367128+0000","last_became_active":"2023-11-24T08:04:11.764903+0000","last_became_peered":"2023-11-24T08:04:11.764903+0000","last_unstale":"2023-11-24T08:04:14.367128+0000","last_undegraded":"2023-11-24T08:04:14.367128+0000","last_fullsized":"2023-11-24T08:04:14.367128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:46.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876321+0000","last_change":"2023-11-24T08:04:12.761708+0000","last_active":"2023-11-24T08:04:13.876321+0000","last_peered":"2023-11-24T08:04:13.876321+0000","last_clean":"2023-11-24T08:04:13.876321+0000","last_became_active":"2023-11-24T08:04:12.761352+0000","last_became_peered":"2023-11-24T08:04:12.761352+0000","last_unstale":"2023-11-24T08:04:13.876321+0000","last_undegraded":"2023-11-24T08:04:13.876321+0000","last_fullsized":"2023-11-24T08:04:13.876321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:03.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366917+0000","last_change":"2023-11-24T08:04:11.761027+0000","last_active":"2023-11-24T08:04:14.366917+0000","last_peered":"2023-11-24T08:04:14.366917+0000","last_clean":"2023-11-24T08:04:14.366917+0000","last_became_active":"2023-11-24T08:04:11.759840+0000","last_became_peered":"2023-11-24T08:04:11.759840+0000","last_unstale":"2023-11-24T08:04:14.366917+0000","last_undegraded":"2023-11-24T08:04:14.366917+0000","last_fullsized":"2023-11-24T08:04:14.366917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366442+0000","last_change":"2023-11-24T08:04:12.761170+0000","last_active":"2023-11-24T08:04:14.366442+0000","last_peered":"2023-11-24T08:04:14.366442+0000","last_clean":"2023-11-24T08:04:14.366442+0000","last_became_active":"2023-11-24T08:04:12.760886+0000","last_became_peered":"2023-11-24T08:04:12.760886+0000","last_unstale":"2023-11-24T08:04:14.366442+0000","last_undegraded":"2023-11-24T08:04:14.366442+0000","last_fullsized":"2023-11-24T08:04:14.366442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:09.942884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177767+0000","last_change":"2023-11-24T08:04:11.764401+0000","last_active":"2023-11-24T08:04:14.177767+0000","last_peered":"2023-11-24T08:04:14.177767+0000","last_clean":"2023-11-24T08:04:14.177767+0000","last_became_active":"2023-11-24T08:04:11.764134+0000","last_became_peered":"2023-11-24T08:04:11.764134+0000","last_unstale":"2023-11-24T08:04:14.177767+0000","last_undegraded":"2023-11-24T08:04:14.177767+0000","last_fullsized":"2023-11-24T08:04:14.177767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:20.626156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876305+0000","last_change":"2023-11-24T08:04:12.768388+0000","last_active":"2023-11-24T08:04:13.876305+0000","last_peered":"2023-11-24T08:04:13.876305+0000","last_clean":"2023-11-24T08:04:13.876305+0000","last_became_active":"2023-11-24T08:04:12.768067+0000","last_became_peered":"2023-11-24T08:04:12.768067+0000","last_unstale":"2023-11-24T08:04:13.876305+0000","last_undegraded":"2023-11-24T08:04:13.876305+0000","last_fullsized":"2023-11-24T08:04:13.876305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366915+0000","last_change":"2023-11-24T08:04:11.755395+0000","last_active":"2023-11-24T08:04:14.366915+0000","last_peered":"2023-11-24T08:04:14.366915+0000","last_clean":"2023-11-24T08:04:14.366915+0000","last_became_active":"2023-11-24T08:04:11.755135+0000","last_became_peered":"2023-11-24T08:04:11.755135+0000","last_unstale":"2023-11-24T08:04:14.366915+0000","last_undegraded":"2023-11-24T08:04:14.366915+0000","last_fullsized":"2023-11-24T08:04:14.366915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366928+0000","last_change":"2023-11-24T08:04:12.756222+0000","last_active":"2023-11-24T08:04:14.366928+0000","last_peered":"2023-11-24T08:04:14.366928+0000","last_clean":"2023-11-24T08:04:14.366928+0000","last_became_active":"2023-11-24T08:04:12.755930+0000","last_became_peered":"2023-11-24T08:04:12.755930+0000","last_unstale":"2023-11-24T08:04:14.366928+0000","last_undegraded":"2023-11-24T08:04:14.366928+0000","last_fullsized":"2023-11-24T08:04:14.366928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:20.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366287+0000","last_change":"2023-11-24T08:04:11.760945+0000","last_active":"2023-11-24T08:04:14.366287+0000","last_peered":"2023-11-24T08:04:14.366287+0000","last_clean":"2023-11-24T08:04:14.366287+0000","last_became_active":"2023-11-24T08:04:11.760661+0000","last_became_peered":"2023-11-24T08:04:11.760661+0000","last_unstale":"2023-11-24T08:04:14.366287+0000","last_undegraded":"2023-11-24T08:04:14.366287+0000","last_fullsized":"2023-11-24T08:04:14.366287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876042+0000","last_change":"2023-11-24T08:04:12.762670+0000","last_active":"2023-11-24T08:04:13.876042+0000","last_peered":"2023-11-24T08:04:13.876042+0000","last_clean":"2023-11-24T08:04:13.876042+0000","last_became_active":"2023-11-24T08:04:12.762385+0000","last_became_peered":"2023-11-24T08:04:12.762385+0000","last_unstale":"2023-11-24T08:04:13.876042+0000","last_undegraded":"2023-11-24T08:04:13.876042+0000","last_fullsized":"2023-11-24T08:04:13.876042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768772+0000","last_change":"2023-11-24T08:04:11.765361+0000","last_active":"2023-11-24T08:04:13.768772+0000","last_peered":"2023-11-24T08:04:13.768772+0000","last_clean":"2023-11-24T08:04:13.768772+0000","last_became_active":"2023-11-24T08:04:11.760138+0000","last_became_peered":"2023-11-24T08:04:11.760138+0000","last_unstale":"2023-11-24T08:04:13.768772+0000","last_undegraded":"2023-11-24T08:04:13.768772+0000","last_fullsized":"2023-11-24T08:04:13.768772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:59:09.945020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876616+0000","last_change":"2023-11-24T08:04:12.770971+0000","last_active":"2023-11-24T08:04:13.876616+0000","last_peered":"2023-11-24T08:04:13.876616+0000","last_clean":"2023-11-24T08:04:13.876616+0000","last_became_active":"2023-11-24T08:04:12.768881+0000","last_became_peered":"2023-11-24T08:04:12.768881+0000","last_unstale":"2023-11-24T08:04:13.876616+0000","last_undegraded":"2023-11-24T08:04:13.876616+0000","last_fullsized":"2023-11-24T08:04:13.876616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:58:32.049664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765677+0000","last_change":"2023-11-24T08:04:11.758492+0000","last_active":"2023-11-24T08:04:13.765677+0000","last_peered":"2023-11-24T08:04:13.765677+0000","last_clean":"2023-11-24T08:04:13.765677+0000","last_became_active":"2023-11-24T08:04:11.758227+0000","last_became_peered":"2023-11-24T08:04:11.758227+0000","last_unstale":"2023-11-24T08:04:13.765677+0000","last_undegraded":"2023-11-24T08:04:13.765677+0000","last_fullsized":"2023-11-24T08:04:13.765677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:19.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177844+0000","last_change":"2023-11-24T08:04:12.762628+0000","last_active":"2023-11-24T08:04:14.177844+0000","last_peered":"2023-11-24T08:04:14.177844+0000","last_clean":"2023-11-24T08:04:14.177844+0000","last_became_active":"2023-11-24T08:04:12.762342+0000","last_became_peered":"2023-11-24T08:04:12.762342+0000","last_unstale":"2023-11-24T08:04:14.177844+0000","last_undegraded":"2023-11-24T08:04:14.177844+0000","last_fullsized":"2023-11-24T08:04:14.177844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:02.788396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177560+0000","last_change":"2023-11-24T08:04:11.763677+0000","last_active":"2023-11-24T08:04:14.177560+0000","last_peered":"2023-11-24T08:04:14.177560+0000","last_clean":"2023-11-24T08:04:14.177560+0000","last_became_active":"2023-11-24T08:04:11.763410+0000","last_became_peered":"2023-11-24T08:04:11.763410+0000","last_unstale":"2023-11-24T08:04:14.177560+0000","last_undegraded":"2023-11-24T08:04:14.177560+0000","last_fullsized":"2023-11-24T08:04:14.177560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:06.394632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768313+0000","last_change":"2023-11-24T08:04:12.758637+0000","last_active":"2023-11-24T08:04:13.768313+0000","last_peered":"2023-11-24T08:04:13.768313+0000","last_clean":"2023-11-24T08:04:13.768313+0000","last_became_active":"2023-11-24T08:04:12.758149+0000","last_became_peered":"2023-11-24T08:04:12.758149+0000","last_unstale":"2023-11-24T08:04:13.768313+0000","last_undegraded":"2023-11-24T08:04:13.768313+0000","last_fullsized":"2023-11-24T08:04:13.768313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:23.086508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765399+0000","last_change":"2023-11-24T08:04:12.762936+0000","last_active":"2023-11-24T08:04:13.765399+0000","last_peered":"2023-11-24T08:04:13.765399+0000","last_clean":"2023-11-24T08:04:13.765399+0000","last_became_active":"2023-11-24T08:04:12.758492+0000","last_became_peered":"2023-11-24T08:04:12.758492+0000","last_unstale":"2023-11-24T08:04:13.765399+0000","last_undegraded":"2023-11-24T08:04:13.765399+0000","last_fullsized":"2023-11-24T08:04:13.765399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:55.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366780+0000","last_change":"2023-11-24T08:04:11.764139+0000","last_active":"2023-11-24T08:04:14.366780+0000","last_peered":"2023-11-24T08:04:14.366780+0000","last_clean":"2023-11-24T08:04:14.366780+0000","last_became_active":"2023-11-24T08:04:11.763864+0000","last_became_peered":"2023-11-24T08:04:11.763864+0000","last_unstale":"2023-11-24T08:04:14.366780+0000","last_undegraded":"2023-11-24T08:04:14.366780+0000","last_fullsized":"2023-11-24T08:04:14.366780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:22.082092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273173+0000","last_change":"2023-11-24T08:04:12.774072+0000","last_active":"2023-11-24T08:04:14.273173+0000","last_peered":"2023-11-24T08:04:14.273173+0000","last_clean":"2023-11-24T08:04:14.273173+0000","last_became_active":"2023-11-24T08:04:12.773801+0000","last_became_peered":"2023-11-24T08:04:12.773801+0000","last_unstale":"2023-11-24T08:04:14.273173+0000","last_undegraded":"2023-11-24T08:04:14.273173+0000","last_fullsized":"2023-11-24T08:04:14.273173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:30.408915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177347+0000","last_change":"2023-11-24T08:04:11.762293+0000","last_active":"2023-11-24T08:04:14.177347+0000","last_peered":"2023-11-24T08:04:14.177347+0000","last_clean":"2023-11-24T08:04:14.177347+0000","last_became_active":"2023-11-24T08:04:11.762010+0000","last_became_peered":"2023-11-24T08:04:11.762010+0000","last_unstale":"2023-11-24T08:04:14.177347+0000","last_undegraded":"2023-11-24T08:04:14.177347+0000","last_fullsized":"2023-11-24T08:04:14.177347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:14.105245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T08:04:12.749389+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:04:12.749389+0000","last_peered":"2023-11-24T08:04:12.749389+0000","last_clean":"2023-11-24T08:04:12.749389+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:04:12.749389+0000","last_undegraded":"2023-11-24T08:04:12.749389+0000","last_fullsized":"2023-11-24T08:04:12.749389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366595+0000","last_change":"2023-11-24T08:04:12.755042+0000","last_active":"2023-11-24T08:04:14.366595+0000","last_peered":"2023-11-24T08:04:14.366595+0000","last_clean":"2023-11-24T08:04:14.366595+0000","last_became_active":"2023-11-24T08:04:12.754746+0000","last_became_peered":"2023-11-24T08:04:12.754746+0000","last_unstale":"2023-11-24T08:04:14.366595+0000","last_undegraded":"2023-11-24T08:04:14.366595+0000","last_fullsized":"2023-11-24T08:04:14.366595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:15.109662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.875943+0000","last_change":"2023-11-24T08:04:11.760961+0000","last_active":"2023-11-24T08:04:13.875943+0000","last_peered":"2023-11-24T08:04:13.875943+0000","last_clean":"2023-11-24T08:04:13.875943+0000","last_became_active":"2023-11-24T08:04:11.760601+0000","last_became_peered":"2023-11-24T08:04:11.760601+0000","last_unstale":"2023-11-24T08:04:13.875943+0000","last_undegraded":"2023-11-24T08:04:13.875943+0000","last_fullsized":"2023-11-24T08:04:13.875943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:29:57.970984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876405+0000","last_change":"2023-11-24T08:04:11.755227+0000","last_active":"2023-11-24T08:04:13.876405+0000","last_peered":"2023-11-24T08:04:13.876405+0000","last_clean":"2023-11-24T08:04:13.876405+0000","last_became_active":"2023-11-24T08:04:11.754941+0000","last_became_peered":"2023-11-24T08:04:11.754941+0000","last_unstale":"2023-11-24T08:04:13.876405+0000","last_undegraded":"2023-11-24T08:04:13.876405+0000","last_fullsized":"2023-11-24T08:04:13.876405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:42.565319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765594+0000","last_change":"2023-11-24T08:04:12.758793+0000","last_active":"2023-11-24T08:04:13.765594+0000","last_peered":"2023-11-24T08:04:13.765594+0000","last_clean":"2023-11-24T08:04:13.765594+0000","last_became_active":"2023-11-24T08:04:12.758047+0000","last_became_peered":"2023-11-24T08:04:12.758047+0000","last_unstale":"2023-11-24T08:04:13.765594+0000","last_undegraded":"2023-11-24T08:04:13.765594+0000","last_fullsized":"2023-11-24T08:04:13.765594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:15.134374+0000","last_change":"2023-11-24T08:04:11.762149+0000","last_active":"2023-11-24T08:04:15.134374+0000","last_peered":"2023-11-24T08:04:15.134374+0000","last_clean":"2023-11-24T08:04:15.134374+0000","last_became_active":"2023-11-24T08:04:11.761849+0000","last_became_peered":"2023-11-24T08:04:11.761849+0000","last_unstale":"2023-11-24T08:04:15.134374+0000","last_undegraded":"2023-11-24T08:04:15.134374+0000","last_fullsized":"2023-11-24T08:04:15.134374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:06:53.037516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273373+0000","last_change":"2023-11-24T08:04:12.762149+0000","last_active":"2023-11-24T08:04:14.273373+0000","last_peered":"2023-11-24T08:04:14.273373+0000","last_clean":"2023-11-24T08:04:14.273373+0000","last_became_active":"2023-11-24T08:04:12.761859+0000","last_became_peered":"2023-11-24T08:04:12.761859+0000","last_unstale":"2023-11-24T08:04:14.273373+0000","last_undegraded":"2023-11-24T08:04:14.273373+0000","last_fullsized":"2023-11-24T08:04:14.273373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367333+0000","last_change":"2023-11-24T08:04:11.763616+0000","last_active":"2023-11-24T08:04:14.367333+0000","last_peered":"2023-11-24T08:04:14.367333+0000","last_clean":"2023-11-24T08:04:14.367333+0000","last_became_active":"2023-11-24T08:04:11.763330+0000","last_became_peered":"2023-11-24T08:04:11.763330+0000","last_unstale":"2023-11-24T08:04:14.367333+0000","last_undegraded":"2023-11-24T08:04:14.367333+0000","last_fullsized":"2023-11-24T08:04:14.367333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:52:58.082140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366794+0000","last_change":"2023-11-24T08:04:12.754815+0000","last_active":"2023-11-24T08:04:14.366794+0000","last_peered":"2023-11-24T08:04:14.366794+0000","last_clean":"2023-11-24T08:04:14.366794+0000","last_became_active":"2023-11-24T08:04:12.754517+0000","last_became_peered":"2023-11-24T08:04:12.754517+0000","last_unstale":"2023-11-24T08:04:14.366794+0000","last_undegraded":"2023-11-24T08:04:14.366794+0000","last_fullsized":"2023-11-24T08:04:14.366794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.875829+0000","last_change":"2023-11-24T08:04:11.759058+0000","last_active":"2023-11-24T08:04:13.875829+0000","last_peered":"2023-11-24T08:04:13.875829+0000","last_clean":"2023-11-24T08:04:13.875829+0000","last_became_active":"2023-11-24T08:04:11.758773+0000","last_became_peered":"2023-11-24T08:04:11.758773+0000","last_unstale":"2023-11-24T08:04:13.875829+0000","last_undegraded":"2023-11-24T08:04:13.875829+0000","last_fullsized":"2023-11-24T08:04:13.875829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:22.082092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.768472+0000","last_change":"2023-11-24T08:04:12.759647+0000","last_active":"2023-11-24T08:04:13.768472+0000","last_peered":"2023-11-24T08:04:13.768472+0000","last_clean":"2023-11-24T08:04:13.768472+0000","last_became_active":"2023-11-24T08:04:12.758979+0000","last_became_peered":"2023-11-24T08:04:12.758979+0000","last_unstale":"2023-11-24T08:04:13.768472+0000","last_undegraded":"2023-11-24T08:04:13.768472+0000","last_fullsized":"2023-11-24T08:04:13.768472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:24.233200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765561+0000","last_change":"2023-11-24T08:04:11.752414+0000","last_active":"2023-11-24T08:04:13.765561+0000","last_peered":"2023-11-24T08:04:13.765561+0000","last_clean":"2023-11-24T08:04:13.765561+0000","last_became_active":"2023-11-24T08:04:11.752132+0000","last_became_peered":"2023-11-24T08:04:11.752132+0000","last_unstale":"2023-11-24T08:04:13.765561+0000","last_undegraded":"2023-11-24T08:04:13.765561+0000","last_fullsized":"2023-11-24T08:04:13.765561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:08.938467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273028+0000","last_change":"2023-11-24T08:04:12.760154+0000","last_active":"2023-11-24T08:04:14.273028+0000","last_peered":"2023-11-24T08:04:14.273028+0000","last_clean":"2023-11-24T08:04:14.273028+0000","last_became_active":"2023-11-24T08:04:12.759870+0000","last_became_peered":"2023-11-24T08:04:12.759870+0000","last_unstale":"2023-11-24T08:04:14.273028+0000","last_undegraded":"2023-11-24T08:04:14.273028+0000","last_fullsized":"2023-11-24T08:04:14.273028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765767+0000","last_change":"2023-11-24T08:04:11.763991+0000","last_active":"2023-11-24T08:04:13.765767+0000","last_peered":"2023-11-24T08:04:13.765767+0000","last_clean":"2023-11-24T08:04:13.765767+0000","last_became_active":"2023-11-24T08:04:11.763720+0000","last_became_peered":"2023-11-24T08:04:11.763720+0000","last_unstale":"2023-11-24T08:04:13.765767+0000","last_undegraded":"2023-11-24T08:04:13.765767+0000","last_fullsized":"2023-11-24T08:04:13.765767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:23.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273371+0000","last_change":"2023-11-24T08:04:12.759529+0000","last_active":"2023-11-24T08:04:14.273371+0000","last_peered":"2023-11-24T08:04:14.273371+0000","last_clean":"2023-11-24T08:04:14.273371+0000","last_became_active":"2023-11-24T08:04:12.758748+0000","last_became_peered":"2023-11-24T08:04:12.758748+0000","last_unstale":"2023-11-24T08:04:14.273371+0000","last_undegraded":"2023-11-24T08:04:14.273371+0000","last_fullsized":"2023-11-24T08:04:14.273371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876108+0000","last_change":"2023-11-24T08:04:11.760060+0000","last_active":"2023-11-24T08:04:13.876108+0000","last_peered":"2023-11-24T08:04:13.876108+0000","last_clean":"2023-11-24T08:04:13.876108+0000","last_became_active":"2023-11-24T08:04:11.759649+0000","last_became_peered":"2023-11-24T08:04:11.759649+0000","last_unstale":"2023-11-24T08:04:13.876108+0000","last_undegraded":"2023-11-24T08:04:13.876108+0000","last_fullsized":"2023-11-24T08:04:13.876108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367073+0000","last_change":"2023-11-24T08:04:12.754189+0000","last_active":"2023-11-24T08:04:14.367073+0000","last_peered":"2023-11-24T08:04:14.367073+0000","last_clean":"2023-11-24T08:04:14.367073+0000","last_became_active":"2023-11-24T08:04:12.753907+0000","last_became_peered":"2023-11-24T08:04:12.753907+0000","last_unstale":"2023-11-24T08:04:14.367073+0000","last_undegraded":"2023-11-24T08:04:14.367073+0000","last_fullsized":"2023-11-24T08:04:14.367073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:21:29.561716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366634+0000","last_change":"2023-11-24T08:04:11.762544+0000","last_active":"2023-11-24T08:04:14.366634+0000","last_peered":"2023-11-24T08:04:14.366634+0000","last_clean":"2023-11-24T08:04:14.366634+0000","last_became_active":"2023-11-24T08:04:11.762250+0000","last_became_peered":"2023-11-24T08:04:11.762250+0000","last_unstale":"2023-11-24T08:04:14.366634+0000","last_undegraded":"2023-11-24T08:04:14.366634+0000","last_fullsized":"2023-11-24T08:04:14.366634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:46.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876467+0000","last_change":"2023-11-24T08:04:12.765834+0000","last_active":"2023-11-24T08:04:13.876467+0000","last_peered":"2023-11-24T08:04:13.876467+0000","last_clean":"2023-11-24T08:04:13.876467+0000","last_became_active":"2023-11-24T08:04:12.765570+0000","last_became_peered":"2023-11-24T08:04:12.765570+0000","last_unstale":"2023-11-24T08:04:13.876467+0000","last_undegraded":"2023-11-24T08:04:13.876467+0000","last_fullsized":"2023-11-24T08:04:13.876467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:53:11.480855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765690+0000","last_change":"2023-11-24T08:04:11.755014+0000","last_active":"2023-11-24T08:04:13.765690+0000","last_peered":"2023-11-24T08:04:13.765690+0000","last_clean":"2023-11-24T08:04:13.765690+0000","last_became_active":"2023-11-24T08:04:11.754748+0000","last_became_peered":"2023-11-24T08:04:11.754748+0000","last_unstale":"2023-11-24T08:04:13.765690+0000","last_undegraded":"2023-11-24T08:04:13.765690+0000","last_fullsized":"2023-11-24T08:04:13.765690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:11.280804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177569+0000","last_change":"2023-11-24T08:04:12.771453+0000","last_active":"2023-11-24T08:04:14.177569+0000","last_peered":"2023-11-24T08:04:14.177569+0000","last_clean":"2023-11-24T08:04:14.177569+0000","last_became_active":"2023-11-24T08:04:12.770894+0000","last_became_peered":"2023-11-24T08:04:12.770894+0000","last_unstale":"2023-11-24T08:04:14.177569+0000","last_undegraded":"2023-11-24T08:04:14.177569+0000","last_fullsized":"2023-11-24T08:04:14.177569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:03.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366534+0000","last_change":"2023-11-24T08:04:11.764045+0000","last_active":"2023-11-24T08:04:14.366534+0000","last_peered":"2023-11-24T08:04:14.366534+0000","last_clean":"2023-11-24T08:04:14.366534+0000","last_became_active":"2023-11-24T08:04:11.763769+0000","last_became_peered":"2023-11-24T08:04:11.763769+0000","last_unstale":"2023-11-24T08:04:14.366534+0000","last_undegraded":"2023-11-24T08:04:14.366534+0000","last_fullsized":"2023-11-24T08:04:14.366534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:10.727134+0000","last_clean_scrub_stamp":"2023-11-24T08:04:10.727134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:57.912213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.876406+0000","last_change":"2023-11-24T08:04:12.769943+0000","last_active":"2023-11-24T08:04:13.876406+0000","last_peered":"2023-11-24T08:04:13.876406+0000","last_clean":"2023-11-24T08:04:13.876406+0000","last_became_active":"2023-11-24T08:04:12.768782+0000","last_became_peered":"2023-11-24T08:04:12.768782+0000","last_unstale":"2023-11-24T08:04:13.876406+0000","last_undegraded":"2023-11-24T08:04:13.876406+0000","last_fullsized":"2023-11-24T08:04:13.876406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:26.559888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366930+0000","last_change":"2023-11-24T08:04:12.756131+0000","last_active":"2023-11-24T08:04:14.366930+0000","last_peered":"2023-11-24T08:04:14.366930+0000","last_clean":"2023-11-24T08:04:14.366930+0000","last_became_active":"2023-11-24T08:04:12.755871+0000","last_became_peered":"2023-11-24T08:04:12.755871+0000","last_unstale":"2023-11-24T08:04:14.366930+0000","last_undegraded":"2023-11-24T08:04:14.366930+0000","last_fullsized":"2023-11-24T08:04:14.366930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:15.109662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366678+0000","last_change":"2023-11-24T08:04:12.763889+0000","last_active":"2023-11-24T08:04:14.366678+0000","last_peered":"2023-11-24T08:04:14.366678+0000","last_clean":"2023-11-24T08:04:14.366678+0000","last_became_active":"2023-11-24T08:04:12.763582+0000","last_became_peered":"2023-11-24T08:04:12.763582+0000","last_unstale":"2023-11-24T08:04:14.366678+0000","last_undegraded":"2023-11-24T08:04:14.366678+0000","last_fullsized":"2023-11-24T08:04:14.366678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:08:11.452166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177507+0000","last_change":"2023-11-24T08:04:12.773095+0000","last_active":"2023-11-24T08:04:14.177507+0000","last_peered":"2023-11-24T08:04:14.177507+0000","last_clean":"2023-11-24T08:04:14.177507+0000","last_became_active":"2023-11-24T08:04:12.772811+0000","last_became_peered":"2023-11-24T08:04:12.772811+0000","last_unstale":"2023-11-24T08:04:14.177507+0000","last_undegraded":"2023-11-24T08:04:14.177507+0000","last_fullsized":"2023-11-24T08:04:14.177507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:47.514948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366824+0000","last_change":"2023-11-24T08:04:12.760168+0000","last_active":"2023-11-24T08:04:14.366824+0000","last_peered":"2023-11-24T08:04:14.366824+0000","last_clean":"2023-11-24T08:04:14.366824+0000","last_became_active":"2023-11-24T08:04:12.759868+0000","last_became_peered":"2023-11-24T08:04:12.759868+0000","last_unstale":"2023-11-24T08:04:14.366824+0000","last_undegraded":"2023-11-24T08:04:14.366824+0000","last_fullsized":"2023-11-24T08:04:14.366824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:21.630572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273253+0000","last_change":"2023-11-24T08:04:12.756627+0000","last_active":"2023-11-24T08:04:14.273253+0000","last_peered":"2023-11-24T08:04:14.273253+0000","last_clean":"2023-11-24T08:04:14.273253+0000","last_became_active":"2023-11-24T08:04:12.756360+0000","last_became_peered":"2023-11-24T08:04:12.756360+0000","last_unstale":"2023-11-24T08:04:14.273253+0000","last_undegraded":"2023-11-24T08:04:14.273253+0000","last_fullsized":"2023-11-24T08:04:14.273253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:13.765638+0000","last_change":"2023-11-24T08:04:12.759234+0000","last_active":"2023-11-24T08:04:13.765638+0000","last_peered":"2023-11-24T08:04:13.765638+0000","last_clean":"2023-11-24T08:04:13.765638+0000","last_became_active":"2023-11-24T08:04:12.758458+0000","last_became_peered":"2023-11-24T08:04:12.758458+0000","last_unstale":"2023-11-24T08:04:13.765638+0000","last_undegraded":"2023-11-24T08:04:13.765638+0000","last_fullsized":"2023-11-24T08:04:13.765638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367321+0000","last_change":"2023-11-24T08:04:12.755695+0000","last_active":"2023-11-24T08:04:14.367321+0000","last_peered":"2023-11-24T08:04:14.367321+0000","last_clean":"2023-11-24T08:04:14.367321+0000","last_became_active":"2023-11-24T08:04:12.755415+0000","last_became_peered":"2023-11-24T08:04:12.755415+0000","last_unstale":"2023-11-24T08:04:14.367321+0000","last_undegraded":"2023-11-24T08:04:14.367321+0000","last_fullsized":"2023-11-24T08:04:14.367321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.273363+0000","last_change":"2023-11-24T08:04:12.761355+0000","last_active":"2023-11-24T08:04:14.273363+0000","last_peered":"2023-11-24T08:04:14.273363+0000","last_clean":"2023-11-24T08:04:14.273363+0000","last_became_active":"2023-11-24T08:04:12.761068+0000","last_became_peered":"2023-11-24T08:04:12.761068+0000","last_unstale":"2023-11-24T08:04:14.273363+0000","last_undegraded":"2023-11-24T08:04:14.273363+0000","last_fullsized":"2023-11-24T08:04:14.273363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.971795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177495+0000","last_change":"2023-11-24T08:04:12.764876+0000","last_active":"2023-11-24T08:04:14.177495+0000","last_peered":"2023-11-24T08:04:14.177495+0000","last_clean":"2023-11-24T08:04:14.177495+0000","last_became_active":"2023-11-24T08:04:12.764548+0000","last_became_peered":"2023-11-24T08:04:12.764548+0000","last_unstale":"2023-11-24T08:04:14.177495+0000","last_undegraded":"2023-11-24T08:04:14.177495+0000","last_fullsized":"2023-11-24T08:04:14.177495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:58.757161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.272974+0000","last_change":"2023-11-24T08:04:12.761400+0000","last_active":"2023-11-24T08:04:14.272974+0000","last_peered":"2023-11-24T08:04:14.272974+0000","last_clean":"2023-11-24T08:04:14.272974+0000","last_became_active":"2023-11-24T08:04:12.761102+0000","last_became_peered":"2023-11-24T08:04:12.761102+0000","last_unstale":"2023-11-24T08:04:14.272974+0000","last_undegraded":"2023-11-24T08:04:14.272974+0000","last_fullsized":"2023-11-24T08:04:14.272974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.177430+0000","last_change":"2023-11-24T08:04:12.773448+0000","last_active":"2023-11-24T08:04:14.177430+0000","last_peered":"2023-11-24T08:04:14.177430+0000","last_clean":"2023-11-24T08:04:14.177430+0000","last_became_active":"2023-11-24T08:04:12.773121+0000","last_became_peered":"2023-11-24T08:04:12.773121+0000","last_unstale":"2023-11-24T08:04:14.177430+0000","last_undegraded":"2023-11-24T08:04:14.177430+0000","last_fullsized":"2023-11-24T08:04:14.177430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:44.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.366803+0000","last_change":"2023-11-24T08:04:12.762494+0000","last_active":"2023-11-24T08:04:14.366803+0000","last_peered":"2023-11-24T08:04:14.366803+0000","last_clean":"2023-11-24T08:04:14.366803+0000","last_became_active":"2023-11-24T08:04:12.762095+0000","last_became_peered":"2023-11-24T08:04:12.762095+0000","last_unstale":"2023-11-24T08:04:14.366803+0000","last_undegraded":"2023-11-24T08:04:14.366803+0000","last_fullsized":"2023-11-24T08:04:14.366803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:07.399049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T08:04:14.367122+0000","last_change":"2023-11-24T08:04:12.754219+0000","last_active":"2023-11-24T08:04:14.367122+0000","last_peered":"2023-11-24T08:04:14.367122+0000","last_clean":"2023-11-24T08:04:14.367122+0000","last_became_active":"2023-11-24T08:04:12.753940+0000","last_became_peered":"2023-11-24T08:04:12.753940+0000","last_unstale":"2023-11-24T08:04:14.367122+0000","last_undegraded":"2023-11-24T08:04:14.367122+0000","last_fullsized":"2023-11-24T08:04:14.367122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:11.731551+0000","last_clean_scrub_stamp":"2023-11-24T08:04:11.731551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:33.963375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.089}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:04:21.907 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T08:04:21.907 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-24T08:04:21.907 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-24T08:04:21.907 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-24T08:04:22.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.060+0000 7f205fa86700 1 Processor -- start 2023-11-24T08:04:22.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.060+0000 7f205fa86700 1 -- start start 2023-11-24T08:04:22.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205fa86700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f205815e080 0x7f20580b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205fa86700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 0x7f20580afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205fa86700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20580ae430 con 0x7f20580af4d0 2023-11-24T08:04:22.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205fa86700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20580af0b0 con 0x7f205815e080 2023-11-24T08:04:22.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205fa86700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20580b05a0 con 0x7f205806c710 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205d822700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f205815e080 0x7f20580b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205d021700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f20580af4d0 0x7f205806c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41962/0 (socket says 172.21.15.153:41962) 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205d021700 1 -- 172.21.15.153:0/2558725250 learned_addr learned my addr 172.21.15.153:0/2558725250 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205e023700 1 --2- 172.21.15.153:0/2558725250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 0x7f20580afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205d822700 1 -- 172.21.15.153:0/2558725250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 msgr2=0x7f20580afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205d822700 1 --2- 172.21.15.153:0/2558725250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 0x7f20580afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205d822700 1 -- 172.21.15.153:0/2558725250 >> v1:172.21.15.153:6789/0 conn(0x7f20580af4d0 legacy=0x7f205806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205d822700 1 -- 172.21.15.153:0/2558725250 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20580ae710 con 0x7f205815e080 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205c820700 1 -- 172.21.15.153:0/2558725250 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009344990 0 0) 0x7f20580ae430 con 0x7f20580af4d0 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.061+0000 7f205e023700 1 --2- 172.21.15.153:0/2558725250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 0x7f20580afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205d822700 1 --2- 172.21.15.153:0/2558725250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205815e080 0x7f20580b5050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2048009870 tx=0x7f2048009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5b8493e74e6a4c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205c820700 1 -- 172.21.15.153:0/2558725250 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048011830 con 0x7f205815e080 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205c820700 1 -- 172.21.15.153:0/2558725250 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048011990 con 0x7f205815e080 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205c820700 1 -- 172.21.15.153:0/2558725250 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048011d20 con 0x7f205815e080 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205fa86700 1 -- 172.21.15.153:0/2558725250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205815e080 msgr2=0x7f20580b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205fa86700 1 --2- 172.21.15.153:0/2558725250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205815e080 0x7f20580b5050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2048009870 tx=0x7f2048009b80 comp rx=0 tx=0).stop 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205fa86700 1 -- 172.21.15.153:0/2558725250 shutdown_connections 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205fa86700 1 --2- 172.21.15.153:0/2558725250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 0x7f20580afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205fa86700 1 --2- 172.21.15.153:0/2558725250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205815e080 0x7f20580b5050 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205fa86700 1 -- 172.21.15.153:0/2558725250 >> 172.21.15.153:0/2558725250 conn(0x7f2058071b90 msgr2=0x7f2058071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205fa86700 1 -- 172.21.15.153:0/2558725250 shutdown_connections 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.062+0000 7f205fa86700 1 -- 172.21.15.153:0/2558725250 wait complete. 2023-11-24T08:04:22.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.064+0000 7f205fa86700 1 Processor -- start 2023-11-24T08:04:22.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.064+0000 7f205fa86700 1 -- start start 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.064+0000 7f205fa86700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 0x7f2058153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.064+0000 7f205fa86700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580af4d0 0x7f2058158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.064+0000 7f205fa86700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205815e080 0x7f205814e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.064+0000 7f205fa86700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2058160cc0 con 0x7f20580af4d0 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.064+0000 7f205fa86700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2058159210 con 0x7f205815e080 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.064+0000 7f205fa86700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2058160ea0 con 0x7f205806c710 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.064+0000 7f205d021700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580af4d0 0x7f2058158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205d021700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580af4d0 0x7f2058158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35864/0 (socket says 172.21.15.153:35864) 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205d021700 1 -- 172.21.15.153:0/3437556781 learned_addr learned my addr 172.21.15.153:0/3437556781 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205d822700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 0x7f2058153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205e023700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205815e080 0x7f205814e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205d021700 1 -- 172.21.15.153:0/3437556781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 msgr2=0x7f2058153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205d021700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 0x7f2058153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205d021700 1 -- 172.21.15.153:0/3437556781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205815e080 msgr2=0x7f205814e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205d021700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205815e080 0x7f205814e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205d021700 1 -- 172.21.15.153:0/3437556781 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480094a0 con 0x7f20580af4d0 2023-11-24T08:04:22.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205d822700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 0x7f2058153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:22.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205d021700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580af4d0 0x7f2058158cd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f205400c540 tx=0x7f205400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f204e7fc700 1 -- 172.21.15.153:0/3437556781 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2054004c80 con 0x7f20580af4d0 2023-11-24T08:04:22.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f204e7fc700 1 -- 172.21.15.153:0/3437556781 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2054004de0 con 0x7f20580af4d0 2023-11-24T08:04:22.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205fa86700 1 -- 172.21.15.153:0/3437556781 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2058161180 con 0x7f20580af4d0 2023-11-24T08:04:22.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f204e7fc700 1 -- 172.21.15.153:0/3437556781 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2054007310 con 0x7f20580af4d0 2023-11-24T08:04:22.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.065+0000 7f205fa86700 1 -- 172.21.15.153:0/3437556781 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205815e740 con 0x7f20580af4d0 2023-11-24T08:04:22.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.066+0000 7f205fa86700 1 -- 172.21.15.153:0/3437556781 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20580753f0 con 0x7f20580af4d0 2023-11-24T08:04:22.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.066+0000 7f204e7fc700 1 -- 172.21.15.153:0/3437556781 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2054007470 con 0x7f20580af4d0 2023-11-24T08:04:22.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.067+0000 7f204e7fc700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203c06aed0 0x7f203c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.067+0000 7f204e7fc700 1 -- 172.21.15.153:0/3437556781 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20540893d0 con 0x7f20580af4d0 2023-11-24T08:04:22.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.067+0000 7f205d822700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203c06aed0 0x7f203c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.067+0000 7f205d822700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203c06aed0 0x7f203c06d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f20580b22e0 tx=0x7f2048008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.071+0000 7f204e7fc700 1 -- 172.21.15.153:0/3437556781 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2054054480 con 0x7f20580af4d0 2023-11-24T08:04:22.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.305+0000 7f205fa86700 1 -- 172.21.15.153:0/3437556781 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2058067f60 con 0x7f20580af4d0 2023-11-24T08:04:22.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.306+0000 7f204e7fc700 1 -- 172.21.15.153:0/3437556781 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2054057aa0 con 0x7f20580af4d0 2023-11-24T08:04:22.308 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:22.308 INFO:teuthology.orchestra.run.smithi153.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-24T08:04:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 -- 172.21.15.153:0/3437556781 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203c06aed0 msgr2=0x7f203c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203c06aed0 0x7f203c06d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f20580b22e0 tx=0x7f2048008030 comp rx=0 tx=0).stop 2023-11-24T08:04:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 -- 172.21.15.153:0/3437556781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580af4d0 msgr2=0x7f2058158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580af4d0 0x7f2058158cd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f205400c540 tx=0x7f205400c900 comp rx=0 tx=0).stop 2023-11-24T08:04:22.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 -- 172.21.15.153:0/3437556781 shutdown_connections 2023-11-24T08:04:22.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205815e080 0x7f205814e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f205806c710 0x7f2058153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203c06aed0 0x7f203c06d390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 --2- 172.21.15.153:0/3437556781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580af4d0 0x7f2058158cd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 -- 172.21.15.153:0/3437556781 >> 172.21.15.153:0/3437556781 conn(0x7f2058071b90 msgr2=0x7f205806e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 -- 172.21.15.153:0/3437556781 shutdown_connections 2023-11-24T08:04:22.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.308+0000 7f205fa86700 1 -- 172.21.15.153:0/3437556781 wait complete. 2023-11-24T08:04:22.322 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-24T08:04:22.322 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:22.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.441+0000 7f9331534700 1 Processor -- start 2023-11-24T08:04:22.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.441+0000 7f9331534700 1 -- start start 2023-11-24T08:04:22.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.441+0000 7f9331534700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f932c0cff10 0x7f932c165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.441+0000 7f9331534700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932c0b4290 con 0x7f932c15f180 2023-11-24T08:04:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.441+0000 7f9331534700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932c0d0380 con 0x7f932c13e000 2023-11-24T08:04:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.441+0000 7f9331534700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c13e570 con 0x7f932c0cff10 2023-11-24T08:04:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.442+0000 7f932b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f932c0cff10 0x7f932c165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.442+0000 7f932a7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f932c15f180 0x7f932c0cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41976/0 (socket says 172.21.15.153:41976) 2023-11-24T08:04:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.442+0000 7f932b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f932c0cff10 0x7f932c165bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35874/0 (socket says 172.21.15.153:35874) 2023-11-24T08:04:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.442+0000 7f932a7fc700 1 -- 172.21.15.153:0/2951670251 learned_addr learned my addr 172.21.15.153:0/2951670251 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:22.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.442+0000 7f932b7fe700 1 -- 172.21.15.153:0/2951670251 >> v1:172.21.15.164:6789/0 conn(0x7f932c13e000 legacy=0x7f932c15ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:22.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.442+0000 7f932b7fe700 1 -- 172.21.15.153:0/2951670251 >> v1:172.21.15.153:6789/0 conn(0x7f932c15f180 legacy=0x7f932c0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.442+0000 7f932b7fe700 1 -- 172.21.15.153:0/2951670251 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c0d05d0 con 0x7f932c0cff10 2023-11-24T08:04:22.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.442+0000 7f932b7fe700 1 --2- 172.21.15.153:0/2951670251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f932c0cff10 0x7f932c165bb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9324009d90 tx=0x7f932400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b36e58ef55c489 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.442+0000 7f9329ffb700 1 -- 172.21.15.153:0/2951670251 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932400e070 con 0x7f932c0cff10 2023-11-24T08:04:22.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.442+0000 7f9329ffb700 1 -- 172.21.15.153:0/2951670251 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932400bb90 con 0x7f932c0cff10 2023-11-24T08:04:22.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.442+0000 7f9329ffb700 1 -- 172.21.15.153:0/2951670251 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324003a20 con 0x7f932c0cff10 2023-11-24T08:04:22.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.443+0000 7f9331534700 1 -- 172.21.15.153:0/2951670251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f932c0cff10 msgr2=0x7f932c165bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.443+0000 7f9331534700 1 --2- 172.21.15.153:0/2951670251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f932c0cff10 0x7f932c165bb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9324009d90 tx=0x7f932400b330 comp rx=0 tx=0).stop 2023-11-24T08:04:22.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.443+0000 7f9331534700 1 -- 172.21.15.153:0/2951670251 shutdown_connections 2023-11-24T08:04:22.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.443+0000 7f9331534700 1 --2- 172.21.15.153:0/2951670251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f932c0cff10 0x7f932c165bb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.443+0000 7f9331534700 1 -- 172.21.15.153:0/2951670251 >> 172.21.15.153:0/2951670251 conn(0x7f932c072990 msgr2=0x7f932c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.443+0000 7f9331534700 1 -- 172.21.15.153:0/2951670251 shutdown_connections 2023-11-24T08:04:22.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.443+0000 7f9331534700 1 -- 172.21.15.153:0/2951670251 wait complete. 2023-11-24T08:04:22.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.444+0000 7f9331534700 1 Processor -- start 2023-11-24T08:04:22.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.444+0000 7f9331534700 1 -- start start 2023-11-24T08:04:22.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f9331534700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f932c0cff10 0x7f932c1333a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f9331534700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f932c13e000 0x7f932c1f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f9331534700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f932c15f180 0x7f932c1424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f9331534700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c1338e0 con 0x7f932c15f180 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f9331534700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c13ea80 con 0x7f932c0cff10 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f9331534700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c13ed60 con 0x7f932c13e000 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f932c15f180 0x7f932c1424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f932c15f180 0x7f932c1424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35880/0 (socket says 172.21.15.153:35880) 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932b7fe700 1 -- 172.21.15.153:0/4290518376 learned_addr learned my addr 172.21.15.153:0/4290518376 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932affd700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f932c0cff10 0x7f932c1333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932a7fc700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f932c13e000 0x7f932c1f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932b7fe700 1 -- 172.21.15.153:0/4290518376 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f932c13e000 msgr2=0x7f932c1f0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932b7fe700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f932c13e000 0x7f932c1f0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932b7fe700 1 -- 172.21.15.153:0/4290518376 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f932c0cff10 msgr2=0x7f932c1333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932b7fe700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f932c0cff10 0x7f932c1333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932b7fe700 1 -- 172.21.15.153:0/4290518376 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9324009a70 con 0x7f932c15f180 2023-11-24T08:04:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932a7fc700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f932c13e000 0x7f932c1f0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f932b7fe700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f932c15f180 0x7f932c1424f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f932c06c770 tx=0x7f9324004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.445+0000 7f93137fe700 1 -- 172.21.15.153:0/4290518376 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324004440 con 0x7f932c15f180 2023-11-24T08:04:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.446+0000 7f93137fe700 1 -- 172.21.15.153:0/4290518376 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93240045c0 con 0x7f932c15f180 2023-11-24T08:04:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.446+0000 7f93137fe700 1 -- 172.21.15.153:0/4290518376 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324004970 con 0x7f932c15f180 2023-11-24T08:04:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.446+0000 7f9331534700 1 -- 172.21.15.153:0/4290518376 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c13f040 con 0x7f932c15f180 2023-11-24T08:04:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.446+0000 7f9331534700 1 -- 172.21.15.153:0/4290518376 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c13f600 con 0x7f932c15f180 2023-11-24T08:04:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.447+0000 7f9331534700 1 -- 172.21.15.153:0/4290518376 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c13f7c0 con 0x7f932c15f180 2023-11-24T08:04:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.447+0000 7f93137fe700 1 -- 172.21.15.153:0/4290518376 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f932401e430 con 0x7f932c15f180 2023-11-24T08:04:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.447+0000 7f93137fe700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f931806aed0 0x7f931806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.447+0000 7f93137fe700 1 -- 172.21.15.153:0/4290518376 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f932408e0c0 con 0x7f932c15f180 2023-11-24T08:04:22.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.447+0000 7f932affd700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f931806aed0 0x7f931806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.448+0000 7f932affd700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f931806aed0 0x7f931806d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f932c1f3f20 tx=0x7f9320009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.452+0000 7f93137fe700 1 -- 172.21.15.153:0/4290518376 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9324059200 con 0x7f932c15f180 2023-11-24T08:04:22.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.645+0000 7f9331534700 1 -- 172.21.15.153:0/4290518376 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f932c067f60 con 0x7f932c15f180 2023-11-24T08:04:22.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.647+0000 7f93137fe700 1 -- 172.21.15.153:0/4290518376 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f932405c820 con 0x7f932c15f180 2023-11-24T08:04:22.648 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:22.649 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:22.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 -- 172.21.15.153:0/4290518376 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f931806aed0 msgr2=0x7f931806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f931806aed0 0x7f931806d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f932c1f3f20 tx=0x7f9320009040 comp rx=0 tx=0).stop 2023-11-24T08:04:22.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 -- 172.21.15.153:0/4290518376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f932c15f180 msgr2=0x7f932c1424f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f932c15f180 0x7f932c1424f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f932c06c770 tx=0x7f9324004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 -- 172.21.15.153:0/4290518376 shutdown_connections 2023-11-24T08:04:22.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f931806aed0 0x7f931806d390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f932c15f180 0x7f932c1424f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f932c0cff10 0x7f932c1333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 --2- 172.21.15.153:0/4290518376 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f932c13e000 0x7f932c1f0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 -- 172.21.15.153:0/4290518376 >> 172.21.15.153:0/4290518376 conn(0x7f932c072990 msgr2=0x7f932c0b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 -- 172.21.15.153:0/4290518376 shutdown_connections 2023-11-24T08:04:22.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.649+0000 7f9331534700 1 -- 172.21.15.153:0/4290518376 wait complete. 2023-11-24T08:04:22.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:22.664 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:22.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.787+0000 7f20700fb700 1 Processor -- start 2023-11-24T08:04:22.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.787+0000 7f20700fb700 1 -- start start 2023-11-24T08:04:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.787+0000 7f20700fb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f206815bf50 0x7f20680ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.787+0000 7f20700fb700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f20680ce830 0x7f20680cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f20700fb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20680cf1f0 0x7f20680c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f20700fb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206815c330 con 0x7f206815bf50 2023-11-24T08:04:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f20700fb700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20680d0140 con 0x7f20680ce830 2023-11-24T08:04:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f20700fb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20680d03e0 con 0x7f20680cf1f0 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206de97700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f206815bf50 0x7f20680ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206de97700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f206815bf50 0x7f20680ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35884/0 (socket says 172.21.15.153:35884) 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206de97700 1 -- 172.21.15.153:0/1400093471 learned_addr learned my addr 172.21.15.153:0/1400093471 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206d696700 1 --2- 172.21.15.153:0/1400093471 >> v2:172.21.15.164:3300/0 conn(0x7f20680ce830 0x7f20680cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206e698700 1 --2- 172.21.15.153:0/1400093471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20680cf1f0 0x7f20680c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206de97700 1 -- 172.21.15.153:0/1400093471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20680cf1f0 msgr2=0x7f20680c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206de97700 1 --2- 172.21.15.153:0/1400093471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20680cf1f0 0x7f20680c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206de97700 1 -- 172.21.15.153:0/1400093471 >> v2:172.21.15.164:3300/0 conn(0x7f20680ce830 msgr2=0x7f20680cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206de97700 1 --2- 172.21.15.153:0/1400093471 >> v2:172.21.15.164:3300/0 conn(0x7f20680ce830 0x7f20680cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206de97700 1 -- 172.21.15.153:0/1400093471 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20680d06c0 con 0x7f206815bf50 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206d696700 1 --2- 172.21.15.153:0/1400093471 >> v2:172.21.15.164:3300/0 conn(0x7f20680ce830 0x7f20680cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206de97700 1 --2- 172.21.15.153:0/1400093471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206815bf50 0x7f20680ce2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2068072420 tx=0x7f2058009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f8f46cdf0deae4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206ce95700 1 -- 172.21.15.153:0/1400093471 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205800b870 con 0x7f206815bf50 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206ce95700 1 -- 172.21.15.153:0/1400093471 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205800b9d0 con 0x7f206815bf50 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.788+0000 7f206ce95700 1 -- 172.21.15.153:0/1400093471 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205800bd60 con 0x7f206815bf50 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.789+0000 7f20700fb700 1 -- 172.21.15.153:0/1400093471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206815bf50 msgr2=0x7f20680ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.789+0000 7f20700fb700 1 --2- 172.21.15.153:0/1400093471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206815bf50 0x7f20680ce2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2068072420 tx=0x7f2058009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.789+0000 7f20700fb700 1 -- 172.21.15.153:0/1400093471 shutdown_connections 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.789+0000 7f20700fb700 1 --2- 172.21.15.153:0/1400093471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20680cf1f0 0x7f20680c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.789+0000 7f20700fb700 1 --2- 172.21.15.153:0/1400093471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206815bf50 0x7f20680ce2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.789+0000 7f20700fb700 1 --2- 172.21.15.153:0/1400093471 >> v2:172.21.15.164:3300/0 conn(0x7f20680ce830 0x7f20680cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.789+0000 7f20700fb700 1 -- 172.21.15.153:0/1400093471 >> 172.21.15.153:0/1400093471 conn(0x7f20680b3780 msgr2=0x7f20680b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.789+0000 7f20700fb700 1 -- 172.21.15.153:0/1400093471 shutdown_connections 2023-11-24T08:04:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.789+0000 7f20700fb700 1 -- 172.21.15.153:0/1400093471 wait complete. 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.790+0000 7f20700fb700 1 Processor -- start 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.790+0000 7f20700fb700 1 -- start start 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f20700fb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20680ce830 0x7f2068155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f20700fb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20680cf1f0 0x7f20680caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f20700fb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206815bf50 0x7f2068158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f20700fb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20680c8fd0 con 0x7f20680ce830 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f20700fb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20680c92b0 con 0x7f206815bf50 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f20700fb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20680c9590 con 0x7f20680cf1f0 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f206de97700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20680ce830 0x7f2068155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f206de97700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20680ce830 0x7f2068155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35890/0 (socket says 172.21.15.153:35890) 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f206de97700 1 -- 172.21.15.153:0/982837799 learned_addr learned my addr 172.21.15.153:0/982837799 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f206de97700 1 -- 172.21.15.153:0/982837799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20680cf1f0 msgr2=0x7f20680caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f206de97700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20680cf1f0 0x7f20680caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f206de97700 1 -- 172.21.15.153:0/982837799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206815bf50 msgr2=0x7f2068158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f206de97700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206815bf50 0x7f2068158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f206de97700 1 -- 172.21.15.153:0/982837799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2058009550 con 0x7f20680ce830 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f206de97700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20680ce830 0x7f2068155280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2058014040 tx=0x7f2058004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f205e7fc700 1 -- 172.21.15.153:0/982837799 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058004520 con 0x7f20680ce830 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f205e7fc700 1 -- 172.21.15.153:0/982837799 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205801e070 con 0x7f20680ce830 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f20700fb700 1 -- 172.21.15.153:0/982837799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20680c9870 con 0x7f20680ce830 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.791+0000 7f205e7fc700 1 -- 172.21.15.153:0/982837799 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580038e0 con 0x7f20680ce830 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.792+0000 7f20700fb700 1 -- 172.21.15.153:0/982837799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20680cb010 con 0x7f20680ce830 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.792+0000 7f20700fb700 1 -- 172.21.15.153:0/982837799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2068068fb0 con 0x7f20680ce830 2023-11-24T08:04:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.793+0000 7f205e7fc700 1 -- 172.21.15.153:0/982837799 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2058003a40 con 0x7f20680ce830 2023-11-24T08:04:22.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.793+0000 7f205e7fc700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 0x7f204c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.793+0000 7f205e7fc700 1 -- 172.21.15.153:0/982837799 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2058020070 con 0x7f20680ce830 2023-11-24T08:04:22.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.793+0000 7f206d696700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 0x7f204c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.794+0000 7f206d696700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 0x7f204c06d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f206815b180 tx=0x7f2064008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.797+0000 7f205e7fc700 1 -- 172.21.15.153:0/982837799 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2058055d50 con 0x7f20680ce830 2023-11-24T08:04:22.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.988+0000 7f20700fb700 1 -- 172.21.15.153:0/982837799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20680b7ab0 con 0x7f20680ce830 2023-11-24T08:04:22.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.988+0000 7f205e7fc700 1 -- 172.21.15.153:0/982837799 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2058015020 con 0x7f20680ce830 2023-11-24T08:04:22.991 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:22.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 -- 172.21.15.153:0/982837799 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 msgr2=0x7f204c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 0x7f204c06d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f206815b180 tx=0x7f2064008040 comp rx=0 tx=0).stop 2023-11-24T08:04:22.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 -- 172.21.15.153:0/982837799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20680ce830 msgr2=0x7f2068155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20680ce830 0x7f2068155280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2058014040 tx=0x7f2058004750 comp rx=0 tx=0).stop 2023-11-24T08:04:22.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 -- 172.21.15.153:0/982837799 shutdown_connections 2023-11-24T08:04:22.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206815bf50 0x7f2068158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 0x7f204c06d390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20680ce830 0x7f2068155280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 --2- 172.21.15.153:0/982837799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20680cf1f0 0x7f20680caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 -- 172.21.15.153:0/982837799 >> 172.21.15.153:0/982837799 conn(0x7f20680b3780 msgr2=0x7f20680cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 -- 172.21.15.153:0/982837799 shutdown_connections 2023-11-24T08:04:22.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:22.991+0000 7f20700fb700 1 -- 172.21.15.153:0/982837799 wait complete. 2023-11-24T08:04:23.005 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:23.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.127+0000 7f2058a15700 1 Processor -- start 2023-11-24T08:04:23.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.127+0000 7f2058a15700 1 -- start start 2023-11-24T08:04:23.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.128+0000 7f2058a15700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f205415e160 0x7f20540b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.128+0000 7f2058a15700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20540afc90 0x7f2054073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.128+0000 7f2058a15700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20540b3c60 con 0x7f20540744d0 2023-11-24T08:04:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.128+0000 7f2058a15700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20540b4500 con 0x7f205415e160 2023-11-24T08:04:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.128+0000 7f2058a15700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2054074960 con 0x7f20540afc90 2023-11-24T08:04:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.128+0000 7f205259c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f205415e160 0x7f20540b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.128+0000 7f205259c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f205415e160 0x7f20540b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35898/0 (socket says 172.21.15.153:35898) 2023-11-24T08:04:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.128+0000 7f2052d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f20540744d0 0x7f205406d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42004/0 (socket says 172.21.15.153:42004) 2023-11-24T08:04:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.128+0000 7f205259c700 1 -- 172.21.15.153:0/78395363 learned_addr learned my addr 172.21.15.153:0/78395363 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.129+0000 7f2051d9b700 1 --2- 172.21.15.153:0/78395363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20540afc90 0x7f2054073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.129+0000 7f205259c700 1 -- 172.21.15.153:0/78395363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20540afc90 msgr2=0x7f2054073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.129+0000 7f205259c700 1 --2- 172.21.15.153:0/78395363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20540afc90 0x7f2054073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.129+0000 7f205259c700 1 -- 172.21.15.153:0/78395363 >> v1:172.21.15.153:6789/0 conn(0x7f20540744d0 legacy=0x7f205406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.129+0000 7f205159a700 1 -- 172.21.15.153:0/78395363 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460368840 0 0) 0x7f20540b3c60 con 0x7f20540744d0 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.129+0000 7f205259c700 1 -- 172.21.15.153:0/78395363 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540b58c0 con 0x7f205415e160 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.129+0000 7f205259c700 1 --2- 172.21.15.153:0/78395363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205415e160 0x7f20540b5da0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f20480098f0 tx=0x7f2048009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14dbb1087344754 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.129+0000 7f205159a700 1 -- 172.21.15.153:0/78395363 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048011830 con 0x7f205415e160 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.129+0000 7f205159a700 1 -- 172.21.15.153:0/78395363 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048011990 con 0x7f205415e160 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.129+0000 7f205159a700 1 -- 172.21.15.153:0/78395363 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048011d20 con 0x7f205415e160 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.130+0000 7f2058a15700 1 -- 172.21.15.153:0/78395363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205415e160 msgr2=0x7f20540b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.130+0000 7f2058a15700 1 --2- 172.21.15.153:0/78395363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205415e160 0x7f20540b5da0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f20480098f0 tx=0x7f2048009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.130+0000 7f2058a15700 1 -- 172.21.15.153:0/78395363 shutdown_connections 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.130+0000 7f2058a15700 1 --2- 172.21.15.153:0/78395363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205415e160 0x7f20540b5da0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.130+0000 7f2058a15700 1 --2- 172.21.15.153:0/78395363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20540afc90 0x7f2054073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.130+0000 7f2058a15700 1 -- 172.21.15.153:0/78395363 >> 172.21.15.153:0/78395363 conn(0x7f20540d0bf0 msgr2=0x7f20540d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:23.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.130+0000 7f2058a15700 1 -- 172.21.15.153:0/78395363 shutdown_connections 2023-11-24T08:04:23.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.130+0000 7f2058a15700 1 -- 172.21.15.153:0/78395363 wait complete. 2023-11-24T08:04:23.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.131+0000 7f2058a15700 1 Processor -- start 2023-11-24T08:04:23.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.131+0000 7f2058a15700 1 -- start start 2023-11-24T08:04:23.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f2058a15700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20540744d0 0x7f20540c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f2058a15700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20540afc90 0x7f2054161f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f2058a15700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205415e160 0x7f205414cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f2058a15700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540cad70 con 0x7f20540744d0 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f2058a15700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205414de60 con 0x7f205415e160 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f2058a15700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205414db80 con 0x7f20540afc90 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f205259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20540744d0 0x7f20540c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f205259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20540744d0 0x7f20540c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35904/0 (socket says 172.21.15.153:35904) 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f205259c700 1 -- 172.21.15.153:0/4213703012 learned_addr learned my addr 172.21.15.153:0/4213703012 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f2051d9b700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20540afc90 0x7f2054161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f2052d9d700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205415e160 0x7f205414cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f205259c700 1 -- 172.21.15.153:0/4213703012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20540afc90 msgr2=0x7f2054161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f205259c700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20540afc90 0x7f2054161f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f205259c700 1 -- 172.21.15.153:0/4213703012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205415e160 msgr2=0x7f205414cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f205259c700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205415e160 0x7f205414cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f205259c700 1 -- 172.21.15.153:0/4213703012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2048009550 con 0x7f20540744d0 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f2052d9d700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205415e160 0x7f205414cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f2051d9b700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20540afc90 0x7f2054161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f205259c700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20540744d0 0x7f20540c67c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2048000c00 tx=0x7f2048004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.132+0000 7f2042ffd700 1 -- 172.21.15.153:0/4213703012 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20480036a0 con 0x7f20540744d0 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.133+0000 7f2042ffd700 1 -- 172.21.15.153:0/4213703012 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204801e070 con 0x7f20540744d0 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.133+0000 7f2058a15700 1 -- 172.21.15.153:0/4213703012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20540c5ce0 con 0x7f20540744d0 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.133+0000 7f2042ffd700 1 -- 172.21.15.153:0/4213703012 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048003a40 con 0x7f20540744d0 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.133+0000 7f2058a15700 1 -- 172.21.15.153:0/4213703012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20540c62a0 con 0x7f20540744d0 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.134+0000 7f2058a15700 1 -- 172.21.15.153:0/4213703012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20540c6430 con 0x7f20540744d0 2023-11-24T08:04:23.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.134+0000 7f2042ffd700 1 -- 172.21.15.153:0/4213703012 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2048003ba0 con 0x7f20540744d0 2023-11-24T08:04:23.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.134+0000 7f2042ffd700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203406aed0 0x7f203406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.135+0000 7f2051d9b700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203406aed0 0x7f203406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.135+0000 7f2042ffd700 1 -- 172.21.15.153:0/4213703012 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f204808a520 con 0x7f20540744d0 2023-11-24T08:04:23.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.135+0000 7f2051d9b700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203406aed0 0x7f203406d390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2044009b60 tx=0x7f2044008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.139+0000 7f2042ffd700 1 -- 172.21.15.153:0/4213703012 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2048055660 con 0x7f20540744d0 2023-11-24T08:04:23.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.330+0000 7f2058a15700 1 -- 172.21.15.153:0/4213703012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2054068fb0 con 0x7f20540744d0 2023-11-24T08:04:23.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.330+0000 7f2042ffd700 1 -- 172.21.15.153:0/4213703012 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2048058c80 con 0x7f20540744d0 2023-11-24T08:04:23.332 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:23.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 -- 172.21.15.153:0/4213703012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203406aed0 msgr2=0x7f203406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203406aed0 0x7f203406d390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2044009b60 tx=0x7f2044008040 comp rx=0 tx=0).stop 2023-11-24T08:04:23.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 -- 172.21.15.153:0/4213703012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20540744d0 msgr2=0x7f20540c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20540744d0 0x7f20540c67c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2048000c00 tx=0x7f2048004750 comp rx=0 tx=0).stop 2023-11-24T08:04:23.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 -- 172.21.15.153:0/4213703012 shutdown_connections 2023-11-24T08:04:23.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205415e160 0x7f205414cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203406aed0 0x7f203406d390 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20540744d0 0x7f20540c67c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 --2- 172.21.15.153:0/4213703012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20540afc90 0x7f2054161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 -- 172.21.15.153:0/4213703012 >> 172.21.15.153:0/4213703012 conn(0x7f20540d0bf0 msgr2=0x7f205406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:23.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 -- 172.21.15.153:0/4213703012 shutdown_connections 2023-11-24T08:04:23.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.332+0000 7f2058a15700 1 -- 172.21.15.153:0/4213703012 wait complete. 2023-11-24T08:04:23.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:23.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.469+0000 7f1d8427e700 1 Processor -- start 2023-11-24T08:04:23.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.469+0000 7f1d8427e700 1 -- start start 2023-11-24T08:04:23.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d8427e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d7c15bf50 0x7f1d7c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d8427e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0d0140 con 0x7f1d7c0ce830 2023-11-24T08:04:23.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d8427e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0cf3c0 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d8427e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c15c330 con 0x7f1d7c15bf50 2023-11-24T08:04:23.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d8201a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d7c15bf50 0x7f1d7c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d8201a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d7c15bf50 0x7f1d7c0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35912/0 (socket says 172.21.15.153:35912) 2023-11-24T08:04:23.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d81819700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1d7c0ce830 0x7f1d7c0cecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42016/0 (socket says 172.21.15.153:42016) 2023-11-24T08:04:23.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d8201a700 1 -- 172.21.15.153:0/2998002106 learned_addr learned my addr 172.21.15.153:0/2998002106 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:23.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d8201a700 1 -- 172.21.15.153:0/2998002106 >> v1:172.21.15.164:6789/0 conn(0x7f1d7c0c6c30 legacy=0x7f1d7c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d8201a700 1 -- 172.21.15.153:0/2998002106 >> v1:172.21.15.153:6789/0 conn(0x7f1d7c0ce830 legacy=0x7f1d7c0cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d8201a700 1 -- 172.21.15.153:0/2998002106 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0d03e0 con 0x7f1d7c15bf50 2023-11-24T08:04:23.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d81018700 1 -- 172.21.15.153:0/2998002106 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476459720 0 0) 0x7f1d7c0d0140 con 0x7f1d7c0ce830 2023-11-24T08:04:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d8201a700 1 --2- 172.21.15.153:0/2998002106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d7c15bf50 0x7f1d7c0ce2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1d780098f0 tx=0x7f1d78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82257022c7366283 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d81018700 1 -- 172.21.15.153:0/2998002106 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800b8a0 con 0x7f1d7c15bf50 2023-11-24T08:04:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d81018700 1 -- 172.21.15.153:0/2998002106 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7800ba00 con 0x7f1d7c15bf50 2023-11-24T08:04:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.470+0000 7f1d81018700 1 -- 172.21.15.153:0/2998002106 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800bd90 con 0x7f1d7c15bf50 2023-11-24T08:04:23.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.471+0000 7f1d8427e700 1 -- 172.21.15.153:0/2998002106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d7c15bf50 msgr2=0x7f1d7c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.471+0000 7f1d8427e700 1 --2- 172.21.15.153:0/2998002106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d7c15bf50 0x7f1d7c0ce2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1d780098f0 tx=0x7f1d78009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:23.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.471+0000 7f1d8427e700 1 -- 172.21.15.153:0/2998002106 shutdown_connections 2023-11-24T08:04:23.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.471+0000 7f1d8427e700 1 --2- 172.21.15.153:0/2998002106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d7c15bf50 0x7f1d7c0ce2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.471+0000 7f1d8427e700 1 -- 172.21.15.153:0/2998002106 >> 172.21.15.153:0/2998002106 conn(0x7f1d7c0b3780 msgr2=0x7f1d7c0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:23.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.471+0000 7f1d8427e700 1 -- 172.21.15.153:0/2998002106 shutdown_connections 2023-11-24T08:04:23.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.471+0000 7f1d8427e700 1 -- 172.21.15.153:0/2998002106 wait complete. 2023-11-24T08:04:23.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.472+0000 7f1d8427e700 1 Processor -- start 2023-11-24T08:04:23.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.472+0000 7f1d8427e700 1 -- start start 2023-11-24T08:04:23.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8427e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d7c0c6c30 0x7f1d7c156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8427e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d7c0ce830 0x7f1d7c0c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8427e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d7c15bf50 0x7f1d7c0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8427e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c157230 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8427e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c155c90 con 0x7f1d7c0ce830 2023-11-24T08:04:23.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8427e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c155f30 con 0x7f1d7c15bf50 2023-11-24T08:04:23.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8201a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d7c0c6c30 0x7f1d7c156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8201a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d7c0c6c30 0x7f1d7c156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35916/0 (socket says 172.21.15.153:35916) 2023-11-24T08:04:23.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8201a700 1 -- 172.21.15.153:0/334648838 learned_addr learned my addr 172.21.15.153:0/334648838 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:23.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d81819700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d7c0ce830 0x7f1d7c0c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8201a700 1 -- 172.21.15.153:0/334648838 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d7c15bf50 msgr2=0x7f1d7c0c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8201a700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d7c15bf50 0x7f1d7c0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8201a700 1 -- 172.21.15.153:0/334648838 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d7c0ce830 msgr2=0x7f1d7c0c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8201a700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d7c0ce830 0x7f1d7c0c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8201a700 1 -- 172.21.15.153:0/334648838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78009550 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.473+0000 7f1d8201a700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d7c0c6c30 0x7f1d7c156cf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d78014040 tx=0x7f1d78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.474+0000 7f1d72ffd700 1 -- 172.21.15.153:0/334648838 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78011a70 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.474+0000 7f1d72ffd700 1 -- 172.21.15.153:0/334648838 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7801e070 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.474+0000 7f1d8427e700 1 -- 172.21.15.153:0/334648838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c156210 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.474+0000 7f1d72ffd700 1 -- 172.21.15.153:0/334648838 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78011dd0 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.474+0000 7f1d8427e700 1 -- 172.21.15.153:0/334648838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c1567d0 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.475+0000 7f1d8427e700 1 -- 172.21.15.153:0/334648838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c068fb0 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.475+0000 7f1d72ffd700 1 -- 172.21.15.153:0/334648838 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d7802d450 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.475+0000 7f1d72ffd700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d6006aed0 0x7f1d6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.475+0000 7f1d81819700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d6006aed0 0x7f1d6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.475+0000 7f1d72ffd700 1 -- 172.21.15.153:0/334648838 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d7808a6d0 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.476+0000 7f1d81819700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d6006aed0 0x7f1d6006d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c159120 tx=0x7f1d6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.480+0000 7f1d72ffd700 1 -- 172.21.15.153:0/334648838 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d78055810 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.668+0000 7f1d8427e700 1 -- 172.21.15.153:0/334648838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d7c0b7ab0 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.668+0000 7f1d72ffd700 1 -- 172.21.15.153:0/334648838 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d78020020 con 0x7f1d7c0c6c30 2023-11-24T08:04:23.670 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:23.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 -- 172.21.15.153:0/334648838 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d6006aed0 msgr2=0x7f1d6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d6006aed0 0x7f1d6006d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c159120 tx=0x7f1d6c009040 comp rx=0 tx=0).stop 2023-11-24T08:04:23.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 -- 172.21.15.153:0/334648838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d7c0c6c30 msgr2=0x7f1d7c156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d7c0c6c30 0x7f1d7c156cf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d78014040 tx=0x7f1d78004750 comp rx=0 tx=0).stop 2023-11-24T08:04:23.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 -- 172.21.15.153:0/334648838 shutdown_connections 2023-11-24T08:04:23.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d7c15bf50 0x7f1d7c0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d6006aed0 0x7f1d6006d390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d7c0c6c30 0x7f1d7c156cf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 --2- 172.21.15.153:0/334648838 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d7c0ce830 0x7f1d7c0c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 -- 172.21.15.153:0/334648838 >> 172.21.15.153:0/334648838 conn(0x7f1d7c0b3780 msgr2=0x7f1d7c0b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:23.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 -- 172.21.15.153:0/334648838 shutdown_connections 2023-11-24T08:04:23.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.671+0000 7f1d8427e700 1 -- 172.21.15.153:0/334648838 wait complete. 2023-11-24T08:04:23.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:23.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.804+0000 7fa793022700 1 Processor -- start 2023-11-24T08:04:23.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.804+0000 7fa793022700 1 -- start start 2023-11-24T08:04:23.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa793022700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa78c15e080 0x7fa78c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa793022700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa78c06c710 0x7fa78c0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa793022700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78c0ae430 con 0x7fa78c0af4d0 2023-11-24T08:04:23.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa793022700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c0af0b0 con 0x7fa78c06c710 2023-11-24T08:04:23.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa793022700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c0b05a0 con 0x7fa78c15e080 2023-11-24T08:04:23.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa7915bf700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa78c06c710 0x7fa78c0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa7915bf700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa78c06c710 0x7fa78c0afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35928/0 (socket says 172.21.15.153:35928) 2023-11-24T08:04:23.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa7915bf700 1 -- 172.21.15.153:0/3011264728 learned_addr learned my addr 172.21.15.153:0/3011264728 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:23.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa790dbe700 1 --2- 172.21.15.153:0/3011264728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa78c15e080 0x7fa78c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa7915bf700 1 -- 172.21.15.153:0/3011264728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa78c15e080 msgr2=0x7fa78c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:23.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa7915bf700 1 --2- 172.21.15.153:0/3011264728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa78c15e080 0x7fa78c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa7915bf700 1 -- 172.21.15.153:0/3011264728 >> v1:172.21.15.164:6789/0 conn(0x7fa78c0af4d0 legacy=0x7fa78c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.805+0000 7fa7915bf700 1 -- 172.21.15.153:0/3011264728 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c0ae710 con 0x7fa78c06c710 2023-11-24T08:04:23.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa7915bf700 1 --2- 172.21.15.153:0/3011264728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c06c710 0x7fa78c0afb90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa784009e80 tx=0x7fa78400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd495d6d4207e019 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa78b7fe700 1 -- 172.21.15.153:0/3011264728 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78400e070 con 0x7fa78c06c710 2023-11-24T08:04:23.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa78b7fe700 1 -- 172.21.15.153:0/3011264728 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78400b8d0 con 0x7fa78c06c710 2023-11-24T08:04:23.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa78b7fe700 1 -- 172.21.15.153:0/3011264728 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78400bc80 con 0x7fa78c06c710 2023-11-24T08:04:23.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa793022700 1 -- 172.21.15.153:0/3011264728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c06c710 msgr2=0x7fa78c0afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa793022700 1 --2- 172.21.15.153:0/3011264728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c06c710 0x7fa78c0afb90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa784009e80 tx=0x7fa78400b330 comp rx=0 tx=0).stop 2023-11-24T08:04:23.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa793022700 1 -- 172.21.15.153:0/3011264728 shutdown_connections 2023-11-24T08:04:23.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa793022700 1 --2- 172.21.15.153:0/3011264728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c06c710 0x7fa78c0afb90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa793022700 1 --2- 172.21.15.153:0/3011264728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa78c15e080 0x7fa78c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa793022700 1 -- 172.21.15.153:0/3011264728 >> 172.21.15.153:0/3011264728 conn(0x7fa78c071b90 msgr2=0x7fa78c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:23.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa793022700 1 -- 172.21.15.153:0/3011264728 shutdown_connections 2023-11-24T08:04:23.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.806+0000 7fa793022700 1 -- 172.21.15.153:0/3011264728 wait complete. 2023-11-24T08:04:23.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.807+0000 7fa793022700 1 Processor -- start 2023-11-24T08:04:23.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.808+0000 7fa793022700 1 -- start start 2023-11-24T08:04:23.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.808+0000 7fa793022700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa78c06c710 0x7fa78c153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.808+0000 7fa793022700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa78c0af4d0 0x7fa78c154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.808+0000 7fa793022700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c15e080 0x7fa78c156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.808+0000 7fa793022700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c158290 con 0x7fa78c15e080 2023-11-24T08:04:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.808+0000 7fa793022700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c153b60 con 0x7fa78c06c710 2023-11-24T08:04:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.808+0000 7fa793022700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c157610 con 0x7fa78c0af4d0 2023-11-24T08:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.808+0000 7fa7915bf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c15e080 0x7fa78c156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.808+0000 7fa7915bf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c15e080 0x7fa78c156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35934/0 (socket says 172.21.15.153:35934) 2023-11-24T08:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa7915bf700 1 -- 172.21.15.153:0/4230835958 learned_addr learned my addr 172.21.15.153:0/4230835958 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa78bfff700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa78c0af4d0 0x7fa78c154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa790dbe700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa78c06c710 0x7fa78c153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa7915bf700 1 -- 172.21.15.153:0/4230835958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa78c0af4d0 msgr2=0x7fa78c154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa7915bf700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa78c0af4d0 0x7fa78c154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa7915bf700 1 -- 172.21.15.153:0/4230835958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa78c06c710 msgr2=0x7fa78c153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa7915bf700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa78c06c710 0x7fa78c153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa7915bf700 1 -- 172.21.15.153:0/4230835958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa784009b30 con 0x7fa78c15e080 2023-11-24T08:04:23.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa7915bf700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c15e080 0x7fa78c156480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa78c09f040 tx=0x7fa784004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa7897fa700 1 -- 172.21.15.153:0/4230835958 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784004800 con 0x7fa78c15e080 2023-11-24T08:04:23.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa7897fa700 1 -- 172.21.15.153:0/4230835958 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa784004960 con 0x7fa78c15e080 2023-11-24T08:04:23.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa793022700 1 -- 172.21.15.153:0/4230835958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c1578f0 con 0x7fa78c15e080 2023-11-24T08:04:23.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa7897fa700 1 -- 172.21.15.153:0/4230835958 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78401c680 con 0x7fa78c15e080 2023-11-24T08:04:23.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.809+0000 7fa793022700 1 -- 172.21.15.153:0/4230835958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c157eb0 con 0x7fa78c15e080 2023-11-24T08:04:23.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.810+0000 7fa793022700 1 -- 172.21.15.153:0/4230835958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c158070 con 0x7fa78c15e080 2023-11-24T08:04:23.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.811+0000 7fa7897fa700 1 -- 172.21.15.153:0/4230835958 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa78401c7e0 con 0x7fa78c15e080 2023-11-24T08:04:23.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.811+0000 7fa7897fa700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa77006aed0 0x7fa77006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.811+0000 7fa7897fa700 1 -- 172.21.15.153:0/4230835958 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa78408ae60 con 0x7fa78c15e080 2023-11-24T08:04:23.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.811+0000 7fa790dbe700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa77006aed0 0x7fa77006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.811+0000 7fa790dbe700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa77006aed0 0x7fa77006d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0c5c80 tx=0x7fa780009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:23.815+0000 7fa7897fa700 1 -- 172.21.15.153:0/4230835958 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa784055fa0 con 0x7fa78c15e080 2023-11-24T08:04:24.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.047+0000 7fa793022700 1 -- 172.21.15.153:0/4230835958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa78c0753f0 con 0x7fa78c15e080 2023-11-24T08:04:24.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.048+0000 7fa7897fa700 1 -- 172.21.15.153:0/4230835958 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fa7840595c0 con 0x7fa78c15e080 2023-11-24T08:04:24.050 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:24.050 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/157182640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":157182640},{"type":"v1","addr":"172.21.15.153:6837","nonce":157182640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2853134113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2853134113},{"type":"v1","addr":"172.21.15.153:6836","nonce":2853134113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1191113201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1191113201},{"type":"v1","addr":"172.21.15.164:6833","nonce":1191113201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:12.137876+0000","modified":"2023-11-24T08:04:15.171907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1557353565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1557353565},{"type":"v1","addr":"172.21.15.164:6835","nonce":1557353565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:24.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 -- 172.21.15.153:0/4230835958 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa77006aed0 msgr2=0x7fa77006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa77006aed0 0x7fa77006d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0c5c80 tx=0x7fa780009210 comp rx=0 tx=0).stop 2023-11-24T08:04:24.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 -- 172.21.15.153:0/4230835958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c15e080 msgr2=0x7fa78c156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c15e080 0x7fa78c156480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa78c09f040 tx=0x7fa784004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 -- 172.21.15.153:0/4230835958 shutdown_connections 2023-11-24T08:04:24.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa77006aed0 0x7fa77006d390 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c15e080 0x7fa78c156480 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa78c06c710 0x7fa78c153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 --2- 172.21.15.153:0/4230835958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa78c0af4d0 0x7fa78c154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 -- 172.21.15.153:0/4230835958 >> 172.21.15.153:0/4230835958 conn(0x7fa78c071b90 msgr2=0x7fa78c06bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 -- 172.21.15.153:0/4230835958 shutdown_connections 2023-11-24T08:04:24.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.050+0000 7fa793022700 1 -- 172.21.15.153:0/4230835958 wait complete. 2023-11-24T08:04:24.055 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2023-11-24T08:04:24.065 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:24.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.188+0000 7f7de2168700 1 Processor -- start 2023-11-24T08:04:24.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.188+0000 7f7de2168700 1 -- start start 2023-11-24T08:04:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7de2168700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7ddc158670 0x7f7ddc0622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7de2168700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7ddc158a50 0x7f7ddc0c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7de2168700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc0cfff0 con 0x7f7ddc162a30 2023-11-24T08:04:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7de2168700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cfd10 con 0x7f7ddc158670 2023-11-24T08:04:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7de2168700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc161f50 con 0x7f7ddc158a50 2023-11-24T08:04:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7ddb7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7ddc158670 0x7f7ddc0622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7ddb7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7ddc158670 0x7f7ddc0622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35938/0 (socket says 172.21.15.153:35938) 2023-11-24T08:04:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7ddbfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7ddc162a30 0x7f7ddc0d0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42046/0 (socket says 172.21.15.153:42046) 2023-11-24T08:04:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7ddb7fe700 1 -- 172.21.15.153:0/4198429597 learned_addr learned my addr 172.21.15.153:0/4198429597 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7ddb7fe700 1 -- 172.21.15.153:0/4198429597 >> v2:172.21.15.164:3300/0 conn(0x7f7ddc158a50 msgr2=0x7f7ddc0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7ddb7fe700 1 --2- 172.21.15.153:0/4198429597 >> v2:172.21.15.164:3300/0 conn(0x7f7ddc158a50 0x7f7ddc0c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7ddb7fe700 1 -- 172.21.15.153:0/4198429597 >> v1:172.21.15.153:6789/0 conn(0x7f7ddc162a30 legacy=0x7f7ddc0d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.189+0000 7f7ddb7fe700 1 -- 172.21.15.153:0/4198429597 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc162230 con 0x7f7ddc158670 2023-11-24T08:04:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7ddb7fe700 1 --2- 172.21.15.153:0/4198429597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ddc158670 0x7f7ddc0622a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0ca730 tx=0x7f7dd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79ff5326eb9883c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7dda7fc700 1 -- 172.21.15.153:0/4198429597 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000b870 con 0x7f7ddc158670 2023-11-24T08:04:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7dda7fc700 1 -- 172.21.15.153:0/4198429597 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000b9d0 con 0x7f7ddc158670 2023-11-24T08:04:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7dda7fc700 1 -- 172.21.15.153:0/4198429597 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000bd60 con 0x7f7ddc158670 2023-11-24T08:04:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7de2168700 1 -- 172.21.15.153:0/4198429597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ddc158670 msgr2=0x7f7ddc0622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7de2168700 1 --2- 172.21.15.153:0/4198429597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ddc158670 0x7f7ddc0622a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0ca730 tx=0x7f7dd0009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7de2168700 1 -- 172.21.15.153:0/4198429597 shutdown_connections 2023-11-24T08:04:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7de2168700 1 --2- 172.21.15.153:0/4198429597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ddc158670 0x7f7ddc0622a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7de2168700 1 --2- 172.21.15.153:0/4198429597 >> v2:172.21.15.164:3300/0 conn(0x7f7ddc158a50 0x7f7ddc0c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7de2168700 1 -- 172.21.15.153:0/4198429597 >> 172.21.15.153:0/4198429597 conn(0x7f7ddc0b57b0 msgr2=0x7f7ddc0b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7de2168700 1 -- 172.21.15.153:0/4198429597 shutdown_connections 2023-11-24T08:04:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.190+0000 7f7de2168700 1 -- 172.21.15.153:0/4198429597 wait complete. 2023-11-24T08:04:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.191+0000 7f7de2168700 1 Processor -- start 2023-11-24T08:04:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.192+0000 7f7de2168700 1 -- start start 2023-11-24T08:04:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.192+0000 7f7de2168700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ddc158670 0x7f7ddc149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.192+0000 7f7de2168700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ddc158a50 0x7f7ddc0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.192+0000 7f7de2168700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ddc162a30 0x7f7ddc0cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.192+0000 7f7de2168700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc149ca0 con 0x7f7ddc158a50 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.192+0000 7f7de2168700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0b4180 con 0x7f7ddc162a30 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.192+0000 7f7de2168700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0ae000 con 0x7f7ddc158670 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7ddaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ddc158a50 0x7f7ddc0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7ddaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ddc158a50 0x7f7ddc0b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35946/0 (socket says 172.21.15.153:35946) 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7ddaffd700 1 -- 172.21.15.153:0/664658928 learned_addr learned my addr 172.21.15.153:0/664658928 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7ddb7fe700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ddc158670 0x7f7ddc149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7ddbfff700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ddc162a30 0x7f7ddc0cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7ddaffd700 1 -- 172.21.15.153:0/664658928 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ddc158670 msgr2=0x7f7ddc149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7ddaffd700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ddc158670 0x7f7ddc149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7ddaffd700 1 -- 172.21.15.153:0/664658928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ddc162a30 msgr2=0x7f7ddc0cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7ddaffd700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ddc162a30 0x7f7ddc0cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7ddaffd700 1 -- 172.21.15.153:0/664658928 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd0009550 con 0x7f7ddc158a50 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7ddaffd700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ddc158a50 0x7f7ddc0b4610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00b4d0 tx=0x7f7dcc00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7dc3fff700 1 -- 172.21.15.153:0/664658928 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc011830 con 0x7f7ddc158a50 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7dc3fff700 1 -- 172.21.15.153:0/664658928 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0119b0 con 0x7f7ddc158a50 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7de2168700 1 -- 172.21.15.153:0/664658928 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc0b3b30 con 0x7f7ddc158a50 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7dc3fff700 1 -- 172.21.15.153:0/664658928 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc011d60 con 0x7f7ddc158a50 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.193+0000 7f7de2168700 1 -- 172.21.15.153:0/664658928 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc0ae2e0 con 0x7f7ddc158a50 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.194+0000 7f7de2168700 1 -- 172.21.15.153:0/664658928 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc0b42f0 con 0x7f7ddc158a50 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.195+0000 7f7dc3fff700 1 -- 172.21.15.153:0/664658928 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7dcc01a400 con 0x7f7ddc158a50 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.195+0000 7f7dc3fff700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7dc806aed0 0x7f7dc806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.195+0000 7f7dc3fff700 1 -- 172.21.15.153:0/664658928 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dcc089580 con 0x7f7ddc158a50 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.195+0000 7f7ddb7fe700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7dc806aed0 0x7f7dc806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.195+0000 7f7ddb7fe700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7dc806aed0 0x7f7dc806d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0000c00 tx=0x7f7dd0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.199+0000 7f7dc3fff700 1 -- 172.21.15.153:0/664658928 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7dcc0545a0 con 0x7f7ddc158a50 2023-11-24T08:04:24.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.394+0000 7f7de2168700 1 -- 172.21.15.153:0/664658928 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ddc067f60 con 0x7f7ddc158a50 2023-11-24T08:04:24.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.395+0000 7f7dc3fff700 1 -- 172.21.15.153:0/664658928 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f7dcc015090 con 0x7f7ddc158a50 2023-11-24T08:04:24.397 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:24.398 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:24.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.397+0000 7f7de2168700 1 -- 172.21.15.153:0/664658928 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7dc806aed0 msgr2=0x7f7dc806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.397+0000 7f7de2168700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7dc806aed0 0x7f7dc806d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0000c00 tx=0x7f7dd0008030 comp rx=0 tx=0).stop 2023-11-24T08:04:24.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.397+0000 7f7de2168700 1 -- 172.21.15.153:0/664658928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ddc158a50 msgr2=0x7f7ddc0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.397+0000 7f7de2168700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ddc158a50 0x7f7ddc0b4610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00b4d0 tx=0x7f7dcc00b7e0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.397+0000 7f7de2168700 1 -- 172.21.15.153:0/664658928 shutdown_connections 2023-11-24T08:04:24.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.397+0000 7f7de2168700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ddc162a30 0x7f7ddc0cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.397+0000 7f7de2168700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ddc158670 0x7f7ddc149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.397+0000 7f7de2168700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7dc806aed0 0x7f7dc806d390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.397+0000 7f7de2168700 1 --2- 172.21.15.153:0/664658928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ddc158a50 0x7f7ddc0b4610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.397+0000 7f7de2168700 1 -- 172.21.15.153:0/664658928 >> 172.21.15.153:0/664658928 conn(0x7f7ddc0b57b0 msgr2=0x7f7ddc0c98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.397+0000 7f7de2168700 1 -- 172.21.15.153:0/664658928 shutdown_connections 2023-11-24T08:04:24.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.398+0000 7f7de2168700 1 -- 172.21.15.153:0/664658928 wait complete. 2023-11-24T08:04:24.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:24.412 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:24.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.534+0000 7f7facee0700 1 Processor -- start 2023-11-24T08:04:24.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.534+0000 7f7facee0700 1 -- start start 2023-11-24T08:04:24.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.535+0000 7f7facee0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7fa815b370 0x7f7fa815b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.535+0000 7f7facee0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80ae5e0 con 0x7f7fa81587f0 2023-11-24T08:04:24.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.535+0000 7f7facee0700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa815be30 con 0x7f7fa80b3c60 2023-11-24T08:04:24.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.535+0000 7f7facee0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa815c110 con 0x7f7fa815b370 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.535+0000 7f7fa5d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7fa815b370 0x7f7fa815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.535+0000 7f7fa5d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7fa815b370 0x7f7fa815b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35954/0 (socket says 172.21.15.153:35954) 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.535+0000 7f7fa5d9b700 1 -- 172.21.15.153:0/3909641029 learned_addr learned my addr 172.21.15.153:0/3909641029 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.535+0000 7f7fa659c700 1 --1- 172.21.15.153:0/3909641029 >> v1:172.21.15.153:6789/0 conn(0x7f7fa81587f0 0x7f7fa806aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42056/0 (socket says 172.21.15.153:42056) 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7fa5d9b700 1 -- 172.21.15.153:0/3909641029 >> v1:172.21.15.164:6789/0 conn(0x7f7fa80b3c60 legacy=0x7f7fa80af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7fa5d9b700 1 -- 172.21.15.153:0/3909641029 >> v1:172.21.15.153:6789/0 conn(0x7f7fa81587f0 legacy=0x7f7fa806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7fa5d9b700 1 -- 172.21.15.153:0/3909641029 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80ae860 con 0x7f7fa815b370 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7fa559a700 1 -- 172.21.15.153:0/3909641029 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141656878 0 0) 0x7f7fa80ae5e0 con 0x7f7fa81587f0 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7fa5d9b700 1 --2- 172.21.15.153:0/3909641029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa815b370 0x7f7fa815b800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800bbc0 tx=0x7f7f9800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4405fc7b39ef38ed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7fa559a700 1 -- 172.21.15.153:0/3909641029 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800dd50 con 0x7f7fa815b370 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7fa559a700 1 -- 172.21.15.153:0/3909641029 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98010470 con 0x7f7fa815b370 2023-11-24T08:04:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7fa559a700 1 -- 172.21.15.153:0/3909641029 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98010800 con 0x7f7fa815b370 2023-11-24T08:04:24.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7facee0700 1 -- 172.21.15.153:0/3909641029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa815b370 msgr2=0x7f7fa815b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7facee0700 1 --2- 172.21.15.153:0/3909641029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa815b370 0x7f7fa815b800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800bbc0 tx=0x7f7f9800bed0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7facee0700 1 -- 172.21.15.153:0/3909641029 shutdown_connections 2023-11-24T08:04:24.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7facee0700 1 --2- 172.21.15.153:0/3909641029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa815b370 0x7f7fa815b800 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.536+0000 7f7facee0700 1 -- 172.21.15.153:0/3909641029 >> 172.21.15.153:0/3909641029 conn(0x7f7fa80d0bf0 msgr2=0x7f7fa80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.537+0000 7f7facee0700 1 -- 172.21.15.153:0/3909641029 shutdown_connections 2023-11-24T08:04:24.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.537+0000 7f7facee0700 1 -- 172.21.15.153:0/3909641029 wait complete. 2023-11-24T08:04:24.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.538+0000 7f7facee0700 1 Processor -- start 2023-11-24T08:04:24.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.538+0000 7f7facee0700 1 -- start start 2023-11-24T08:04:24.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7facee0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fa80b3c60 0x7f7fa81eed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7facee0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa81587f0 0x7f7fa80b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7facee0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fa815b370 0x7f7fa809bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7facee0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8154150 con 0x7f7fa81587f0 2023-11-24T08:04:24.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7facee0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8153540 con 0x7f7fa80b3c60 2023-11-24T08:04:24.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7facee0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8153820 con 0x7f7fa815b370 2023-11-24T08:04:24.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa81587f0 0x7f7fa80b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa81587f0 0x7f7fa80b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35960/0 (socket says 172.21.15.153:35960) 2023-11-24T08:04:24.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa5d9b700 1 -- 172.21.15.153:0/681186922 learned_addr learned my addr 172.21.15.153:0/681186922 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa659c700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fa80b3c60 0x7f7fa81eed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa6d9d700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fa815b370 0x7f7fa809bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa5d9b700 1 -- 172.21.15.153:0/681186922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fa815b370 msgr2=0x7f7fa809bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa5d9b700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fa815b370 0x7f7fa809bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa5d9b700 1 -- 172.21.15.153:0/681186922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fa80b3c60 msgr2=0x7f7fa81eed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa5d9b700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fa80b3c60 0x7f7fa81eed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa5d9b700 1 -- 172.21.15.153:0/681186922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9800b7f0 con 0x7f7fa81587f0 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa659c700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fa80b3c60 0x7f7fa81eed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7fa5d9b700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa81587f0 0x7f7fa80b1700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800b340 tx=0x7f7f98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7f96ffd700 1 -- 172.21.15.153:0/681186922 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9801f070 con 0x7f7fa81587f0 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7f96ffd700 1 -- 172.21.15.153:0/681186922 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98010e10 con 0x7f7fa81587f0 2023-11-24T08:04:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7facee0700 1 -- 172.21.15.153:0/681186922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa8153b00 con 0x7f7fa81587f0 2023-11-24T08:04:24.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7f96ffd700 1 -- 172.21.15.153:0/681186922 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98019810 con 0x7f7fa81587f0 2023-11-24T08:04:24.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.539+0000 7f7facee0700 1 -- 172.21.15.153:0/681186922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa81ef2b0 con 0x7f7fa81587f0 2023-11-24T08:04:24.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.540+0000 7f7facee0700 1 -- 172.21.15.153:0/681186922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa81542c0 con 0x7f7fa81587f0 2023-11-24T08:04:24.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.541+0000 7f7f96ffd700 1 -- 172.21.15.153:0/681186922 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f98019970 con 0x7f7fa81587f0 2023-11-24T08:04:24.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.541+0000 7f7f96ffd700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f8806aed0 0x7f7f8806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.541+0000 7f7fa659c700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f8806aed0 0x7f7f8806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.541+0000 7f7f96ffd700 1 -- 172.21.15.153:0/681186922 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f9808ce50 con 0x7f7fa81587f0 2023-11-24T08:04:24.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.542+0000 7f7fa659c700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f8806aed0 0x7f7f8806d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c000f60 tx=0x7f7f9c007ce0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.546+0000 7f7f96ffd700 1 -- 172.21.15.153:0/681186922 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f98058070 con 0x7f7fa81587f0 2023-11-24T08:04:24.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.735+0000 7f7facee0700 1 -- 172.21.15.153:0/681186922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fa8068fb0 con 0x7f7fa81587f0 2023-11-24T08:04:24.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.735+0000 7f7f96ffd700 1 -- 172.21.15.153:0/681186922 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f9805b690 con 0x7f7fa81587f0 2023-11-24T08:04:24.737 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:24.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 -- 172.21.15.153:0/681186922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f8806aed0 msgr2=0x7f7f8806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f8806aed0 0x7f7f8806d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c000f60 tx=0x7f7f9c007ce0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 -- 172.21.15.153:0/681186922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa81587f0 msgr2=0x7f7fa80b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa81587f0 0x7f7fa80b1700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800b340 tx=0x7f7f98004750 comp rx=0 tx=0).stop 2023-11-24T08:04:24.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 -- 172.21.15.153:0/681186922 shutdown_connections 2023-11-24T08:04:24.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fa815b370 0x7f7fa809bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fa80b3c60 0x7f7fa81eed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f8806aed0 0x7f7f8806d390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 --2- 172.21.15.153:0/681186922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa81587f0 0x7f7fa80b1700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 -- 172.21.15.153:0/681186922 >> 172.21.15.153:0/681186922 conn(0x7f7fa80d0bf0 msgr2=0x7f7fa80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 -- 172.21.15.153:0/681186922 shutdown_connections 2023-11-24T08:04:24.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.738+0000 7f7facee0700 1 -- 172.21.15.153:0/681186922 wait complete. 2023-11-24T08:04:24.752 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:24.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.875+0000 7f553b329700 1 Processor -- start 2023-11-24T08:04:24.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.876+0000 7f553b329700 1 -- start start 2023-11-24T08:04:24.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.876+0000 7f553b329700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553415e160 0x7f55340b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.876+0000 7f553b329700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f55340afc90 0x7f5534073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.876+0000 7f553b329700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55340b3c60 con 0x7f55340744d0 2023-11-24T08:04:24.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.876+0000 7f553b329700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55340b4500 con 0x7f55340afc90 2023-11-24T08:04:24.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.876+0000 7f553b329700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5534074960 con 0x7f553415e160 2023-11-24T08:04:24.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55388c4700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f55340afc90 0x7f5534073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55390c5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553415e160 0x7f55340b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55398c6700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f55340744d0 0x7f553406d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:49756/0 (socket says 172.21.15.153:49756) 2023-11-24T08:04:24.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55390c5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553415e160 0x7f55340b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:48036/0 (socket says 172.21.15.153:48036) 2023-11-24T08:04:24.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55388c4700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f55340afc90 0x7f5534073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57554/0 (socket says 172.21.15.153:57554) 2023-11-24T08:04:24.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55390c5700 1 -- 172.21.15.153:0/4003928851 learned_addr learned my addr 172.21.15.153:0/4003928851 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:24.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55388c4700 1 -- 172.21.15.153:0/4003928851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553415e160 msgr2=0x7f55340b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:24.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55388c4700 1 --2- 172.21.15.153:0/4003928851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553415e160 0x7f55340b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55388c4700 1 -- 172.21.15.153:0/4003928851 >> v1:172.21.15.164:6789/0 conn(0x7f55340744d0 legacy=0x7f553406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55388c4700 1 -- 172.21.15.153:0/4003928851 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55340b58c0 con 0x7f55340afc90 2023-11-24T08:04:24.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55390c5700 1 --2- 172.21.15.153:0/4003928851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553415e160 0x7f55340b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:24.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f55388c4700 1 --2- 172.21.15.153:0/4003928851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55340afc90 0x7f5534073f90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5530009840 tx=0x7f5530009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d762e541de018ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f552bfff700 1 -- 172.21.15.153:0/4003928851 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530011830 con 0x7f55340afc90 2023-11-24T08:04:24.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f552bfff700 1 -- 172.21.15.153:0/4003928851 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5530011990 con 0x7f55340afc90 2023-11-24T08:04:24.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.877+0000 7f552bfff700 1 -- 172.21.15.153:0/4003928851 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530011d20 con 0x7f55340afc90 2023-11-24T08:04:24.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.878+0000 7f553b329700 1 -- 172.21.15.153:0/4003928851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55340afc90 msgr2=0x7f5534073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.878+0000 7f553b329700 1 --2- 172.21.15.153:0/4003928851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55340afc90 0x7f5534073f90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5530009840 tx=0x7f5530009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:24.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.878+0000 7f553b329700 1 -- 172.21.15.153:0/4003928851 shutdown_connections 2023-11-24T08:04:24.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.878+0000 7f553b329700 1 --2- 172.21.15.153:0/4003928851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553415e160 0x7f55340b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.878+0000 7f553b329700 1 --2- 172.21.15.153:0/4003928851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55340afc90 0x7f5534073f90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.878+0000 7f553b329700 1 -- 172.21.15.153:0/4003928851 >> 172.21.15.153:0/4003928851 conn(0x7f55340d0bf0 msgr2=0x7f55340d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.878+0000 7f553b329700 1 -- 172.21.15.153:0/4003928851 shutdown_connections 2023-11-24T08:04:24.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.878+0000 7f553b329700 1 -- 172.21.15.153:0/4003928851 wait complete. 2023-11-24T08:04:24.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.879+0000 7f553b329700 1 Processor -- start 2023-11-24T08:04:24.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.879+0000 7f553b329700 1 -- start start 2023-11-24T08:04:24.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f553b329700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55340744d0 0x7f5534147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f553b329700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55340afc90 0x7f5534160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f553b329700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f553415e160 0x7f55341f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f553b329700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553415e540 con 0x7f553415e160 2023-11-24T08:04:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f553b329700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5534160b80 con 0x7f55340744d0 2023-11-24T08:04:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f553b329700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5534160e60 con 0x7f55340afc90 2023-11-24T08:04:24.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f55398c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f553415e160 0x7f55341f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f55398c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f553415e160 0x7f55341f73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35976/0 (socket says 172.21.15.153:35976) 2023-11-24T08:04:24.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f55398c6700 1 -- 172.21.15.153:0/3459772199 learned_addr learned my addr 172.21.15.153:0/3459772199 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:24.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f55390c5700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55340744d0 0x7f5534147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f55388c4700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55340afc90 0x7f5534160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f55398c6700 1 -- 172.21.15.153:0/3459772199 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55340afc90 msgr2=0x7f5534160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f55398c6700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55340afc90 0x7f5534160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f55398c6700 1 -- 172.21.15.153:0/3459772199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55340744d0 msgr2=0x7f5534147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f55398c6700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55340744d0 0x7f5534147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.880+0000 7f55398c6700 1 -- 172.21.15.153:0/3459772199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524009550 con 0x7f553415e160 2023-11-24T08:04:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.881+0000 7f55398c6700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f553415e160 0x7f55341f73d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f552c00cbd0 tx=0x7f552c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.881+0000 7f5529ffb700 1 -- 172.21.15.153:0/3459772199 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c00aaa0 con 0x7f553415e160 2023-11-24T08:04:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.881+0000 7f5529ffb700 1 -- 172.21.15.153:0/3459772199 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c00ac00 con 0x7f553415e160 2023-11-24T08:04:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.881+0000 7f553b329700 1 -- 172.21.15.153:0/3459772199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55300094a0 con 0x7f553415e160 2023-11-24T08:04:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.881+0000 7f5529ffb700 1 -- 172.21.15.153:0/3459772199 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c007070 con 0x7f553415e160 2023-11-24T08:04:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.881+0000 7f553b329700 1 -- 172.21.15.153:0/3459772199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5534161420 con 0x7f553415e160 2023-11-24T08:04:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.882+0000 7f553b329700 1 -- 172.21.15.153:0/3459772199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55340b48e0 con 0x7f553415e160 2023-11-24T08:04:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.882+0000 7f5529ffb700 1 -- 172.21.15.153:0/3459772199 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f552c0071d0 con 0x7f553415e160 2023-11-24T08:04:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.883+0000 7f5529ffb700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551806aed0 0x7f551806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.883+0000 7f5529ffb700 1 -- 172.21.15.153:0/3459772199 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f552c0891a0 con 0x7f553415e160 2023-11-24T08:04:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.883+0000 7f55390c5700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551806aed0 0x7f551806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.883+0000 7f55390c5700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551806aed0 0x7f551806d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5534074d20 tx=0x7f55240092c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:24.887+0000 7f5529ffb700 1 -- 172.21.15.153:0/3459772199 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f552c054300 con 0x7f553415e160 2023-11-24T08:04:25.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.077+0000 7f553b329700 1 -- 172.21.15.153:0/3459772199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f553415e680 con 0x7f553415e160 2023-11-24T08:04:25.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.078+0000 7f5529ffb700 1 -- 172.21.15.153:0/3459772199 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f553415e680 con 0x7f553415e160 2023-11-24T08:04:25.079 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:25.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 -- 172.21.15.153:0/3459772199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551806aed0 msgr2=0x7f551806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551806aed0 0x7f551806d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5534074d20 tx=0x7f55240092c0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 -- 172.21.15.153:0/3459772199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f553415e160 msgr2=0x7f55341f73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f553415e160 0x7f55341f73d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f552c00cbd0 tx=0x7f552c00cee0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 -- 172.21.15.153:0/3459772199 shutdown_connections 2023-11-24T08:04:25.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551806aed0 0x7f551806d390 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f553415e160 0x7f55341f73d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55340744d0 0x7f5534147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 --2- 172.21.15.153:0/3459772199 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55340afc90 0x7f5534160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 -- 172.21.15.153:0/3459772199 >> 172.21.15.153:0/3459772199 conn(0x7f55340d0bf0 msgr2=0x7f55340d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 -- 172.21.15.153:0/3459772199 shutdown_connections 2023-11-24T08:04:25.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.080+0000 7f553b329700 1 -- 172.21.15.153:0/3459772199 wait complete. 2023-11-24T08:04:25.093 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:25.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.216+0000 7fcbd5e60700 1 Processor -- start 2023-11-24T08:04:25.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.216+0000 7fcbd5e60700 1 -- start start 2023-11-24T08:04:25.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbd5e60700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbd015e320 0x7fcbd00d2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbd5e60700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbd006b700 0x7fcbd0167d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbd5e60700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd00b6fb0 con 0x7fcbd00b93c0 2023-11-24T08:04:25.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbd5e60700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd00d4da0 con 0x7fcbd015e320 2023-11-24T08:04:25.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbd5e60700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00d2940 con 0x7fcbd006b700 2023-11-24T08:04:25.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbcf7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbd015e320 0x7fcbd00d2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbcf7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbd015e320 0x7fcbd00d2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35980/0 (socket says 172.21.15.153:35980) 2023-11-24T08:04:25.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbcf7fe700 1 -- 172.21.15.153:0/223223459 learned_addr learned my addr 172.21.15.153:0/223223459 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:25.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbcffff700 1 --2- 172.21.15.153:0/223223459 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbd006b700 0x7fcbd0167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbcf7fe700 1 -- 172.21.15.153:0/223223459 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbd006b700 msgr2=0x7fcbd0167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:25.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbcf7fe700 1 --2- 172.21.15.153:0/223223459 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbd006b700 0x7fcbd0167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbcf7fe700 1 -- 172.21.15.153:0/223223459 >> v1:172.21.15.164:6789/0 conn(0x7fcbd00b93c0 legacy=0x7fcbd006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.217+0000 7fcbcf7fe700 1 -- 172.21.15.153:0/223223459 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd00d2c10 con 0x7fcbd015e320 2023-11-24T08:04:25.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbcf7fe700 1 --2- 172.21.15.153:0/223223459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd015e320 0x7fcbd00d2400 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40098f0 tx=0x7fcbc4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470fcfa321d3bd9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbce7fc700 1 -- 172.21.15.153:0/223223459 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400b8a0 con 0x7fcbd015e320 2023-11-24T08:04:25.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbce7fc700 1 -- 172.21.15.153:0/223223459 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc400ba00 con 0x7fcbd015e320 2023-11-24T08:04:25.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbce7fc700 1 -- 172.21.15.153:0/223223459 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400bd90 con 0x7fcbd015e320 2023-11-24T08:04:25.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbd5e60700 1 -- 172.21.15.153:0/223223459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd015e320 msgr2=0x7fcbd00d2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbd5e60700 1 --2- 172.21.15.153:0/223223459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd015e320 0x7fcbd00d2400 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40098f0 tx=0x7fcbc4009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:25.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbd5e60700 1 -- 172.21.15.153:0/223223459 shutdown_connections 2023-11-24T08:04:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbd5e60700 1 --2- 172.21.15.153:0/223223459 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbd006b700 0x7fcbd0167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbd5e60700 1 --2- 172.21.15.153:0/223223459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd015e320 0x7fcbd00d2400 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbd5e60700 1 -- 172.21.15.153:0/223223459 >> 172.21.15.153:0/223223459 conn(0x7fcbd00d3e50 msgr2=0x7fcbd00d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbd5e60700 1 -- 172.21.15.153:0/223223459 shutdown_connections 2023-11-24T08:04:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.218+0000 7fcbd5e60700 1 -- 172.21.15.153:0/223223459 wait complete. 2023-11-24T08:04:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.220+0000 7fcbd5e60700 1 Processor -- start 2023-11-24T08:04:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.220+0000 7fcbd5e60700 1 -- start start 2023-11-24T08:04:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.220+0000 7fcbd5e60700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbd006b700 0x7fcbd00cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.220+0000 7fcbd5e60700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbd00b93c0 0x7fcbd00cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.220+0000 7fcbd5e60700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd015e320 0x7fcbd01512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.220+0000 7fcbd5e60700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00cefb0 con 0x7fcbd015e320 2023-11-24T08:04:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.220+0000 7fcbd5e60700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00c9fb0 con 0x7fcbd00b93c0 2023-11-24T08:04:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.220+0000 7fcbd5e60700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00cc060 con 0x7fcbd006b700 2023-11-24T08:04:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbcffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd015e320 0x7fcbd01512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbcffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd015e320 0x7fcbd01512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35986/0 (socket says 172.21.15.153:35986) 2023-11-24T08:04:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbcffff700 1 -- 172.21.15.153:0/1844123442 learned_addr learned my addr 172.21.15.153:0/1844123442 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbcf7fe700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbd006b700 0x7fcbd00cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbceffd700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbd00b93c0 0x7fcbd00cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbcffff700 1 -- 172.21.15.153:0/1844123442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbd006b700 msgr2=0x7fcbd00cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbcffff700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbd006b700 0x7fcbd00cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbcffff700 1 -- 172.21.15.153:0/1844123442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbd00b93c0 msgr2=0x7fcbd00cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbcffff700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbd00b93c0 0x7fcbd00cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbcffff700 1 -- 172.21.15.153:0/1844123442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4009550 con 0x7fcbd015e320 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbceffd700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbd00b93c0 0x7fcbd00cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbcffff700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd015e320 0x7fcbd01512c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8007e10 tx=0x7fcbc800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbb7fff700 1 -- 172.21.15.153:0/1844123442 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc800ede0 con 0x7fcbd015e320 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbb7fff700 1 -- 172.21.15.153:0/1844123442 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc8014420 con 0x7fcbd015e320 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbd5e60700 1 -- 172.21.15.153:0/1844123442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd0151800 con 0x7fcbd015e320 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbb7fff700 1 -- 172.21.15.153:0/1844123442 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80147d0 con 0x7fcbd015e320 2023-11-24T08:04:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.221+0000 7fcbd5e60700 1 -- 172.21.15.153:0/1844123442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd00cb070 con 0x7fcbd015e320 2023-11-24T08:04:25.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.222+0000 7fcbd5e60700 1 -- 172.21.15.153:0/1844123442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd00cfc10 con 0x7fcbd015e320 2023-11-24T08:04:25.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.223+0000 7fcbb7fff700 1 -- 172.21.15.153:0/1844123442 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbc8014930 con 0x7fcbd015e320 2023-11-24T08:04:25.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.223+0000 7fcbb7fff700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcbbc06aed0 0x7fcbbc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.223+0000 7fcbb7fff700 1 -- 172.21.15.153:0/1844123442 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbc8089c40 con 0x7fcbd015e320 2023-11-24T08:04:25.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.223+0000 7fcbcf7fe700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcbbc06aed0 0x7fcbbc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.224+0000 7fcbcf7fe700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcbbc06aed0 0x7fcbbc06d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4014040 tx=0x7fcbc4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.227+0000 7fcbb7fff700 1 -- 172.21.15.153:0/1844123442 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcbc8054d80 con 0x7fcbd015e320 2023-11-24T08:04:25.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.420+0000 7fcbd5e60700 1 -- 172.21.15.153:0/1844123442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbd0068fb0 con 0x7fcbd015e320 2023-11-24T08:04:25.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.421+0000 7fcbb7fff700 1 -- 172.21.15.153:0/1844123442 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbc80583a0 con 0x7fcbd015e320 2023-11-24T08:04:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:25.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 -- 172.21.15.153:0/1844123442 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcbbc06aed0 msgr2=0x7fcbbc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcbbc06aed0 0x7fcbbc06d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4014040 tx=0x7fcbc4008030 comp rx=0 tx=0).stop 2023-11-24T08:04:25.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 -- 172.21.15.153:0/1844123442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd015e320 msgr2=0x7fcbd01512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd015e320 0x7fcbd01512c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8007e10 tx=0x7fcbc800e3c0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 -- 172.21.15.153:0/1844123442 shutdown_connections 2023-11-24T08:04:25.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fcbbc06aed0 0x7fcbbc06d390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd015e320 0x7fcbd01512c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbd006b700 0x7fcbd00cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 --2- 172.21.15.153:0/1844123442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbd00b93c0 0x7fcbd00cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 -- 172.21.15.153:0/1844123442 >> 172.21.15.153:0/1844123442 conn(0x7fcbd00d3e50 msgr2=0x7fcbd00b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 -- 172.21.15.153:0/1844123442 shutdown_connections 2023-11-24T08:04:25.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.423+0000 7fcbd5e60700 1 -- 172.21.15.153:0/1844123442 wait complete. 2023-11-24T08:04:25.437 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:25.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.556+0000 7f8c48896700 1 Processor -- start 2023-11-24T08:04:25.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.556+0000 7f8c48896700 1 -- start start 2023-11-24T08:04:25.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.557+0000 7f8c48896700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8c4406c710 0x7f8c440b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.557+0000 7f8c48896700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c440af4d0 0x7f8c440afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.557+0000 7f8c48896700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c440ae430 con 0x7f8c4415e080 2023-11-24T08:04:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.557+0000 7f8c48896700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c440af0b0 con 0x7f8c4406c710 2023-11-24T08:04:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.557+0000 7f8c48896700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c440b05a0 con 0x7f8c440af4d0 2023-11-24T08:04:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c41d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8c4406c710 0x7f8c440b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c41d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8c4406c710 0x7f8c440b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35992/0 (socket says 172.21.15.153:35992) 2023-11-24T08:04:25.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c41d9b700 1 -- 172.21.15.153:0/2863207367 learned_addr learned my addr 172.21.15.153:0/2863207367 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:25.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c42d9d700 1 --2- 172.21.15.153:0/2863207367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c440af4d0 0x7f8c440afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c41d9b700 1 -- 172.21.15.153:0/2863207367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c440af4d0 msgr2=0x7f8c440afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:25.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c41d9b700 1 --2- 172.21.15.153:0/2863207367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c440af4d0 0x7f8c440afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c41d9b700 1 -- 172.21.15.153:0/2863207367 >> v1:172.21.15.164:6789/0 conn(0x7f8c4415e080 legacy=0x7f8c4406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c41d9b700 1 -- 172.21.15.153:0/2863207367 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c440ae710 con 0x7f8c4406c710 2023-11-24T08:04:25.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c41d9b700 1 --2- 172.21.15.153:0/2863207367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c4406c710 0x7f8c440b5050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c340098f0 tx=0x7f8c34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95e18761bba2f07 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c4159a700 1 -- 172.21.15.153:0/2863207367 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34011830 con 0x7f8c4406c710 2023-11-24T08:04:25.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c4159a700 1 -- 172.21.15.153:0/2863207367 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c34011990 con 0x7f8c4406c710 2023-11-24T08:04:25.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.558+0000 7f8c4159a700 1 -- 172.21.15.153:0/2863207367 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34011d20 con 0x7f8c4406c710 2023-11-24T08:04:25.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.559+0000 7f8c48896700 1 -- 172.21.15.153:0/2863207367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c4406c710 msgr2=0x7f8c440b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.559+0000 7f8c48896700 1 --2- 172.21.15.153:0/2863207367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c4406c710 0x7f8c440b5050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c340098f0 tx=0x7f8c34009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:25.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.559+0000 7f8c48896700 1 -- 172.21.15.153:0/2863207367 shutdown_connections 2023-11-24T08:04:25.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.559+0000 7f8c48896700 1 --2- 172.21.15.153:0/2863207367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c440af4d0 0x7f8c440afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.559+0000 7f8c48896700 1 --2- 172.21.15.153:0/2863207367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c4406c710 0x7f8c440b5050 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.559+0000 7f8c48896700 1 -- 172.21.15.153:0/2863207367 >> 172.21.15.153:0/2863207367 conn(0x7f8c44071b90 msgr2=0x7f8c44071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.559+0000 7f8c48896700 1 -- 172.21.15.153:0/2863207367 shutdown_connections 2023-11-24T08:04:25.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.559+0000 7f8c48896700 1 -- 172.21.15.153:0/2863207367 wait complete. 2023-11-24T08:04:25.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.560+0000 7f8c48896700 1 Processor -- start 2023-11-24T08:04:25.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.560+0000 7f8c48896700 1 -- start start 2023-11-24T08:04:25.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c48896700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c4406c710 0x7f8c44156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c48896700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c440af4d0 0x7f8c441f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c48896700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c4415e080 0x7f8c44160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c48896700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4415e840 con 0x7f8c440af4d0 2023-11-24T08:04:25.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c48896700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c441f3ff0 con 0x7f8c4415e080 2023-11-24T08:04:25.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c48896700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c441f42d0 con 0x7f8c4406c710 2023-11-24T08:04:25.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c41d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c440af4d0 0x7f8c441f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c41d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c440af4d0 0x7f8c441f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35998/0 (socket says 172.21.15.153:35998) 2023-11-24T08:04:25.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c41d9b700 1 -- 172.21.15.153:0/3691842043 learned_addr learned my addr 172.21.15.153:0/3691842043 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:25.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c42d9d700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c4415e080 0x7f8c44160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c4259c700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c4406c710 0x7f8c44156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c41d9b700 1 -- 172.21.15.153:0/3691842043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c4406c710 msgr2=0x7f8c44156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c41d9b700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c4406c710 0x7f8c44156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c41d9b700 1 -- 172.21.15.153:0/3691842043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c4415e080 msgr2=0x7f8c44160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c41d9b700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c4415e080 0x7f8c44160db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c41d9b700 1 -- 172.21.15.153:0/3691842043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c34009550 con 0x7f8c440af4d0 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.561+0000 7f8c41d9b700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c440af4d0 0x7f8c441f3760 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c34000c00 tx=0x7f8c34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.562+0000 7f8c32ffd700 1 -- 172.21.15.153:0/3691842043 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34004570 con 0x7f8c440af4d0 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.562+0000 7f8c32ffd700 1 -- 172.21.15.153:0/3691842043 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3401f070 con 0x7f8c440af4d0 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.562+0000 7f8c48896700 1 -- 172.21.15.153:0/3691842043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c441f45b0 con 0x7f8c440af4d0 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.562+0000 7f8c32ffd700 1 -- 172.21.15.153:0/3691842043 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c340038c0 con 0x7f8c440af4d0 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.562+0000 7f8c48896700 1 -- 172.21.15.153:0/3691842043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c441f3ca0 con 0x7f8c440af4d0 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.563+0000 7f8c48896700 1 -- 172.21.15.153:0/3691842043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c440753f0 con 0x7f8c440af4d0 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.563+0000 7f8c32ffd700 1 -- 172.21.15.153:0/3691842043 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c34021030 con 0x7f8c440af4d0 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.563+0000 7f8c32ffd700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8c2406af00 0x7f8c2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.564+0000 7f8c32ffd700 1 -- 172.21.15.153:0/3691842043 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c3408a9a0 con 0x7f8c440af4d0 2023-11-24T08:04:25.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.564+0000 7f8c4259c700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8c2406af00 0x7f8c2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.564+0000 7f8c4259c700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8c2406af00 0x7f8c2406d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8c38000f60 tx=0x7f8c38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.568+0000 7f8c32ffd700 1 -- 172.21.15.153:0/3691842043 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c34055ae0 con 0x7f8c440af4d0 2023-11-24T08:04:25.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.803+0000 7f8c48896700 1 -- 172.21.15.153:0/3691842043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c44072cf0 con 0x7f8c440af4d0 2023-11-24T08:04:25.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.804+0000 7f8c32ffd700 1 -- 172.21.15.153:0/3691842043 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f8c34015020 con 0x7f8c440af4d0 2023-11-24T08:04:25.806 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:25.806 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/157182640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":157182640},{"type":"v1","addr":"172.21.15.153:6837","nonce":157182640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2853134113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2853134113},{"type":"v1","addr":"172.21.15.153:6836","nonce":2853134113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1191113201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1191113201},{"type":"v1","addr":"172.21.15.164:6833","nonce":1191113201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:12.137876+0000","modified":"2023-11-24T08:04:15.171907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1557353565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1557353565},{"type":"v1","addr":"172.21.15.164:6835","nonce":1557353565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:25.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 -- 172.21.15.153:0/3691842043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8c2406af00 msgr2=0x7f8c2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8c2406af00 0x7f8c2406d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8c38000f60 tx=0x7f8c38009040 comp rx=0 tx=0).stop 2023-11-24T08:04:25.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 -- 172.21.15.153:0/3691842043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c440af4d0 msgr2=0x7f8c441f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c440af4d0 0x7f8c441f3760 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c34000c00 tx=0x7f8c34004750 comp rx=0 tx=0).stop 2023-11-24T08:04:25.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 -- 172.21.15.153:0/3691842043 shutdown_connections 2023-11-24T08:04:25.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c4415e080 0x7f8c44160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c4406c710 0x7f8c44156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8c2406af00 0x7f8c2406d3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 --2- 172.21.15.153:0/3691842043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c440af4d0 0x7f8c441f3760 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 -- 172.21.15.153:0/3691842043 >> 172.21.15.153:0/3691842043 conn(0x7f8c44071b90 msgr2=0x7f8c4406be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 -- 172.21.15.153:0/3691842043 shutdown_connections 2023-11-24T08:04:25.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.806+0000 7f8c48896700 1 -- 172.21.15.153:0/3691842043 wait complete. 2023-11-24T08:04:25.809 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2023-11-24T08:04:25.821 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:25.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.939+0000 7fba4653a700 1 Processor -- start 2023-11-24T08:04:25.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.940+0000 7fba4653a700 1 -- start start 2023-11-24T08:04:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.940+0000 7fba4653a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fba401446a0 0x7fba400b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.940+0000 7fba4653a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba400adf00 0x7fba4006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.940+0000 7fba4653a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba400af950 con 0x7fba4006c540 2023-11-24T08:04:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.940+0000 7fba4653a700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba40144a80 con 0x7fba401446a0 2023-11-24T08:04:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.940+0000 7fba4653a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4006c9b0 con 0x7fba400adf00 2023-11-24T08:04:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3f7fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba400adf00 0x7fba4006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3ffff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fba401446a0 0x7fba400b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3f7fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba400adf00 0x7fba4006c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:48074/0 (socket says 172.21.15.153:48074) 2023-11-24T08:04:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba44ad7700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fba4006c540 0x7fba4006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:49792/0 (socket says 172.21.15.153:49792) 2023-11-24T08:04:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3ffff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fba401446a0 0x7fba400b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57590/0 (socket says 172.21.15.153:57590) 2023-11-24T08:04:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3f7fe700 1 -- 172.21.15.153:0/2501805125 learned_addr learned my addr 172.21.15.153:0/2501805125 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3f7fe700 1 -- 172.21.15.153:0/2501805125 >> v2:172.21.15.164:3300/0 conn(0x7fba401446a0 msgr2=0x7fba400b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3f7fe700 1 --2- 172.21.15.153:0/2501805125 >> v2:172.21.15.164:3300/0 conn(0x7fba401446a0 0x7fba400b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3f7fe700 1 -- 172.21.15.153:0/2501805125 >> v1:172.21.15.164:6789/0 conn(0x7fba4006c540 legacy=0x7fba4006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3f7fe700 1 -- 172.21.15.153:0/2501805125 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba400afc30 con 0x7fba400adf00 2023-11-24T08:04:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3ffff700 1 --2- 172.21.15.153:0/2501805125 >> v2:172.21.15.164:3300/0 conn(0x7fba401446a0 0x7fba400b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3f7fe700 1 --2- 172.21.15.153:0/2501805125 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba400adf00 0x7fba4006c000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba300098f0 tx=0x7fba30009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b34d4b67e1f0c92c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3effd700 1 -- 172.21.15.153:0/2501805125 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30011830 con 0x7fba400adf00 2023-11-24T08:04:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3effd700 1 -- 172.21.15.153:0/2501805125 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30011990 con 0x7fba400adf00 2023-11-24T08:04:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.941+0000 7fba3effd700 1 -- 172.21.15.153:0/2501805125 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30011d20 con 0x7fba400adf00 2023-11-24T08:04:25.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.942+0000 7fba4653a700 1 -- 172.21.15.153:0/2501805125 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba400adf00 msgr2=0x7fba4006c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.942+0000 7fba4653a700 1 --2- 172.21.15.153:0/2501805125 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba400adf00 0x7fba4006c000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba300098f0 tx=0x7fba30009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:25.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.942+0000 7fba4653a700 1 -- 172.21.15.153:0/2501805125 shutdown_connections 2023-11-24T08:04:25.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.942+0000 7fba4653a700 1 --2- 172.21.15.153:0/2501805125 >> v2:172.21.15.164:3300/0 conn(0x7fba401446a0 0x7fba400b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.942+0000 7fba4653a700 1 --2- 172.21.15.153:0/2501805125 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba400adf00 0x7fba4006c000 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.942+0000 7fba4653a700 1 -- 172.21.15.153:0/2501805125 >> 172.21.15.153:0/2501805125 conn(0x7fba40071b90 msgr2=0x7fba40071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.942+0000 7fba4653a700 1 -- 172.21.15.153:0/2501805125 shutdown_connections 2023-11-24T08:04:25.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.942+0000 7fba4653a700 1 -- 172.21.15.153:0/2501805125 wait complete. 2023-11-24T08:04:25.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.943+0000 7fba4653a700 1 Processor -- start 2023-11-24T08:04:25.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.943+0000 7fba4653a700 1 -- start start 2023-11-24T08:04:25.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.944+0000 7fba4653a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba4006c540 0x7fba40155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.944+0000 7fba4653a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba400adf00 0x7fba4013b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.944+0000 7fba4653a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba401446a0 0x7fba400ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.944+0000 7fba4653a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba40142c10 con 0x7fba401446a0 2023-11-24T08:04:25.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.944+0000 7fba4653a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4013bcc0 con 0x7fba400adf00 2023-11-24T08:04:25.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.944+0000 7fba4653a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba40156840 con 0x7fba4006c540 2023-11-24T08:04:25.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.944+0000 7fba44ad7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba401446a0 0x7fba400ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.944+0000 7fba44ad7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba401446a0 0x7fba400ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36012/0 (socket says 172.21.15.153:36012) 2023-11-24T08:04:25.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.944+0000 7fba44ad7700 1 -- 172.21.15.153:0/596988457 learned_addr learned my addr 172.21.15.153:0/596988457 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:25.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.944+0000 7fba3f7fe700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba400adf00 0x7fba4013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.944+0000 7fba3ffff700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba4006c540 0x7fba40155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.945+0000 7fba44ad7700 1 -- 172.21.15.153:0/596988457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba4006c540 msgr2=0x7fba40155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.945+0000 7fba44ad7700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba4006c540 0x7fba40155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.945+0000 7fba44ad7700 1 -- 172.21.15.153:0/596988457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba400adf00 msgr2=0x7fba4013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.945+0000 7fba44ad7700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba400adf00 0x7fba4013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.945+0000 7fba44ad7700 1 -- 172.21.15.153:0/596988457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba340094a0 con 0x7fba401446a0 2023-11-24T08:04:25.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.945+0000 7fba44ad7700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba401446a0 0x7fba400ceff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fba3800cbd0 tx=0x7fba3800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.945+0000 7fba3cff9700 1 -- 172.21.15.153:0/596988457 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800aaa0 con 0x7fba401446a0 2023-11-24T08:04:25.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.945+0000 7fba3cff9700 1 -- 172.21.15.153:0/596988457 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3800ac00 con 0x7fba401446a0 2023-11-24T08:04:25.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.945+0000 7fba4653a700 1 -- 172.21.15.153:0/596988457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba30009550 con 0x7fba401446a0 2023-11-24T08:04:25.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.945+0000 7fba3cff9700 1 -- 172.21.15.153:0/596988457 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba38007070 con 0x7fba401446a0 2023-11-24T08:04:25.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.945+0000 7fba4653a700 1 -- 172.21.15.153:0/596988457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba401422e0 con 0x7fba401446a0 2023-11-24T08:04:25.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.946+0000 7fba4653a700 1 -- 172.21.15.153:0/596988457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba400753f0 con 0x7fba401446a0 2023-11-24T08:04:25.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.946+0000 7fba3cff9700 1 -- 172.21.15.153:0/596988457 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba380071d0 con 0x7fba401446a0 2023-11-24T08:04:25.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.947+0000 7fba3cff9700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba2c06aed0 0x7fba2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.947+0000 7fba3cff9700 1 -- 172.21.15.153:0/596988457 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba380892e0 con 0x7fba401446a0 2023-11-24T08:04:25.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.947+0000 7fba3ffff700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba2c06aed0 0x7fba2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.947+0000 7fba3ffff700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba2c06aed0 0x7fba2c06d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba34009cd0 tx=0x7fba34009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:25.951+0000 7fba3cff9700 1 -- 172.21.15.153:0/596988457 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba38054320 con 0x7fba401446a0 2023-11-24T08:04:26.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.144+0000 7fba4653a700 1 -- 172.21.15.153:0/596988457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba40067f60 con 0x7fba401446a0 2023-11-24T08:04:26.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.145+0000 7fba3cff9700 1 -- 172.21.15.153:0/596988457 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fba38057940 con 0x7fba401446a0 2023-11-24T08:04:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:26.147 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:26.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 -- 172.21.15.153:0/596988457 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba2c06aed0 msgr2=0x7fba2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba2c06aed0 0x7fba2c06d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba34009cd0 tx=0x7fba34009210 comp rx=0 tx=0).stop 2023-11-24T08:04:26.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 -- 172.21.15.153:0/596988457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba401446a0 msgr2=0x7fba400ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba401446a0 0x7fba400ceff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fba3800cbd0 tx=0x7fba3800cee0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 -- 172.21.15.153:0/596988457 shutdown_connections 2023-11-24T08:04:26.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba2c06aed0 0x7fba2c06d390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba401446a0 0x7fba400ceff0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba4006c540 0x7fba40155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 --2- 172.21.15.153:0/596988457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba400adf00 0x7fba4013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 -- 172.21.15.153:0/596988457 >> 172.21.15.153:0/596988457 conn(0x7fba40071b90 msgr2=0x7fba400b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:26.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 -- 172.21.15.153:0/596988457 shutdown_connections 2023-11-24T08:04:26.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.147+0000 7fba4653a700 1 -- 172.21.15.153:0/596988457 wait complete. 2023-11-24T08:04:26.162 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.283+0000 7f20720dc700 1 Processor -- start 2023-11-24T08:04:26.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.283+0000 7f20720dc700 1 -- start start 2023-11-24T08:04:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f20720dc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f206c15bdd0 0x7f206c1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f20720dc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f206c0d1c70 0x7f206c0d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f20720dc700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c0b22d0 con 0x7f206c0b3370 2023-11-24T08:04:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f20720dc700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c0b2f50 con 0x7f206c15bdd0 2023-11-24T08:04:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f20720dc700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c0d2640 con 0x7f206c0d1c70 2023-11-24T08:04:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f206c15bdd0 0x7f206c1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206affd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f206c0b3370 0x7f206c0b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42122/0 (socket says 172.21.15.153:42122) 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f206c15bdd0 0x7f206c1604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36016/0 (socket says 172.21.15.153:36016) 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206affd700 1 -- 172.21.15.153:0/256369005 learned_addr learned my addr 172.21.15.153:0/256369005 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206bfff700 1 --2- 172.21.15.153:0/256369005 >> v2:172.21.15.164:3300/0 conn(0x7f206c0d1c70 0x7f206c0d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206b7fe700 1 -- 172.21.15.153:0/256369005 >> v2:172.21.15.164:3300/0 conn(0x7f206c0d1c70 msgr2=0x7f206c0d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206b7fe700 1 --2- 172.21.15.153:0/256369005 >> v2:172.21.15.164:3300/0 conn(0x7f206c0d1c70 0x7f206c0d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206b7fe700 1 -- 172.21.15.153:0/256369005 >> v1:172.21.15.153:6789/0 conn(0x7f206c0b3370 legacy=0x7f206c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206a7fc700 1 -- 172.21.15.153:0/256369005 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154392708 0 0) 0x7f206c0b22d0 con 0x7f206c0b3370 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206b7fe700 1 -- 172.21.15.153:0/256369005 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c0b25b0 con 0x7f206c15bdd0 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206bfff700 1 --2- 172.21.15.153:0/256369005 >> v2:172.21.15.164:3300/0 conn(0x7f206c0d1c70 0x7f206c0d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206b7fe700 1 --2- 172.21.15.153:0/256369005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206c15bdd0 0x7f206c1604e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f206c160a50 tx=0x7f2054009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f143e12579dca61 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206a7fc700 1 -- 172.21.15.153:0/256369005 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2054011830 con 0x7f206c15bdd0 2023-11-24T08:04:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206a7fc700 1 -- 172.21.15.153:0/256369005 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2054011990 con 0x7f206c15bdd0 2023-11-24T08:04:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.284+0000 7f206a7fc700 1 -- 172.21.15.153:0/256369005 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2054011d20 con 0x7f206c15bdd0 2023-11-24T08:04:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.285+0000 7f20720dc700 1 -- 172.21.15.153:0/256369005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206c15bdd0 msgr2=0x7f206c1604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.285+0000 7f20720dc700 1 --2- 172.21.15.153:0/256369005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206c15bdd0 0x7f206c1604e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f206c160a50 tx=0x7f2054009b20 comp rx=0 tx=0).stop 2023-11-24T08:04:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.285+0000 7f20720dc700 1 -- 172.21.15.153:0/256369005 shutdown_connections 2023-11-24T08:04:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.285+0000 7f20720dc700 1 --2- 172.21.15.153:0/256369005 >> v2:172.21.15.164:3300/0 conn(0x7f206c0d1c70 0x7f206c0d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.285+0000 7f20720dc700 1 --2- 172.21.15.153:0/256369005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206c15bdd0 0x7f206c1604e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.285+0000 7f20720dc700 1 -- 172.21.15.153:0/256369005 >> 172.21.15.153:0/256369005 conn(0x7f206c0731a0 msgr2=0x7f206c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.285+0000 7f20720dc700 1 -- 172.21.15.153:0/256369005 shutdown_connections 2023-11-24T08:04:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.285+0000 7f20720dc700 1 -- 172.21.15.153:0/256369005 wait complete. 2023-11-24T08:04:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.286+0000 7f20720dc700 1 Processor -- start 2023-11-24T08:04:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.286+0000 7f20720dc700 1 -- start start 2023-11-24T08:04:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f20720dc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206c0b3370 0x7f206c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f20720dc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f206c0d1c70 0x7f206c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f20720dc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206c15bdd0 0x7f206c0b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f20720dc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c06b4c0 con 0x7f206c15bdd0 2023-11-24T08:04:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f20720dc700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c06b170 con 0x7f206c0b3370 2023-11-24T08:04:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f20720dc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0b5b20 con 0x7f206c0d1c70 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f206bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206c15bdd0 0x7f206c0b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f206bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206c15bdd0 0x7f206c0b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36026/0 (socket says 172.21.15.153:36026) 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f206bfff700 1 -- 172.21.15.153:0/2341214916 learned_addr learned my addr 172.21.15.153:0/2341214916 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f206b7fe700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206c0b3370 0x7f206c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f206affd700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f206c0d1c70 0x7f206c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f206bfff700 1 -- 172.21.15.153:0/2341214916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f206c0d1c70 msgr2=0x7f206c14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f206bfff700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f206c0d1c70 0x7f206c14f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f206bfff700 1 -- 172.21.15.153:0/2341214916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206c0b3370 msgr2=0x7f206c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f206bfff700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206c0b3370 0x7f206c0cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f206bfff700 1 -- 172.21.15.153:0/2341214916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540094a0 con 0x7f206c15bdd0 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.287+0000 7f206affd700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f206c0d1c70 0x7f206c14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.288+0000 7f206bfff700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206c15bdd0 0x7f206c0b55e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f206400cef0 tx=0x7f206400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.288+0000 7f2063fff700 1 -- 172.21.15.153:0/2341214916 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400ae50 con 0x7f206c15bdd0 2023-11-24T08:04:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.288+0000 7f2063fff700 1 -- 172.21.15.153:0/2341214916 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2064015440 con 0x7f206c15bdd0 2023-11-24T08:04:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.288+0000 7f20720dc700 1 -- 172.21.15.153:0/2341214916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c0cde10 con 0x7f206c15bdd0 2023-11-24T08:04:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.288+0000 7f2063fff700 1 -- 172.21.15.153:0/2341214916 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20640157f0 con 0x7f206c15bdd0 2023-11-24T08:04:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.288+0000 7f20720dc700 1 -- 172.21.15.153:0/2341214916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c0c5e50 con 0x7f206c15bdd0 2023-11-24T08:04:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.289+0000 7f20720dc700 1 -- 172.21.15.153:0/2341214916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c0ce330 con 0x7f206c15bdd0 2023-11-24T08:04:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.289+0000 7f2063fff700 1 -- 172.21.15.153:0/2341214916 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f206400d430 con 0x7f206c15bdd0 2023-11-24T08:04:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.289+0000 7f2063fff700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 0x7f204c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.290+0000 7f2063fff700 1 -- 172.21.15.153:0/2341214916 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2064089bb0 con 0x7f206c15bdd0 2023-11-24T08:04:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.290+0000 7f206b7fe700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 0x7f204c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.290+0000 7f206b7fe700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 0x7f204c06d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f20540090b0 tx=0x7f205401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.294+0000 7f2063fff700 1 -- 172.21.15.153:0/2341214916 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2064054cf0 con 0x7f206c15bdd0 2023-11-24T08:04:26.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.528+0000 7f20720dc700 1 -- 172.21.15.153:0/2341214916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f206c067f60 con 0x7f206c15bdd0 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.528+0000 7f2063fff700 1 -- 172.21.15.153:0/2341214916 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f206401a020 con 0x7f206c15bdd0 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/157182640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":157182640},{"type":"v1","addr":"172.21.15.153:6837","nonce":157182640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2853134113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2853134113},{"type":"v1","addr":"172.21.15.153:6836","nonce":2853134113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1191113201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1191113201},{"type":"v1","addr":"172.21.15.164:6833","nonce":1191113201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:12.137876+0000","modified":"2023-11-24T08:04:15.171907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1557353565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1557353565},{"type":"v1","addr":"172.21.15.164:6835","nonce":1557353565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:26.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.530+0000 7f20720dc700 1 -- 172.21.15.153:0/2341214916 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 msgr2=0x7f204c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.530+0000 7f20720dc700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 0x7f204c06d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f20540090b0 tx=0x7f205401c040 comp rx=0 tx=0).stop 2023-11-24T08:04:26.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.530+0000 7f20720dc700 1 -- 172.21.15.153:0/2341214916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206c15bdd0 msgr2=0x7f206c0b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.530+0000 7f20720dc700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206c15bdd0 0x7f206c0b55e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f206400cef0 tx=0x7f206400a340 comp rx=0 tx=0).stop 2023-11-24T08:04:26.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.530+0000 7f20720dc700 1 -- 172.21.15.153:0/2341214916 shutdown_connections 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.530+0000 7f20720dc700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f204c06aed0 0x7f204c06d390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.530+0000 7f20720dc700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f206c15bdd0 0x7f206c0b55e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.530+0000 7f20720dc700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206c0b3370 0x7f206c0cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.530+0000 7f20720dc700 1 --2- 172.21.15.153:0/2341214916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f206c0d1c70 0x7f206c14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.530+0000 7f20720dc700 1 -- 172.21.15.153:0/2341214916 >> 172.21.15.153:0/2341214916 conn(0x7f206c0731a0 msgr2=0x7f206c15a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.530+0000 7f20720dc700 1 -- 172.21.15.153:0/2341214916 shutdown_connections 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:26.531+0000 7f20720dc700 1 -- 172.21.15.153:0/2341214916 wait complete. 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2023-11-24T08:04:26.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:04:12.137876+0000', 'modified': '2023-11-24T08:04:15.171907+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.164:6835/1557353565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 1557353565}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 1557353565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:04:26.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:04:26.947 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-24T08:04:27.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.069+0000 7f27eac76700 1 Processor -- start 2023-11-24T08:04:27.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.069+0000 7f27eac76700 1 -- start start 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.070+0000 7f27eac76700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f27e415ae20 0x7f27e40b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.070+0000 7f27eac76700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40cfd40 con 0x7f27e415b200 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.070+0000 7f27eac76700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40affa0 con 0x7f27e40b1a70 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.070+0000 7f27eac76700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e40d0020 con 0x7f27e415ae20 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.070+0000 7f27e3fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f27e415b200 0x7f27e40b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42134/0 (socket says 172.21.15.153:42134) 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.070+0000 7f27e3fff700 1 -- 172.21.15.153:0/862655695 learned_addr learned my addr 172.21.15.153:0/862655695 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e8a12700 1 --2- 172.21.15.153:0/862655695 >> v2:172.21.15.164:3300/0 conn(0x7f27e415ae20 0x7f27e40b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509953600 0 0) 0x7f27e40cfd40 con 0x7f27e415b200 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d40035b0 con 0x7f27e415b200 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 556520758 0 0) 0x7f27d40035b0 con 0x7f27e415b200 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 >> v2:172.21.15.164:3300/0 conn(0x7f27e415ae20 msgr2=0x7f27e40b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 --2- 172.21.15.153:0/862655695 >> v2:172.21.15.164:3300/0 conn(0x7f27e415ae20 0x7f27e40b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 >> v1:172.21.15.164:6789/0 conn(0x7f27e40b1a70 legacy=0x7f27e4164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40b0280 con 0x7f27e415b200 2023-11-24T08:04:27.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f27d0001670 con 0x7f27e415b200 2023-11-24T08:04:27.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 >> v1:172.21.15.153:6789/0 conn(0x7f27e415b200 legacy=0x7f27e40b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 --2- 172.21.15.153:0/862655695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d4003a00 0x7f27d4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 --2- 172.21.15.153:0/862655695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d4004850 0x7f27d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 --2- 172.21.15.153:0/862655695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d4005210 0x7f27d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40d0020 con 0x7f27d4004850 2023-11-24T08:04:27.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d400c1b0 con 0x7f27d4003a00 2023-11-24T08:04:27.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d400c370 con 0x7f27d4005210 2023-11-24T08:04:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e3fff700 1 --2- 172.21.15.153:0/862655695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d4004850 0x7f27d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e8a12700 1 --2- 172.21.15.153:0/862655695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d4003a00 0x7f27d4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e9213700 1 --2- 172.21.15.153:0/862655695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d4005210 0x7f27d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e3fff700 1 -- 172.21.15.153:0/862655695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d4005210 msgr2=0x7f27d400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e3fff700 1 --2- 172.21.15.153:0/862655695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d4005210 0x7f27d400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e3fff700 1 -- 172.21.15.153:0/862655695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d4003a00 msgr2=0x7f27d4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e3fff700 1 --2- 172.21.15.153:0/862655695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d4003a00 0x7f27d4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e9213700 1 -- 172.21.15.153:0/862655695 reap_dead start 2023-11-24T08:04:27.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e3fff700 1 -- 172.21.15.153:0/862655695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40035b0 con 0x7f27d4004850 2023-11-24T08:04:27.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e3fff700 1 --2- 172.21.15.153:0/862655695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d4004850 0x7f27d4004cd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f27e406d1d0 tx=0x7f27d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2047e1861d2fea8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.071+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0007c10 con 0x7f27d4004850 2023-11-24T08:04:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.072+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d000cd20 con 0x7f27d4004850 2023-11-24T08:04:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.072+0000 7f27e37fe700 1 -- 172.21.15.153:0/862655695 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0005ba0 con 0x7f27d4004850 2023-11-24T08:04:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.072+0000 7f27eac76700 1 -- 172.21.15.153:0/862655695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d4004850 msgr2=0x7f27d4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.072+0000 7f27eac76700 1 --2- 172.21.15.153:0/862655695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d4004850 0x7f27d4004cd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f27e406d1d0 tx=0x7f27d4005880 comp rx=0 tx=0).stop 2023-11-24T08:04:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.072+0000 7f27eac76700 1 -- 172.21.15.153:0/862655695 shutdown_connections 2023-11-24T08:04:27.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.072+0000 7f27eac76700 1 --2- 172.21.15.153:0/862655695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d4004850 0x7f27d4004cd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.072+0000 7f27eac76700 1 -- 172.21.15.153:0/862655695 >> 172.21.15.153:0/862655695 conn(0x7f27e40b57b0 msgr2=0x7f27e40b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.072+0000 7f27eac76700 1 -- 172.21.15.153:0/862655695 shutdown_connections 2023-11-24T08:04:27.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.072+0000 7f27eac76700 1 -- 172.21.15.153:0/862655695 wait complete. 2023-11-24T08:04:27.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.073+0000 7f27eac76700 1 Processor -- start 2023-11-24T08:04:27.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.073+0000 7f27eac76700 1 -- start start 2023-11-24T08:04:27.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.074+0000 7f27eac76700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d4004850 0x7f27e4146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.074+0000 7f27eac76700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27e40ca6c0 0x7f27e4169c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.074+0000 7f27eac76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e40b3f90 0x7f27e40999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.074+0000 7f27eac76700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4099f20 con 0x7f27e40b3f90 2023-11-24T08:04:27.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.074+0000 7f27eac76700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40ae740 con 0x7f27d4004850 2023-11-24T08:04:27.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.074+0000 7f27eac76700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40ae110 con 0x7f27e40ca6c0 2023-11-24T08:04:27.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.074+0000 7f27e9213700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e40b3f90 0x7f27e40999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.074+0000 7f27e9213700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e40b3f90 0x7f27e40999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36044/0 (socket says 172.21.15.153:36044) 2023-11-24T08:04:27.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.074+0000 7f27e9213700 1 -- 172.21.15.153:0/290667221 learned_addr learned my addr 172.21.15.153:0/290667221 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:27.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.074+0000 7f27e3fff700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27e40ca6c0 0x7f27e4169c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.074+0000 7f27e8a12700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d4004850 0x7f27e4146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.075+0000 7f27e9213700 1 -- 172.21.15.153:0/290667221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27e40ca6c0 msgr2=0x7f27e4169c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.075+0000 7f27e9213700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27e40ca6c0 0x7f27e4169c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.075+0000 7f27e9213700 1 -- 172.21.15.153:0/290667221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d4004850 msgr2=0x7f27e4146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.075+0000 7f27e9213700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d4004850 0x7f27e4146390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.075+0000 7f27e9213700 1 -- 172.21.15.153:0/290667221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40cd950 con 0x7f27e40b3f90 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.075+0000 7f27e9213700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e40b3f90 0x7f27e40999e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f27e40cea90 tx=0x7f27dc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.075+0000 7f27e17fa700 1 -- 172.21.15.153:0/290667221 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc003c10 con 0x7f27e40b3f90 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.075+0000 7f27e17fa700 1 -- 172.21.15.153:0/290667221 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc003d90 con 0x7f27e40b3f90 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.075+0000 7f27eac76700 1 -- 172.21.15.153:0/290667221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e40ae3d0 con 0x7f27e40b3f90 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.075+0000 7f27e17fa700 1 -- 172.21.15.153:0/290667221 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc00db70 con 0x7f27e40b3f90 2023-11-24T08:04:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.075+0000 7f27eac76700 1 -- 172.21.15.153:0/290667221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e40c9610 con 0x7f27e40b3f90 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.076+0000 7f27e17fa700 1 -- 172.21.15.153:0/290667221 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27dc00dcd0 con 0x7f27e40b3f90 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.077+0000 7f27e17fa700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c806aed0 0x7f27c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.077+0000 7f27e8a12700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c806aed0 0x7f27c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.077+0000 7f27e17fa700 1 -- 172.21.15.153:0/290667221 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27dc089830 con 0x7f27e40b3f90 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.077+0000 7f27e8a12700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c806aed0 0x7f27c806d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009ba0 tx=0x7f27d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.079+0000 7f27f6e6fb80 1 Processor -- start 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.079+0000 7f27f6e6fb80 1 -- start start 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0e080 0x55ce1df54840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df23ed0 0x55ce1df54d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0b490 0x55ce1df37e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1de81770 con 0x55ce1df0b490 2023-11-24T08:04:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1de68750 con 0x55ce1df0e080 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce1de66070 con 0x55ce1df23ed0 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27e9213700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0b490 0x55ce1df37e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27e9213700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0b490 0x55ce1df37e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36052/0 (socket says 172.21.15.153:36052) 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27e9213700 1 -- 172.21.15.153:0/2596444764 learned_addr learned my addr 172.21.15.153:0/2596444764 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27e8a12700 1 --2- 172.21.15.153:0/2596444764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0e080 0x55ce1df54840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27e3fff700 1 --2- 172.21.15.153:0/2596444764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df23ed0 0x55ce1df54d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27e9213700 1 -- 172.21.15.153:0/2596444764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df23ed0 msgr2=0x55ce1df54d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27e9213700 1 --2- 172.21.15.153:0/2596444764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df23ed0 0x55ce1df54d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27e9213700 1 -- 172.21.15.153:0/2596444764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0e080 msgr2=0x55ce1df54840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27e9213700 1 --2- 172.21.15.153:0/2596444764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0e080 0x55ce1df54840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27e9213700 1 -- 172.21.15.153:0/2596444764 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce1dcde5e0 con 0x55ce1df0b490 2023-11-24T08:04:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27e9213700 1 --2- 172.21.15.153:0/2596444764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0b490 0x55ce1df37e70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27dc087cd0 tx=0x7f27dc058420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452cbbc7e306abb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27ce7fc700 1 -- 172.21.15.153:0/2596444764 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0585a0 con 0x55ce1df0b490 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27ce7fc700 1 -- 172.21.15.153:0/2596444764 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc05c6f0 con 0x55ce1df0b490 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.080+0000 7f27ce7fc700 1 -- 172.21.15.153:0/2596444764 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0608a0 con 0x55ce1df0b490 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.081+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2596444764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0b490 msgr2=0x55ce1df37e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.081+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/2596444764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0b490 0x55ce1df37e70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27dc087cd0 tx=0x7f27dc058420 comp rx=0 tx=0).stop 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.081+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2596444764 shutdown_connections 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.081+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/2596444764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0b490 0x55ce1df37e70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.081+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/2596444764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0e080 0x55ce1df54840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.081+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/2596444764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df23ed0 0x55ce1df54d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.081+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2596444764 >> 172.21.15.153:0/2596444764 conn(0x55ce1de3c310 msgr2=0x55ce1df52e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.081+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2596444764 shutdown_connections 2023-11-24T08:04:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.081+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2596444764 wait complete. 2023-11-24T08:04:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.082+0000 7f27f6e6fb80 1 -- start start 2023-11-24T08:04:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.082+0000 7f27f6e6fb80 1 Processor -- start 2023-11-24T08:04:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0b490 0x55ce1df49d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0e080 0x55ce1df4cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df62350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1de61960 con 0x55ce1df23ed0 2023-11-24T08:04:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1de1b510 con 0x55ce1df0b490 2023-11-24T08:04:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce1de1b1b0 con 0x55ce1df0e080 2023-11-24T08:04:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27f6e6fb80 10 client.0 _ll_register_callbacks cb 0x55ce1dd46a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:04:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27e9213700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df62350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27e9213700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df62350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36058/0 (socket says 172.21.15.153:36058) 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27e9213700 1 -- 172.21.15.153:0/2522412299 learned_addr learned my addr 172.21.15.153:0/2522412299 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27e8a12700 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0b490 0x55ce1df49d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27e3fff700 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0e080 0x55ce1df4cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27e9213700 1 -- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0e080 msgr2=0x55ce1df4cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27e9213700 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0e080 0x55ce1df4cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27e9213700 1 -- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0b490 msgr2=0x55ce1df49d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27e9213700 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0b490 0x55ce1df49d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27e9213700 1 -- 172.21.15.153:0/2522412299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e40c9610 con 0x55ce1df23ed0 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27e9213700 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df62350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f27dc054aa0 tx=0x7f27dc00ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5031bd04a21b49a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27c37fe700 1 -- 172.21.15.153:0/2522412299 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc057c90 con 0x55ce1df23ed0 2023-11-24T08:04:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27c37fe700 1 -- 172.21.15.153:0/2522412299 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27dc0608a0 con 0x55ce1df23ed0 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2522412299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce1df00a40 con 0x55ce1df23ed0 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27c37fe700 1 -- 172.21.15.153:0/2522412299 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27dc0585a0 con 0x55ce1df23ed0 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27f6e6fb80 10 client.4623 fetch_fsmap learned FSMap version 8 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2522412299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55ce1dc8ad90 con 0x55ce1df23ed0 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.083+0000 7f27c37fe700 1 -- 172.21.15.153:0/2522412299 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce1df00a40 con 0x55ce1df23ed0 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.084+0000 7f27c37fe700 1 -- 172.21.15.153:0/2522412299 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f27dc075030 con 0x55ce1df23ed0 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.084+0000 7f27f6e6fb80 10 client.4623 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.084+0000 7f27f6e6fb80 10 client.4623 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.084+0000 7f27f6e6fb80 20 client.4623 populate_metadata read hostname 'smithi153' 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.084+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:6834/1557353565,v1:172.21.15.164:6835/1557353565] conn(0x55ce1df3a770 0x55ce1df3ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.084+0000 7f27f6e6fb80 4 client.4623 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:04:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.084+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2522412299 --> [v2:172.21.15.164:6834/1557353565,v1:172.21.15.164:6835/1557353565] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce1dedc840 con 0x55ce1df3a770 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.084+0000 7f27e8a12700 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:6834/1557353565,v1:172.21.15.164:6835/1557353565] conn(0x55ce1df3a770 0x55ce1df3ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.084+0000 7f27c37fe700 10 client.4623 ms_handle_connect on v2:172.21.15.164:6834/1557353565 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.084+0000 7f27e8a12700 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:6834/1557353565,v1:172.21.15.164:6835/1557353565] conn(0x55ce1df3a770 0x55ce1df3ab50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b36ddc701591cd9d server_cookie=7e58279ca1c2943a in_seq=0 out_seq=0 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27c37fe700 1 -- 172.21.15.153:0/2522412299 <== mds.0 v2:172.21.15.164:6834/1557353565 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ce1dedc840 con 0x55ce1df3a770 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27c37fe700 10 client.4623 handle_command_reply: tid=0 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 1 client.4623 shutdown 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2522412299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 msgr2=0x55ce1df62350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df62350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f27dc054aa0 tx=0x7f27dc00ffd0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2522412299 shutdown_connections 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df62350 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0b490 0x55ce1df49d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:6834/1557353565,v1:172.21.15.164:6835/1557353565] conn(0x55ce1df3a770 0x55ce1df3ab50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/2522412299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0e080 0x55ce1df4cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2522412299 >> 172.21.15.153:0/2522412299 conn(0x55ce1de3c310 msgr2=0x55ce1df56c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27c37fe700 0 client.4623 ms_handle_reset on v2:172.21.15.164:6834/1557353565 2023-11-24T08:04:27.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2522412299 shutdown_connections 2023-11-24T08:04:27.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/2522412299 wait complete. 2023-11-24T08:04:27.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.085+0000 7f27f6e6fb80 20 client.4623 trim_cache size 0 max 16384 2023-11-24T08:04:27.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.103+0000 7f27f6e6fb80 1 Processor -- start 2023-11-24T08:04:27.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.103+0000 7f27f6e6fb80 1 -- start start 2023-11-24T08:04:27.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0b490 0x55ce1df3bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0e080 0x55ce1df08cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df4c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1dce08d0 con 0x55ce1df23ed0 2023-11-24T08:04:27.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1df032f0 con 0x55ce1df0e080 2023-11-24T08:04:27.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce1df525c0 con 0x55ce1df0b490 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e9213700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df4c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e9213700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df4c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36066/0 (socket says 172.21.15.153:36066) 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e9213700 1 -- 172.21.15.153:0/3919235398 learned_addr learned my addr 172.21.15.153:0/3919235398 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e8a12700 1 --2- 172.21.15.153:0/3919235398 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0b490 0x55ce1df3bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e3fff700 1 --2- 172.21.15.153:0/3919235398 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0e080 0x55ce1df08cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e9213700 1 -- 172.21.15.153:0/3919235398 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0b490 msgr2=0x55ce1df3bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e9213700 1 --2- 172.21.15.153:0/3919235398 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0b490 0x55ce1df3bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e9213700 1 -- 172.21.15.153:0/3919235398 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0e080 msgr2=0x55ce1df08cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e9213700 1 --2- 172.21.15.153:0/3919235398 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0e080 0x55ce1df08cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e9213700 1 -- 172.21.15.153:0/3919235398 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce1dc73c10 con 0x55ce1df23ed0 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e3fff700 1 --2- 172.21.15.153:0/3919235398 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0e080 0x55ce1df08cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:27.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27e9213700 1 --2- 172.21.15.153:0/3919235398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df4c750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f27dc000f80 tx=0x7f27dc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d40312e2dbb1dba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27ceffd700 1 -- 172.21.15.153:0/3919235398 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc00f070 con 0x55ce1df23ed0 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27ceffd700 1 -- 172.21.15.153:0/3919235398 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc060610 con 0x55ce1df23ed0 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.104+0000 7f27ceffd700 1 -- 172.21.15.153:0/3919235398 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc057c90 con 0x55ce1df23ed0 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.105+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/3919235398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 msgr2=0x55ce1df4c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.105+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/3919235398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df4c750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f27dc000f80 tx=0x7f27dc01f000 comp rx=0 tx=0).stop 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.105+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/3919235398 shutdown_connections 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.105+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/3919235398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df23ed0 0x55ce1df4c750 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.105+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/3919235398 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0b490 0x55ce1df3bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.105+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/3919235398 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df0e080 0x55ce1df08cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.105+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/3919235398 >> 172.21.15.153:0/3919235398 conn(0x55ce1de3c310 msgr2=0x55ce1df504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.105+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/3919235398 shutdown_connections 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.105+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/3919235398 wait complete. 2023-11-24T08:04:27.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.105+0000 7f27f6e6fb80 1 -- start start 2023-11-24T08:04:27.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.106+0000 7f27f6e6fb80 1 Processor -- start 2023-11-24T08:04:27.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0b490 0x55ce1df4c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0e080 0x55ce1df4b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27f6e6fb80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df23ed0 0x55ce1df4b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1df38820 con 0x55ce1df0e080 2023-11-24T08:04:27.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1df4cc70 con 0x55ce1df23ed0 2023-11-24T08:04:27.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27f6e6fb80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce1df355d0 con 0x55ce1df0b490 2023-11-24T08:04:27.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27f6e6fb80 10 client.0 _ll_register_callbacks cb 0x55ce1dd46a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:04:27.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0e080 0x55ce1df4b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0e080 0x55ce1df4b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36070/0 (socket says 172.21.15.153:36070) 2023-11-24T08:04:27.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e3fff700 1 -- 172.21.15.153:0/968805087 learned_addr learned my addr 172.21.15.153:0/968805087 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:27.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e9213700 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df23ed0 0x55ce1df4b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e8a12700 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0b490 0x55ce1df4c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e3fff700 1 -- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0b490 msgr2=0x55ce1df4c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e3fff700 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0b490 0x55ce1df4c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e3fff700 1 -- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df23ed0 msgr2=0x55ce1df4b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e3fff700 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df23ed0 0x55ce1df4b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e3fff700 1 -- 172.21.15.153:0/968805087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e40c9610 con 0x55ce1df0e080 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e9213700 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df23ed0 0x55ce1df4b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27e3fff700 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0e080 0x55ce1df4b140 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f27d0011000 tx=0x7f27d0009050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef5e26fc5f532f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.107+0000 7f27c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27c37fe700 1 -- 172.21.15.153:0/968805087 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0004c80 con 0x55ce1df0e080 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27c37fe700 1 -- 172.21.15.153:0/968805087 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27d0004de0 con 0x55ce1df0e080 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/968805087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27dc05c6f0 con 0x55ce1df0e080 2023-11-24T08:04:27.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27c37fe700 1 -- 172.21.15.153:0/968805087 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27d00070d0 con 0x55ce1df0e080 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27f6e6fb80 10 client.4629 fetch_fsmap learned FSMap version 8 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/968805087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55ce1dcb1200 con 0x55ce1df0e080 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27c37fe700 1 -- 172.21.15.153:0/968805087 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d0030070 con 0x55ce1df0e080 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27c37fe700 1 -- 172.21.15.153:0/968805087 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f27d0007230 con 0x55ce1df0e080 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27f6e6fb80 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27f6e6fb80 10 client.4629 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27f6e6fb80 20 client.4629 populate_metadata read hostname 'smithi153' 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:6834/1557353565,v1:172.21.15.164:6835/1557353565] conn(0x55ce1df514a0 0x55ce1df51880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27f6e6fb80 4 client.4629 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/968805087 --> [v2:172.21.15.164:6834/1557353565,v1:172.21.15.164:6835/1557353565] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ce1de27f80 con 0x55ce1df514a0 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.108+0000 7f27e8a12700 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:6834/1557353565,v1:172.21.15.164:6835/1557353565] conn(0x55ce1df514a0 0x55ce1df51880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27c37fe700 10 client.4629 ms_handle_connect on v2:172.21.15.164:6834/1557353565 2023-11-24T08:04:27.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27e8a12700 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:6834/1557353565,v1:172.21.15.164:6835/1557353565] conn(0x55ce1df514a0 0x55ce1df51880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d90a6add11bfabf server_cookie=55d4aa8ea2c19754 in_seq=0 out_seq=0 2023-11-24T08:04:27.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27c37fe700 1 -- 172.21.15.153:0/968805087 <== mds.0 v2:172.21.15.164:6834/1557353565 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55ce1de27f80 con 0x55ce1df514a0 2023-11-24T08:04:27.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27c37fe700 10 client.4629 handle_command_reply: tid=0 2023-11-24T08:04:27.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 1 client.4629 shutdown 2023-11-24T08:04:27.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/968805087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0e080 msgr2=0x55ce1df4b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0e080 0x55ce1df4b140 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f27d0011000 tx=0x7f27d0009050 comp rx=0 tx=0).stop 2023-11-24T08:04:27.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/968805087 shutdown_connections 2023-11-24T08:04:27.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ce1df23ed0 0x55ce1df4b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:6834/1557353565,v1:172.21.15.164:6835/1557353565] conn(0x55ce1df514a0 0x55ce1df51880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ce1df0b490 0x55ce1df4c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 1 --2- 172.21.15.153:0/968805087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce1df0e080 0x55ce1df4b140 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27c37fe700 0 client.4629 ms_handle_reset on v2:172.21.15.164:6834/1557353565 2023-11-24T08:04:27.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/968805087 >> 172.21.15.153:0/968805087 conn(0x55ce1de3c310 msgr2=0x55ce1df3ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/968805087 shutdown_connections 2023-11-24T08:04:27.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 1 -- 172.21.15.153:0/968805087 wait complete. 2023-11-24T08:04:27.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27f6e6fb80 20 client.4629 trim_cache size 0 max 16384 2023-11-24T08:04:27.118 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:04:27.118 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "a594d4d2-de60-4a04-bb93-76779d526986", 2023-11-24T08:04:27.118 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-11-24T08:04:27.118 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4273, 2023-11-24T08:04:27.119 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-11-24T08:04:27.119 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-11-24T08:04:27.119 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-11-24T08:04:27.119 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 14.355073357, 2023-11-24T08:04:27.119 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 8, 2023-11-24T08:04:27.119 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 20, 2023-11-24T08:04:27.119 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 20, 2023-11-24T08:04:27.119 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 21.681654733999999 2023-11-24T08:04:27.119 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:04:27.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.109+0000 7f27eac76700 1 -- 172.21.15.153:0/290667221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c806aed0 msgr2=0x7f27c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.110+0000 7f27eac76700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c806aed0 0x7f27c806d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009ba0 tx=0x7f27d8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:27.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.110+0000 7f27eac76700 1 -- 172.21.15.153:0/290667221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e40b3f90 msgr2=0x7f27e40999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.110+0000 7f27eac76700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e40b3f90 0x7f27e40999e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f27e40cea90 tx=0x7f27dc00d430 comp rx=0 tx=0).stop 2023-11-24T08:04:27.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.110+0000 7f27eac76700 1 -- 172.21.15.153:0/290667221 shutdown_connections 2023-11-24T08:04:27.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.110+0000 7f27eac76700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c806aed0 0x7f27c806d390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.110+0000 7f27eac76700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e40b3f90 0x7f27e40999e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.110+0000 7f27eac76700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d4004850 0x7f27e4146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.110+0000 7f27eac76700 1 --2- 172.21.15.153:0/290667221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27e40ca6c0 0x7f27e4169c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.110+0000 7f27eac76700 1 -- 172.21.15.153:0/290667221 >> 172.21.15.153:0/290667221 conn(0x7f27e40b57b0 msgr2=0x7f27e414c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.110+0000 7f27eac76700 1 -- 172.21.15.153:0/290667221 shutdown_connections 2023-11-24T08:04:27.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.110+0000 7f27eac76700 1 -- 172.21.15.153:0/290667221 wait complete. 2023-11-24T08:04:27.123 INFO:teuthology.run_tasks:Running task kclient... 2023-11-24T08:04:27.147 INFO:tasks.kclient:Mounting kernel clients... 2023-11-24T08:04:27.147 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-24T08:04:27.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:27.148 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-11-24T08:04:27.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:27.165 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2023-11-24T08:04:27.233 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2023-11-24T08:04:27.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:27.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:27.235 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-11-24T08:04:27.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:27.293 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2023-11-24T08:04:27.360 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2023-11-24T08:04:27.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:27.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:27.362 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-11-24T08:04:27.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:27.383 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2023-11-24T08:04:27.457 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2023-11-24T08:04:27.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:27.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:27.459 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-11-24T08:04:27.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:27.519 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2023-11-24T08:04:27.590 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2023-11-24T08:04:27.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:27.591 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-24T08:04:27.591 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:04:27.591 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:27.592 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:04:27.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.711+0000 7fa5fa999700 1 Processor -- start 2023-11-24T08:04:27.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.711+0000 7fa5fa999700 1 -- start start 2023-11-24T08:04:27.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5fa999700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5f406c710 0x7fa5f40b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5fa999700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f40ae430 con 0x7fa5f415e080 2023-11-24T08:04:27.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5fa999700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f40ae710 con 0x7fa5f40af4d0 2023-11-24T08:04:27.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5fa999700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f40af0b0 con 0x7fa5f406c710 2023-11-24T08:04:27.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5f37fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5f406c710 0x7fa5f40b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5f3fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa5f415e080 0x7fa5f406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42180/0 (socket says 172.21.15.153:42180) 2023-11-24T08:04:27.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5f37fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5f406c710 0x7fa5f40b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36078/0 (socket says 172.21.15.153:36078) 2023-11-24T08:04:27.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5f3fff700 1 -- 172.21.15.153:0/3281591295 learned_addr learned my addr 172.21.15.153:0/3281591295 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:27.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5f37fe700 1 -- 172.21.15.153:0/3281591295 >> v1:172.21.15.164:6789/0 conn(0x7fa5f40af4d0 legacy=0x7fa5f406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5f37fe700 1 -- 172.21.15.153:0/3281591295 >> v1:172.21.15.153:6789/0 conn(0x7fa5f415e080 legacy=0x7fa5f406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5f2ffd700 1 -- 172.21.15.153:0/3281591295 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186902189 0 0) 0x7fa5f40ae430 con 0x7fa5f415e080 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5f37fe700 1 -- 172.21.15.153:0/3281591295 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f40ae9f0 con 0x7fa5f406c710 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.712+0000 7fa5f37fe700 1 --2- 172.21.15.153:0/3281591295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f406c710 0x7fa5f40b5050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009840 tx=0x7fa5e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383237df711c420c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.713+0000 7fa5f2ffd700 1 -- 172.21.15.153:0/3281591295 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4011830 con 0x7fa5f406c710 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.713+0000 7fa5f2ffd700 1 -- 172.21.15.153:0/3281591295 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e4011990 con 0x7fa5f406c710 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.713+0000 7fa5f2ffd700 1 -- 172.21.15.153:0/3281591295 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4011d20 con 0x7fa5f406c710 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.713+0000 7fa5fa999700 1 -- 172.21.15.153:0/3281591295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f406c710 msgr2=0x7fa5f40b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.713+0000 7fa5fa999700 1 --2- 172.21.15.153:0/3281591295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f406c710 0x7fa5f40b5050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009840 tx=0x7fa5e4009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.713+0000 7fa5fa999700 1 -- 172.21.15.153:0/3281591295 shutdown_connections 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.713+0000 7fa5fa999700 1 --2- 172.21.15.153:0/3281591295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f406c710 0x7fa5f40b5050 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.713+0000 7fa5fa999700 1 -- 172.21.15.153:0/3281591295 >> 172.21.15.153:0/3281591295 conn(0x7fa5f4071b90 msgr2=0x7fa5f4071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.713+0000 7fa5fa999700 1 -- 172.21.15.153:0/3281591295 shutdown_connections 2023-11-24T08:04:27.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.713+0000 7fa5fa999700 1 -- 172.21.15.153:0/3281591295 wait complete. 2023-11-24T08:04:27.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.714+0000 7fa5fa999700 1 Processor -- start 2023-11-24T08:04:27.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.715+0000 7fa5fa999700 1 -- start start 2023-11-24T08:04:27.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.715+0000 7fa5fa999700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f406c710 0x7fa5f40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.715+0000 7fa5fa999700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5f40af4d0 0x7fa5f4160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.715+0000 7fa5fa999700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5f415e080 0x7fa5f4144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.715+0000 7fa5fa999700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40cf8f0 con 0x7fa5f406c710 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.715+0000 7fa5fa999700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f41613f0 con 0x7fa5f415e080 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.715+0000 7fa5fa999700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40cece0 con 0x7fa5f40af4d0 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.715+0000 7fa5f3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f406c710 0x7fa5f40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.715+0000 7fa5f3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f406c710 0x7fa5f40ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36084/0 (socket says 172.21.15.153:36084) 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.715+0000 7fa5f3fff700 1 -- 172.21.15.153:0/1559177829 learned_addr learned my addr 172.21.15.153:0/1559177829 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5f8f36700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5f415e080 0x7fa5f4144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5f37fe700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5f40af4d0 0x7fa5f4160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5f3fff700 1 -- 172.21.15.153:0/1559177829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5f40af4d0 msgr2=0x7fa5f4160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5f3fff700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5f40af4d0 0x7fa5f4160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5f3fff700 1 -- 172.21.15.153:0/1559177829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5f415e080 msgr2=0x7fa5f4144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5f3fff700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5f415e080 0x7fa5f4144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5f3fff700 1 -- 172.21.15.153:0/1559177829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40094a0 con 0x7fa5f406c710 2023-11-24T08:04:27.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5f3fff700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f406c710 0x7fa5f40ce670 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c520 tx=0x7fa5e800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5f0ff9700 1 -- 172.21.15.153:0/1559177829 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8004c80 con 0x7fa5f406c710 2023-11-24T08:04:27.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5f0ff9700 1 -- 172.21.15.153:0/1559177829 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8004e20 con 0x7fa5f406c710 2023-11-24T08:04:27.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5fa999700 1 -- 172.21.15.153:0/1559177829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f40cefc0 con 0x7fa5f406c710 2023-11-24T08:04:27.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5f0ff9700 1 -- 172.21.15.153:0/1559177829 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8007310 con 0x7fa5f406c710 2023-11-24T08:04:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.716+0000 7fa5fa999700 1 -- 172.21.15.153:0/1559177829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f40cf580 con 0x7fa5f406c710 2023-11-24T08:04:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.717+0000 7fa5fa999700 1 -- 172.21.15.153:0/1559177829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f40753f0 con 0x7fa5f406c710 2023-11-24T08:04:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.717+0000 7fa5f0ff9700 1 -- 172.21.15.153:0/1559177829 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa5e8007470 con 0x7fa5f406c710 2023-11-24T08:04:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.718+0000 7fa5f0ff9700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5e006aed0 0x7fa5e006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.718+0000 7fa5f0ff9700 1 -- 172.21.15.153:0/1559177829 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5e80891f0 con 0x7fa5f406c710 2023-11-24T08:04:27.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.718+0000 7fa5f37fe700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5e006aed0 0x7fa5e006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.718+0000 7fa5f37fe700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5e006aed0 0x7fa5e006d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40b5560 tx=0x7fa5e401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.722+0000 7fa5f0ff9700 1 -- 172.21.15.153:0/1559177829 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5e8054330 con 0x7fa5f406c710 2023-11-24T08:04:27.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.957+0000 7fa5fa999700 1 -- 172.21.15.153:0/1559177829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5f4067f60 con 0x7fa5f406c710 2023-11-24T08:04:27.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.958+0000 7fa5f0ff9700 1 -- 172.21.15.153:0/1559177829 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa5e8057950 con 0x7fa5f406c710 2023-11-24T08:04:27.960 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:04:27.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 -- 172.21.15.153:0/1559177829 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5e006aed0 msgr2=0x7fa5e006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5e006aed0 0x7fa5e006d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40b5560 tx=0x7fa5e401c040 comp rx=0 tx=0).stop 2023-11-24T08:04:27.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 -- 172.21.15.153:0/1559177829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f406c710 msgr2=0x7fa5f40ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f406c710 0x7fa5f40ce670 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c520 tx=0x7fa5e800c8e0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 -- 172.21.15.153:0/1559177829 shutdown_connections 2023-11-24T08:04:27.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5f415e080 0x7fa5f4144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5e006aed0 0x7fa5e006d390 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f406c710 0x7fa5f40ce670 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 --2- 172.21.15.153:0/1559177829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5f40af4d0 0x7fa5f4160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 -- 172.21.15.153:0/1559177829 >> 172.21.15.153:0/1559177829 conn(0x7fa5f4071b90 msgr2=0x7fa5f406bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 -- 172.21.15.153:0/1559177829 shutdown_connections 2023-11-24T08:04:27.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:27.960+0000 7fa5fa999700 1 -- 172.21.15.153:0/1559177829 wait complete. 2023-11-24T08:04:27.974 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:04:27.974 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:04:27.974 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-11-24T08:04:27.974 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:04:27.974 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:27.974 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:04:27.974 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:04:27.974 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:04:27.975 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:04:27.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:27.975 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-11-24T08:04:27.992 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:27.992 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:27.992 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:27.993 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:27.993 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:27.993 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:27.993 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:27.993 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:27.993 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:27.994 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:27.994 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:27.994 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:27.994 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:04:27.994 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:27.994 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:04:27.994 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42405sec preferred_lft 42405sec 2023-11-24T08:04:27.994 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e4cb:ff36:bdaf:3e03/64 scope link noprefixroute 2023-11-24T08:04:27.994 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:27.997 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T08:04:27.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:27.998 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:04:27.998 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:04:27.998 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2023-11-24T08:04:27.998 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2023-11-24T08:04:27.998 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2023-11-24T08:04:27.998 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T08:04:27.999 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:04:28.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:28.168 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:04:28.198 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-11-24T08:04:28.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:28.200 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-11-24T08:04:28.268 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-11-24T08:04:28.268 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:04:28.268 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:04:28.268 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:04:28.268 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:04:28.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:28.269 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:04:28.269 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:04:28.269 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:04:28.269 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:04:28.269 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:04:28.269 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:04:28.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:28.515 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-11-24T08:04:28.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:28.532 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2023-11-24T08:04:28.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:28.590 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:04:28.590 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:04:28.590 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:04:28.590 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-24T08:04:28.590 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:04:28.684 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-24T08:04:28.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:28.684 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:04:28.685 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:04:28.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-24T08:04:28.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T08:04:28.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-24T08:04:28.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-24T08:04:28.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-24T08:04:28.685 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:04:28.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:28.871 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:04:28.871 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:04:28.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-11-24T08:04:28.872 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T08:04:28.872 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:04:28.972 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:28.973 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:28.992 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:04:28.993 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:28.993 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:29.049 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T08:04:29.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:29.050 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:04:29.145 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:04:29.145 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:04:29.145 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:04:29.245 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:04:29.245 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:04:29.245 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:04:29.245 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:04:29.245 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:04:29.321 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:04:29.321 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:04:29.321 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:04:29.321 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:04:29.321 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:04:29.321 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-11-24T08:04:29.321 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-11-24T08:04:29.321 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a594d4d2-de60-4a04-bb93-76779d526986" will pass to kernel 2023-11-24T08:04:29.324 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:04:29.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:29.324 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:29.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:29.353 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:29.446 INFO:teuthology.orchestra.run.smithi153.stdout:client4481 2023-11-24T08:04:29.446 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:04:29.447 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:29.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:29.464 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:29.552 INFO:teuthology.orchestra.run.smithi153.stdout:client4481 2023-11-24T08:04:29.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:29.553 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:29.599 INFO:teuthology.orchestra.run.smithi153.stdout:client4481 2023-11-24T08:04:29.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:29.599 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a594d4d2-de60-4a04-bb93-76779d526986.client4481/status') 2023-11-24T08:04:29.653 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.4481 (3)172.21.15.153:0/3707822496 2023-11-24T08:04:29.653 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2023-11-24T08:04:29.655 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2023-11-24T08:04:29.655 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2023-11-24T08:04:29.655 INFO:teuthology.orchestra.run.smithi153.stderr:71 bytes copied, 2.4157e-05 s, 2.9 MB/s 2023-11-24T08:04:29.655 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-11-24T08:04:29.655 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:04:29.655 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T08:04:29.656 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:04:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.774+0000 7f0dcd505700 1 Processor -- start 2023-11-24T08:04:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.774+0000 7f0dcd505700 1 -- start start 2023-11-24T08:04:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.775+0000 7f0dcd505700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0dc80b0ba0 0x7f0dc80af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.775+0000 7f0dcd505700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc815bb60 con 0x7f0dc815ee90 2023-11-24T08:04:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.775+0000 7f0dcd505700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc80b2bd0 con 0x7f0dc80b0f80 2023-11-24T08:04:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.775+0000 7f0dcd505700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc80b1fc0 con 0x7f0dc80b0ba0 2023-11-24T08:04:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.775+0000 7f0dc77fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0dc815ee90 0x7f0dc815b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42202/0 (socket says 172.21.15.153:42202) 2023-11-24T08:04:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.775+0000 7f0dc77fe700 1 -- 172.21.15.153:0/2907354396 learned_addr learned my addr 172.21.15.153:0/2907354396 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.776+0000 7f0dc6ffd700 1 --2- 172.21.15.153:0/2907354396 >> v2:172.21.15.164:3300/0 conn(0x7f0dc80b0ba0 0x7f0dc80af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.776+0000 7f0dc5ffb700 1 -- 172.21.15.153:0/2907354396 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327812796 0 0) 0x7f0dc0001490 con 0x7f0dc815ee90 2023-11-24T08:04:29.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.776+0000 7f0dc5ffb700 1 -- 172.21.15.153:0/2907354396 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db00035b0 con 0x7f0dc815ee90 2023-11-24T08:04:29.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.776+0000 7f0dc6ffd700 1 -- 172.21.15.153:0/2907354396 >> v1:172.21.15.164:6789/0 conn(0x7f0dc80b0f80 legacy=0x7f0dc80cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.776+0000 7f0dc5ffb700 1 -- 172.21.15.153:0/2907354396 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 574277223 0 0) 0x7f0db00035b0 con 0x7f0dc815ee90 2023-11-24T08:04:29.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.776+0000 7f0dc6ffd700 1 -- 172.21.15.153:0/2907354396 >> v1:172.21.15.153:6789/0 conn(0x7f0dc815ee90 legacy=0x7f0dc815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.776+0000 7f0dc6ffd700 1 -- 172.21.15.153:0/2907354396 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80b22a0 con 0x7f0dc80b0ba0 2023-11-24T08:04:29.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.776+0000 7f0dc6ffd700 1 --2- 172.21.15.153:0/2907354396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dc80b0ba0 0x7f0dc80af5c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00bae0 tx=0x7f0dbc00bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcd5fbe155c36bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:29.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.776+0000 7f0dc5ffb700 1 -- 172.21.15.153:0/2907354396 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0001b80 con 0x7f0dc80b0ba0 2023-11-24T08:04:29.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.776+0000 7f0dc5ffb700 1 -- 172.21.15.153:0/2907354396 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00da70 con 0x7f0dc80b0ba0 2023-11-24T08:04:29.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.776+0000 7f0dc5ffb700 1 -- 172.21.15.153:0/2907354396 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00de20 con 0x7f0dc80b0ba0 2023-11-24T08:04:29.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.777+0000 7f0dcd505700 1 -- 172.21.15.153:0/2907354396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dc80b0ba0 msgr2=0x7f0dc80af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.777+0000 7f0dcd505700 1 --2- 172.21.15.153:0/2907354396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dc80b0ba0 0x7f0dc80af5c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00bae0 tx=0x7f0dbc00bdf0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.777+0000 7f0dcd505700 1 -- 172.21.15.153:0/2907354396 shutdown_connections 2023-11-24T08:04:29.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.777+0000 7f0dcd505700 1 --2- 172.21.15.153:0/2907354396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dc80b0ba0 0x7f0dc80af5c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.777+0000 7f0dcd505700 1 -- 172.21.15.153:0/2907354396 >> 172.21.15.153:0/2907354396 conn(0x7f0dc80b57b0 msgr2=0x7f0dc80b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:29.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.777+0000 7f0dcd505700 1 -- 172.21.15.153:0/2907354396 shutdown_connections 2023-11-24T08:04:29.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.777+0000 7f0dcd505700 1 -- 172.21.15.153:0/2907354396 wait complete. 2023-11-24T08:04:29.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.778+0000 7f0dcd505700 1 Processor -- start 2023-11-24T08:04:29.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.778+0000 7f0dcd505700 1 -- start start 2023-11-24T08:04:29.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.779+0000 7f0dcd505700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dc80b0ba0 0x7f0dc8154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.779+0000 7f0dcd505700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0dc80b0f80 0x7f0dc8154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.779+0000 7f0dcd505700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815ee90 0x7f0dc80b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.779+0000 7f0dcd505700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc815dda0 con 0x7f0dc815ee90 2023-11-24T08:04:29.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.779+0000 7f0dcd505700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc8155630 con 0x7f0dc80b0ba0 2023-11-24T08:04:29.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.779+0000 7f0dcd505700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc8155910 con 0x7f0dc80b0f80 2023-11-24T08:04:29.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.779+0000 7f0dc77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815ee90 0x7f0dc80b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:29.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.779+0000 7f0dc77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815ee90 0x7f0dc80b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36104/0 (socket says 172.21.15.153:36104) 2023-11-24T08:04:29.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.779+0000 7f0dc77fe700 1 -- 172.21.15.153:0/2222733777 learned_addr learned my addr 172.21.15.153:0/2222733777 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.779+0000 7f0dc6ffd700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dc80b0ba0 0x7f0dc8154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0dc77fe700 1 -- 172.21.15.153:0/2222733777 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0dc80b0f80 msgr2=0x7f0dc8154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0dc77fe700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0dc80b0f80 0x7f0dc8154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0dc77fe700 1 -- 172.21.15.153:0/2222733777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dc80b0ba0 msgr2=0x7f0dc8154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0dc77fe700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dc80b0ba0 0x7f0dc8154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0dc77fe700 1 -- 172.21.15.153:0/2222733777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc00b740 con 0x7f0dc815ee90 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0dc6ffd700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dc80b0ba0 0x7f0dc8154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0dc77fe700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815ee90 0x7f0dc80b3080 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000cc10 tx=0x7f0dc000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0daf7fe700 1 -- 172.21.15.153:0/2222733777 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000ab90 con 0x7f0dc815ee90 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0daf7fe700 1 -- 172.21.15.153:0/2222733777 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000ad10 con 0x7f0dc815ee90 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0dcd505700 1 -- 172.21.15.153:0/2222733777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc8155bf0 con 0x7f0dc815ee90 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0daf7fe700 1 -- 172.21.15.153:0/2222733777 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0007310 con 0x7f0dc815ee90 2023-11-24T08:04:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.780+0000 7f0dcd505700 1 -- 172.21.15.153:0/2222733777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc81561b0 con 0x7f0dc815ee90 2023-11-24T08:04:29.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.781+0000 7f0dcd505700 1 -- 172.21.15.153:0/2222733777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc8067f60 con 0x7f0dc815ee90 2023-11-24T08:04:29.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.781+0000 7f0daf7fe700 1 -- 172.21.15.153:0/2222733777 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0dc0007470 con 0x7f0dc815ee90 2023-11-24T08:04:29.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.782+0000 7f0daf7fe700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0db406aed0 0x7f0db406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.782+0000 7f0daf7fe700 1 -- 172.21.15.153:0/2222733777 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dc0089320 con 0x7f0dc815ee90 2023-11-24T08:04:29.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.782+0000 7f0dc6ffd700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0db406aed0 0x7f0db406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:29.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.782+0000 7f0dc6ffd700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0db406aed0 0x7f0db406d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00dfd0 tx=0x7f0dbc013000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:29.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:29.786+0000 7f0daf7fe700 1 -- 172.21.15.153:0/2222733777 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0dc00543d0 con 0x7f0dc815ee90 2023-11-24T08:04:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.021+0000 7f0dcd505700 1 -- 172.21.15.153:0/2222733777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0dc815bb60 con 0x7f0dc815ee90 2023-11-24T08:04:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.022+0000 7f0daf7fe700 1 -- 172.21.15.153:0/2222733777 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0dc815bb60 con 0x7f0dc815ee90 2023-11-24T08:04:30.023 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:04:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 -- 172.21.15.153:0/2222733777 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0db406aed0 msgr2=0x7f0db406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0db406aed0 0x7f0db406d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00dfd0 tx=0x7f0dbc013000 comp rx=0 tx=0).stop 2023-11-24T08:04:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 -- 172.21.15.153:0/2222733777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815ee90 msgr2=0x7f0dc80b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815ee90 0x7f0dc80b3080 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000cc10 tx=0x7f0dc000a060 comp rx=0 tx=0).stop 2023-11-24T08:04:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 -- 172.21.15.153:0/2222733777 shutdown_connections 2023-11-24T08:04:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0db406aed0 0x7f0db406d390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815ee90 0x7f0dc80b3080 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dc80b0ba0 0x7f0dc8154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 --2- 172.21.15.153:0/2222733777 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0dc80b0f80 0x7f0dc8154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 -- 172.21.15.153:0/2222733777 >> 172.21.15.153:0/2222733777 conn(0x7f0dc80b57b0 msgr2=0x7f0dc80cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 -- 172.21.15.153:0/2222733777 shutdown_connections 2023-11-24T08:04:30.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:30.024+0000 7f0dcd505700 1 -- 172.21.15.153:0/2222733777 wait complete. 2023-11-24T08:04:30.037 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:04:30.038 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:04:30.038 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-11-24T08:04:30.038 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-24T08:04:30.038 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T08:04:30.038 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:04:30.038 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:04:30.038 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:04:30.038 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-24T08:04:30.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:30.039 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-11-24T08:04:30.056 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:30.056 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:30.056 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:30.056 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.057 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:30.057 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.057 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:30.057 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:30.057 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:30.058 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:30.058 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:30.058 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:30.058 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:04:30.058 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:30.058 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:04:30.059 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42403sec preferred_lft 42403sec 2023-11-24T08:04:30.059 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e4cb:ff36:bdaf:3e03/64 scope link noprefixroute 2023-11-24T08:04:30.059 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.059 INFO:teuthology.orchestra.run.smithi153.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:30.059 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 9e:57:11:a0:a0:4b brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:30.059 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:04:30.060 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.060 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e4cd:e0ff:fe37:cdab/64 scope link 2023-11-24T08:04:30.060 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.060 INFO:teuthology.orchestra.run.smithi153.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:04:30.060 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 9e:57:11:a0:a0:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:04:30.060 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::9c57:11ff:fea0:a04b/64 scope link 2023-11-24T08:04:30.060 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:30.061 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:04:30.121 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-11-24T08:04:30.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:30.123 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-11-24T08:04:30.182 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-11-24T08:04:30.182 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:04:30.182 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:04:30.182 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:04:30.182 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:04:30.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:30.183 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:04:30.183 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:04:30.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:04:30.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:04:30.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:04:30.183 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:04:30.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:30.288 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-11-24T08:04:30.305 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:04:30.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:30.306 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2023-11-24T08:04:30.362 INFO:teuthology.orchestra.run.smithi153.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-24T08:04:30.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:30.363 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:04:30.363 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:04:30.363 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:04:30.363 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-24T08:04:30.363 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:04:30.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:30.456 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T08:04:30.497 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.498 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:32:73:16:39:32 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:04:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:04:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::32:73ff:fe16:3932/64 scope link tentative 2023-11-24T08:04:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:30.511 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T08:04:30.589 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.590 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:32:73:16:39:32 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:04:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:04:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::32:73ff:fe16:3932/64 scope link tentative 2023-11-24T08:04:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:30.608 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-24T08:04:30.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:30.608 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:04:30.609 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:04:30.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-24T08:04:30.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T08:04:30.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-24T08:04:30.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-24T08:04:30.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-24T08:04:30.609 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:04:30.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:30.851 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:04:30.851 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:04:30.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.1 up 2023-11-24T08:04:30.852 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T08:04:30.852 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:04:30.958 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:30.959 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-24T08:04:30.981 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-24T08:04:30.981 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:30.982 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-24T08:04:31.038 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T08:04:31.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:31.038 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T08:04:31.124 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T08:04:31.124 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-24T08:04:31.125 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:04:31.133 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T08:04:31.133 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-24T08:04:31.134 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:04:31.134 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:04:31.134 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:04:31.207 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T08:04:31.208 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-24T08:04:31.208 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:04:31.208 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:04:31.208 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:04:31.208 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-11-24T08:04:31.208 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-11-24T08:04:31.208 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=a594d4d2-de60-4a04-bb93-76779d526986" will pass to kernel 2023-11-24T08:04:31.210 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:04:31.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:31.210 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-24T08:04:31.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:31.238 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:31.310 INFO:teuthology.orchestra.run.smithi153.stdout:client4484 2023-11-24T08:04:31.310 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:04:31.311 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:31.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:31.368 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:31.440 INFO:teuthology.orchestra.run.smithi153.stdout:client4484 2023-11-24T08:04:31.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:31.441 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:31.512 INFO:teuthology.orchestra.run.smithi153.stdout:client4484 2023-11-24T08:04:31.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:31.513 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a594d4d2-de60-4a04-bb93-76779d526986.client4484/status') 2023-11-24T08:04:31.593 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.4484 (3)172.21.15.153:0/867670969 2023-11-24T08:04:31.593 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2023-11-24T08:04:31.593 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2023-11-24T08:04:31.593 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2023-11-24T08:04:31.593 INFO:teuthology.orchestra.run.smithi153.stderr:70 bytes copied, 2.2022e-05 s, 3.2 MB/s 2023-11-24T08:04:31.594 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-11-24T08:04:31.595 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:04:31.595 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:04:31.595 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:04:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.754+0000 7f55d49e9700 1 Processor -- start 2023-11-24T08:04:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.754+0000 7f55d49e9700 1 -- start start 2023-11-24T08:04:31.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55d49e9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f55d015e080 0x7f55d00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55d49e9700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f55d00af4d0 0x7f55d00afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55d49e9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55d006c000 0x7f55d006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55d49e9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d00af0b0 con 0x7f55d015e080 2023-11-24T08:04:31.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55d49e9700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d006c9f0 con 0x7f55d00af4d0 2023-11-24T08:04:31.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55d49e9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00b05a0 con 0x7f55d006c000 2023-11-24T08:04:31.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55ce59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f55d015e080 0x7f55d00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55ce59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f55d015e080 0x7f55d00b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36114/0 (socket says 172.21.15.153:36114) 2023-11-24T08:04:31.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55ce59c700 1 -- 172.21.15.153:0/2180841576 learned_addr learned my addr 172.21.15.153:0/2180841576 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:31.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55cdd9b700 1 --2- 172.21.15.153:0/2180841576 >> v2:172.21.15.164:3300/0 conn(0x7f55d00af4d0 0x7f55d00afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55ced9d700 1 --2- 172.21.15.153:0/2180841576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55d006c000 0x7f55d006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55ce59c700 1 -- 172.21.15.153:0/2180841576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55d006c000 msgr2=0x7f55d006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:31.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55ce59c700 1 --2- 172.21.15.153:0/2180841576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55d006c000 0x7f55d006c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55ce59c700 1 -- 172.21.15.153:0/2180841576 >> v2:172.21.15.164:3300/0 conn(0x7f55d00af4d0 msgr2=0x7f55d00afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:31.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55ce59c700 1 --2- 172.21.15.153:0/2180841576 >> v2:172.21.15.164:3300/0 conn(0x7f55d00af4d0 0x7f55d00afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55ce59c700 1 -- 172.21.15.153:0/2180841576 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d00ae430 con 0x7f55d015e080 2023-11-24T08:04:31.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.755+0000 7f55ce59c700 1 --2- 172.21.15.153:0/2180841576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55d015e080 0x7f55d00b5050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f55d006e4e0 tx=0x7f55c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a15b615a675475d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55cd59a700 1 -- 172.21.15.153:0/2180841576 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c400b870 con 0x7f55d015e080 2023-11-24T08:04:31.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55cd59a700 1 -- 172.21.15.153:0/2180841576 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c400b9d0 con 0x7f55d015e080 2023-11-24T08:04:31.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55cd59a700 1 -- 172.21.15.153:0/2180841576 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c400bd60 con 0x7f55d015e080 2023-11-24T08:04:31.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55d49e9700 1 -- 172.21.15.153:0/2180841576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55d015e080 msgr2=0x7f55d00b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55d49e9700 1 --2- 172.21.15.153:0/2180841576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55d015e080 0x7f55d00b5050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f55d006e4e0 tx=0x7f55c4009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55d49e9700 1 -- 172.21.15.153:0/2180841576 shutdown_connections 2023-11-24T08:04:31.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55d49e9700 1 --2- 172.21.15.153:0/2180841576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55d006c000 0x7f55d006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55d49e9700 1 --2- 172.21.15.153:0/2180841576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55d015e080 0x7f55d00b5050 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55d49e9700 1 --2- 172.21.15.153:0/2180841576 >> v2:172.21.15.164:3300/0 conn(0x7f55d00af4d0 0x7f55d00afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55d49e9700 1 -- 172.21.15.153:0/2180841576 >> 172.21.15.153:0/2180841576 conn(0x7f55d0071b90 msgr2=0x7f55d0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:31.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55d49e9700 1 -- 172.21.15.153:0/2180841576 shutdown_connections 2023-11-24T08:04:31.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.756+0000 7f55d49e9700 1 -- 172.21.15.153:0/2180841576 wait complete. 2023-11-24T08:04:31.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.758+0000 7f55d49e9700 1 Processor -- start 2023-11-24T08:04:31.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.758+0000 7f55d49e9700 1 -- start start 2023-11-24T08:04:31.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.758+0000 7f55d49e9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55d006c000 0x7f55d0151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.758+0000 7f55d49e9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55d00af4d0 0x7f55d015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.758+0000 7f55d49e9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55d015e080 0x7f55d0154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.758+0000 7f55d49e9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0156840 con 0x7f55d015e080 2023-11-24T08:04:31.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.758+0000 7f55d49e9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0151e80 con 0x7f55d006c000 2023-11-24T08:04:31.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.758+0000 7f55d49e9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0157340 con 0x7f55d00af4d0 2023-11-24T08:04:31.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.758+0000 7f55ced9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55d015e080 0x7f55d0154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.758+0000 7f55ced9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55d015e080 0x7f55d0154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36124/0 (socket says 172.21.15.153:36124) 2023-11-24T08:04:31.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.758+0000 7f55ced9d700 1 -- 172.21.15.153:0/908359982 learned_addr learned my addr 172.21.15.153:0/908359982 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:31.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55cdd9b700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55d00af4d0 0x7f55d015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55ce59c700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55d006c000 0x7f55d0151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55ced9d700 1 -- 172.21.15.153:0/908359982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55d00af4d0 msgr2=0x7f55d015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55ced9d700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55d00af4d0 0x7f55d015f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55ced9d700 1 -- 172.21.15.153:0/908359982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55d006c000 msgr2=0x7f55d0151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55ced9d700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55d006c000 0x7f55d0151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55ced9d700 1 -- 172.21.15.153:0/908359982 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c4009550 con 0x7f55d015e080 2023-11-24T08:04:31.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55ce59c700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55d006c000 0x7f55d0151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:31.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55ced9d700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55d015e080 0x7f55d0154630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f55c8007e60 tx=0x7f55c800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55beffd700 1 -- 172.21.15.153:0/908359982 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c800ede0 con 0x7f55d015e080 2023-11-24T08:04:31.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55beffd700 1 -- 172.21.15.153:0/908359982 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c8014420 con 0x7f55d015e080 2023-11-24T08:04:31.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55beffd700 1 -- 172.21.15.153:0/908359982 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80147d0 con 0x7f55d015e080 2023-11-24T08:04:31.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55d49e9700 1 -- 172.21.15.153:0/908359982 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d0157620 con 0x7f55d015e080 2023-11-24T08:04:31.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.759+0000 7f55d49e9700 1 -- 172.21.15.153:0/908359982 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d0157be0 con 0x7f55d015e080 2023-11-24T08:04:31.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.760+0000 7f55d49e9700 1 -- 172.21.15.153:0/908359982 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d0157da0 con 0x7f55d015e080 2023-11-24T08:04:31.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.760+0000 7f55beffd700 1 -- 172.21.15.153:0/908359982 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f55c8014930 con 0x7f55d015e080 2023-11-24T08:04:31.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.761+0000 7f55beffd700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b006aed0 0x7f55b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.761+0000 7f55beffd700 1 -- 172.21.15.153:0/908359982 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55c8089d00 con 0x7f55d015e080 2023-11-24T08:04:31.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.761+0000 7f55ce59c700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b006aed0 0x7f55b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.761+0000 7f55ce59c700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b006aed0 0x7f55b006d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009130 tx=0x7f55c4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:31.765+0000 7f55beffd700 1 -- 172.21.15.153:0/908359982 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f55c8054db0 con 0x7f55d015e080 2023-11-24T08:04:32.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.002+0000 7f55d49e9700 1 -- 172.21.15.153:0/908359982 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f55d00753f0 con 0x7f55d015e080 2023-11-24T08:04:32.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.002+0000 7f55beffd700 1 -- 172.21.15.153:0/908359982 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f55c80583d0 con 0x7f55d015e080 2023-11-24T08:04:32.004 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:04:32.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 -- 172.21.15.153:0/908359982 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b006aed0 msgr2=0x7f55b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b006aed0 0x7f55b006d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009130 tx=0x7f55c4008030 comp rx=0 tx=0).stop 2023-11-24T08:04:32.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 -- 172.21.15.153:0/908359982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55d015e080 msgr2=0x7f55d0154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55d015e080 0x7f55d0154630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f55c8007e60 tx=0x7f55c800e3c0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 -- 172.21.15.153:0/908359982 shutdown_connections 2023-11-24T08:04:32.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b006aed0 0x7f55b006d390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55d015e080 0x7f55d0154630 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55d006c000 0x7f55d0151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 --2- 172.21.15.153:0/908359982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55d00af4d0 0x7f55d015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 -- 172.21.15.153:0/908359982 >> 172.21.15.153:0/908359982 conn(0x7f55d0071b90 msgr2=0x7f55d0073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:32.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 -- 172.21.15.153:0/908359982 shutdown_connections 2023-11-24T08:04:32.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:32.004+0000 7f55d49e9700 1 -- 172.21.15.153:0/908359982 wait complete. 2023-11-24T08:04:32.018 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:04:32.018 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:04:32.018 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-11-24T08:04:32.019 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:04:32.019 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:04:32.019 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:04:32.019 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:04:32.019 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:04:32.019 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:04:32.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:32.020 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-11-24T08:04:32.042 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:32.043 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:32.043 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:32.043 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:32.043 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:04:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:04:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42407sec preferred_lft 42407sec 2023-11-24T08:04:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c3a:c9d4:b907:ae22/64 scope link noprefixroute 2023-11-24T08:04:32.044 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:32.044 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T08:04:32.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:32.045 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:04:32.045 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:04:32.046 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add name ceph-brx type bridge 2023-11-24T08:04:32.046 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr flush dev ceph-brx 2023-11-24T08:04:32.046 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set ceph-brx up 2023-11-24T08:04:32.046 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T08:04:32.046 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:04:32.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:32.217 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:04:32.245 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-11-24T08:04:32.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:32.247 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-11-24T08:04:32.316 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-11-24T08:04:32.316 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:04:32.316 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:04:32.316 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:04:32.316 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:04:32.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:32.317 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:04:32.317 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:04:32.317 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:04:32.317 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:04:32.317 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:04:32.317 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:04:32.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:32.593 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-11-24T08:04:32.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:32.610 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2023-11-24T08:04:32.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:32.666 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:04:32.666 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:04:32.666 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:04:32.666 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-24T08:04:32.667 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:04:32.760 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-24T08:04:32.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:32.760 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:04:32.761 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:04:32.761 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-24T08:04:32.761 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T08:04:32.761 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-24T08:04:32.761 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-24T08:04:32.761 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-24T08:04:32.761 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:04:32.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:32.979 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:04:32.980 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:04:32.980 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-11-24T08:04:32.980 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T08:04:32.980 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:04:33.079 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:33.079 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:04:33.099 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:04:33.099 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:33.099 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:04:33.155 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T08:04:33.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:33.156 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:04:33.258 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:04:33.259 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:04:33.259 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:04:33.367 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:04:33.368 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:04:33.368 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:04:33.368 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:04:33.368 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:04:33.441 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:04:33.442 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:04:33.442 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:04:33.442 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:04:33.442 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:04:33.442 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-11-24T08:04:33.442 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-11-24T08:04:33.442 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a594d4d2-de60-4a04-bb93-76779d526986" will pass to kernel 2023-11-24T08:04:33.444 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:04:33.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:33.445 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:04:33.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:33.471 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:33.543 INFO:teuthology.orchestra.run.smithi164.stdout:client4653 2023-11-24T08:04:33.544 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:04:33.544 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:33.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:33.601 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:33.672 INFO:teuthology.orchestra.run.smithi164.stdout:client4653 2023-11-24T08:04:33.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:33.673 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:33.744 INFO:teuthology.orchestra.run.smithi164.stdout:client4653 2023-11-24T08:04:33.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:33.744 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a594d4d2-de60-4a04-bb93-76779d526986.client4653/status') 2023-11-24T08:04:33.824 INFO:teuthology.orchestra.run.smithi164.stdout:instance: client.4653 (3)172.21.15.164:0/1575214742 2023-11-24T08:04:33.824 INFO:teuthology.orchestra.run.smithi164.stdout:blocklisted: false 2023-11-24T08:04:33.824 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2023-11-24T08:04:33.825 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2023-11-24T08:04:33.825 INFO:teuthology.orchestra.run.smithi164.stderr:71 bytes copied, 2.0828e-05 s, 3.4 MB/s 2023-11-24T08:04:33.826 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-11-24T08:04:33.826 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:04:33.826 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T08:04:33.826 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:04:33.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.959+0000 7f9829ccd700 1 Processor -- start 2023-11-24T08:04:33.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.959+0000 7f9829ccd700 1 -- start start 2023-11-24T08:04:33.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9829ccd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f982415e080 0x7f98240b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9829ccd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f98240af4d0 0x7f98240afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9829ccd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f982406c000 0x7f982406c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9829ccd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98240af0b0 con 0x7f982406c000 2023-11-24T08:04:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9829ccd700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982406c9f0 con 0x7f98240af4d0 2023-11-24T08:04:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9829ccd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98240b05a0 con 0x7f982415e080 2023-11-24T08:04:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9823fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f982406c000 0x7f982406c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9823fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f982406c000 0x7f982406c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36132/0 (socket says 172.21.15.153:36132) 2023-11-24T08:04:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9823fff700 1 -- 172.21.15.153:0/2720263110 learned_addr learned my addr 172.21.15.153:0/2720263110 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9822ffd700 1 --2- 172.21.15.153:0/2720263110 >> v2:172.21.15.164:3300/0 conn(0x7f98240af4d0 0x7f98240afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f98237fe700 1 --2- 172.21.15.153:0/2720263110 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f982415e080 0x7f98240b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9823fff700 1 -- 172.21.15.153:0/2720263110 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f982415e080 msgr2=0x7f98240b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:33.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9823fff700 1 --2- 172.21.15.153:0/2720263110 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f982415e080 0x7f98240b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9823fff700 1 -- 172.21.15.153:0/2720263110 >> v2:172.21.15.164:3300/0 conn(0x7f98240af4d0 msgr2=0x7f98240afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:33.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9823fff700 1 --2- 172.21.15.153:0/2720263110 >> v2:172.21.15.164:3300/0 conn(0x7f98240af4d0 0x7f98240afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9823fff700 1 -- 172.21.15.153:0/2720263110 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240ae430 con 0x7f982406c000 2023-11-24T08:04:33.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.960+0000 7f9823fff700 1 --2- 172.21.15.153:0/2720263110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f982406c000 0x7f982406c4b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f982406d380 tx=0x7f981c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6389c874c7693d85 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:33.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f98227fc700 1 -- 172.21.15.153:0/2720263110 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c00e070 con 0x7f982406c000 2023-11-24T08:04:33.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f98227fc700 1 -- 172.21.15.153:0/2720263110 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c00b980 con 0x7f982406c000 2023-11-24T08:04:33.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f98227fc700 1 -- 172.21.15.153:0/2720263110 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c00bd30 con 0x7f982406c000 2023-11-24T08:04:33.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f9829ccd700 1 -- 172.21.15.153:0/2720263110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f982406c000 msgr2=0x7f982406c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f9829ccd700 1 --2- 172.21.15.153:0/2720263110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f982406c000 0x7f982406c4b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f982406d380 tx=0x7f981c00b330 comp rx=0 tx=0).stop 2023-11-24T08:04:33.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f9829ccd700 1 -- 172.21.15.153:0/2720263110 shutdown_connections 2023-11-24T08:04:33.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f9829ccd700 1 --2- 172.21.15.153:0/2720263110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f982406c000 0x7f982406c4b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f9829ccd700 1 --2- 172.21.15.153:0/2720263110 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f982415e080 0x7f98240b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f9829ccd700 1 --2- 172.21.15.153:0/2720263110 >> v2:172.21.15.164:3300/0 conn(0x7f98240af4d0 0x7f98240afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f9829ccd700 1 -- 172.21.15.153:0/2720263110 >> 172.21.15.153:0/2720263110 conn(0x7f9824071b90 msgr2=0x7f9824071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:33.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f9829ccd700 1 -- 172.21.15.153:0/2720263110 shutdown_connections 2023-11-24T08:04:33.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.961+0000 7f9829ccd700 1 -- 172.21.15.153:0/2720263110 wait complete. 2023-11-24T08:04:33.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.963+0000 7f9829ccd700 1 Processor -- start 2023-11-24T08:04:33.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.963+0000 7f9829ccd700 1 -- start start 2023-11-24T08:04:33.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9829ccd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f982406c000 0x7f9824157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9829ccd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98240af4d0 0x7f982415ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9829ccd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f982415e080 0x7f98241604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9829ccd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9824158950 con 0x7f98240af4d0 2023-11-24T08:04:33.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9829ccd700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9824157cd0 con 0x7f982406c000 2023-11-24T08:04:33.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9829ccd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9824157fb0 con 0x7f982415e080 2023-11-24T08:04:33.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9822ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98240af4d0 0x7f982415ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9822ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98240af4d0 0x7f982415ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36136/0 (socket says 172.21.15.153:36136) 2023-11-24T08:04:33.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9822ffd700 1 -- 172.21.15.153:0/2953121964 learned_addr learned my addr 172.21.15.153:0/2953121964 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:33.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9823fff700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f982415e080 0x7f98241604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f98237fe700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f982406c000 0x7f9824157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9822ffd700 1 -- 172.21.15.153:0/2953121964 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f982415e080 msgr2=0x7f98241604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9822ffd700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f982415e080 0x7f98241604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9822ffd700 1 -- 172.21.15.153:0/2953121964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f982406c000 msgr2=0x7f9824157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9822ffd700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f982406c000 0x7f9824157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.964+0000 7f9822ffd700 1 -- 172.21.15.153:0/2953121964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c009b30 con 0x7f98240af4d0 2023-11-24T08:04:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.965+0000 7f9822ffd700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98240af4d0 0x7f982415ffa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f980c00e810 tx=0x7f980c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.965+0000 7f981bfff700 1 -- 172.21.15.153:0/2953121964 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c004230 con 0x7f98240af4d0 2023-11-24T08:04:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.965+0000 7f981bfff700 1 -- 172.21.15.153:0/2953121964 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c004390 con 0x7f98240af4d0 2023-11-24T08:04:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.965+0000 7f9829ccd700 1 -- 172.21.15.153:0/2953121964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9824158290 con 0x7f98240af4d0 2023-11-24T08:04:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.965+0000 7f981bfff700 1 -- 172.21.15.153:0/2953121964 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0036a0 con 0x7f98240af4d0 2023-11-24T08:04:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.965+0000 7f9829ccd700 1 -- 172.21.15.153:0/2953121964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9824156a00 con 0x7f98240af4d0 2023-11-24T08:04:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.966+0000 7f9829ccd700 1 -- 172.21.15.153:0/2953121964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98240753f0 con 0x7f98240af4d0 2023-11-24T08:04:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.966+0000 7f981bfff700 1 -- 172.21.15.153:0/2953121964 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f980c003800 con 0x7f98240af4d0 2023-11-24T08:04:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.966+0000 7f981bfff700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f980406aed0 0x7f980406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.967+0000 7f981bfff700 1 -- 172.21.15.153:0/2953121964 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f980c089290 con 0x7f98240af4d0 2023-11-24T08:04:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.967+0000 7f98237fe700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f980406aed0 0x7f980406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.967+0000 7f98237fe700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f980406aed0 0x7f980406d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f98240b5a10 tx=0x7f9814008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:33.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:33.971+0000 7f981bfff700 1 -- 172.21.15.153:0/2953121964 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f980c0543d0 con 0x7f98240af4d0 2023-11-24T08:04:34.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.208+0000 7f9829ccd700 1 -- 172.21.15.153:0/2953121964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9824067f60 con 0x7f98240af4d0 2023-11-24T08:04:34.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.208+0000 7f981bfff700 1 -- 172.21.15.153:0/2953121964 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f980c0579f0 con 0x7f98240af4d0 2023-11-24T08:04:34.210 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:04:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 -- 172.21.15.153:0/2953121964 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f980406aed0 msgr2=0x7f980406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f980406aed0 0x7f980406d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f98240b5a10 tx=0x7f9814008040 comp rx=0 tx=0).stop 2023-11-24T08:04:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 -- 172.21.15.153:0/2953121964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98240af4d0 msgr2=0x7f982415ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98240af4d0 0x7f982415ffa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f980c00e810 tx=0x7f980c00ebd0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 -- 172.21.15.153:0/2953121964 shutdown_connections 2023-11-24T08:04:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f982415e080 0x7f98241604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f982406c000 0x7f9824157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f980406aed0 0x7f980406d390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 --2- 172.21.15.153:0/2953121964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98240af4d0 0x7f982415ffa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 -- 172.21.15.153:0/2953121964 >> 172.21.15.153:0/2953121964 conn(0x7f9824071b90 msgr2=0x7f98240b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 -- 172.21.15.153:0/2953121964 shutdown_connections 2023-11-24T08:04:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:34.210+0000 7f9829ccd700 1 -- 172.21.15.153:0/2953121964 wait complete. 2023-11-24T08:04:34.224 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:04:34.224 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:04:34.224 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-11-24T08:04:34.224 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-24T08:04:34.224 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T08:04:34.224 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:04:34.225 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:04:34.225 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:04:34.225 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-24T08:04:34.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:34.225 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-11-24T08:04:34.246 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:34.246 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:34.246 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:34.246 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.246 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42405sec preferred_lft 42405sec 2023-11-24T08:04:34.247 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c3a:c9d4:b907:ae22/64 scope link noprefixroute 2023-11-24T08:04:34.248 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.248 INFO:teuthology.orchestra.run.smithi164.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:34.248 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 2a:59:a8:c3:97:84 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:34.248 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:04:34.248 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.248 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::743c:f9ff:fe03:c5d2/64 scope link 2023-11-24T08:04:34.248 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.248 INFO:teuthology.orchestra.run.smithi164.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:04:34.248 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 2a:59:a8:c3:97:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:04:34.248 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::2859:a8ff:fec3:9784/64 scope link tentative 2023-11-24T08:04:34.248 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:34.249 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:04:34.312 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-11-24T08:04:34.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:34.314 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-11-24T08:04:34.372 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-11-24T08:04:34.372 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:04:34.372 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:04:34.373 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:04:34.373 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:04:34.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:34.373 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:04:34.373 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:04:34.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:04:34.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:04:34.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:04:34.373 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:04:34.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:34.477 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-11-24T08:04:34.494 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:04:34.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:34.494 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2023-11-24T08:04:34.551 INFO:teuthology.orchestra.run.smithi164.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-24T08:04:34.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:34.551 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:04:34.551 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:04:34.551 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:04:34.552 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-24T08:04:34.552 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:04:34.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:34.645 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T08:04:34.682 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.683 INFO:teuthology.orchestra.run.smithi164.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether e2:d6:e4:a9:7e:11 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:04:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:04:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::e0d6:e4ff:fea9:7e11/64 scope link 2023-11-24T08:04:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:34.699 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T08:04:34.777 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:34.778 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:34.778 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:34.778 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.778 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:34.778 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.778 INFO:teuthology.orchestra.run.smithi164.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:34.779 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether e2:d6:e4:a9:7e:11 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:04:34.779 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:04:34.779 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.779 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::e0d6:e4ff:fea9:7e11/64 scope link 2023-11-24T08:04:34.779 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:34.794 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-24T08:04:34.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:34.794 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:04:34.794 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:04:34.794 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-24T08:04:34.794 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T08:04:34.795 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-24T08:04:34.795 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-24T08:04:34.795 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-24T08:04:34.795 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:04:35.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:35.040 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:04:35.040 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:04:35.040 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.1 up 2023-11-24T08:04:35.041 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T08:04:35.041 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:04:35.146 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:35.147 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-24T08:04:35.167 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-24T08:04:35.168 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:35.168 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-24T08:04:35.224 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T08:04:35.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:35.224 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T08:04:35.310 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T08:04:35.310 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-24T08:04:35.311 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:04:35.319 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T08:04:35.319 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-24T08:04:35.320 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:04:35.320 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:04:35.320 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:04:35.394 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T08:04:35.395 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-24T08:04:35.395 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:04:35.395 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:04:35.395 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:04:35.395 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-11-24T08:04:35.395 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-11-24T08:04:35.395 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=a594d4d2-de60-4a04-bb93-76779d526986" will pass to kernel 2023-11-24T08:04:35.396 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:04:35.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:35.397 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-24T08:04:35.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:35.424 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:35.496 INFO:teuthology.orchestra.run.smithi164.stdout:client4662 2023-11-24T08:04:35.496 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:04:35.496 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:35.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:35.554 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:35.626 INFO:teuthology.orchestra.run.smithi164.stdout:client4662 2023-11-24T08:04:35.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:35.626 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:35.698 INFO:teuthology.orchestra.run.smithi164.stdout:client4662 2023-11-24T08:04:35.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:35.699 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a594d4d2-de60-4a04-bb93-76779d526986.client4662/status') 2023-11-24T08:04:35.779 INFO:teuthology.orchestra.run.smithi164.stdout:instance: client.4662 (3)172.21.15.164:0/939302809 2023-11-24T08:04:35.779 INFO:teuthology.orchestra.run.smithi164.stdout:blocklisted: false 2023-11-24T08:04:35.779 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2023-11-24T08:04:35.779 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2023-11-24T08:04:35.779 INFO:teuthology.orchestra.run.smithi164.stderr:70 bytes copied, 3.5499e-05 s, 2.0 MB/s 2023-11-24T08:04:35.780 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-24T08:04:35.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.926+0000 7f627cbef700 1 Processor -- start 2023-11-24T08:04:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.926+0000 7f627cbef700 1 -- start start 2023-11-24T08:04:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.927+0000 7f627cbef700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6278152cc0 0x7f627806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.927+0000 7f627cbef700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627815c4b0 con 0x7f62780d0630 2023-11-24T08:04:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.927+0000 7f627cbef700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627815c790 con 0x7f62780b49a0 2023-11-24T08:04:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.927+0000 7f627cbef700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627815ca70 con 0x7f6278152cc0 2023-11-24T08:04:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f6276d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f62780d0630 0x7f627815fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42248/0 (socket says 172.21.15.153:42248) 2023-11-24T08:04:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f6276d9d700 1 -- 172.21.15.153:0/2649862125 learned_addr learned my addr 172.21.15.153:0/2649862125 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99685524 0 0) 0x7f627815c4b0 con 0x7f62780d0630 2023-11-24T08:04:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627659c700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6278152cc0 0x7f627806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62600035b0 con 0x7f62780d0630 2023-11-24T08:04:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 346626094 0 0) 0x7f62600035b0 con 0x7f62780d0630 2023-11-24T08:04:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6278152cc0 msgr2=0x7f627806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6278152cc0 0x7f627806c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 >> v1:172.21.15.164:6789/0 conn(0x7f62780b49a0 legacy=0x7f62780cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627815cd50 con 0x7f62780d0630 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f62700019f0 con 0x7f62780d0630 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 >> v1:172.21.15.153:6789/0 conn(0x7f62780d0630 legacy=0x7f627815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6260003a30 0x7f6260003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6278152cc0 0x7f6260004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6260004d90 0x7f6260005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627815ca70 con 0x7f6260004d90 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626000bba0 con 0x7f6260003a30 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626000bd30 con 0x7f6278152cc0 2023-11-24T08:04:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f6276d9d700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6260004d90 0x7f6260005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f627659c700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6260003a30 0x7f6260003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.928+0000 7f6275d9b700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6278152cc0 0x7f6260004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f6276d9d700 1 -- 172.21.15.153:0/2649862125 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6278152cc0 msgr2=0x7f6260004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f6276d9d700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6278152cc0 0x7f6260004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f6276d9d700 1 -- 172.21.15.153:0/2649862125 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6260003a30 msgr2=0x7f6260003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f6276d9d700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6260003a30 0x7f6260003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f6276d9d700 1 -- 172.21.15.153:0/2649862125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600035b0 con 0x7f6260004d90 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f6276d9d700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6260004d90 0x7f6260005210 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f627000a860 tx=0x7f6260005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6457f967860fbd97 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270012600 con 0x7f6260004d90 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6270012780 con 0x7f6260004d90 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f627559a700 1 -- 172.21.15.153:0/2649862125 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270012b30 con 0x7f6260004d90 2023-11-24T08:04:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f627cbef700 1 -- 172.21.15.153:0/2649862125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6260004d90 msgr2=0x7f6260005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f627cbef700 1 --2- 172.21.15.153:0/2649862125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6260004d90 0x7f6260005210 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f627000a860 tx=0x7f6260005880 comp rx=0 tx=0).stop 2023-11-24T08:04:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.929+0000 7f6276d9d700 1 -- 172.21.15.153:0/2649862125 reap_dead start 2023-11-24T08:04:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.930+0000 7f627cbef700 1 -- 172.21.15.153:0/2649862125 shutdown_connections 2023-11-24T08:04:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.930+0000 7f627cbef700 1 -- 172.21.15.153:0/2649862125 >> 172.21.15.153:0/2649862125 conn(0x7f6278071b90 msgr2=0x7f6278071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.930+0000 7f627cbef700 1 -- 172.21.15.153:0/2649862125 shutdown_connections 2023-11-24T08:04:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.930+0000 7f627cbef700 1 -- 172.21.15.153:0/2649862125 wait complete. 2023-11-24T08:04:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.931+0000 7f627cbef700 1 Processor -- start 2023-11-24T08:04:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.931+0000 7f627cbef700 1 -- start start 2023-11-24T08:04:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f627cbef700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6260004d90 0x7f6278147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f627cbef700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62781575e0 0x7f6278157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f627cbef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f627815d400 0x7f627815d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f627cbef700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627815f260 con 0x7f627815d400 2023-11-24T08:04:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f627cbef700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627815df50 con 0x7f6260004d90 2023-11-24T08:04:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f627cbef700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627815e230 con 0x7f62781575e0 2023-11-24T08:04:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6276d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f627815d400 0x7f627815d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f627659c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6260004d90 0x7f6278147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6276d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f627815d400 0x7f627815d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36156/0 (socket says 172.21.15.153:36156) 2023-11-24T08:04:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6276d9d700 1 -- 172.21.15.153:0/1381594896 learned_addr learned my addr 172.21.15.153:0/1381594896 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6275d9b700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62781575e0 0x7f6278157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6276d9d700 1 -- 172.21.15.153:0/1381594896 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62781575e0 msgr2=0x7f6278157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6276d9d700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62781575e0 0x7f6278157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6276d9d700 1 -- 172.21.15.153:0/1381594896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6260004d90 msgr2=0x7f6278147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6276d9d700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6260004d90 0x7f6278147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6276d9d700 1 -- 172.21.15.153:0/1381594896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278153430 con 0x7f627815d400 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f627659c700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6260004d90 0x7f6278147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6276d9d700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f627815d400 0x7f627815d880 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6270012000 tx=0x7f6270001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6266ffd700 1 -- 172.21.15.153:0/1381594896 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700019b0 con 0x7f627815d400 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f6266ffd700 1 -- 172.21.15.153:0/1381594896 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6270012610 con 0x7f627815d400 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.932+0000 7f627cbef700 1 -- 172.21.15.153:0/1381594896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6278153710 con 0x7f627815d400 2023-11-24T08:04:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.933+0000 7f6266ffd700 1 -- 172.21.15.153:0/1381594896 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627001e670 con 0x7f627815d400 2023-11-24T08:04:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.933+0000 7f627cbef700 1 -- 172.21.15.153:0/1381594896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62780b1a10 con 0x7f627815d400 2023-11-24T08:04:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.933+0000 7f627cbef700 1 -- 172.21.15.153:0/1381594896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62780753f0 con 0x7f627815d400 2023-11-24T08:04:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.934+0000 7f6266ffd700 1 -- 172.21.15.153:0/1381594896 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6270024020 con 0x7f627815d400 2023-11-24T08:04:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.935+0000 7f6266ffd700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f625806aed0 0x7f625806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.935+0000 7f6266ffd700 1 -- 172.21.15.153:0/1381594896 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f627008bbf0 con 0x7f627815d400 2023-11-24T08:04:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.935+0000 7f627659c700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f625806aed0 0x7f625806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.935+0000 7f627659c700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f625806aed0 0x7f625806d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6268014400 tx=0x7f6268009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:35.939+0000 7f6266ffd700 1 -- 172.21.15.153:0/1381594896 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6270056f30 con 0x7f627815d400 2023-11-24T08:04:36.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.133+0000 7f627cbef700 1 -- 172.21.15.153:0/1381594896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6278153900 con 0x7f627815d400 2023-11-24T08:04:36.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.135+0000 7f6266ffd700 1 -- 172.21.15.153:0/1381594896 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f627002c020 con 0x7f627815d400 2023-11-24T08:04:36.137 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:36.137 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 -- 172.21.15.153:0/1381594896 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f625806aed0 msgr2=0x7f625806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f625806aed0 0x7f625806d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6268014400 tx=0x7f6268009210 comp rx=0 tx=0).stop 2023-11-24T08:04:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 -- 172.21.15.153:0/1381594896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f627815d400 msgr2=0x7f627815d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f627815d400 0x7f627815d880 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6270012000 tx=0x7f6270001d80 comp rx=0 tx=0).stop 2023-11-24T08:04:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 -- 172.21.15.153:0/1381594896 shutdown_connections 2023-11-24T08:04:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f625806aed0 0x7f625806d390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f627815d400 0x7f627815d880 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6260004d90 0x7f6278147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 --2- 172.21.15.153:0/1381594896 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62781575e0 0x7f6278157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 -- 172.21.15.153:0/1381594896 >> 172.21.15.153:0/1381594896 conn(0x7f6278071b90 msgr2=0x7f62780cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 -- 172.21.15.153:0/1381594896 shutdown_connections 2023-11-24T08:04:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.137+0000 7f627cbef700 1 -- 172.21.15.153:0/1381594896 wait complete. 2023-11-24T08:04:36.151 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:36.152 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:36.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.275+0000 7f58e894a700 1 Processor -- start 2023-11-24T08:04:36.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.275+0000 7f58e894a700 1 -- start start 2023-11-24T08:04:36.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e894a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58e415b210 0x7f58e406b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e894a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e415b640 con 0x7f58e40b49a0 2023-11-24T08:04:36.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e894a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e415e9f0 con 0x7f58e406e370 2023-11-24T08:04:36.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e894a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e415ec90 con 0x7f58e415b210 2023-11-24T08:04:36.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e2d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58e415b210 0x7f58e406b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e259c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f58e40b49a0 0x7f58e40b4d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42264/0 (socket says 172.21.15.153:42264) 2023-11-24T08:04:36.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e259c700 1 -- 172.21.15.153:0/944586151 learned_addr learned my addr 172.21.15.153:0/944586151 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:36.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e2d9d700 1 -- 172.21.15.153:0/944586151 >> v1:172.21.15.164:6789/0 conn(0x7f58e406e370 legacy=0x7f58e406b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e2d9d700 1 -- 172.21.15.153:0/944586151 >> v1:172.21.15.153:6789/0 conn(0x7f58e40b49a0 legacy=0x7f58e40b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e2d9d700 1 -- 172.21.15.153:0/944586151 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e415ef70 con 0x7f58e415b210 2023-11-24T08:04:36.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e159a700 1 -- 172.21.15.153:0/944586151 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904163894 0 0) 0x7f58d8001110 con 0x7f58e40b49a0 2023-11-24T08:04:36.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e2d9d700 1 --2- 172.21.15.153:0/944586151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58e415b210 0x7f58e406b800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009d90 tx=0x7f58dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59ece0a4359b606 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e159a700 1 -- 172.21.15.153:0/944586151 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00e070 con 0x7f58e415b210 2023-11-24T08:04:36.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e159a700 1 -- 172.21.15.153:0/944586151 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc00bbd0 con 0x7f58e415b210 2023-11-24T08:04:36.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.277+0000 7f58e159a700 1 -- 172.21.15.153:0/944586151 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc012430 con 0x7f58e415b210 2023-11-24T08:04:36.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.278+0000 7f58e894a700 1 -- 172.21.15.153:0/944586151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58e415b210 msgr2=0x7f58e406b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.278+0000 7f58e894a700 1 --2- 172.21.15.153:0/944586151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58e415b210 0x7f58e406b800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009d90 tx=0x7f58dc00b330 comp rx=0 tx=0).stop 2023-11-24T08:04:36.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.278+0000 7f58e894a700 1 -- 172.21.15.153:0/944586151 shutdown_connections 2023-11-24T08:04:36.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.278+0000 7f58e894a700 1 --2- 172.21.15.153:0/944586151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58e415b210 0x7f58e406b800 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.278+0000 7f58e894a700 1 -- 172.21.15.153:0/944586151 >> 172.21.15.153:0/944586151 conn(0x7f58e40b28f0 msgr2=0x7f58e40b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.278+0000 7f58e894a700 1 -- 172.21.15.153:0/944586151 shutdown_connections 2023-11-24T08:04:36.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.278+0000 7f58e894a700 1 -- 172.21.15.153:0/944586151 wait complete. 2023-11-24T08:04:36.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.280+0000 7f58e894a700 1 Processor -- start 2023-11-24T08:04:36.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.280+0000 7f58e894a700 1 -- start start 2023-11-24T08:04:36.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e894a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58e406e370 0x7f58e41f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e894a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58e40b49a0 0x7f58e41f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e894a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58e415b210 0x7f58e4150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e894a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41f5ed0 con 0x7f58e415b210 2023-11-24T08:04:36.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e894a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40cd500 con 0x7f58e406e370 2023-11-24T08:04:36.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e894a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41f20f0 con 0x7f58e40b49a0 2023-11-24T08:04:36.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58e415b210 0x7f58e4150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e259c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58e406e370 0x7f58e41f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58e415b210 0x7f58e4150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36170/0 (socket says 172.21.15.153:36170) 2023-11-24T08:04:36.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e2d9d700 1 -- 172.21.15.153:0/835042139 learned_addr learned my addr 172.21.15.153:0/835042139 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:36.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e1d9b700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58e40b49a0 0x7f58e41f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e2d9d700 1 -- 172.21.15.153:0/835042139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58e40b49a0 msgr2=0x7f58e41f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e2d9d700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58e40b49a0 0x7f58e41f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e2d9d700 1 -- 172.21.15.153:0/835042139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58e406e370 msgr2=0x7f58e41f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e2d9d700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58e406e370 0x7f58e41f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e2d9d700 1 -- 172.21.15.153:0/835042139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc009a70 con 0x7f58e415b210 2023-11-24T08:04:36.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e2d9d700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58e415b210 0x7f58e4150610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58e4072f70 tx=0x7f58dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58d2ffd700 1 -- 172.21.15.153:0/835042139 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc01b810 con 0x7f58e415b210 2023-11-24T08:04:36.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58d2ffd700 1 -- 172.21.15.153:0/835042139 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc020070 con 0x7f58e415b210 2023-11-24T08:04:36.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e894a700 1 -- 172.21.15.153:0/835042139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e4156e90 con 0x7f58e415b210 2023-11-24T08:04:36.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58d2ffd700 1 -- 172.21.15.153:0/835042139 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc01bbd0 con 0x7f58e415b210 2023-11-24T08:04:36.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.281+0000 7f58e894a700 1 -- 172.21.15.153:0/835042139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e41f1d80 con 0x7f58e415b210 2023-11-24T08:04:36.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.282+0000 7f58e894a700 1 -- 172.21.15.153:0/835042139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e41f2280 con 0x7f58e415b210 2023-11-24T08:04:36.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.283+0000 7f58d2ffd700 1 -- 172.21.15.153:0/835042139 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58dc01bd30 con 0x7f58e415b210 2023-11-24T08:04:36.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.283+0000 7f58d2ffd700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f58c406aed0 0x7f58c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.283+0000 7f58d2ffd700 1 -- 172.21.15.153:0/835042139 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58dc022070 con 0x7f58e415b210 2023-11-24T08:04:36.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.283+0000 7f58e259c700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f58c406aed0 0x7f58c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.284+0000 7f58e259c700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f58c406aed0 0x7f58c406d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f58d8007c40 tx=0x7f58d8007b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.288+0000 7f58d2ffd700 1 -- 172.21.15.153:0/835042139 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f58dc056ec0 con 0x7f58e415b210 2023-11-24T08:04:36.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.477+0000 7f58e894a700 1 -- 172.21.15.153:0/835042139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58e4068fb0 con 0x7f58e415b210 2023-11-24T08:04:36.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.477+0000 7f58d2ffd700 1 -- 172.21.15.153:0/835042139 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58dc05a4e0 con 0x7f58e415b210 2023-11-24T08:04:36.479 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:36.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 -- 172.21.15.153:0/835042139 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f58c406aed0 msgr2=0x7f58c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f58c406aed0 0x7f58c406d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f58d8007c40 tx=0x7f58d8007b90 comp rx=0 tx=0).stop 2023-11-24T08:04:36.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 -- 172.21.15.153:0/835042139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58e415b210 msgr2=0x7f58e4150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58e415b210 0x7f58e4150610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58e4072f70 tx=0x7f58dc004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 -- 172.21.15.153:0/835042139 shutdown_connections 2023-11-24T08:04:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f58c406aed0 0x7f58c406d390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58e415b210 0x7f58e4150610 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58e406e370 0x7f58e41f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 --2- 172.21.15.153:0/835042139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58e40b49a0 0x7f58e41f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 -- 172.21.15.153:0/835042139 >> 172.21.15.153:0/835042139 conn(0x7f58e40b28f0 msgr2=0x7f58e40b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 -- 172.21.15.153:0/835042139 shutdown_connections 2023-11-24T08:04:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.479+0000 7f58e894a700 1 -- 172.21.15.153:0/835042139 wait complete. 2023-11-24T08:04:36.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:36.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.616+0000 7f47e7985700 1 Processor -- start 2023-11-24T08:04:36.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.616+0000 7f47e7985700 1 -- start start 2023-11-24T08:04:36.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e7985700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f47e015e160 0x7f47e00b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e7985700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47e00746a0 0x7f47e006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e7985700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e00b3c60 con 0x7f47e00afc90 2023-11-24T08:04:36.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e7985700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e00b4500 con 0x7f47e00746a0 2023-11-24T08:04:36.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e7985700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e00b58c0 con 0x7f47e015e160 2023-11-24T08:04:36.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e5f22700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47e00746a0 0x7f47e006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e5f22700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47e00746a0 0x7f47e006d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36178/0 (socket says 172.21.15.153:36178) 2023-11-24T08:04:36.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e5f22700 1 -- 172.21.15.153:0/572685852 learned_addr learned my addr 172.21.15.153:0/572685852 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:36.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e5721700 1 --2- 172.21.15.153:0/572685852 >> v2:172.21.15.164:3300/0 conn(0x7f47e015e160 0x7f47e00b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e5f22700 1 -- 172.21.15.153:0/572685852 >> v2:172.21.15.164:3300/0 conn(0x7f47e015e160 msgr2=0x7f47e00b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:36.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e5f22700 1 --2- 172.21.15.153:0/572685852 >> v2:172.21.15.164:3300/0 conn(0x7f47e015e160 0x7f47e00b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e5f22700 1 -- 172.21.15.153:0/572685852 >> v1:172.21.15.164:6789/0 conn(0x7f47e00afc90 legacy=0x7f47e0073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e5f22700 1 -- 172.21.15.153:0/572685852 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e00b0140 con 0x7f47e00746a0 2023-11-24T08:04:36.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.617+0000 7f47e5f22700 1 --2- 172.21.15.153:0/572685852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e00746a0 0x7f47e006d930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f47e009efa0 tx=0x7f47d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73010815c5715692 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.618+0000 7f47d7fff700 1 -- 172.21.15.153:0/572685852 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d800e070 con 0x7f47e00746a0 2023-11-24T08:04:36.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.618+0000 7f47d7fff700 1 -- 172.21.15.153:0/572685852 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d800b910 con 0x7f47e00746a0 2023-11-24T08:04:36.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.618+0000 7f47d7fff700 1 -- 172.21.15.153:0/572685852 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d800bcc0 con 0x7f47e00746a0 2023-11-24T08:04:36.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.618+0000 7f47e7985700 1 -- 172.21.15.153:0/572685852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e00746a0 msgr2=0x7f47e006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.618+0000 7f47e7985700 1 --2- 172.21.15.153:0/572685852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e00746a0 0x7f47e006d930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f47e009efa0 tx=0x7f47d800b330 comp rx=0 tx=0).stop 2023-11-24T08:04:36.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.618+0000 7f47e7985700 1 -- 172.21.15.153:0/572685852 shutdown_connections 2023-11-24T08:04:36.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.618+0000 7f47e7985700 1 --2- 172.21.15.153:0/572685852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e00746a0 0x7f47e006d930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.618+0000 7f47e7985700 1 --2- 172.21.15.153:0/572685852 >> v2:172.21.15.164:3300/0 conn(0x7f47e015e160 0x7f47e00b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.618+0000 7f47e7985700 1 -- 172.21.15.153:0/572685852 >> 172.21.15.153:0/572685852 conn(0x7f47e00d0bf0 msgr2=0x7f47e00d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.618+0000 7f47e7985700 1 -- 172.21.15.153:0/572685852 shutdown_connections 2023-11-24T08:04:36.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.618+0000 7f47e7985700 1 -- 172.21.15.153:0/572685852 wait complete. 2023-11-24T08:04:36.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.619+0000 7f47e7985700 1 Processor -- start 2023-11-24T08:04:36.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.619+0000 7f47e7985700 1 -- start start 2023-11-24T08:04:36.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.620+0000 7f47e7985700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f47e00746a0 0x7f47e01f7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.620+0000 7f47e7985700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47e00afc90 0x7f47e00c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.620+0000 7f47e7985700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e015e160 0x7f47e00c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.620+0000 7f47e7985700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e014d1b0 con 0x7f47e015e160 2023-11-24T08:04:36.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.620+0000 7f47e7985700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00c7e20 con 0x7f47e00afc90 2023-11-24T08:04:36.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.620+0000 7f47e7985700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e01f7670 con 0x7f47e00746a0 2023-11-24T08:04:36.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.620+0000 7f47e5f22700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e015e160 0x7f47e00c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.620+0000 7f47e5f22700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e015e160 0x7f47e00c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36184/0 (socket says 172.21.15.153:36184) 2023-11-24T08:04:36.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.620+0000 7f47e5f22700 1 -- 172.21.15.153:0/3114240306 learned_addr learned my addr 172.21.15.153:0/3114240306 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:36.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47e4f20700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47e00afc90 0x7f47e00c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47e5721700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f47e00746a0 0x7f47e01f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47e5f22700 1 -- 172.21.15.153:0/3114240306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f47e00746a0 msgr2=0x7f47e01f7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47e5f22700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f47e00746a0 0x7f47e01f7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47e5f22700 1 -- 172.21.15.153:0/3114240306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47e00afc90 msgr2=0x7f47e00c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47e5f22700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47e00afc90 0x7f47e00c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47e5f22700 1 -- 172.21.15.153:0/3114240306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8009b30 con 0x7f47e015e160 2023-11-24T08:04:36.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47e4f20700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47e00afc90 0x7f47e00c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:36.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47e5f22700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e015e160 0x7f47e00c8270 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f47d800b370 tx=0x7f47d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47d5ffb700 1 -- 172.21.15.153:0/3114240306 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80092e0 con 0x7f47e015e160 2023-11-24T08:04:36.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47d5ffb700 1 -- 172.21.15.153:0/3114240306 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d801c440 con 0x7f47e015e160 2023-11-24T08:04:36.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47e7985700 1 -- 172.21.15.153:0/3114240306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e01f7950 con 0x7f47e015e160 2023-11-24T08:04:36.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47d5ffb700 1 -- 172.21.15.153:0/3114240306 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d801c7f0 con 0x7f47e015e160 2023-11-24T08:04:36.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.621+0000 7f47e7985700 1 -- 172.21.15.153:0/3114240306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e01f7f10 con 0x7f47e015e160 2023-11-24T08:04:36.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.622+0000 7f47e7985700 1 -- 172.21.15.153:0/3114240306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e0062580 con 0x7f47e015e160 2023-11-24T08:04:36.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.623+0000 7f47d5ffb700 1 -- 172.21.15.153:0/3114240306 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47d801c950 con 0x7f47e015e160 2023-11-24T08:04:36.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.623+0000 7f47d5ffb700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f47c406aed0 0x7f47c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.623+0000 7f47d5ffb700 1 -- 172.21.15.153:0/3114240306 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47d808af60 con 0x7f47e015e160 2023-11-24T08:04:36.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.623+0000 7f47e5721700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f47c406aed0 0x7f47c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.624+0000 7f47e5721700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f47c406aed0 0x7f47c406d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009a10 tx=0x7f47dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.628+0000 7f47d5ffb700 1 -- 172.21.15.153:0/3114240306 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47d80560a0 con 0x7f47e015e160 2023-11-24T08:04:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.821+0000 7f47e7985700 1 -- 172.21.15.153:0/3114240306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47e014cf50 con 0x7f47e015e160 2023-11-24T08:04:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.821+0000 7f47d5ffb700 1 -- 172.21.15.153:0/3114240306 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47d80596c0 con 0x7f47e015e160 2023-11-24T08:04:36.823 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.823+0000 7f47e7985700 1 -- 172.21.15.153:0/3114240306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f47c406aed0 msgr2=0x7f47c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.823+0000 7f47e7985700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f47c406aed0 0x7f47c406d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009a10 tx=0x7f47dc008040 comp rx=0 tx=0).stop 2023-11-24T08:04:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.823+0000 7f47e7985700 1 -- 172.21.15.153:0/3114240306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e015e160 msgr2=0x7f47e00c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.823+0000 7f47e7985700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e015e160 0x7f47e00c8270 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f47d800b370 tx=0x7f47d8004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.823+0000 7f47e7985700 1 -- 172.21.15.153:0/3114240306 shutdown_connections 2023-11-24T08:04:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.823+0000 7f47e7985700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f47c406aed0 0x7f47c406d390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.823+0000 7f47e7985700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e015e160 0x7f47e00c8270 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.823+0000 7f47e7985700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f47e00746a0 0x7f47e01f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.823+0000 7f47e7985700 1 --2- 172.21.15.153:0/3114240306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47e00afc90 0x7f47e00c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.823+0000 7f47e7985700 1 -- 172.21.15.153:0/3114240306 >> 172.21.15.153:0/3114240306 conn(0x7f47e00d0bf0 msgr2=0x7f47e01619f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.824+0000 7f47e7985700 1 -- 172.21.15.153:0/3114240306 shutdown_connections 2023-11-24T08:04:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.824+0000 7f47e7985700 1 -- 172.21.15.153:0/3114240306 wait complete. 2023-11-24T08:04:36.837 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.958+0000 7fc5e79c4700 1 Processor -- start 2023-11-24T08:04:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.959+0000 7fc5e79c4700 1 -- start start 2023-11-24T08:04:36.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5e79c4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5e015e160 0x7fc5e00b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5e79c4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e00b3c60 con 0x7fc5e00746a0 2023-11-24T08:04:36.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5e79c4700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e00b58c0 con 0x7fc5e00afc90 2023-11-24T08:04:36.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5e79c4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00b4500 con 0x7fc5e015e160 2023-11-24T08:04:36.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5e5f61700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc5e00746a0 0x7fc5e006d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42298/0 (socket says 172.21.15.153:42298) 2023-11-24T08:04:36.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5e5f61700 1 -- 172.21.15.153:0/4208645799 learned_addr learned my addr 172.21.15.153:0/4208645799 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:36.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5e5760700 1 --2- 172.21.15.153:0/4208645799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5e015e160 0x7fc5e00b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5d7fff700 1 -- 172.21.15.153:0/4208645799 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994807817 0 0) 0x7fc5e00b3c60 con 0x7fc5e00746a0 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5d7fff700 1 -- 172.21.15.153:0/4208645799 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5cc0035b0 con 0x7fc5e00746a0 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5d7fff700 1 -- 172.21.15.153:0/4208645799 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561873275 0 0) 0x7fc5e00b58c0 con 0x7fc5e00afc90 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5d7fff700 1 -- 172.21.15.153:0/4208645799 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e00b3c60 con 0x7fc5e00afc90 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5e5760700 1 -- 172.21.15.153:0/4208645799 >> v1:172.21.15.164:6789/0 conn(0x7fc5e00afc90 legacy=0x7fc5e0073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5d7fff700 1 -- 172.21.15.153:0/4208645799 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1228725107 0 0) 0x7fc5cc0035b0 con 0x7fc5e00746a0 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5e5760700 1 -- 172.21.15.153:0/4208645799 >> v1:172.21.15.153:6789/0 conn(0x7fc5e00746a0 legacy=0x7fc5e006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5e5760700 1 -- 172.21.15.153:0/4208645799 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e006bdc0 con 0x7fc5e015e160 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.960+0000 7fc5e5760700 1 --2- 172.21.15.153:0/4208645799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5e015e160 0x7fc5e00b5da0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009870 tx=0x7fc5d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38e623a836c645df server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.961+0000 7fc5d7fff700 1 -- 172.21.15.153:0/4208645799 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80019f0 con 0x7fc5e015e160 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.961+0000 7fc5d7fff700 1 -- 172.21.15.153:0/4208645799 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d0004030 con 0x7fc5e015e160 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.961+0000 7fc5d7fff700 1 -- 172.21.15.153:0/4208645799 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d00043a0 con 0x7fc5e015e160 2023-11-24T08:04:36.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.961+0000 7fc5e79c4700 1 -- 172.21.15.153:0/4208645799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5e015e160 msgr2=0x7fc5e00b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.961+0000 7fc5e79c4700 1 --2- 172.21.15.153:0/4208645799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5e015e160 0x7fc5e00b5da0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009870 tx=0x7fc5d0009b80 comp rx=0 tx=0).stop 2023-11-24T08:04:36.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.961+0000 7fc5e79c4700 1 -- 172.21.15.153:0/4208645799 shutdown_connections 2023-11-24T08:04:36.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.961+0000 7fc5e79c4700 1 --2- 172.21.15.153:0/4208645799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5e015e160 0x7fc5e00b5da0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.961+0000 7fc5e79c4700 1 -- 172.21.15.153:0/4208645799 >> 172.21.15.153:0/4208645799 conn(0x7fc5e00d0bf0 msgr2=0x7fc5e00d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.961+0000 7fc5e79c4700 1 -- 172.21.15.153:0/4208645799 shutdown_connections 2023-11-24T08:04:36.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.961+0000 7fc5e79c4700 1 -- 172.21.15.153:0/4208645799 wait complete. 2023-11-24T08:04:36.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.962+0000 7fc5e79c4700 1 Processor -- start 2023-11-24T08:04:36.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.962+0000 7fc5e79c4700 1 -- start start 2023-11-24T08:04:36.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.963+0000 7fc5e79c4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5e00746a0 0x7fc5e01f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.963+0000 7fc5e79c4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5e00afc90 0x7fc5e006ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.963+0000 7fc5e79c4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e015e160 0x7fc5e015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.963+0000 7fc5e79c4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e01f3990 con 0x7fc5e015e160 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.963+0000 7fc5e79c4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00c5bd0 con 0x7fc5e00afc90 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.963+0000 7fc5e79c4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e006efb0 con 0x7fc5e00746a0 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.963+0000 7fc5e5f61700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e015e160 0x7fc5e015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.963+0000 7fc5e5f61700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e015e160 0x7fc5e015c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36200/0 (socket says 172.21.15.153:36200) 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.963+0000 7fc5e5f61700 1 -- 172.21.15.153:0/1436517954 learned_addr learned my addr 172.21.15.153:0/1436517954 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5e4f5f700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5e00afc90 0x7fc5e006ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5e5f61700 1 -- 172.21.15.153:0/1436517954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5e00746a0 msgr2=0x7fc5e01f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5e5760700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5e00746a0 0x7fc5e01f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5e5f61700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5e00746a0 0x7fc5e01f3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5e5f61700 1 -- 172.21.15.153:0/1436517954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5e00afc90 msgr2=0x7fc5e006ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5e5f61700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5e00afc90 0x7fc5e006ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5e5f61700 1 -- 172.21.15.153:0/1436517954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d00094a0 con 0x7fc5e015e160 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5e5f61700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e015e160 0x7fc5e015c0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8001560 tx=0x7fc5d800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5d5ffb700 1 -- 172.21.15.153:0/1436517954 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800ab70 con 0x7fc5e015e160 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5d5ffb700 1 -- 172.21.15.153:0/1436517954 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d800acd0 con 0x7fc5e015e160 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5e79c4700 1 -- 172.21.15.153:0/1436517954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e00c5e70 con 0x7fc5e015e160 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5d5ffb700 1 -- 172.21.15.153:0/1436517954 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8007310 con 0x7fc5e015e160 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.964+0000 7fc5e79c4700 1 -- 172.21.15.153:0/1436517954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e00c6430 con 0x7fc5e015e160 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.965+0000 7fc5e79c4700 1 -- 172.21.15.153:0/1436517954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e0068fb0 con 0x7fc5e015e160 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.965+0000 7fc5d5ffb700 1 -- 172.21.15.153:0/1436517954 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5d8007470 con 0x7fc5e015e160 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.966+0000 7fc5d5ffb700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc5c406aed0 0x7fc5c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.966+0000 7fc5d5ffb700 1 -- 172.21.15.153:0/1436517954 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5d8089460 con 0x7fc5e015e160 2023-11-24T08:04:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.966+0000 7fc5e5760700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc5c406aed0 0x7fc5c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.966+0000 7fc5e5760700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc5c406aed0 0x7fc5c406d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00097c0 tx=0x7fc5d0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:36.970+0000 7fc5d5ffb700 1 -- 172.21.15.153:0/1436517954 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5d8054510 con 0x7fc5e015e160 2023-11-24T08:04:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.159+0000 7fc5e79c4700 1 -- 172.21.15.153:0/1436517954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5e00b2740 con 0x7fc5e015e160 2023-11-24T08:04:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.160+0000 7fc5d5ffb700 1 -- 172.21.15.153:0/1436517954 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5d8018020 con 0x7fc5e015e160 2023-11-24T08:04:37.162 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 -- 172.21.15.153:0/1436517954 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc5c406aed0 msgr2=0x7fc5c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc5c406aed0 0x7fc5c406d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00097c0 tx=0x7fc5d0008030 comp rx=0 tx=0).stop 2023-11-24T08:04:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 -- 172.21.15.153:0/1436517954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e015e160 msgr2=0x7fc5e015c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e015e160 0x7fc5e015c0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8001560 tx=0x7fc5d800cf90 comp rx=0 tx=0).stop 2023-11-24T08:04:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 -- 172.21.15.153:0/1436517954 shutdown_connections 2023-11-24T08:04:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc5c406aed0 0x7fc5c406d390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e015e160 0x7fc5e015c0d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5e00746a0 0x7fc5e01f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 --2- 172.21.15.153:0/1436517954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5e00afc90 0x7fc5e006ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 -- 172.21.15.153:0/1436517954 >> 172.21.15.153:0/1436517954 conn(0x7fc5e00d0bf0 msgr2=0x7fc5e015d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 -- 172.21.15.153:0/1436517954 shutdown_connections 2023-11-24T08:04:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.162+0000 7fc5e79c4700 1 -- 172.21.15.153:0/1436517954 wait complete. 2023-11-24T08:04:37.176 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:37.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.296+0000 7f5bf47b6700 1 Processor -- start 2023-11-24T08:04:37.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.296+0000 7f5bf47b6700 1 -- start start 2023-11-24T08:04:37.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.297+0000 7f5bf47b6700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5bec1446a0 0x7f5bec0b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.297+0000 7f5bf47b6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec06c710 0x7f5bec0b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.297+0000 7f5bf47b6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0af950 con 0x7f5bec0adf00 2023-11-24T08:04:37.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.297+0000 7f5bf47b6700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec144a80 con 0x7f5bec1446a0 2023-11-24T08:04:37.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.297+0000 7f5bf47b6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0afc30 con 0x7f5bec06c710 2023-11-24T08:04:37.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.297+0000 7f5bf1d51700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5bec0adf00 0x7f5bec06c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42310/0 (socket says 172.21.15.153:42310) 2023-11-24T08:04:37.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.297+0000 7f5bf1d51700 1 -- 172.21.15.153:0/1702601981 learned_addr learned my addr 172.21.15.153:0/1702601981 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:37.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.297+0000 7f5bf2552700 1 --2- 172.21.15.153:0/1702601981 >> v2:172.21.15.164:3300/0 conn(0x7f5bec1446a0 0x7f5bec0b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.297+0000 7f5bf2d53700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec06c710 0x7f5bec0b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.297+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986381569 0 0) 0x7f5bec0af950 con 0x7f5bec0adf00 2023-11-24T08:04:37.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd80035b0 con 0x7f5bec0adf00 2023-11-24T08:04:37.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 323348825 0 0) 0x7f5bd80035b0 con 0x7f5bec0adf00 2023-11-24T08:04:37.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec06c710 msgr2=0x7f5bec0b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:37.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec06c710 0x7f5bec0b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 >> v2:172.21.15.164:3300/0 conn(0x7f5bec1446a0 msgr2=0x7f5bec0b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:37.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 --2- 172.21.15.153:0/1702601981 >> v2:172.21.15.164:3300/0 conn(0x7f5bec1446a0 0x7f5bec0b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0aff10 con 0x7f5bec0adf00 2023-11-24T08:04:37.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f5bdc001670 con 0x7f5bec0adf00 2023-11-24T08:04:37.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 >> v1:172.21.15.153:6789/0 conn(0x7f5bec0adf00 legacy=0x7f5bec06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd8003a00 0x7f5bd8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec06c710 0x7f5bd8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bd8004d90 0x7f5bd8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec144a80 con 0x7f5bd8004d90 2023-11-24T08:04:37.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0afc30 con 0x7f5bd8003a00 2023-11-24T08:04:37.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd800ba10 con 0x7f5bec06c710 2023-11-24T08:04:37.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf2d53700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bd8004d90 0x7f5bd8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf1d51700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec06c710 0x7f5bd8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf2552700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd8003a00 0x7f5bd8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf2d53700 1 -- 172.21.15.153:0/1702601981 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec06c710 msgr2=0x7f5bd8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:37.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf2d53700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec06c710 0x7f5bd8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf2d53700 1 -- 172.21.15.153:0/1702601981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd8003a00 msgr2=0x7f5bd8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:37.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf2d53700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd8003a00 0x7f5bd8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf2d53700 1 -- 172.21.15.153:0/1702601981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80035b0 con 0x7f5bd8004d90 2023-11-24T08:04:37.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.298+0000 7f5bf2d53700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bd8004d90 0x7f5bd8005210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009fc0 tx=0x7f5bd8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defba1d2b88f3535 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.299+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400ec30 con 0x7f5bd8004d90 2023-11-24T08:04:37.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.299+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400f040 con 0x7f5bd8004d90 2023-11-24T08:04:37.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.299+0000 7f5bf1550700 1 -- 172.21.15.153:0/1702601981 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4014480 con 0x7f5bd8004d90 2023-11-24T08:04:37.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.299+0000 7f5bf47b6700 1 -- 172.21.15.153:0/1702601981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bd8004d90 msgr2=0x7f5bd8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.299+0000 7f5bf47b6700 1 --2- 172.21.15.153:0/1702601981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bd8004d90 0x7f5bd8005210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009fc0 tx=0x7f5bd8005880 comp rx=0 tx=0).stop 2023-11-24T08:04:37.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.299+0000 7f5bf2d53700 1 -- 172.21.15.153:0/1702601981 reap_dead start 2023-11-24T08:04:37.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.299+0000 7f5bf47b6700 1 -- 172.21.15.153:0/1702601981 shutdown_connections 2023-11-24T08:04:37.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.299+0000 7f5bf47b6700 1 -- 172.21.15.153:0/1702601981 >> 172.21.15.153:0/1702601981 conn(0x7f5bec071b90 msgr2=0x7f5bec071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.299+0000 7f5bf47b6700 1 -- 172.21.15.153:0/1702601981 shutdown_connections 2023-11-24T08:04:37.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.299+0000 7f5bf47b6700 1 -- 172.21.15.153:0/1702601981 wait complete. 2023-11-24T08:04:37.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.300+0000 7f5bf47b6700 1 Processor -- start 2023-11-24T08:04:37.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.300+0000 7f5bf47b6700 1 -- start start 2023-11-24T08:04:37.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.301+0000 7f5bf47b6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd8004d90 0x7f5bec1f3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.301+0000 7f5bf47b6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec15df70 0x7f5bec0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.301+0000 7f5bf47b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bec1569b0 0x7f5bec0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.301+0000 7f5bf47b6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0cd400 con 0x7f5bec1569b0 2023-11-24T08:04:37.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.301+0000 7f5bf47b6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0cd160 con 0x7f5bd8004d90 2023-11-24T08:04:37.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.301+0000 7f5bf47b6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0ce140 con 0x7f5bec15df70 2023-11-24T08:04:37.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.301+0000 7f5bf2d53700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bec1569b0 0x7f5bec0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.301+0000 7f5bf2d53700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bec1569b0 0x7f5bec0ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36220/0 (socket says 172.21.15.153:36220) 2023-11-24T08:04:37.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.301+0000 7f5bf2d53700 1 -- 172.21.15.153:0/3507384555 learned_addr learned my addr 172.21.15.153:0/3507384555 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.301+0000 7f5bf2552700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd8004d90 0x7f5bec1f3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.301+0000 7f5bf1d51700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec15df70 0x7f5bec0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.302+0000 7f5bf2d53700 1 -- 172.21.15.153:0/3507384555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec15df70 msgr2=0x7f5bec0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.302+0000 7f5bf2d53700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec15df70 0x7f5bec0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.302+0000 7f5bf2d53700 1 -- 172.21.15.153:0/3507384555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd8004d90 msgr2=0x7f5bec1f3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.302+0000 7f5bf2d53700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd8004d90 0x7f5bec1f3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.302+0000 7f5bf2d53700 1 -- 172.21.15.153:0/3507384555 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0ce420 con 0x7f5bec1569b0 2023-11-24T08:04:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.302+0000 7f5bf2d53700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bec1569b0 0x7f5bec0ca520 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5be4017040 tx=0x7f5be4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.302+0000 7f5be2ffd700 1 -- 172.21.15.153:0/3507384555 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4004450 con 0x7f5bec1569b0 2023-11-24T08:04:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.302+0000 7f5be2ffd700 1 -- 172.21.15.153:0/3507384555 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be40045f0 con 0x7f5bec1569b0 2023-11-24T08:04:37.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.302+0000 7f5be2ffd700 1 -- 172.21.15.153:0/3507384555 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4003e10 con 0x7f5bec1569b0 2023-11-24T08:04:37.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.302+0000 7f5bf47b6700 1 -- 172.21.15.153:0/3507384555 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec0ce700 con 0x7f5bec1569b0 2023-11-24T08:04:37.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.302+0000 7f5bf47b6700 1 -- 172.21.15.153:0/3507384555 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec06ea20 con 0x7f5bec1569b0 2023-11-24T08:04:37.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.303+0000 7f5bf47b6700 1 -- 172.21.15.153:0/3507384555 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec0cea70 con 0x7f5bec1569b0 2023-11-24T08:04:37.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.303+0000 7f5be2ffd700 1 -- 172.21.15.153:0/3507384555 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5be4023070 con 0x7f5bec1569b0 2023-11-24T08:04:37.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.303+0000 7f5be2ffd700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5bd006ae60 0x7f5bd006d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.304+0000 7f5be2ffd700 1 -- 172.21.15.153:0/3507384555 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5be408acd0 con 0x7f5bec1569b0 2023-11-24T08:04:37.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.304+0000 7f5bf2552700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5bd006ae60 0x7f5bd006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.304+0000 7f5bf2552700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5bd006ae60 0x7f5bd006d320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009ba0 tx=0x7f5be8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.308+0000 7f5be2ffd700 1 -- 172.21.15.153:0/3507384555 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5be4055f30 con 0x7f5bec1569b0 2023-11-24T08:04:37.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.499+0000 7f5bf47b6700 1 -- 172.21.15.153:0/3507384555 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bec0753f0 con 0x7f5bec1569b0 2023-11-24T08:04:37.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.500+0000 7f5be2ffd700 1 -- 172.21.15.153:0/3507384555 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f5be4018090 con 0x7f5bec1569b0 2023-11-24T08:04:37.502 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:37.502 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 -- 172.21.15.153:0/3507384555 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5bd006ae60 msgr2=0x7f5bd006d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5bd006ae60 0x7f5bd006d320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009ba0 tx=0x7f5be8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 -- 172.21.15.153:0/3507384555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bec1569b0 msgr2=0x7f5bec0ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bec1569b0 0x7f5bec0ca520 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5be4017040 tx=0x7f5be4009750 comp rx=0 tx=0).stop 2023-11-24T08:04:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 -- 172.21.15.153:0/3507384555 shutdown_connections 2023-11-24T08:04:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5bd006ae60 0x7f5bd006d320 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bec1569b0 0x7f5bec0ca520 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd8004d90 0x7f5bec1f3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 --2- 172.21.15.153:0/3507384555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5bec15df70 0x7f5bec0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 -- 172.21.15.153:0/3507384555 >> 172.21.15.153:0/3507384555 conn(0x7f5bec071b90 msgr2=0x7f5bec0b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 -- 172.21.15.153:0/3507384555 shutdown_connections 2023-11-24T08:04:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.502+0000 7f5bf47b6700 1 -- 172.21.15.153:0/3507384555 wait complete. 2023-11-24T08:04:37.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:37.517 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.640+0000 7fee7b1a4700 1 Processor -- start 2023-11-24T08:04:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.640+0000 7fee7b1a4700 1 -- start start 2023-11-24T08:04:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.641+0000 7fee7b1a4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fee740746a0 0x7fee740add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.641+0000 7fee7b1a4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7406b080 con 0x7fee7415f9e0 2023-11-24T08:04:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.641+0000 7fee7b1a4700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7415c290 con 0x7fee740cf610 2023-11-24T08:04:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.641+0000 7fee7b1a4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee740cf9f0 con 0x7fee740746a0 2023-11-24T08:04:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.641+0000 7fee79741700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fee740746a0 0x7fee740add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.641+0000 7fee73fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fee7415f9e0 0x7fee74073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42330/0 (socket says 172.21.15.153:42330) 2023-11-24T08:04:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.641+0000 7fee73fff700 1 -- 172.21.15.153:0/4107569926 learned_addr learned my addr 172.21.15.153:0/4107569926 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee737fe700 1 -- 172.21.15.153:0/4107569926 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264639435 0 0) 0x7fee7406b080 con 0x7fee7415f9e0 2023-11-24T08:04:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee737fe700 1 -- 172.21.15.153:0/4107569926 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee640035b0 con 0x7fee7415f9e0 2023-11-24T08:04:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee79741700 1 -- 172.21.15.153:0/4107569926 >> v1:172.21.15.164:6789/0 conn(0x7fee740cf610 legacy=0x7fee740b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee79741700 1 -- 172.21.15.153:0/4107569926 >> v1:172.21.15.153:6789/0 conn(0x7fee7415f9e0 legacy=0x7fee74073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee79741700 1 -- 172.21.15.153:0/4107569926 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7415ff80 con 0x7fee740746a0 2023-11-24T08:04:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee79741700 1 --2- 172.21.15.153:0/4107569926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee740746a0 0x7fee740add40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009d90 tx=0x7fee6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452651e318fc2225 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee737fe700 1 -- 172.21.15.153:0/4107569926 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c00e070 con 0x7fee740746a0 2023-11-24T08:04:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee737fe700 1 -- 172.21.15.153:0/4107569926 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c00bb20 con 0x7fee740746a0 2023-11-24T08:04:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee737fe700 1 -- 172.21.15.153:0/4107569926 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c012430 con 0x7fee740746a0 2023-11-24T08:04:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee7b1a4700 1 -- 172.21.15.153:0/4107569926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee740746a0 msgr2=0x7fee740add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee7b1a4700 1 --2- 172.21.15.153:0/4107569926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee740746a0 0x7fee740add40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009d90 tx=0x7fee6c00b330 comp rx=0 tx=0).stop 2023-11-24T08:04:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee7b1a4700 1 -- 172.21.15.153:0/4107569926 shutdown_connections 2023-11-24T08:04:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee7b1a4700 1 --2- 172.21.15.153:0/4107569926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee740746a0 0x7fee740add40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.642+0000 7fee7b1a4700 1 -- 172.21.15.153:0/4107569926 >> 172.21.15.153:0/4107569926 conn(0x7fee740d0bf0 msgr2=0x7fee740d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.643+0000 7fee7b1a4700 1 -- 172.21.15.153:0/4107569926 shutdown_connections 2023-11-24T08:04:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.643+0000 7fee7b1a4700 1 -- 172.21.15.153:0/4107569926 wait complete. 2023-11-24T08:04:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.644+0000 7fee7b1a4700 1 Processor -- start 2023-11-24T08:04:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.644+0000 7fee7b1a4700 1 -- start start 2023-11-24T08:04:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee7b1a4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee740746a0 0x7fee74156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee7b1a4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee740cf610 0x7fee74154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee7b1a4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee7415f9e0 0x7fee7413ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee7b1a4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee74156fe0 con 0x7fee7415f9e0 2023-11-24T08:04:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee7b1a4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee74155300 con 0x7fee740746a0 2023-11-24T08:04:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee7b1a4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee74153d20 con 0x7fee740cf610 2023-11-24T08:04:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee79741700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee7415f9e0 0x7fee7413ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee79741700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee7415f9e0 0x7fee7413ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36234/0 (socket says 172.21.15.153:36234) 2023-11-24T08:04:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee79741700 1 -- 172.21.15.153:0/706556947 learned_addr learned my addr 172.21.15.153:0/706556947 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee73fff700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee740cf610 0x7fee74154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee78f40700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee740746a0 0x7fee74156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee79741700 1 -- 172.21.15.153:0/706556947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee740cf610 msgr2=0x7fee74154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee79741700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee740cf610 0x7fee74154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee79741700 1 -- 172.21.15.153:0/706556947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee740746a0 msgr2=0x7fee74156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee79741700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee740746a0 0x7fee74156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee79741700 1 -- 172.21.15.153:0/706556947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c009a70 con 0x7fee7415f9e0 2023-11-24T08:04:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee73fff700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee740cf610 0x7fee74154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee79741700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee7415f9e0 0x7fee7413ed00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fee6c013000 tx=0x7fee6c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee717fa700 1 -- 172.21.15.153:0/706556947 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c012430 con 0x7fee7415f9e0 2023-11-24T08:04:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee717fa700 1 -- 172.21.15.153:0/706556947 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c020070 con 0x7fee7415f9e0 2023-11-24T08:04:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee717fa700 1 -- 172.21.15.153:0/706556947 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c004280 con 0x7fee7415f9e0 2023-11-24T08:04:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee7b1a4700 1 -- 172.21.15.153:0/706556947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee74154000 con 0x7fee7415f9e0 2023-11-24T08:04:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.645+0000 7fee7b1a4700 1 -- 172.21.15.153:0/706556947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee741545c0 con 0x7fee7415f9e0 2023-11-24T08:04:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.646+0000 7fee7b1a4700 1 -- 172.21.15.153:0/706556947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee74074350 con 0x7fee7415f9e0 2023-11-24T08:04:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.647+0000 7fee717fa700 1 -- 172.21.15.153:0/706556947 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee6c0043e0 con 0x7fee7415f9e0 2023-11-24T08:04:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.647+0000 7fee717fa700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee5806aed0 0x7fee5806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.647+0000 7fee717fa700 1 -- 172.21.15.153:0/706556947 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee6c022070 con 0x7fee7415f9e0 2023-11-24T08:04:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.647+0000 7fee78f40700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee5806aed0 0x7fee5806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.648+0000 7fee78f40700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee5806aed0 0x7fee5806d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fee7415a6c0 tx=0x7fee68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.651+0000 7fee717fa700 1 -- 172.21.15.153:0/706556947 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee6c056340 con 0x7fee7415f9e0 2023-11-24T08:04:37.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.838+0000 7fee7b1a4700 1 -- 172.21.15.153:0/706556947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee74068fb0 con 0x7fee7415f9e0 2023-11-24T08:04:37.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.839+0000 7fee717fa700 1 -- 172.21.15.153:0/706556947 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee6c059960 con 0x7fee7415f9e0 2023-11-24T08:04:37.840 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 -- 172.21.15.153:0/706556947 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee5806aed0 msgr2=0x7fee5806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee5806aed0 0x7fee5806d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fee7415a6c0 tx=0x7fee68009040 comp rx=0 tx=0).stop 2023-11-24T08:04:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 -- 172.21.15.153:0/706556947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee7415f9e0 msgr2=0x7fee7413ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee7415f9e0 0x7fee7413ed00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fee6c013000 tx=0x7fee6c004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 -- 172.21.15.153:0/706556947 shutdown_connections 2023-11-24T08:04:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee5806aed0 0x7fee5806d390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee7415f9e0 0x7fee7413ed00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee740746a0 0x7fee74156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 --2- 172.21.15.153:0/706556947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee740cf610 0x7fee74154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 -- 172.21.15.153:0/706556947 >> 172.21.15.153:0/706556947 conn(0x7fee740d0bf0 msgr2=0x7fee7415a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 -- 172.21.15.153:0/706556947 shutdown_connections 2023-11-24T08:04:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.841+0000 7fee7b1a4700 1 -- 172.21.15.153:0/706556947 wait complete. 2023-11-24T08:04:37.854 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:37.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.975+0000 7f872935e700 1 Processor -- start 2023-11-24T08:04:37.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.975+0000 7f872935e700 1 -- start start 2023-11-24T08:04:37.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.976+0000 7f872935e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f872415f9e0 0x7f87240add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.976+0000 7f872935e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8724073f90 0x7f8724074420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.976+0000 7f872935e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872406b080 con 0x7f87240cf610 2023-11-24T08:04:37.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.976+0000 7f872935e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8724074960 con 0x7f872415f9e0 2023-11-24T08:04:37.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.976+0000 7f872935e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872415c290 con 0x7f8724073f90 2023-11-24T08:04:37.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.976+0000 7f87227fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f872415f9e0 0x7f87240add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.976+0000 7f87227fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f872415f9e0 0x7f87240add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36240/0 (socket says 172.21.15.153:36240) 2023-11-24T08:04:37.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.976+0000 7f8722ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f87240cf610 0x7f87240b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42342/0 (socket says 172.21.15.153:42342) 2023-11-24T08:04:37.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.976+0000 7f87227fc700 1 -- 172.21.15.153:0/2091243425 learned_addr learned my addr 172.21.15.153:0/2091243425 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:37.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f87237fe700 1 --2- 172.21.15.153:0/2091243425 >> v2:172.21.15.164:3300/0 conn(0x7f8724073f90 0x7f8724074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f87227fc700 1 -- 172.21.15.153:0/2091243425 >> v2:172.21.15.164:3300/0 conn(0x7f8724073f90 msgr2=0x7f8724074420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:37.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f87227fc700 1 --2- 172.21.15.153:0/2091243425 >> v2:172.21.15.164:3300/0 conn(0x7f8724073f90 0x7f8724074420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f87227fc700 1 -- 172.21.15.153:0/2091243425 >> v1:172.21.15.153:6789/0 conn(0x7f87240cf610 legacy=0x7f87240b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f87227fc700 1 -- 172.21.15.153:0/2091243425 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240cf9f0 con 0x7f872415f9e0 2023-11-24T08:04:37.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f87237fe700 1 --2- 172.21.15.153:0/2091243425 >> v2:172.21.15.164:3300/0 conn(0x7f8724073f90 0x7f8724074420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:37.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f87227fc700 1 --2- 172.21.15.153:0/2091243425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872415f9e0 0x7f87240add40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87140098f0 tx=0x7f8714009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5921be8c08713ca server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f8721ffb700 1 -- 172.21.15.153:0/2091243425 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871400b860 con 0x7f872415f9e0 2023-11-24T08:04:37.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f8721ffb700 1 -- 172.21.15.153:0/2091243425 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871400b9c0 con 0x7f872415f9e0 2023-11-24T08:04:37.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f8721ffb700 1 -- 172.21.15.153:0/2091243425 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871400bd50 con 0x7f872415f9e0 2023-11-24T08:04:37.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f872935e700 1 -- 172.21.15.153:0/2091243425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872415f9e0 msgr2=0x7f87240add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.977+0000 7f872935e700 1 --2- 172.21.15.153:0/2091243425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872415f9e0 0x7f87240add40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87140098f0 tx=0x7f8714009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:37.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.978+0000 7f872935e700 1 -- 172.21.15.153:0/2091243425 shutdown_connections 2023-11-24T08:04:37.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.978+0000 7f872935e700 1 --2- 172.21.15.153:0/2091243425 >> v2:172.21.15.164:3300/0 conn(0x7f8724073f90 0x7f8724074420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.978+0000 7f872935e700 1 --2- 172.21.15.153:0/2091243425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872415f9e0 0x7f87240add40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.978+0000 7f872935e700 1 -- 172.21.15.153:0/2091243425 >> 172.21.15.153:0/2091243425 conn(0x7f87240d0bf0 msgr2=0x7f87240d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.978+0000 7f872935e700 1 -- 172.21.15.153:0/2091243425 shutdown_connections 2023-11-24T08:04:37.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.978+0000 7f872935e700 1 -- 172.21.15.153:0/2091243425 wait complete. 2023-11-24T08:04:37.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.979+0000 7f872935e700 1 Processor -- start 2023-11-24T08:04:37.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.979+0000 7f872935e700 1 -- start start 2023-11-24T08:04:37.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.980+0000 7f872935e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8724073f90 0x7f8724144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.980+0000 7f872935e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87240cf610 0x7f8724143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.980+0000 7f872935e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872415f9e0 0x7f872415d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.980+0000 7f872935e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8724159e40 con 0x7f872415f9e0 2023-11-24T08:04:37.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.980+0000 7f872935e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8724144500 con 0x7f87240cf610 2023-11-24T08:04:37.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.980+0000 7f872935e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872415cb30 con 0x7f8724073f90 2023-11-24T08:04:37.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.980+0000 7f87237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872415f9e0 0x7f872415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.980+0000 7f87237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872415f9e0 0x7f872415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36248/0 (socket says 172.21.15.153:36248) 2023-11-24T08:04:37.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.980+0000 7f87237fe700 1 -- 172.21.15.153:0/2796247771 learned_addr learned my addr 172.21.15.153:0/2796247771 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:37.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f87227fc700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87240cf610 0x7f8724143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f87237fe700 1 -- 172.21.15.153:0/2796247771 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8724073f90 msgr2=0x7f8724144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f8722ffd700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8724073f90 0x7f8724144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f87237fe700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8724073f90 0x7f8724144780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f87237fe700 1 -- 172.21.15.153:0/2796247771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87240cf610 msgr2=0x7f8724143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f87237fe700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87240cf610 0x7f8724143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f87237fe700 1 -- 172.21.15.153:0/2796247771 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8714009550 con 0x7f872415f9e0 2023-11-24T08:04:37.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f87227fc700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87240cf610 0x7f8724143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:37.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f87237fe700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872415f9e0 0x7f872415d860 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f871c007ea0 tx=0x7f871c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f870b7fe700 1 -- 172.21.15.153:0/2796247771 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00de70 con 0x7f872415f9e0 2023-11-24T08:04:37.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f870b7fe700 1 -- 172.21.15.153:0/2796247771 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c00f040 con 0x7f872415f9e0 2023-11-24T08:04:37.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f870b7fe700 1 -- 172.21.15.153:0/2796247771 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c003c60 con 0x7f872415f9e0 2023-11-24T08:04:37.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f872935e700 1 -- 172.21.15.153:0/2796247771 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87241566b0 con 0x7f872415f9e0 2023-11-24T08:04:37.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.981+0000 7f872935e700 1 -- 172.21.15.153:0/2796247771 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872415d060 con 0x7f872415f9e0 2023-11-24T08:04:37.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.982+0000 7f872935e700 1 -- 172.21.15.153:0/2796247771 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8724068fb0 con 0x7f872415f9e0 2023-11-24T08:04:37.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.982+0000 7f870b7fe700 1 -- 172.21.15.153:0/2796247771 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f871c004030 con 0x7f872415f9e0 2023-11-24T08:04:37.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.983+0000 7f870b7fe700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f871006aed0 0x7f871006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.983+0000 7f870b7fe700 1 -- 172.21.15.153:0/2796247771 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f871c089690 con 0x7f872415f9e0 2023-11-24T08:04:37.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.983+0000 7f8722ffd700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f871006aed0 0x7f871006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.983+0000 7f8722ffd700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f871006aed0 0x7f871006d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8718000f60 tx=0x7f8718009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:37.987+0000 7f870b7fe700 1 -- 172.21.15.153:0/2796247771 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f871c0547d0 con 0x7f872415f9e0 2023-11-24T08:04:38.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.178+0000 7f872935e700 1 -- 172.21.15.153:0/2796247771 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f872406c240 con 0x7f872415f9e0 2023-11-24T08:04:38.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.179+0000 7f870b7fe700 1 -- 172.21.15.153:0/2796247771 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f871c057df0 con 0x7f872415f9e0 2023-11-24T08:04:38.181 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:38.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 -- 172.21.15.153:0/2796247771 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f871006aed0 msgr2=0x7f871006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f871006aed0 0x7f871006d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8718000f60 tx=0x7f8718009040 comp rx=0 tx=0).stop 2023-11-24T08:04:38.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 -- 172.21.15.153:0/2796247771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872415f9e0 msgr2=0x7f872415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872415f9e0 0x7f872415d860 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f871c007ea0 tx=0x7f871c00d3b0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 -- 172.21.15.153:0/2796247771 shutdown_connections 2023-11-24T08:04:38.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f871006aed0 0x7f871006d390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872415f9e0 0x7f872415d860 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8724073f90 0x7f8724144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 --2- 172.21.15.153:0/2796247771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87240cf610 0x7f8724143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 -- 172.21.15.153:0/2796247771 >> 172.21.15.153:0/2796247771 conn(0x7f87240d0bf0 msgr2=0x7f872406b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 -- 172.21.15.153:0/2796247771 shutdown_connections 2023-11-24T08:04:38.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.181+0000 7f872935e700 1 -- 172.21.15.153:0/2796247771 wait complete. 2023-11-24T08:04:38.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.318+0000 7ff5c7996700 1 Processor -- start 2023-11-24T08:04:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.319+0000 7ff5c7996700 1 -- start start 2023-11-24T08:04:38.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.319+0000 7ff5c7996700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff5c015e160 0x7ff5c00b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.319+0000 7ff5c7996700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5c00afc90 0x7ff5c0073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.319+0000 7ff5c7996700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5c00744d0 0x7ff5c006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.319+0000 7ff5c7996700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c00b4500 con 0x7ff5c00afc90 2023-11-24T08:04:38.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.319+0000 7ff5c7996700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c0074960 con 0x7ff5c015e160 2023-11-24T08:04:38.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.319+0000 7ff5c7996700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00b3c60 con 0x7ff5c00744d0 2023-11-24T08:04:38.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5c4f31700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5c00afc90 0x7ff5c0073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5c4f31700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5c00afc90 0x7ff5c0073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36254/0 (socket says 172.21.15.153:36254) 2023-11-24T08:04:38.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5c4f31700 1 -- 172.21.15.153:0/4058613630 learned_addr learned my addr 172.21.15.153:0/4058613630 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:38.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5c5f33700 1 --2- 172.21.15.153:0/4058613630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5c00744d0 0x7ff5c006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5c5732700 1 --2- 172.21.15.153:0/4058613630 >> v2:172.21.15.164:3300/0 conn(0x7ff5c015e160 0x7ff5c00b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5c4f31700 1 -- 172.21.15.153:0/4058613630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5c00744d0 msgr2=0x7ff5c006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5c4f31700 1 --2- 172.21.15.153:0/4058613630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5c00744d0 0x7ff5c006d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5c4f31700 1 -- 172.21.15.153:0/4058613630 >> v2:172.21.15.164:3300/0 conn(0x7ff5c015e160 msgr2=0x7ff5c00b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5c4f31700 1 --2- 172.21.15.153:0/4058613630 >> v2:172.21.15.164:3300/0 conn(0x7ff5c015e160 0x7ff5c00b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5c4f31700 1 -- 172.21.15.153:0/4058613630 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00b58c0 con 0x7ff5c00afc90 2023-11-24T08:04:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5c4f31700 1 --2- 172.21.15.153:0/4058613630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c00afc90 0x7ff5c0073f90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff5c009efa0 tx=0x7ff5b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5b265656f8bdd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5b7fff700 1 -- 172.21.15.153:0/4058613630 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b000b870 con 0x7ff5c00afc90 2023-11-24T08:04:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5b7fff700 1 -- 172.21.15.153:0/4058613630 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b000b9d0 con 0x7ff5c00afc90 2023-11-24T08:04:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.320+0000 7ff5b7fff700 1 -- 172.21.15.153:0/4058613630 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b000bd60 con 0x7ff5c00afc90 2023-11-24T08:04:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.321+0000 7ff5c7996700 1 -- 172.21.15.153:0/4058613630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c00afc90 msgr2=0x7ff5c0073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.321+0000 7ff5c7996700 1 --2- 172.21.15.153:0/4058613630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c00afc90 0x7ff5c0073f90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff5c009efa0 tx=0x7ff5b0009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.321+0000 7ff5c7996700 1 -- 172.21.15.153:0/4058613630 shutdown_connections 2023-11-24T08:04:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.321+0000 7ff5c7996700 1 --2- 172.21.15.153:0/4058613630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5c00744d0 0x7ff5c006d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.321+0000 7ff5c7996700 1 --2- 172.21.15.153:0/4058613630 >> v2:172.21.15.164:3300/0 conn(0x7ff5c015e160 0x7ff5c00b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.321+0000 7ff5c7996700 1 --2- 172.21.15.153:0/4058613630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c00afc90 0x7ff5c0073f90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.321+0000 7ff5c7996700 1 -- 172.21.15.153:0/4058613630 >> 172.21.15.153:0/4058613630 conn(0x7ff5c00d0bf0 msgr2=0x7ff5c00d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.321+0000 7ff5c7996700 1 -- 172.21.15.153:0/4058613630 shutdown_connections 2023-11-24T08:04:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.321+0000 7ff5c7996700 1 -- 172.21.15.153:0/4058613630 wait complete. 2023-11-24T08:04:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.322+0000 7ff5c7996700 1 Processor -- start 2023-11-24T08:04:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.322+0000 7ff5c7996700 1 -- start start 2023-11-24T08:04:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c7996700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c00744d0 0x7ff5c01446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c7996700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5c00afc90 0x7ff5c0161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c7996700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5c015e160 0x7ff5c00b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c7996700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0144bf0 con 0x7ff5c00744d0 2023-11-24T08:04:38.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c7996700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c015fd40 con 0x7ff5c015e160 2023-11-24T08:04:38.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c7996700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0160ba0 con 0x7ff5c00afc90 2023-11-24T08:04:38.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c5732700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c00744d0 0x7ff5c01446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c5732700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c00744d0 0x7ff5c01446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36258/0 (socket says 172.21.15.153:36258) 2023-11-24T08:04:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c5732700 1 -- 172.21.15.153:0/2683591843 learned_addr learned my addr 172.21.15.153:0/2683591843 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c4f31700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5c00afc90 0x7ff5c0161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c5f33700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5c015e160 0x7ff5c00b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c5732700 1 -- 172.21.15.153:0/2683591843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5c00afc90 msgr2=0x7ff5c0161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c5732700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5c00afc90 0x7ff5c0161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c5732700 1 -- 172.21.15.153:0/2683591843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5c015e160 msgr2=0x7ff5c00b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c5732700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5c015e160 0x7ff5c00b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c5732700 1 -- 172.21.15.153:0/2683591843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0009550 con 0x7ff5c00744d0 2023-11-24T08:04:38.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c5732700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c00744d0 0x7ff5c01446b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800d800 tx=0x7ff5b800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5b5ffb700 1 -- 172.21.15.153:0/2683591843 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80125f0 con 0x7ff5c00744d0 2023-11-24T08:04:38.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5b5ffb700 1 -- 172.21.15.153:0/2683591843 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b8012750 con 0x7ff5c00744d0 2023-11-24T08:04:38.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.323+0000 7ff5c7996700 1 -- 172.21.15.153:0/2683591843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c015ff90 con 0x7ff5c00744d0 2023-11-24T08:04:38.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.324+0000 7ff5b5ffb700 1 -- 172.21.15.153:0/2683591843 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8012b00 con 0x7ff5c00744d0 2023-11-24T08:04:38.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.324+0000 7ff5c7996700 1 -- 172.21.15.153:0/2683591843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c0160550 con 0x7ff5c00744d0 2023-11-24T08:04:38.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.325+0000 7ff5c7996700 1 -- 172.21.15.153:0/2683591843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c0068fb0 con 0x7ff5c00744d0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.325+0000 7ff5b5ffb700 1 -- 172.21.15.153:0/2683591843 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5b8012c60 con 0x7ff5c00744d0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.325+0000 7ff5b5ffb700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5a406aed0 0x7ff5a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.325+0000 7ff5c4f31700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5a406aed0 0x7ff5a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.325+0000 7ff5b5ffb700 1 -- 172.21.15.153:0/2683591843 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5b8089580 con 0x7ff5c00744d0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.326+0000 7ff5c4f31700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5a406aed0 0x7ff5a406d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0000c00 tx=0x7ff5b0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.330+0000 7ff5b5ffb700 1 -- 172.21.15.153:0/2683591843 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff5b80546c0 con 0x7ff5c00744d0 2023-11-24T08:04:38.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.524+0000 7ff5c7996700 1 -- 172.21.15.153:0/2683591843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5c006c140 con 0x7ff5c00744d0 2023-11-24T08:04:38.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.524+0000 7ff5b5ffb700 1 -- 172.21.15.153:0/2683591843 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5b8057ce0 con 0x7ff5c00744d0 2023-11-24T08:04:38.526 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:38.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 -- 172.21.15.153:0/2683591843 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5a406aed0 msgr2=0x7ff5a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5a406aed0 0x7ff5a406d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0000c00 tx=0x7ff5b0008030 comp rx=0 tx=0).stop 2023-11-24T08:04:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 -- 172.21.15.153:0/2683591843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c00744d0 msgr2=0x7ff5c01446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c00744d0 0x7ff5c01446b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800d800 tx=0x7ff5b800db10 comp rx=0 tx=0).stop 2023-11-24T08:04:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 -- 172.21.15.153:0/2683591843 shutdown_connections 2023-11-24T08:04:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5c015e160 0x7ff5c00b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5a406aed0 0x7ff5a406d390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c00744d0 0x7ff5c01446b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 --2- 172.21.15.153:0/2683591843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5c00afc90 0x7ff5c0161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 -- 172.21.15.153:0/2683591843 >> 172.21.15.153:0/2683591843 conn(0x7ff5c00d0bf0 msgr2=0x7ff5c006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 -- 172.21.15.153:0/2683591843 shutdown_connections 2023-11-24T08:04:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.527+0000 7ff5c7996700 1 -- 172.21.15.153:0/2683591843 wait complete. 2023-11-24T08:04:38.541 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:38.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.660+0000 7fc427316700 1 Processor -- start 2023-11-24T08:04:38.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.660+0000 7fc427316700 1 -- start start 2023-11-24T08:04:38.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.661+0000 7fc427316700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc420158670 0x7fc4200622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.661+0000 7fc427316700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4200c9fc0 0x7fc4200ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.661+0000 7fc427316700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4200cfff0 con 0x7fc420158a50 2023-11-24T08:04:38.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.661+0000 7fc427316700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4200cfd10 con 0x7fc420158670 2023-11-24T08:04:38.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.661+0000 7fc427316700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc420161f50 con 0x7fc4200c9fc0 2023-11-24T08:04:38.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.661+0000 7fc4250b2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc420158670 0x7fc4200622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.661+0000 7fc4258b3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4200c9fc0 0x7fc4200ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.661+0000 7fc4248b1700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc420158a50 0x7fc4200c98b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:50052/0 (socket says 172.21.15.153:50052) 2023-11-24T08:04:38.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.661+0000 7fc4248b1700 1 -- 172.21.15.153:0/745678691 learned_addr learned my addr 172.21.15.153:0/745678691 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:38.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.662+0000 7fc417fff700 1 -- 172.21.15.153:0/745678691 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050442301 0 0) 0x7fc4200cfff0 con 0x7fc420158a50 2023-11-24T08:04:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.662+0000 7fc417fff700 1 -- 172.21.15.153:0/745678691 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc40c0035b0 con 0x7fc420158a50 2023-11-24T08:04:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.662+0000 7fc4250b2700 1 -- 172.21.15.153:0/745678691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4200c9fc0 msgr2=0x7fc4200ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.662+0000 7fc4250b2700 1 --2- 172.21.15.153:0/745678691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4200c9fc0 0x7fc4200ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.662+0000 7fc4250b2700 1 -- 172.21.15.153:0/745678691 >> v1:172.21.15.164:6789/0 conn(0x7fc420158a50 legacy=0x7fc4200c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.662+0000 7fc4250b2700 1 -- 172.21.15.153:0/745678691 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc420162230 con 0x7fc420158670 2023-11-24T08:04:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.662+0000 7fc4250b2700 1 --2- 172.21.15.153:0/745678691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc420158670 0x7fc4200622a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc410009840 tx=0x7fc410009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3c8eb41a87a4138 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.662+0000 7fc417fff700 1 -- 172.21.15.153:0/745678691 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410011830 con 0x7fc420158670 2023-11-24T08:04:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.662+0000 7fc417fff700 1 -- 172.21.15.153:0/745678691 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc410011990 con 0x7fc420158670 2023-11-24T08:04:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.662+0000 7fc417fff700 1 -- 172.21.15.153:0/745678691 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410011d20 con 0x7fc420158670 2023-11-24T08:04:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.663+0000 7fc427316700 1 -- 172.21.15.153:0/745678691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc420158670 msgr2=0x7fc4200622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.663+0000 7fc427316700 1 --2- 172.21.15.153:0/745678691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc420158670 0x7fc4200622a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc410009840 tx=0x7fc410009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.663+0000 7fc427316700 1 -- 172.21.15.153:0/745678691 shutdown_connections 2023-11-24T08:04:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.663+0000 7fc427316700 1 --2- 172.21.15.153:0/745678691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4200c9fc0 0x7fc4200ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.663+0000 7fc427316700 1 --2- 172.21.15.153:0/745678691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc420158670 0x7fc4200622a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.663+0000 7fc427316700 1 -- 172.21.15.153:0/745678691 >> 172.21.15.153:0/745678691 conn(0x7fc4200b57b0 msgr2=0x7fc4200b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.663+0000 7fc427316700 1 -- 172.21.15.153:0/745678691 shutdown_connections 2023-11-24T08:04:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.663+0000 7fc427316700 1 -- 172.21.15.153:0/745678691 wait complete. 2023-11-24T08:04:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.664+0000 7fc427316700 1 Processor -- start 2023-11-24T08:04:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.664+0000 7fc427316700 1 -- start start 2023-11-24T08:04:38.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc427316700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4200c9fc0 0x7fc4201501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc427316700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc420158670 0x7fc4200b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc427316700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc420158a50 0x7fc420160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc427316700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4200cb320 con 0x7fc420158670 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc427316700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc420150710 con 0x7fc420158a50 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc427316700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4200ae400 con 0x7fc4200c9fc0 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4248b1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc420158670 0x7fc4200b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4248b1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc420158670 0x7fc4200b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36274/0 (socket says 172.21.15.153:36274) 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4248b1700 1 -- 172.21.15.153:0/3793696787 learned_addr learned my addr 172.21.15.153:0/3793696787 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4250b2700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4200c9fc0 0x7fc4201501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4258b3700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc420158a50 0x7fc420160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4248b1700 1 -- 172.21.15.153:0/3793696787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4200c9fc0 msgr2=0x7fc4201501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4248b1700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4200c9fc0 0x7fc4201501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4248b1700 1 -- 172.21.15.153:0/3793696787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc420158a50 msgr2=0x7fc420160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4248b1700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc420158a50 0x7fc420160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4248b1700 1 -- 172.21.15.153:0/3793696787 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4100094a0 con 0x7fc420158670 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4258b3700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc420158a50 0x7fc420160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4250b2700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4200c9fc0 0x7fc4201501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc4248b1700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc420158670 0x7fc4200b4f10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00c4d0 tx=0x7fc41c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.665+0000 7fc415ffb700 1 -- 172.21.15.153:0/3793696787 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c005d70 con 0x7fc420158670 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.666+0000 7fc415ffb700 1 -- 172.21.15.153:0/3793696787 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c0070d0 con 0x7fc420158670 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.666+0000 7fc415ffb700 1 -- 172.21.15.153:0/3793696787 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c007440 con 0x7fc420158670 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.666+0000 7fc427316700 1 -- 172.21.15.153:0/3793696787 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4200ae6e0 con 0x7fc420158670 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.666+0000 7fc427316700 1 -- 172.21.15.153:0/3793696787 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4200aeca0 con 0x7fc420158670 2023-11-24T08:04:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.667+0000 7fc427316700 1 -- 172.21.15.153:0/3793696787 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc420067f60 con 0x7fc420158670 2023-11-24T08:04:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.667+0000 7fc415ffb700 1 -- 172.21.15.153:0/3793696787 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc41c0075a0 con 0x7fc420158670 2023-11-24T08:04:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.667+0000 7fc415ffb700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc40406aed0 0x7fc40406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.667+0000 7fc415ffb700 1 -- 172.21.15.153:0/3793696787 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc41c0888c0 con 0x7fc420158670 2023-11-24T08:04:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.667+0000 7fc4250b2700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc40406aed0 0x7fc40406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.668+0000 7fc4250b2700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc40406aed0 0x7fc40406d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc410000c00 tx=0x7fc410008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.672+0000 7fc415ffb700 1 -- 172.21.15.153:0/3793696787 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc41c053ab0 con 0x7fc420158670 2023-11-24T08:04:38.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.861+0000 7fc427316700 1 -- 172.21.15.153:0/3793696787 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4200cb460 con 0x7fc420158670 2023-11-24T08:04:38.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.862+0000 7fc415ffb700 1 -- 172.21.15.153:0/3793696787 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fc41c017090 con 0x7fc420158670 2023-11-24T08:04:38.864 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:38.864 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:38.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.864+0000 7fc427316700 1 -- 172.21.15.153:0/3793696787 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc40406aed0 msgr2=0x7fc40406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.864+0000 7fc427316700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc40406aed0 0x7fc40406d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc410000c00 tx=0x7fc410008030 comp rx=0 tx=0).stop 2023-11-24T08:04:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.864+0000 7fc427316700 1 -- 172.21.15.153:0/3793696787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc420158670 msgr2=0x7fc4200b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.864+0000 7fc427316700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc420158670 0x7fc4200b4f10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00c4d0 tx=0x7fc41c00c890 comp rx=0 tx=0).stop 2023-11-24T08:04:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.865+0000 7fc427316700 1 -- 172.21.15.153:0/3793696787 shutdown_connections 2023-11-24T08:04:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.865+0000 7fc427316700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc420158a50 0x7fc420160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.865+0000 7fc427316700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4200c9fc0 0x7fc4201501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.865+0000 7fc427316700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc40406aed0 0x7fc40406d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.865+0000 7fc427316700 1 --2- 172.21.15.153:0/3793696787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc420158670 0x7fc4200b4f10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.865+0000 7fc427316700 1 -- 172.21.15.153:0/3793696787 >> 172.21.15.153:0/3793696787 conn(0x7fc4200b57b0 msgr2=0x7fc420156370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.865+0000 7fc427316700 1 -- 172.21.15.153:0/3793696787 shutdown_connections 2023-11-24T08:04:38.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:38.865+0000 7fc427316700 1 -- 172.21.15.153:0/3793696787 wait complete. 2023-11-24T08:04:38.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:38.879 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:39.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.001+0000 7f1b5e67c700 1 Processor -- start 2023-11-24T08:04:39.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.002+0000 7f1b5e67c700 1 -- start start 2023-11-24T08:04:39.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.002+0000 7f1b5e67c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b580746a0 0x7f1b580b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.002+0000 7f1b5e67c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b580b3c60 con 0x7f1b580afc90 2023-11-24T08:04:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.002+0000 7f1b5e67c700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b580b58c0 con 0x7f1b5815e160 2023-11-24T08:04:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.002+0000 7f1b5e67c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b580b4500 con 0x7f1b580746a0 2023-11-24T08:04:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.002+0000 7f1b577fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b580746a0 0x7f1b580b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.002+0000 7f1b5cc19700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1b580afc90 0x7f1b5806d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42388/0 (socket says 172.21.15.153:42388) 2023-11-24T08:04:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.002+0000 7f1b5cc19700 1 -- 172.21.15.153:0/1549606666 learned_addr learned my addr 172.21.15.153:0/1549606666 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.003+0000 7f1b577fe700 1 -- 172.21.15.153:0/1549606666 >> v1:172.21.15.164:6789/0 conn(0x7f1b5815e160 legacy=0x7f1b58073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:39.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.003+0000 7f1b577fe700 1 -- 172.21.15.153:0/1549606666 >> v1:172.21.15.153:6789/0 conn(0x7f1b580afc90 legacy=0x7f1b5806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.003+0000 7f1b577fe700 1 -- 172.21.15.153:0/1549606666 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5806bdc0 con 0x7f1b580746a0 2023-11-24T08:04:39.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.003+0000 7f1b577fe700 1 --2- 172.21.15.153:0/1549606666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b580746a0 0x7f1b580b5da0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009840 tx=0x7f1b4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa128ca8a7599dd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.003+0000 7f1b56ffd700 1 -- 172.21.15.153:0/1549606666 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c004230 con 0x7f1b580746a0 2023-11-24T08:04:39.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.003+0000 7f1b56ffd700 1 -- 172.21.15.153:0/1549606666 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c004390 con 0x7f1b580746a0 2023-11-24T08:04:39.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.003+0000 7f1b56ffd700 1 -- 172.21.15.153:0/1549606666 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0036a0 con 0x7f1b580746a0 2023-11-24T08:04:39.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.004+0000 7f1b5e67c700 1 -- 172.21.15.153:0/1549606666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b580746a0 msgr2=0x7f1b580b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.004+0000 7f1b5e67c700 1 --2- 172.21.15.153:0/1549606666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b580746a0 0x7f1b580b5da0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009840 tx=0x7f1b4c009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:39.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.004+0000 7f1b5e67c700 1 -- 172.21.15.153:0/1549606666 shutdown_connections 2023-11-24T08:04:39.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.004+0000 7f1b5e67c700 1 --2- 172.21.15.153:0/1549606666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b580746a0 0x7f1b580b5da0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.004+0000 7f1b5e67c700 1 -- 172.21.15.153:0/1549606666 >> 172.21.15.153:0/1549606666 conn(0x7f1b580d0bf0 msgr2=0x7f1b580d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.004+0000 7f1b5e67c700 1 -- 172.21.15.153:0/1549606666 shutdown_connections 2023-11-24T08:04:39.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.004+0000 7f1b5e67c700 1 -- 172.21.15.153:0/1549606666 wait complete. 2023-11-24T08:04:39.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.005+0000 7f1b5e67c700 1 Processor -- start 2023-11-24T08:04:39.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.005+0000 7f1b5e67c700 1 -- start start 2023-11-24T08:04:39.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b5e67c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b580746a0 0x7f1b581f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b5e67c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b580afc90 0x7f1b581601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b5e67c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b5815e160 0x7f1b5815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b5e67c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58156190 con 0x7f1b580746a0 2023-11-24T08:04:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b5e67c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58160d20 con 0x7f1b580afc90 2023-11-24T08:04:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b5e67c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58161000 con 0x7f1b5815e160 2023-11-24T08:04:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b57fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b580746a0 0x7f1b581f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b57fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b580746a0 0x7f1b581f34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36286/0 (socket says 172.21.15.153:36286) 2023-11-24T08:04:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b57fff700 1 -- 172.21.15.153:0/3923114824 learned_addr learned my addr 172.21.15.153:0/3923114824 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b577fe700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b580afc90 0x7f1b581601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b5cc19700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b5815e160 0x7f1b5815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b57fff700 1 -- 172.21.15.153:0/3923114824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b5815e160 msgr2=0x7f1b5815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b57fff700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b5815e160 0x7f1b5815c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b57fff700 1 -- 172.21.15.153:0/3923114824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b580afc90 msgr2=0x7f1b581601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b57fff700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b580afc90 0x7f1b581601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b57fff700 1 -- 172.21.15.153:0/3923114824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c0094a0 con 0x7f1b580746a0 2023-11-24T08:04:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b577fe700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b580afc90 0x7f1b581601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b5cc19700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b5815e160 0x7f1b5815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b57fff700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b580746a0 0x7f1b581f34e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800b4a0 tx=0x7f1b4800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b54ff9700 1 -- 172.21.15.153:0/3923114824 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48011830 con 0x7f1b580746a0 2023-11-24T08:04:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b54ff9700 1 -- 172.21.15.153:0/3923114824 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b48011990 con 0x7f1b580746a0 2023-11-24T08:04:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b5e67c700 1 -- 172.21.15.153:0/3923114824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b581612e0 con 0x7f1b580746a0 2023-11-24T08:04:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b54ff9700 1 -- 172.21.15.153:0/3923114824 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48011d40 con 0x7f1b580746a0 2023-11-24T08:04:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.006+0000 7f1b5e67c700 1 -- 172.21.15.153:0/3923114824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b581606f0 con 0x7f1b580746a0 2023-11-24T08:04:39.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.007+0000 7f1b5e67c700 1 -- 172.21.15.153:0/3923114824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b58068fb0 con 0x7f1b580746a0 2023-11-24T08:04:39.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.008+0000 7f1b54ff9700 1 -- 172.21.15.153:0/3923114824 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b4801a400 con 0x7f1b580746a0 2023-11-24T08:04:39.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.008+0000 7f1b54ff9700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1b4406aed0 0x7f1b4406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.008+0000 7f1b54ff9700 1 -- 172.21.15.153:0/3923114824 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b480892f0 con 0x7f1b580746a0 2023-11-24T08:04:39.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.008+0000 7f1b577fe700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1b4406aed0 0x7f1b4406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.009+0000 7f1b577fe700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1b4406aed0 0x7f1b4406d390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b581f6fd0 tx=0x7f1b4c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.013+0000 7f1b54ff9700 1 -- 172.21.15.153:0/3923114824 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b48054430 con 0x7f1b580746a0 2023-11-24T08:04:39.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.202+0000 7f1b5e67c700 1 -- 172.21.15.153:0/3923114824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b5806c140 con 0x7f1b580746a0 2023-11-24T08:04:39.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.202+0000 7f1b54ff9700 1 -- 172.21.15.153:0/3923114824 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b48057a50 con 0x7f1b580746a0 2023-11-24T08:04:39.204 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 -- 172.21.15.153:0/3923114824 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1b4406aed0 msgr2=0x7f1b4406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1b4406aed0 0x7f1b4406d390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b581f6fd0 tx=0x7f1b4c008030 comp rx=0 tx=0).stop 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 -- 172.21.15.153:0/3923114824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b580746a0 msgr2=0x7f1b581f34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b580746a0 0x7f1b581f34e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800b4a0 tx=0x7f1b4800b860 comp rx=0 tx=0).stop 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 -- 172.21.15.153:0/3923114824 shutdown_connections 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b5815e160 0x7f1b5815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1b4406aed0 0x7f1b4406d390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b580746a0 0x7f1b581f34e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 --2- 172.21.15.153:0/3923114824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b580afc90 0x7f1b581601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 -- 172.21.15.153:0/3923114824 >> 172.21.15.153:0/3923114824 conn(0x7f1b580d0bf0 msgr2=0x7f1b5815d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 -- 172.21.15.153:0/3923114824 shutdown_connections 2023-11-24T08:04:39.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.205+0000 7f1b5e67c700 1 -- 172.21.15.153:0/3923114824 wait complete. 2023-11-24T08:04:39.219 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.341+0000 7fa4f3bb6700 1 Processor -- start 2023-11-24T08:04:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.341+0000 7fa4f3bb6700 1 -- start start 2023-11-24T08:04:39.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f3bb6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa4ec1587f0 0x7fa4ec06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f3bb6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4ec15b370 0x7fa4ec15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f3bb6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ec06b530 con 0x7fa4ec0b3c60 2023-11-24T08:04:39.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f3bb6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec0ae5e0 con 0x7fa4ec1587f0 2023-11-24T08:04:39.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f3bb6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec15be30 con 0x7fa4ec15b370 2023-11-24T08:04:39.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f1952700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa4ec1587f0 0x7fa4ec06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f2153700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa4ec0b3c60 0x7fa4ec0af060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42402/0 (socket says 172.21.15.153:42402) 2023-11-24T08:04:39.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f2153700 1 -- 172.21.15.153:0/1274962746 learned_addr learned my addr 172.21.15.153:0/1274962746 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:39.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f1151700 1 --2- 172.21.15.153:0/1274962746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4ec15b370 0x7fa4ec15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f1952700 1 -- 172.21.15.153:0/1274962746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4ec15b370 msgr2=0x7fa4ec15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f1952700 1 --2- 172.21.15.153:0/1274962746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4ec15b370 0x7fa4ec15b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f1952700 1 -- 172.21.15.153:0/1274962746 >> v1:172.21.15.153:6789/0 conn(0x7fa4ec0b3c60 legacy=0x7fa4ec0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f0950700 1 -- 172.21.15.153:0/1274962746 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459789960 0 0) 0x7fa4ec06b530 con 0x7fa4ec0b3c60 2023-11-24T08:04:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.342+0000 7fa4f1952700 1 -- 172.21.15.153:0/1274962746 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec15c110 con 0x7fa4ec1587f0 2023-11-24T08:04:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f1952700 1 --2- 172.21.15.153:0/1274962746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ec1587f0 0x7fa4ec06aff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009840 tx=0x7fa4dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5744f3b782d2104 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f0950700 1 -- 172.21.15.153:0/1274962746 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc011830 con 0x7fa4ec1587f0 2023-11-24T08:04:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f0950700 1 -- 172.21.15.153:0/1274962746 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc011990 con 0x7fa4ec1587f0 2023-11-24T08:04:39.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f0950700 1 -- 172.21.15.153:0/1274962746 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc011d20 con 0x7fa4ec1587f0 2023-11-24T08:04:39.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/1274962746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ec1587f0 msgr2=0x7fa4ec06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f3bb6700 1 --2- 172.21.15.153:0/1274962746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ec1587f0 0x7fa4ec06aff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009840 tx=0x7fa4dc009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:39.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/1274962746 shutdown_connections 2023-11-24T08:04:39.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f3bb6700 1 --2- 172.21.15.153:0/1274962746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ec1587f0 0x7fa4ec06aff0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f3bb6700 1 --2- 172.21.15.153:0/1274962746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4ec15b370 0x7fa4ec15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/1274962746 >> 172.21.15.153:0/1274962746 conn(0x7fa4ec0d0bf0 msgr2=0x7fa4ec0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/1274962746 shutdown_connections 2023-11-24T08:04:39.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.343+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/1274962746 wait complete. 2023-11-24T08:04:39.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.345+0000 7fa4f3bb6700 1 Processor -- start 2023-11-24T08:04:39.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.345+0000 7fa4f3bb6700 1 -- start start 2023-11-24T08:04:39.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.345+0000 7fa4f3bb6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4ec0b3c60 0x7fa4ec09d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.345+0000 7fa4f3bb6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4ec1587f0 0x7fa4ec14c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.345+0000 7fa4f3bb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ec15b370 0x7fa4ec071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.345+0000 7fa4f3bb6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec09d390 con 0x7fa4ec15b370 2023-11-24T08:04:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.345+0000 7fa4f3bb6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec14cc70 con 0x7fa4ec1587f0 2023-11-24T08:04:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.345+0000 7fa4f3bb6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec09c710 con 0x7fa4ec0b3c60 2023-11-24T08:04:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.345+0000 7fa4f2153700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ec15b370 0x7fa4ec071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f2153700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ec15b370 0x7fa4ec071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36304/0 (socket says 172.21.15.153:36304) 2023-11-24T08:04:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f2153700 1 -- 172.21.15.153:0/4079187720 learned_addr learned my addr 172.21.15.153:0/4079187720 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:39.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f1952700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4ec0b3c60 0x7fa4ec09d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f1151700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4ec1587f0 0x7fa4ec14c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f2153700 1 -- 172.21.15.153:0/4079187720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4ec0b3c60 msgr2=0x7fa4ec09d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f2153700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4ec0b3c60 0x7fa4ec09d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f2153700 1 -- 172.21.15.153:0/4079187720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4ec1587f0 msgr2=0x7fa4ec14c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f2153700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4ec1587f0 0x7fa4ec14c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f2153700 1 -- 172.21.15.153:0/4079187720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc0094a0 con 0x7fa4ec15b370 2023-11-24T08:04:39.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f1952700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4ec0b3c60 0x7fa4ec09d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:39.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f2153700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ec15b370 0x7fa4ec071bb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4002230 tx=0x7fa4e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4e27fc700 1 -- 172.21.15.153:0/4079187720 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e400ac20 con 0x7fa4ec15b370 2023-11-24T08:04:39.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4e27fc700 1 -- 172.21.15.153:0/4079187720 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e400ada0 con 0x7fa4ec15b370 2023-11-24T08:04:39.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/4079187720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ec09c9f0 con 0x7fa4ec15b370 2023-11-24T08:04:39.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4e27fc700 1 -- 172.21.15.153:0/4079187720 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4007310 con 0x7fa4ec15b370 2023-11-24T08:04:39.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.346+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/4079187720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec09cfb0 con 0x7fa4ec15b370 2023-11-24T08:04:39.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.347+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/4079187720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec09d4d0 con 0x7fa4ec15b370 2023-11-24T08:04:39.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.347+0000 7fa4e27fc700 1 -- 172.21.15.153:0/4079187720 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4e4007470 con 0x7fa4ec15b370 2023-11-24T08:04:39.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.348+0000 7fa4e27fc700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa4d006aed0 0x7fa4d006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.348+0000 7fa4e27fc700 1 -- 172.21.15.153:0/4079187720 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4e4089440 con 0x7fa4ec15b370 2023-11-24T08:04:39.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.348+0000 7fa4f1952700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa4d006aed0 0x7fa4d006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.348+0000 7fa4f1952700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa4d006aed0 0x7fa4d006d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc0090b0 tx=0x7fa4dc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.352+0000 7fa4e27fc700 1 -- 172.21.15.153:0/4079187720 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4ec09d4d0 con 0x7fa4ec15b370 2023-11-24T08:04:39.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.541+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/4079187720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4ec09d4d0 con 0x7fa4ec15b370 2023-11-24T08:04:39.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.542+0000 7fa4e27fc700 1 -- 172.21.15.153:0/4079187720 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4ec09d4d0 con 0x7fa4ec15b370 2023-11-24T08:04:39.543 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/4079187720 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa4d006aed0 msgr2=0x7fa4d006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa4d006aed0 0x7fa4d006d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc0090b0 tx=0x7fa4dc008030 comp rx=0 tx=0).stop 2023-11-24T08:04:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/4079187720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ec15b370 msgr2=0x7fa4ec071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ec15b370 0x7fa4ec071bb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4002230 tx=0x7fa4e400a060 comp rx=0 tx=0).stop 2023-11-24T08:04:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/4079187720 shutdown_connections 2023-11-24T08:04:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa4d006aed0 0x7fa4d006d390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ec15b370 0x7fa4ec071bb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4ec0b3c60 0x7fa4ec09d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 --2- 172.21.15.153:0/4079187720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4ec1587f0 0x7fa4ec14c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/4079187720 >> 172.21.15.153:0/4079187720 conn(0x7fa4ec0d0bf0 msgr2=0x7fa4ec156910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/4079187720 shutdown_connections 2023-11-24T08:04:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.544+0000 7fa4f3bb6700 1 -- 172.21.15.153:0/4079187720 wait complete. 2023-11-24T08:04:39.558 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.680+0000 7f1c24b41700 1 Processor -- start 2023-11-24T08:04:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.680+0000 7f1c24b41700 1 -- start start 2023-11-24T08:04:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c24b41700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c200c5100 0x7f1c200c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c24b41700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1c200af5c0 0x7f1c2015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c24b41700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c2015ac30 0x7f1c2015b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c24b41700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c200afcc0 con 0x7f1c2015ac30 2023-11-24T08:04:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c24b41700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c200b0560 con 0x7f1c200af5c0 2023-11-24T08:04:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c24b41700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200c5a20 con 0x7f1c200c5100 2023-11-24T08:04:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c1ed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c2015ac30 0x7f1c2015b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c1ed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c2015ac30 0x7f1c2015b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36312/0 (socket says 172.21.15.153:36312) 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c1ed9d700 1 -- 172.21.15.153:0/1649481461 learned_addr learned my addr 172.21.15.153:0/1649481461 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c1e59c700 1 --2- 172.21.15.153:0/1649481461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c200c5100 0x7f1c200c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c1dd9b700 1 --2- 172.21.15.153:0/1649481461 >> v2:172.21.15.164:3300/0 conn(0x7f1c200af5c0 0x7f1c2015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c1ed9d700 1 -- 172.21.15.153:0/1649481461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c200c5100 msgr2=0x7f1c200c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c1ed9d700 1 --2- 172.21.15.153:0/1649481461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c200c5100 0x7f1c200c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c1ed9d700 1 -- 172.21.15.153:0/1649481461 >> v2:172.21.15.164:3300/0 conn(0x7f1c200af5c0 msgr2=0x7f1c2015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c1ed9d700 1 --2- 172.21.15.153:0/1649481461 >> v2:172.21.15.164:3300/0 conn(0x7f1c200af5c0 0x7f1c2015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c1ed9d700 1 -- 172.21.15.153:0/1649481461 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2015e9f0 con 0x7f1c2015ac30 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.681+0000 7f1c1ed9d700 1 --2- 172.21.15.153:0/1649481461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c2015ac30 0x7f1c2015b0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1c20070350 tx=0x7f1c1800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cf9ed59a4c83b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c1d59a700 1 -- 172.21.15.153:0/1649481461 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18010070 con 0x7f1c2015ac30 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c1d59a700 1 -- 172.21.15.153:0/1649481461 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1800dad0 con 0x7f1c2015ac30 2023-11-24T08:04:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c1d59a700 1 -- 172.21.15.153:0/1649481461 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1800de80 con 0x7f1c2015ac30 2023-11-24T08:04:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c24b41700 1 -- 172.21.15.153:0/1649481461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c2015ac30 msgr2=0x7f1c2015b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c24b41700 1 --2- 172.21.15.153:0/1649481461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c2015ac30 0x7f1c2015b0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1c20070350 tx=0x7f1c1800d430 comp rx=0 tx=0).stop 2023-11-24T08:04:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c24b41700 1 -- 172.21.15.153:0/1649481461 shutdown_connections 2023-11-24T08:04:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c24b41700 1 --2- 172.21.15.153:0/1649481461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c2015ac30 0x7f1c2015b0c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c24b41700 1 --2- 172.21.15.153:0/1649481461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c200c5100 0x7f1c200c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c24b41700 1 --2- 172.21.15.153:0/1649481461 >> v2:172.21.15.164:3300/0 conn(0x7f1c200af5c0 0x7f1c2015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c24b41700 1 -- 172.21.15.153:0/1649481461 >> 172.21.15.153:0/1649481461 conn(0x7f1c200b1e90 msgr2=0x7f1c200b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c24b41700 1 -- 172.21.15.153:0/1649481461 shutdown_connections 2023-11-24T08:04:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.682+0000 7f1c24b41700 1 -- 172.21.15.153:0/1649481461 wait complete. 2023-11-24T08:04:39.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.684+0000 7f1c24b41700 1 Processor -- start 2023-11-24T08:04:39.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.684+0000 7f1c24b41700 1 -- start start 2023-11-24T08:04:39.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.684+0000 7f1c24b41700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c200af5c0 0x7f1c2015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.684+0000 7f1c24b41700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c200c5100 0x7f1c200b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.684+0000 7f1c24b41700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c2015ac30 0x7f1c200b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.684+0000 7f1c24b41700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20157c60 con 0x7f1c200af5c0 2023-11-24T08:04:39.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.684+0000 7f1c24b41700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200b2bc0 con 0x7f1c200c5100 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.684+0000 7f1c24b41700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200b2e60 con 0x7f1c2015ac30 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.684+0000 7f1c1e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c200af5c0 0x7f1c2015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c1e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c200af5c0 0x7f1c2015dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36314/0 (socket says 172.21.15.153:36314) 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c1e59c700 1 -- 172.21.15.153:0/3134379746 learned_addr learned my addr 172.21.15.153:0/3134379746 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c1dd9b700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c200c5100 0x7f1c200b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c1ed9d700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c2015ac30 0x7f1c200b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c1e59c700 1 -- 172.21.15.153:0/3134379746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c2015ac30 msgr2=0x7f1c200b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c1e59c700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c2015ac30 0x7f1c200b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c1e59c700 1 -- 172.21.15.153:0/3134379746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c200c5100 msgr2=0x7f1c200b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c1e59c700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c200c5100 0x7f1c200b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c1e59c700 1 -- 172.21.15.153:0/3134379746 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1800bd40 con 0x7f1c200af5c0 2023-11-24T08:04:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c1e59c700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c200af5c0 0x7f1c2015dba0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e870 tx=0x7f1c1400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c0effd700 1 -- 172.21.15.153:0/3134379746 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14009590 con 0x7f1c200af5c0 2023-11-24T08:04:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c0effd700 1 -- 172.21.15.153:0/3134379746 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14013680 con 0x7f1c200af5c0 2023-11-24T08:04:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c24b41700 1 -- 172.21.15.153:0/3134379746 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c200ce160 con 0x7f1c200af5c0 2023-11-24T08:04:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c0effd700 1 -- 172.21.15.153:0/3134379746 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140139f0 con 0x7f1c200af5c0 2023-11-24T08:04:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.685+0000 7f1c24b41700 1 -- 172.21.15.153:0/3134379746 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c20146350 con 0x7f1c200af5c0 2023-11-24T08:04:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.686+0000 7f1c24b41700 1 -- 172.21.15.153:0/3134379746 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c200cdfc0 con 0x7f1c200af5c0 2023-11-24T08:04:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.687+0000 7f1c0effd700 1 -- 172.21.15.153:0/3134379746 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c14013b50 con 0x7f1c200af5c0 2023-11-24T08:04:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.687+0000 7f1c0effd700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1c0006aed0 0x7f1c0006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.687+0000 7f1c0effd700 1 -- 172.21.15.153:0/3134379746 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c14089430 con 0x7f1c200af5c0 2023-11-24T08:04:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.687+0000 7f1c1dd9b700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1c0006aed0 0x7f1c0006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.687+0000 7f1c1dd9b700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1c0006aed0 0x7f1c0006d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009ac0 tx=0x7f1c10009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.691+0000 7f1c0effd700 1 -- 172.21.15.153:0/3134379746 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c200cdfc0 con 0x7f1c200af5c0 2023-11-24T08:04:39.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.883+0000 7f1c24b41700 1 -- 172.21.15.153:0/3134379746 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c200cdfc0 con 0x7f1c200af5c0 2023-11-24T08:04:39.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.883+0000 7f1c0effd700 1 -- 172.21.15.153:0/3134379746 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c200cdfc0 con 0x7f1c200af5c0 2023-11-24T08:04:39.885 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 -- 172.21.15.153:0/3134379746 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1c0006aed0 msgr2=0x7f1c0006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1c0006aed0 0x7f1c0006d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009ac0 tx=0x7f1c10009210 comp rx=0 tx=0).stop 2023-11-24T08:04:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 -- 172.21.15.153:0/3134379746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c200af5c0 msgr2=0x7f1c2015dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c200af5c0 0x7f1c2015dba0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e870 tx=0x7f1c1400eb80 comp rx=0 tx=0).stop 2023-11-24T08:04:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 -- 172.21.15.153:0/3134379746 shutdown_connections 2023-11-24T08:04:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c2015ac30 0x7f1c200b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1c0006aed0 0x7f1c0006d390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c200af5c0 0x7f1c2015dba0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 --2- 172.21.15.153:0/3134379746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c200c5100 0x7f1c200b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 -- 172.21.15.153:0/3134379746 >> 172.21.15.153:0/3134379746 conn(0x7f1c200b1e90 msgr2=0x7f1c20159920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 -- 172.21.15.153:0/3134379746 shutdown_connections 2023-11-24T08:04:39.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:39.886+0000 7f1c24b41700 1 -- 172.21.15.153:0/3134379746 wait complete. 2023-11-24T08:04:39.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.018+0000 7f5d0f3bd700 1 Processor -- start 2023-11-24T08:04:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.019+0000 7f5d0f3bd700 1 -- start start 2023-11-24T08:04:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0f3bd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5d08152cc0 0x7f5d0806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0f3bd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d080b49a0 0x7f5d0806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0f3bd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5d080cff20 0x7f5d080d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0f3bd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0815c4b0 con 0x7f5d08152cc0 2023-11-24T08:04:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0f3bd700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0815c790 con 0x7f5d080cff20 2023-11-24T08:04:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0f3bd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0815ca70 con 0x7f5d080b49a0 2023-11-24T08:04:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0d159700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5d08152cc0 0x7f5d0806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0d159700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5d08152cc0 0x7f5d0806c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36322/0 (socket says 172.21.15.153:36322) 2023-11-24T08:04:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0d159700 1 -- 172.21.15.153:0/3172364282 learned_addr learned my addr 172.21.15.153:0/3172364282 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0d95a700 1 --2- 172.21.15.153:0/3172364282 >> v2:172.21.15.164:3300/0 conn(0x7f5d080cff20 0x7f5d080d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0c958700 1 --2- 172.21.15.153:0/3172364282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d080b49a0 0x7f5d0806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0d159700 1 -- 172.21.15.153:0/3172364282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d080b49a0 msgr2=0x7f5d0806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0d159700 1 --2- 172.21.15.153:0/3172364282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d080b49a0 0x7f5d0806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0d159700 1 -- 172.21.15.153:0/3172364282 >> v2:172.21.15.164:3300/0 conn(0x7f5d080cff20 msgr2=0x7f5d080d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0d159700 1 --2- 172.21.15.153:0/3172364282 >> v2:172.21.15.164:3300/0 conn(0x7f5d080cff20 0x7f5d080d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0d159700 1 -- 172.21.15.153:0/3172364282 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0815cd50 con 0x7f5d08152cc0 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0d95a700 1 --2- 172.21.15.153:0/3172364282 >> v2:172.21.15.164:3300/0 conn(0x7f5d080cff20 0x7f5d080d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.020+0000 7f5d0d159700 1 --2- 172.21.15.153:0/3172364282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d08152cc0 0x7f5d0806c000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5d08159e50 tx=0x7f5cf8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0536a0b878491d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5cfffff700 1 -- 172.21.15.153:0/3172364282 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8011830 con 0x7f5d08152cc0 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5cfffff700 1 -- 172.21.15.153:0/3172364282 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8011990 con 0x7f5d08152cc0 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5cfffff700 1 -- 172.21.15.153:0/3172364282 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8011d20 con 0x7f5d08152cc0 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/3172364282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d08152cc0 msgr2=0x7f5d0806c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5d0f3bd700 1 --2- 172.21.15.153:0/3172364282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d08152cc0 0x7f5d0806c000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5d08159e50 tx=0x7f5cf8009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/3172364282 shutdown_connections 2023-11-24T08:04:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5d0f3bd700 1 --2- 172.21.15.153:0/3172364282 >> v2:172.21.15.164:3300/0 conn(0x7f5d080cff20 0x7f5d080d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5d0f3bd700 1 --2- 172.21.15.153:0/3172364282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d08152cc0 0x7f5d0806c000 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5d0f3bd700 1 --2- 172.21.15.153:0/3172364282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d080b49a0 0x7f5d0806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/3172364282 >> 172.21.15.153:0/3172364282 conn(0x7f5d08071b90 msgr2=0x7f5d08071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/3172364282 shutdown_connections 2023-11-24T08:04:40.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.021+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/3172364282 wait complete. 2023-11-24T08:04:40.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.022+0000 7f5d0f3bd700 1 Processor -- start 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.023+0000 7f5d0f3bd700 1 -- start start 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.023+0000 7f5d0f3bd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d080b49a0 0x7f5d08147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.023+0000 7f5d0f3bd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080cff20 0x7f5d08155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.023+0000 7f5d0f3bd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d08152cc0 0x7f5d081f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.023+0000 7f5d0f3bd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0814b920 con 0x7f5d08152cc0 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.023+0000 7f5d0f3bd700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d08147db0 con 0x7f5d080cff20 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.023+0000 7f5d0f3bd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d08155cd0 con 0x7f5d080b49a0 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.023+0000 7f5d0d95a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d08152cc0 0x7f5d081f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.023+0000 7f5d0d95a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d08152cc0 0x7f5d081f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36332/0 (socket says 172.21.15.153:36332) 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.023+0000 7f5d0d95a700 1 -- 172.21.15.153:0/2429637222 learned_addr learned my addr 172.21.15.153:0/2429637222 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5d0c958700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080cff20 0x7f5d08155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5d0d159700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d080b49a0 0x7f5d08147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5d0d95a700 1 -- 172.21.15.153:0/2429637222 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d080b49a0 msgr2=0x7f5d08147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5d0d95a700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d080b49a0 0x7f5d08147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5d0d95a700 1 -- 172.21.15.153:0/2429637222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080cff20 msgr2=0x7f5d08155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5d0d95a700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080cff20 0x7f5d08155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5d0d95a700 1 -- 172.21.15.153:0/2429637222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d00009a70 con 0x7f5d08152cc0 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5d0d95a700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d08152cc0 0x7f5d081f5ee0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000efc0 tx=0x7f5d0000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5cfdffb700 1 -- 172.21.15.153:0/2429637222 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00009d70 con 0x7f5d08152cc0 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5cfdffb700 1 -- 172.21.15.153:0/2429637222 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0000f040 con 0x7f5d08152cc0 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/2429637222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf8009550 con 0x7f5d08152cc0 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5cfdffb700 1 -- 172.21.15.153:0/2429637222 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000ce00 con 0x7f5d08152cc0 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.024+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/2429637222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d08156290 con 0x7f5d08152cc0 2023-11-24T08:04:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.025+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/2429637222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d080753f0 con 0x7f5d08152cc0 2023-11-24T08:04:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.025+0000 7f5cfdffb700 1 -- 172.21.15.153:0/2429637222 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d00014480 con 0x7f5d08152cc0 2023-11-24T08:04:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.026+0000 7f5cfdffb700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5cec06aed0 0x7f5cec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.026+0000 7f5cfdffb700 1 -- 172.21.15.153:0/2429637222 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d00089d40 con 0x7f5d08152cc0 2023-11-24T08:04:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.026+0000 7f5d0d159700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5cec06aed0 0x7f5cec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.026+0000 7f5d0d159700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5cec06aed0 0x7f5cec06d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8014040 tx=0x7f5cf8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.030+0000 7f5cfdffb700 1 -- 172.21.15.153:0/2429637222 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d00054df0 con 0x7f5d08152cc0 2023-11-24T08:04:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.223+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/2429637222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d08067f60 con 0x7f5d08152cc0 2023-11-24T08:04:40.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.224+0000 7f5cfdffb700 1 -- 172.21.15.153:0/2429637222 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f5d00058410 con 0x7f5d08152cc0 2023-11-24T08:04:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:40.226 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:40.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.226+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/2429637222 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5cec06aed0 msgr2=0x7f5cec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.226+0000 7f5d0f3bd700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5cec06aed0 0x7f5cec06d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8014040 tx=0x7f5cf8008030 comp rx=0 tx=0).stop 2023-11-24T08:04:40.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.226+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/2429637222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d08152cc0 msgr2=0x7f5d081f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.226+0000 7f5d0f3bd700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d08152cc0 0x7f5d081f5ee0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000efc0 tx=0x7f5d0000c3a0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.226+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/2429637222 shutdown_connections 2023-11-24T08:04:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.226+0000 7f5d0f3bd700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5cec06aed0 0x7f5cec06d390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.226+0000 7f5d0f3bd700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d08152cc0 0x7f5d081f5ee0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.226+0000 7f5d0f3bd700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d080b49a0 0x7f5d08147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.226+0000 7f5d0f3bd700 1 --2- 172.21.15.153:0/2429637222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080cff20 0x7f5d08155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.226+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/2429637222 >> 172.21.15.153:0/2429637222 conn(0x7f5d08071b90 msgr2=0x7f5d0806c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.226+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/2429637222 shutdown_connections 2023-11-24T08:04:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.227+0000 7f5d0f3bd700 1 -- 172.21.15.153:0/2429637222 wait complete. 2023-11-24T08:04:40.240 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:40.241 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:40.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.365+0000 7f09a71e4700 1 Processor -- start 2023-11-24T08:04:40.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.365+0000 7f09a71e4700 1 -- start start 2023-11-24T08:04:40.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f09a71e4700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f09a01587f0 0x7f09a006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f09a71e4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09a015b370 0x7f09a015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f09a71e4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a006b530 con 0x7f09a00b3c60 2023-11-24T08:04:40.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f09a71e4700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a00ae5e0 con 0x7f09a01587f0 2023-11-24T08:04:40.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f09a71e4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a015be30 con 0x7f09a015b370 2023-11-24T08:04:40.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f09a5781700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f09a00b3c60 0x7f09a00af060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42444/0 (socket says 172.21.15.153:42444) 2023-11-24T08:04:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f09a5781700 1 -- 172.21.15.153:0/2976444002 learned_addr learned my addr 172.21.15.153:0/2976444002 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f09a4f80700 1 --2- 172.21.15.153:0/2976444002 >> v2:172.21.15.164:3300/0 conn(0x7f09a01587f0 0x7f09a006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099ffff700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09a015b370 0x7f09a015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234881653 0 0) 0x7f09a006b530 con 0x7f09a00b3c60 2023-11-24T08:04:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09900035b0 con 0x7f09a00b3c60 2023-11-24T08:04:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3003583022 0 0) 0x7f09900035b0 con 0x7f09a00b3c60 2023-11-24T08:04:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09a015b370 msgr2=0x7f09a015b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09a015b370 0x7f09a015b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 >> v2:172.21.15.164:3300/0 conn(0x7f09a01587f0 msgr2=0x7f09a006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 --2- 172.21.15.153:0/2976444002 >> v2:172.21.15.164:3300/0 conn(0x7f09a01587f0 0x7f09a006aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a015c110 con 0x7f09a00b3c60 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f09980019f0 con 0x7f09a00b3c60 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 >> v1:172.21.15.153:6789/0 conn(0x7f09a00b3c60 legacy=0x7f09a00af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09a015b370 0x7f0990003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0990003f80 0x7f0990004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0990004d90 0x7f0990005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00ae5e0 con 0x7f0990003f80 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a015be30 con 0x7f0990004d90 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099000ba10 con 0x7f09a015b370 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.366+0000 7f099ffff700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0990003f80 0x7f0990004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.367+0000 7f09a4f80700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09a015b370 0x7f0990003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.367+0000 7f09a5781700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0990004d90 0x7f0990005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.367+0000 7f099ffff700 1 -- 172.21.15.153:0/2976444002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09a015b370 msgr2=0x7f0990003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.367+0000 7f099ffff700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09a015b370 0x7f0990003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.367+0000 7f099ffff700 1 -- 172.21.15.153:0/2976444002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0990004d90 msgr2=0x7f0990005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.367+0000 7f099ffff700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0990004d90 0x7f0990005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.367+0000 7f099ffff700 1 -- 172.21.15.153:0/2976444002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09900035b0 con 0x7f0990003f80 2023-11-24T08:04:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.367+0000 7f099ffff700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0990003f80 0x7f0990004850 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f098c009b60 tx=0x7f0990005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfaeb97a516e1eb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.367+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00e660 con 0x7f0990003f80 2023-11-24T08:04:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.367+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c00e7c0 con 0x7f0990003f80 2023-11-24T08:04:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.367+0000 7f099f7fe700 1 -- 172.21.15.153:0/2976444002 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00eb30 con 0x7f0990003f80 2023-11-24T08:04:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.368+0000 7f09a71e4700 1 -- 172.21.15.153:0/2976444002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0990003f80 msgr2=0x7f0990004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.368+0000 7f09a71e4700 1 --2- 172.21.15.153:0/2976444002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0990003f80 0x7f0990004850 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f098c009b60 tx=0x7f0990005880 comp rx=0 tx=0).stop 2023-11-24T08:04:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.368+0000 7f09a5781700 1 -- 172.21.15.153:0/2976444002 reap_dead start 2023-11-24T08:04:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.368+0000 7f09a71e4700 1 -- 172.21.15.153:0/2976444002 shutdown_connections 2023-11-24T08:04:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.368+0000 7f09a71e4700 1 -- 172.21.15.153:0/2976444002 >> 172.21.15.153:0/2976444002 conn(0x7f09a00d0bf0 msgr2=0x7f09a00d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.368+0000 7f09a71e4700 1 -- 172.21.15.153:0/2976444002 shutdown_connections 2023-11-24T08:04:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.368+0000 7f09a71e4700 1 -- 172.21.15.153:0/2976444002 wait complete. 2023-11-24T08:04:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.369+0000 7f09a71e4700 1 Processor -- start 2023-11-24T08:04:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.369+0000 7f09a71e4700 1 -- start start 2023-11-24T08:04:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f09a71e4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0990003f80 0x7f09a01f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f09a71e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09a006f1d0 0x7f09a01eee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f09a71e4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09a009aa00 0x7f09a0071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f09a71e4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00cfde0 con 0x7f09a006f1d0 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f09a71e4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a01f3a70 con 0x7f09a009aa00 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f09a71e4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00b0180 con 0x7f0990003f80 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f099ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09a006f1d0 0x7f09a01eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f099ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09a006f1d0 0x7f09a01eee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36350/0 (socket says 172.21.15.153:36350) 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f099ffff700 1 -- 172.21.15.153:0/1247656287 learned_addr learned my addr 172.21.15.153:0/1247656287 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f09a5781700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09a009aa00 0x7f09a0071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f09a4f80700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0990003f80 0x7f09a01f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f099ffff700 1 -- 172.21.15.153:0/1247656287 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0990003f80 msgr2=0x7f09a01f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f099ffff700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0990003f80 0x7f09a01f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f099ffff700 1 -- 172.21.15.153:0/1247656287 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09a009aa00 msgr2=0x7f09a0071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f099ffff700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09a009aa00 0x7f09a0071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f099ffff700 1 -- 172.21.15.153:0/1247656287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a00b0460 con 0x7f09a006f1d0 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f099ffff700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09a006f1d0 0x7f09a01eee80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f09900046f0 tx=0x7f098c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.370+0000 7f099d7fa700 1 -- 172.21.15.153:0/1247656287 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00e660 con 0x7f09a006f1d0 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.371+0000 7f099d7fa700 1 -- 172.21.15.153:0/1247656287 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c003ab0 con 0x7f09a006f1d0 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.371+0000 7f09a71e4700 1 -- 172.21.15.153:0/1247656287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a00b0740 con 0x7f09a006f1d0 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.371+0000 7f099d7fa700 1 -- 172.21.15.153:0/1247656287 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c003e60 con 0x7f09a006f1d0 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.371+0000 7f09a71e4700 1 -- 172.21.15.153:0/1247656287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a00b0d00 con 0x7f09a006f1d0 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.371+0000 7f09a71e4700 1 -- 172.21.15.153:0/1247656287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a00b0e90 con 0x7f09a006f1d0 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.372+0000 7f099d7fa700 1 -- 172.21.15.153:0/1247656287 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f098c013470 con 0x7f09a006f1d0 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.372+0000 7f099d7fa700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f098406aec0 0x7f098406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.372+0000 7f099d7fa700 1 -- 172.21.15.153:0/1247656287 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f098c08acc0 con 0x7f09a006f1d0 2023-11-24T08:04:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.372+0000 7f09a4f80700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f098406aec0 0x7f098406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.373+0000 7f09a4f80700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f098406aec0 0x7f098406d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0994009c20 tx=0x7f0994008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.377+0000 7f099d7fa700 1 -- 172.21.15.153:0/1247656287 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f098c055e00 con 0x7f09a006f1d0 2023-11-24T08:04:40.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.566+0000 7f09a71e4700 1 -- 172.21.15.153:0/1247656287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09a0068fb0 con 0x7f09a006f1d0 2023-11-24T08:04:40.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.566+0000 7f099d7fa700 1 -- 172.21.15.153:0/1247656287 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f098c0170a0 con 0x7f09a006f1d0 2023-11-24T08:04:40.568 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 -- 172.21.15.153:0/1247656287 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f098406aec0 msgr2=0x7f098406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f098406aec0 0x7f098406d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0994009c20 tx=0x7f0994008040 comp rx=0 tx=0).stop 2023-11-24T08:04:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 -- 172.21.15.153:0/1247656287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09a006f1d0 msgr2=0x7f09a01eee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09a006f1d0 0x7f09a01eee80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f09900046f0 tx=0x7f098c0047c0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 -- 172.21.15.153:0/1247656287 shutdown_connections 2023-11-24T08:04:40.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09a009aa00 0x7f09a0071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0990003f80 0x7f09a01f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f098406aec0 0x7f098406d380 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 --2- 172.21.15.153:0/1247656287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09a006f1d0 0x7f09a01eee80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 -- 172.21.15.153:0/1247656287 >> 172.21.15.153:0/1247656287 conn(0x7f09a00d0bf0 msgr2=0x7f09a00b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 -- 172.21.15.153:0/1247656287 shutdown_connections 2023-11-24T08:04:40.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.568+0000 7f09a71e4700 1 -- 172.21.15.153:0/1247656287 wait complete. 2023-11-24T08:04:40.582 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.704+0000 7fa759c30700 1 Processor -- start 2023-11-24T08:04:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.704+0000 7fa759c30700 1 -- start start 2023-11-24T08:04:40.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.705+0000 7fa759c30700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7540b5da0 0x7fa7540afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.705+0000 7fa759c30700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7540b3c60 con 0x7fa75415e160 2023-11-24T08:04:40.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.705+0000 7fa759c30700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7540b58c0 con 0x7fa7540746a0 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.705+0000 7fa759c30700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7540b4500 con 0x7fa7540b5da0 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.705+0000 7fa753fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7540b5da0 0x7fa7540afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.705+0000 7fa7537fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa75415e160 0x7fa754073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42460/0 (socket says 172.21.15.153:42460) 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.705+0000 7fa7537fe700 1 -- 172.21.15.153:0/2591528389 learned_addr learned my addr 172.21.15.153:0/2591528389 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.705+0000 7fa753fff700 1 -- 172.21.15.153:0/2591528389 >> v1:172.21.15.164:6789/0 conn(0x7fa7540746a0 legacy=0x7fa75406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.705+0000 7fa753fff700 1 -- 172.21.15.153:0/2591528389 >> v1:172.21.15.153:6789/0 conn(0x7fa75415e160 legacy=0x7fa754073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.705+0000 7fa753fff700 1 -- 172.21.15.153:0/2591528389 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75406bdc0 con 0x7fa7540b5da0 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.706+0000 7fa753fff700 1 --2- 172.21.15.153:0/2591528389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7540b5da0 0x7fa7540afc90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009d90 tx=0x7fa74c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26187ecf8c255ac server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.706+0000 7fa7527fc700 1 -- 172.21.15.153:0/2591528389 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00e070 con 0x7fa7540b5da0 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.706+0000 7fa7527fc700 1 -- 172.21.15.153:0/2591528389 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c00bbd0 con 0x7fa7540b5da0 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.706+0000 7fa7527fc700 1 -- 172.21.15.153:0/2591528389 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c012430 con 0x7fa7540b5da0 2023-11-24T08:04:40.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.706+0000 7fa759c30700 1 -- 172.21.15.153:0/2591528389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7540b5da0 msgr2=0x7fa7540afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.706+0000 7fa759c30700 1 --2- 172.21.15.153:0/2591528389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7540b5da0 0x7fa7540afc90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009d90 tx=0x7fa74c00b330 comp rx=0 tx=0).stop 2023-11-24T08:04:40.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.706+0000 7fa759c30700 1 -- 172.21.15.153:0/2591528389 shutdown_connections 2023-11-24T08:04:40.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.706+0000 7fa759c30700 1 --2- 172.21.15.153:0/2591528389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7540b5da0 0x7fa7540afc90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.706+0000 7fa759c30700 1 -- 172.21.15.153:0/2591528389 >> 172.21.15.153:0/2591528389 conn(0x7fa7540d0bf0 msgr2=0x7fa7540d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.706+0000 7fa759c30700 1 -- 172.21.15.153:0/2591528389 shutdown_connections 2023-11-24T08:04:40.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.706+0000 7fa759c30700 1 -- 172.21.15.153:0/2591528389 wait complete. 2023-11-24T08:04:40.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.707+0000 7fa759c30700 1 Processor -- start 2023-11-24T08:04:40.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.708+0000 7fa759c30700 1 -- start start 2023-11-24T08:04:40.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.708+0000 7fa759c30700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7540746a0 0x7fa754155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.708+0000 7fa759c30700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7540b5da0 0x7fa754156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.708+0000 7fa759c30700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa75415e160 0x7fa754157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.708+0000 7fa759c30700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7541583a0 con 0x7fa7540b5da0 2023-11-24T08:04:40.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.708+0000 7fa759c30700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa754156040 con 0x7fa75415e160 2023-11-24T08:04:40.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.708+0000 7fa759c30700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75415cd90 con 0x7fa7540746a0 2023-11-24T08:04:40.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa752ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7540b5da0 0x7fa754156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa752ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7540b5da0 0x7fa754156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36362/0 (socket says 172.21.15.153:36362) 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa752ffd700 1 -- 172.21.15.153:0/3799856134 learned_addr learned my addr 172.21.15.153:0/3799856134 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa753fff700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa75415e160 0x7fa754157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa7537fe700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7540746a0 0x7fa754155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa752ffd700 1 -- 172.21.15.153:0/3799856134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7540746a0 msgr2=0x7fa754155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa752ffd700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7540746a0 0x7fa754155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa752ffd700 1 -- 172.21.15.153:0/3799856134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa75415e160 msgr2=0x7fa754157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa752ffd700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa75415e160 0x7fa754157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa752ffd700 1 -- 172.21.15.153:0/3799856134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c009a70 con 0x7fa7540b5da0 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa7537fe700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7540746a0 0x7fa754155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa752ffd700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7540b5da0 0x7fa754156c40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c4e0 tx=0x7fa74400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa74bfff700 1 -- 172.21.15.153:0/3799856134 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440052d0 con 0x7fa7540b5da0 2023-11-24T08:04:40.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa74bfff700 1 -- 172.21.15.153:0/3799856134 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744005430 con 0x7fa7540b5da0 2023-11-24T08:04:40.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa74bfff700 1 -- 172.21.15.153:0/3799856134 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440038c0 con 0x7fa7540b5da0 2023-11-24T08:04:40.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa759c30700 1 -- 172.21.15.153:0/3799856134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7541f3e20 con 0x7fa7540b5da0 2023-11-24T08:04:40.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.709+0000 7fa759c30700 1 -- 172.21.15.153:0/3799856134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa754157b00 con 0x7fa7540b5da0 2023-11-24T08:04:40.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.710+0000 7fa759c30700 1 -- 172.21.15.153:0/3799856134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa754068fb0 con 0x7fa7540b5da0 2023-11-24T08:04:40.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.711+0000 7fa74bfff700 1 -- 172.21.15.153:0/3799856134 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa744003a20 con 0x7fa7540b5da0 2023-11-24T08:04:40.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.711+0000 7fa74bfff700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa73406aed0 0x7fa73406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.711+0000 7fa74bfff700 1 -- 172.21.15.153:0/3799856134 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7440889f0 con 0x7fa7540b5da0 2023-11-24T08:04:40.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.711+0000 7fa7537fe700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa73406aed0 0x7fa73406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.711+0000 7fa7537fe700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa73406aed0 0x7fa73406d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa73c007fd0 tx=0x7fa73c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.715+0000 7fa74bfff700 1 -- 172.21.15.153:0/3799856134 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa744053aa0 con 0x7fa7540b5da0 2023-11-24T08:04:40.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.905+0000 7fa759c30700 1 -- 172.21.15.153:0/3799856134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa7541f3fb0 con 0x7fa7540b5da0 2023-11-24T08:04:40.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.905+0000 7fa74bfff700 1 -- 172.21.15.153:0/3799856134 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa744017020 con 0x7fa7540b5da0 2023-11-24T08:04:40.908 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:40.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.907+0000 7fa759c30700 1 -- 172.21.15.153:0/3799856134 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa73406aed0 msgr2=0x7fa73406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.907+0000 7fa759c30700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa73406aed0 0x7fa73406d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa73c007fd0 tx=0x7fa73c009040 comp rx=0 tx=0).stop 2023-11-24T08:04:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.907+0000 7fa759c30700 1 -- 172.21.15.153:0/3799856134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7540b5da0 msgr2=0x7fa754156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.907+0000 7fa759c30700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7540b5da0 0x7fa754156c40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c4e0 tx=0x7fa74400c7f0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.907+0000 7fa759c30700 1 -- 172.21.15.153:0/3799856134 shutdown_connections 2023-11-24T08:04:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.907+0000 7fa759c30700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa75415e160 0x7fa754157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.907+0000 7fa759c30700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7540746a0 0x7fa754155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.907+0000 7fa759c30700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa73406aed0 0x7fa73406d390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.907+0000 7fa759c30700 1 --2- 172.21.15.153:0/3799856134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7540b5da0 0x7fa754156c40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.907+0000 7fa759c30700 1 -- 172.21.15.153:0/3799856134 >> 172.21.15.153:0/3799856134 conn(0x7fa7540d0bf0 msgr2=0x7fa754161ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.908+0000 7fa759c30700 1 -- 172.21.15.153:0/3799856134 shutdown_connections 2023-11-24T08:04:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:40.908+0000 7fa759c30700 1 -- 172.21.15.153:0/3799856134 wait complete. 2023-11-24T08:04:40.922 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:41.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.043+0000 7f0641f88700 1 Processor -- start 2023-11-24T08:04:41.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.043+0000 7f0641f88700 1 -- start start 2023-11-24T08:04:41.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.043+0000 7f0641f88700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f063c1587f0 0x7f063c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.043+0000 7f0641f88700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c15b370 0x7f063c15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.043+0000 7f0641f88700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c06b530 con 0x7f063c0b3c60 2023-11-24T08:04:41.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.043+0000 7f0641f88700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0ae5e0 con 0x7f063c1587f0 2023-11-24T08:04:41.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.043+0000 7f0641f88700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c15be30 con 0x7f063c15b370 2023-11-24T08:04:41.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f063c0b3c60 0x7f063c0af060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42476/0 (socket says 172.21.15.153:42476) 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063bfff700 1 -- 172.21.15.153:0/614273937 learned_addr learned my addr 172.21.15.153:0/614273937 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847978626 0 0) 0x7f063c06b530 con 0x7f063c0b3c60 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063b7fe700 1 --2- 172.21.15.153:0/614273937 >> v2:172.21.15.164:3300/0 conn(0x7f063c1587f0 0x7f063c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063affd700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c15b370 0x7f063c15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06240035b0 con 0x7f063c0b3c60 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 850188245 0 0) 0x7f06240035b0 con 0x7f063c0b3c60 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c15b370 msgr2=0x7f063c15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c15b370 0x7f063c15b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 >> v2:172.21.15.164:3300/0 conn(0x7f063c1587f0 msgr2=0x7f063c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 --2- 172.21.15.153:0/614273937 >> v2:172.21.15.164:3300/0 conn(0x7f063c1587f0 0x7f063c06aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c15c110 con 0x7f063c0b3c60 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f06340019f0 con 0x7f063c0b3c60 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063affd700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c15b370 0x7f063c15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:41.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 >> v1:172.21.15.153:6789/0 conn(0x7f063c0b3c60 legacy=0x7f063c0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0624003a00 0x7f0624003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c15b370 0x7f0624004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0624004d90 0x7f0624005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0ae5e0 con 0x7f0624004d90 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c15be30 con 0x7f0624003a00 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062400ba10 con 0x7f063c15b370 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063bfff700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0624004d90 0x7f0624005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063b7fe700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0624003a00 0x7f0624003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.044+0000 7f063affd700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c15b370 0x7f0624004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f063bfff700 1 -- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c15b370 msgr2=0x7f0624004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f063bfff700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c15b370 0x7f0624004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f063bfff700 1 -- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0624003a00 msgr2=0x7f0624003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f063bfff700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0624003a00 0x7f0624003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f063bfff700 1 -- 172.21.15.153:0/614273937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240035b0 con 0x7f0624004d90 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f063bfff700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0624004d90 0x7f0624005210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f063400a860 tx=0x7f0624005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fed9004cb81317 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634012600 con 0x7f0624004d90 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634012780 con 0x7f0624004d90 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f063a7fc700 1 -- 172.21.15.153:0/614273937 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634012b30 con 0x7f0624004d90 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f0641f88700 1 -- 172.21.15.153:0/614273937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0624004d90 msgr2=0x7f0624005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f0641f88700 1 --2- 172.21.15.153:0/614273937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0624004d90 0x7f0624005210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f063400a860 tx=0x7f0624005880 comp rx=0 tx=0).stop 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f063bfff700 1 -- 172.21.15.153:0/614273937 reap_dead start 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f0641f88700 1 -- 172.21.15.153:0/614273937 shutdown_connections 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.045+0000 7f0641f88700 1 -- 172.21.15.153:0/614273937 >> 172.21.15.153:0/614273937 conn(0x7f063c0d0bf0 msgr2=0x7f063c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.046+0000 7f0641f88700 1 -- 172.21.15.153:0/614273937 shutdown_connections 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.046+0000 7f0641f88700 1 -- 172.21.15.153:0/614273937 wait complete. 2023-11-24T08:04:41.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.047+0000 7f0641f88700 1 Processor -- start 2023-11-24T08:04:41.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.047+0000 7f0641f88700 1 -- start start 2023-11-24T08:04:41.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f0641f88700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f063c14d6d0 0x7f063c1f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f0641f88700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c0c5bd0 0x7f063c073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f0641f88700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f063c0744d0 0x7f063c1f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f0641f88700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c074950 con 0x7f063c14d6d0 2023-11-24T08:04:41.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f0641f88700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0c6420 con 0x7f063c0744d0 2023-11-24T08:04:41.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f0641f88700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0c6700 con 0x7f063c0c5bd0 2023-11-24T08:04:41.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f063b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f063c14d6d0 0x7f063c1f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f063b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f063c14d6d0 0x7f063c1f7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36380/0 (socket says 172.21.15.153:36380) 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f063b7fe700 1 -- 172.21.15.153:0/3803704652 learned_addr learned my addr 172.21.15.153:0/3803704652 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f063affd700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c0c5bd0 0x7f063c073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f063bfff700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f063c0744d0 0x7f063c1f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f063b7fe700 1 -- 172.21.15.153:0/3803704652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c0c5bd0 msgr2=0x7f063c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f063b7fe700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c0c5bd0 0x7f063c073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f063b7fe700 1 -- 172.21.15.153:0/3803704652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f063c0744d0 msgr2=0x7f063c1f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f063b7fe700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f063c0744d0 0x7f063c1f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f063b7fe700 1 -- 172.21.15.153:0/3803704652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c1f4e20 con 0x7f063c14d6d0 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f063b7fe700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f063c14d6d0 0x7f063c1f7b30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f062c011aa0 tx=0x7f062c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f0623fff700 1 -- 172.21.15.153:0/3803704652 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00f980 con 0x7f063c14d6d0 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f0623fff700 1 -- 172.21.15.153:0/3803704652 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c00fb00 con 0x7f063c14d6d0 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f0623fff700 1 -- 172.21.15.153:0/3803704652 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00feb0 con 0x7f063c14d6d0 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f0641f88700 1 -- 172.21.15.153:0/3803704652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c1f5100 con 0x7f063c14d6d0 2023-11-24T08:04:41.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.048+0000 7f0641f88700 1 -- 172.21.15.153:0/3803704652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c0c6050 con 0x7f063c14d6d0 2023-11-24T08:04:41.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.049+0000 7f0641f88700 1 -- 172.21.15.153:0/3803704652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c1f5470 con 0x7f063c14d6d0 2023-11-24T08:04:41.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.050+0000 7f0623fff700 1 -- 172.21.15.153:0/3803704652 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f062c014440 con 0x7f063c14d6d0 2023-11-24T08:04:41.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.050+0000 7f0623fff700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f062806aed0 0x7f062806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.050+0000 7f063affd700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f062806aed0 0x7f062806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.050+0000 7f0623fff700 1 -- 172.21.15.153:0/3803704652 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f062c089d80 con 0x7f063c14d6d0 2023-11-24T08:04:41.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.051+0000 7f063affd700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f062806aed0 0x7f062806d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f063c09eef0 tx=0x7f0630008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.056+0000 7f0623fff700 1 -- 172.21.15.153:0/3803704652 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f062c054ef0 con 0x7f063c14d6d0 2023-11-24T08:04:41.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.246+0000 7f0641f88700 1 -- 172.21.15.153:0/3803704652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f063c068fb0 con 0x7f063c14d6d0 2023-11-24T08:04:41.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.247+0000 7f0623fff700 1 -- 172.21.15.153:0/3803704652 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f062c022020 con 0x7f063c14d6d0 2023-11-24T08:04:41.249 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 -- 172.21.15.153:0/3803704652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f062806aed0 msgr2=0x7f062806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f062806aed0 0x7f062806d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f063c09eef0 tx=0x7f0630008040 comp rx=0 tx=0).stop 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 -- 172.21.15.153:0/3803704652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f063c14d6d0 msgr2=0x7f063c1f7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f063c14d6d0 0x7f063c1f7b30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f062c011aa0 tx=0x7f062c011e60 comp rx=0 tx=0).stop 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 -- 172.21.15.153:0/3803704652 shutdown_connections 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f063c0744d0 0x7f063c1f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f062806aed0 0x7f062806d390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f063c14d6d0 0x7f063c1f7b30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 --2- 172.21.15.153:0/3803704652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f063c0c5bd0 0x7f063c073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 -- 172.21.15.153:0/3803704652 >> 172.21.15.153:0/3803704652 conn(0x7f063c0d0bf0 msgr2=0x7f063c1569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 -- 172.21.15.153:0/3803704652 shutdown_connections 2023-11-24T08:04:41.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.249+0000 7f0641f88700 1 -- 172.21.15.153:0/3803704652 wait complete. 2023-11-24T08:04:41.333 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2023-11-24T08:04:41.333 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:04:41.333 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.452+0000 7fd7b2c21700 1 Processor -- start 2023-11-24T08:04:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.452+0000 7fd7b2c21700 1 -- start start 2023-11-24T08:04:41.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd7ac15bdd0 0x7fd7ac1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7ac0d1c70 0x7fd7ac0d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ac0b22d0 con 0x7fd7ac0b3370 2023-11-24T08:04:41.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac0b2f50 con 0x7fd7ac0d1c70 2023-11-24T08:04:41.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac0d2640 con 0x7fd7ac15bdd0 2023-11-24T08:04:41.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b11be700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7ac0d1c70 0x7fd7ac0d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b11be700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7ac0d1c70 0x7fd7ac0d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36392/0 (socket says 172.21.15.153:36392) 2023-11-24T08:04:41.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b11be700 1 -- 172.21.15.153:0/431877950 learned_addr learned my addr 172.21.15.153:0/431877950 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:41.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b09bd700 1 --2- 172.21.15.153:0/431877950 >> v2:172.21.15.164:3300/0 conn(0x7fd7ac15bdd0 0x7fd7ac1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b11be700 1 -- 172.21.15.153:0/431877950 >> v2:172.21.15.164:3300/0 conn(0x7fd7ac15bdd0 msgr2=0x7fd7ac1604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b11be700 1 --2- 172.21.15.153:0/431877950 >> v2:172.21.15.164:3300/0 conn(0x7fd7ac15bdd0 0x7fd7ac1604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b11be700 1 -- 172.21.15.153:0/431877950 >> v1:172.21.15.164:6789/0 conn(0x7fd7ac0b3370 legacy=0x7fd7ac0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b11be700 1 -- 172.21.15.153:0/431877950 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac0b25b0 con 0x7fd7ac0d1c70 2023-11-24T08:04:41.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b11be700 1 --2- 172.21.15.153:0/431877950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ac0d1c70 0x7fd7ac0d2100 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac06ec10 tx=0x7fd7a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bacead8fc294bc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7ab7fe700 1 -- 172.21.15.153:0/431877950 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a400e070 con 0x7fd7ac0d1c70 2023-11-24T08:04:41.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7ab7fe700 1 -- 172.21.15.153:0/431877950 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a400b910 con 0x7fd7ac0d1c70 2023-11-24T08:04:41.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7ab7fe700 1 -- 172.21.15.153:0/431877950 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a400bcc0 con 0x7fd7ac0d1c70 2023-11-24T08:04:41.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 -- 172.21.15.153:0/431877950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ac0d1c70 msgr2=0x7fd7ac0d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 --2- 172.21.15.153:0/431877950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ac0d1c70 0x7fd7ac0d2100 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac06ec10 tx=0x7fd7a400b330 comp rx=0 tx=0).stop 2023-11-24T08:04:41.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 -- 172.21.15.153:0/431877950 shutdown_connections 2023-11-24T08:04:41.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 --2- 172.21.15.153:0/431877950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ac0d1c70 0x7fd7ac0d2100 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 --2- 172.21.15.153:0/431877950 >> v2:172.21.15.164:3300/0 conn(0x7fd7ac15bdd0 0x7fd7ac1604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 -- 172.21.15.153:0/431877950 >> 172.21.15.153:0/431877950 conn(0x7fd7ac0731a0 msgr2=0x7fd7ac09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 -- 172.21.15.153:0/431877950 shutdown_connections 2023-11-24T08:04:41.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.454+0000 7fd7b2c21700 1 -- 172.21.15.153:0/431877950 wait complete. 2023-11-24T08:04:41.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.455+0000 7fd7b2c21700 1 Processor -- start 2023-11-24T08:04:41.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.455+0000 7fd7b2c21700 1 -- start start 2023-11-24T08:04:41.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.456+0000 7fd7b2c21700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ac0b3370 0x7fd7ac157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.456+0000 7fd7b2c21700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7ac0d1c70 0x7fd7ac0c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.456+0000 7fd7b2c21700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7ac15bdd0 0x7fd7ac0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.456+0000 7fd7b2c21700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0c6970 con 0x7fd7ac0b3370 2023-11-24T08:04:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.456+0000 7fd7b2c21700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0c5cf0 con 0x7fd7ac0d1c70 2023-11-24T08:04:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.456+0000 7fd7b2c21700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0c5fd0 con 0x7fd7ac15bdd0 2023-11-24T08:04:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.456+0000 7fd7b09bd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ac0b3370 0x7fd7ac157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.456+0000 7fd7b09bd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ac0b3370 0x7fd7ac157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36394/0 (socket says 172.21.15.153:36394) 2023-11-24T08:04:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.456+0000 7fd7b09bd700 1 -- 172.21.15.153:0/578624857 learned_addr learned my addr 172.21.15.153:0/578624857 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7b09bd700 1 -- 172.21.15.153:0/578624857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7ac15bdd0 msgr2=0x7fd7ac0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7b09bd700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7ac15bdd0 0x7fd7ac0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7b09bd700 1 -- 172.21.15.153:0/578624857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7ac0d1c70 msgr2=0x7fd7ac0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7abfff700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7ac0d1c70 0x7fd7ac0c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7b09bd700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7ac0d1c70 0x7fd7ac0c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7b09bd700 1 -- 172.21.15.153:0/578624857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a4009b30 con 0x7fd7ac0b3370 2023-11-24T08:04:41.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7b09bd700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ac0b3370 0x7fd7ac157580 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000e870 tx=0x7fd7a000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7a97fa700 1 -- 172.21.15.153:0/578624857 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0009590 con 0x7fd7ac0b3370 2023-11-24T08:04:41.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7a97fa700 1 -- 172.21.15.153:0/578624857 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a000ee70 con 0x7fd7ac0b3370 2023-11-24T08:04:41.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7b2c21700 1 -- 172.21.15.153:0/578624857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ac0c62b0 con 0x7fd7ac0b3370 2023-11-24T08:04:41.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7a97fa700 1 -- 172.21.15.153:0/578624857 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000ca50 con 0x7fd7ac0b3370 2023-11-24T08:04:41.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.457+0000 7fd7b2c21700 1 -- 172.21.15.153:0/578624857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ac0c6d90 con 0x7fd7ac0b3370 2023-11-24T08:04:41.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.458+0000 7fd7b2c21700 1 -- 172.21.15.153:0/578624857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ac067f60 con 0x7fd7ac0b3370 2023-11-24T08:04:41.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.458+0000 7fd7a97fa700 1 -- 172.21.15.153:0/578624857 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7a000cbb0 con 0x7fd7ac0b3370 2023-11-24T08:04:41.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.459+0000 7fd7a97fa700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd79006aed0 0x7fd79006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.459+0000 7fd7a97fa700 1 -- 172.21.15.153:0/578624857 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7a0089550 con 0x7fd7ac0b3370 2023-11-24T08:04:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.459+0000 7fd7abfff700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd79006aed0 0x7fd79006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.459+0000 7fd7abfff700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd79006aed0 0x7fd79006d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0c5370 tx=0x7fd798009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.464+0000 7fd7a97fa700 1 -- 172.21.15.153:0/578624857 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7a0054610 con 0x7fd7ac0b3370 2023-11-24T08:04:41.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.655+0000 7fd7b2c21700 1 -- 172.21.15.153:0/578624857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7ac0c6be0 con 0x7fd7ac0b3370 2023-11-24T08:04:41.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.657+0000 7fd7a97fa700 1 -- 172.21.15.153:0/578624857 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fd7a000ce60 con 0x7fd7ac0b3370 2023-11-24T08:04:41.659 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 -- 172.21.15.153:0/578624857 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd79006aed0 msgr2=0x7fd79006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd79006aed0 0x7fd79006d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0c5370 tx=0x7fd798009040 comp rx=0 tx=0).stop 2023-11-24T08:04:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 -- 172.21.15.153:0/578624857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ac0b3370 msgr2=0x7fd7ac157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ac0b3370 0x7fd7ac157580 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000e870 tx=0x7fd7a000ec30 comp rx=0 tx=0).stop 2023-11-24T08:04:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 -- 172.21.15.153:0/578624857 shutdown_connections 2023-11-24T08:04:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7ac15bdd0 0x7fd7ac0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd79006aed0 0x7fd79006d390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ac0b3370 0x7fd7ac157580 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 --2- 172.21.15.153:0/578624857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7ac0d1c70 0x7fd7ac0c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 -- 172.21.15.153:0/578624857 >> 172.21.15.153:0/578624857 conn(0x7fd7ac0731a0 msgr2=0x7fd7ac0b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 -- 172.21.15.153:0/578624857 shutdown_connections 2023-11-24T08:04:41.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.660+0000 7fd7b2c21700 1 -- 172.21.15.153:0/578624857 wait complete. 2023-11-24T08:04:41.674 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:41.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:41.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.796+0000 7fe6ef444700 1 Processor -- start 2023-11-24T08:04:41.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.796+0000 7fe6ef444700 1 -- start start 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.796+0000 7fe6ef444700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6e81587f0 0x7fe6e806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.796+0000 7fe6ef444700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe6e815b370 0x7fe6e815b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.796+0000 7fe6ef444700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e806b530 con 0x7fe6e80b3c60 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.796+0000 7fe6ef444700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e80ae5e0 con 0x7fe6e81587f0 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.796+0000 7fe6ef444700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e815be30 con 0x7fe6e815b370 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6ed1e0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6e81587f0 0x7fe6e806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6ed9e1700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe6e80b3c60 0x7fe6e80af060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42510/0 (socket says 172.21.15.153:42510) 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6ed9e1700 1 -- 172.21.15.153:0/3146048383 learned_addr learned my addr 172.21.15.153:0/3146048383 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6dffff700 1 -- 172.21.15.153:0/3146048383 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275681052 0 0) 0x7fe6e806b530 con 0x7fe6e80b3c60 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6ec9df700 1 --2- 172.21.15.153:0/3146048383 >> v2:172.21.15.164:3300/0 conn(0x7fe6e815b370 0x7fe6e815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6dffff700 1 -- 172.21.15.153:0/3146048383 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d40035b0 con 0x7fe6e80b3c60 2023-11-24T08:04:41.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6ed1e0700 1 -- 172.21.15.153:0/3146048383 >> v2:172.21.15.164:3300/0 conn(0x7fe6e815b370 msgr2=0x7fe6e815b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6ed1e0700 1 --2- 172.21.15.153:0/3146048383 >> v2:172.21.15.164:3300/0 conn(0x7fe6e815b370 0x7fe6e815b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6ed1e0700 1 -- 172.21.15.153:0/3146048383 >> v1:172.21.15.153:6789/0 conn(0x7fe6e80b3c60 legacy=0x7fe6e80af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6ed1e0700 1 -- 172.21.15.153:0/3146048383 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e815c110 con 0x7fe6e81587f0 2023-11-24T08:04:41.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6ed1e0700 1 --2- 172.21.15.153:0/3146048383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e81587f0 0x7fe6e806aff0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009840 tx=0x7fe6d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6879f9f79e2d9b74 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6dffff700 1 -- 172.21.15.153:0/3146048383 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8010a30 con 0x7fe6e81587f0 2023-11-24T08:04:41.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6dffff700 1 -- 172.21.15.153:0/3146048383 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d8010b90 con 0x7fe6e81587f0 2023-11-24T08:04:41.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.797+0000 7fe6dffff700 1 -- 172.21.15.153:0/3146048383 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8018440 con 0x7fe6e81587f0 2023-11-24T08:04:41.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.798+0000 7fe6ef444700 1 -- 172.21.15.153:0/3146048383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e81587f0 msgr2=0x7fe6e806aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.798+0000 7fe6ef444700 1 --2- 172.21.15.153:0/3146048383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e81587f0 0x7fe6e806aff0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009840 tx=0x7fe6d8009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:41.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.798+0000 7fe6ef444700 1 -- 172.21.15.153:0/3146048383 shutdown_connections 2023-11-24T08:04:41.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.798+0000 7fe6ef444700 1 --2- 172.21.15.153:0/3146048383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e81587f0 0x7fe6e806aff0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.798+0000 7fe6ef444700 1 --2- 172.21.15.153:0/3146048383 >> v2:172.21.15.164:3300/0 conn(0x7fe6e815b370 0x7fe6e815b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.798+0000 7fe6ef444700 1 -- 172.21.15.153:0/3146048383 >> 172.21.15.153:0/3146048383 conn(0x7fe6e80d0bf0 msgr2=0x7fe6e80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.798+0000 7fe6ef444700 1 -- 172.21.15.153:0/3146048383 shutdown_connections 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.798+0000 7fe6ef444700 1 -- 172.21.15.153:0/3146048383 wait complete. 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.799+0000 7fe6ef444700 1 Processor -- start 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.799+0000 7fe6ef444700 1 -- start start 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ef444700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e80b3c60 0x7fe6e80b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ef444700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e81587f0 0x7fe6e8144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ef444700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e815b370 0x7fe6e814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ef444700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8145430 con 0x7fe6e81587f0 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ef444700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e814ad50 con 0x7fe6e80b3c60 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ef444700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8145690 con 0x7fe6e815b370 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ec9df700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e81587f0 0x7fe6e8144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ec9df700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e81587f0 0x7fe6e8144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36410/0 (socket says 172.21.15.153:36410) 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ec9df700 1 -- 172.21.15.153:0/70943677 learned_addr learned my addr 172.21.15.153:0/70943677 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:41.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ed1e0700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e80b3c60 0x7fe6e80b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ed9e1700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e815b370 0x7fe6e814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ec9df700 1 -- 172.21.15.153:0/70943677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e815b370 msgr2=0x7fe6e814a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ec9df700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e815b370 0x7fe6e814a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ec9df700 1 -- 172.21.15.153:0/70943677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e80b3c60 msgr2=0x7fe6e80b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ec9df700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e80b3c60 0x7fe6e80b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.800+0000 7fe6ec9df700 1 -- 172.21.15.153:0/70943677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d80094a0 con 0x7fe6e81587f0 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.801+0000 7fe6ec9df700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e81587f0 0x7fe6e8144ef0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400d800 tx=0x7fe6e400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.801+0000 7fe6ddffb700 1 -- 172.21.15.153:0/70943677 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40125f0 con 0x7fe6e81587f0 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.801+0000 7fe6ddffb700 1 -- 172.21.15.153:0/70943677 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4012750 con 0x7fe6e81587f0 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.801+0000 7fe6ddffb700 1 -- 172.21.15.153:0/70943677 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4012b00 con 0x7fe6e81587f0 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.801+0000 7fe6ef444700 1 -- 172.21.15.153:0/70943677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e8145970 con 0x7fe6e81587f0 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.801+0000 7fe6ef444700 1 -- 172.21.15.153:0/70943677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e8145f30 con 0x7fe6e81587f0 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.802+0000 7fe6ef444700 1 -- 172.21.15.153:0/70943677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e8146580 con 0x7fe6e81587f0 2023-11-24T08:04:41.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.802+0000 7fe6ddffb700 1 -- 172.21.15.153:0/70943677 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6e4012c60 con 0x7fe6e81587f0 2023-11-24T08:04:41.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.803+0000 7fe6ddffb700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 0x7fe6cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.803+0000 7fe6ddffb700 1 -- 172.21.15.153:0/70943677 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6e4089980 con 0x7fe6e81587f0 2023-11-24T08:04:41.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.803+0000 7fe6ed1e0700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 0x7fe6cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.803+0000 7fe6ed1e0700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 0x7fe6cc06d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80093a0 tx=0x7fe6d8009f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.808+0000 7fe6ddffb700 1 -- 172.21.15.153:0/70943677 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6e4054a30 con 0x7fe6e81587f0 2023-11-24T08:04:41.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.994+0000 7fe6ef444700 1 -- 172.21.15.153:0/70943677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6e8068fb0 con 0x7fe6e81587f0 2023-11-24T08:04:41.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.995+0000 7fe6ddffb700 1 -- 172.21.15.153:0/70943677 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6e4058050 con 0x7fe6e81587f0 2023-11-24T08:04:41.997 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:42.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 -- 172.21.15.153:0/70943677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 msgr2=0x7fe6cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 0x7fe6cc06d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80093a0 tx=0x7fe6d8009f90 comp rx=0 tx=0).stop 2023-11-24T08:04:42.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 -- 172.21.15.153:0/70943677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e81587f0 msgr2=0x7fe6e8144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e81587f0 0x7fe6e8144ef0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400d800 tx=0x7fe6e400dbc0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 -- 172.21.15.153:0/70943677 shutdown_connections 2023-11-24T08:04:42.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6e815b370 0x7fe6e814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e80b3c60 0x7fe6e80b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6cc06aed0 0x7fe6cc06d390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 --2- 172.21.15.153:0/70943677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6e81587f0 0x7fe6e8144ef0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 -- 172.21.15.153:0/70943677 >> 172.21.15.153:0/70943677 conn(0x7fe6e80d0bf0 msgr2=0x7fe6e8156930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 -- 172.21.15.153:0/70943677 shutdown_connections 2023-11-24T08:04:42.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:41.997+0000 7fe6ef444700 1 -- 172.21.15.153:0/70943677 wait complete. 2023-11-24T08:04:42.012 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:42.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.133+0000 7ff2990ec700 1 Processor -- start 2023-11-24T08:04:42.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.133+0000 7ff2990ec700 1 -- start start 2023-11-24T08:04:42.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.134+0000 7ff2990ec700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff29415e160 0x7ff2940b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.134+0000 7ff2990ec700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2940746a0 0x7ff29406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.134+0000 7ff2990ec700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2940b3c60 con 0x7ff2940afc90 2023-11-24T08:04:42.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.134+0000 7ff2990ec700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2940b4500 con 0x7ff29415e160 2023-11-24T08:04:42.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.134+0000 7ff2990ec700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2940b58c0 con 0x7ff2940746a0 2023-11-24T08:04:42.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.134+0000 7ff29359e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2940746a0 0x7ff29406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.134+0000 7ff292d9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff29415e160 0x7ff2940b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.134+0000 7ff29259c700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff2940afc90 0x7ff294073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:50202/0 (socket says 172.21.15.153:50202) 2023-11-24T08:04:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.134+0000 7ff29259c700 1 -- 172.21.15.153:0/842796316 learned_addr learned my addr 172.21.15.153:0/842796316 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.135+0000 7ff291d9b700 1 -- 172.21.15.153:0/842796316 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327751639 0 0) 0x7ff2940b3c60 con 0x7ff2940afc90 2023-11-24T08:04:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.135+0000 7ff291d9b700 1 -- 172.21.15.153:0/842796316 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2800035b0 con 0x7ff2940afc90 2023-11-24T08:04:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.135+0000 7ff292d9d700 1 -- 172.21.15.153:0/842796316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2940746a0 msgr2=0x7ff29406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.135+0000 7ff292d9d700 1 --2- 172.21.15.153:0/842796316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2940746a0 0x7ff29406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.135+0000 7ff292d9d700 1 -- 172.21.15.153:0/842796316 >> v1:172.21.15.164:6789/0 conn(0x7ff2940afc90 legacy=0x7ff294073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.135+0000 7ff292d9d700 1 -- 172.21.15.153:0/842796316 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2940b0140 con 0x7ff29415e160 2023-11-24T08:04:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.135+0000 7ff292d9d700 1 --2- 172.21.15.153:0/842796316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff29415e160 0x7ff2940b5da0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009840 tx=0x7ff27c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f311f4c8737726ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.135+0000 7ff291d9b700 1 -- 172.21.15.153:0/842796316 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c011830 con 0x7ff29415e160 2023-11-24T08:04:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.135+0000 7ff291d9b700 1 -- 172.21.15.153:0/842796316 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c011990 con 0x7ff29415e160 2023-11-24T08:04:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.135+0000 7ff291d9b700 1 -- 172.21.15.153:0/842796316 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c011d00 con 0x7ff29415e160 2023-11-24T08:04:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.136+0000 7ff2990ec700 1 -- 172.21.15.153:0/842796316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff29415e160 msgr2=0x7ff2940b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.136+0000 7ff2990ec700 1 --2- 172.21.15.153:0/842796316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff29415e160 0x7ff2940b5da0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009840 tx=0x7ff27c009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.136+0000 7ff2990ec700 1 -- 172.21.15.153:0/842796316 shutdown_connections 2023-11-24T08:04:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.136+0000 7ff2990ec700 1 --2- 172.21.15.153:0/842796316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2940746a0 0x7ff29406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.136+0000 7ff2990ec700 1 --2- 172.21.15.153:0/842796316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff29415e160 0x7ff2940b5da0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.136+0000 7ff2990ec700 1 -- 172.21.15.153:0/842796316 >> 172.21.15.153:0/842796316 conn(0x7ff2940d0bf0 msgr2=0x7ff2940d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.136+0000 7ff2990ec700 1 -- 172.21.15.153:0/842796316 shutdown_connections 2023-11-24T08:04:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.136+0000 7ff2990ec700 1 -- 172.21.15.153:0/842796316 wait complete. 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.137+0000 7ff2990ec700 1 Processor -- start 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.137+0000 7ff2990ec700 1 -- start start 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff2990ec700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2940746a0 0x7ff2940c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff2990ec700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2940afc90 0x7ff2941f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff2990ec700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff29415e160 0x7ff2941619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff2990ec700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941f7ea0 con 0x7ff2940746a0 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff2990ec700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2940c60e0 con 0x7ff2940afc90 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff2990ec700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941f78e0 con 0x7ff29415e160 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff292d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2940746a0 0x7ff2940c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff292d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2940746a0 0x7ff2940c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36420/0 (socket says 172.21.15.153:36420) 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff292d9d700 1 -- 172.21.15.153:0/3498575295 learned_addr learned my addr 172.21.15.153:0/3498575295 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff29259c700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2940afc90 0x7ff2941f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff29359e700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff29415e160 0x7ff2941619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff292d9d700 1 -- 172.21.15.153:0/3498575295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff29415e160 msgr2=0x7ff2941619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff292d9d700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff29415e160 0x7ff2941619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff292d9d700 1 -- 172.21.15.153:0/3498575295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2940afc90 msgr2=0x7ff2941f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.138+0000 7ff292d9d700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2940afc90 0x7ff2941f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.139+0000 7ff292d9d700 1 -- 172.21.15.153:0/3498575295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c0094a0 con 0x7ff2940746a0 2023-11-24T08:04:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.139+0000 7ff292d9d700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2940746a0 0x7ff2940c6570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0090b0 tx=0x7ff27c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.139+0000 7ff28b7fe700 1 -- 172.21.15.153:0/3498575295 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c004550 con 0x7ff2940746a0 2023-11-24T08:04:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.139+0000 7ff28b7fe700 1 -- 172.21.15.153:0/3498575295 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c01e070 con 0x7ff2940746a0 2023-11-24T08:04:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.139+0000 7ff2990ec700 1 -- 172.21.15.153:0/3498575295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2941f7bc0 con 0x7ff2940746a0 2023-11-24T08:04:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.139+0000 7ff28b7fe700 1 -- 172.21.15.153:0/3498575295 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0038e0 con 0x7ff2940746a0 2023-11-24T08:04:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.139+0000 7ff2990ec700 1 -- 172.21.15.153:0/3498575295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2940c6ab0 con 0x7ff2940746a0 2023-11-24T08:04:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.140+0000 7ff2990ec700 1 -- 172.21.15.153:0/3498575295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2940c5bd0 con 0x7ff2940746a0 2023-11-24T08:04:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.140+0000 7ff28b7fe700 1 -- 172.21.15.153:0/3498575295 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff27c003a40 con 0x7ff2940746a0 2023-11-24T08:04:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.141+0000 7ff28b7fe700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff27406aed0 0x7ff27406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.141+0000 7ff28b7fe700 1 -- 172.21.15.153:0/3498575295 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff27c08a3b0 con 0x7ff2940746a0 2023-11-24T08:04:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.141+0000 7ff29259c700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff27406aed0 0x7ff27406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.141+0000 7ff29259c700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff27406aed0 0x7ff27406d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff29415b650 tx=0x7ff284009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.146+0000 7ff28b7fe700 1 -- 172.21.15.153:0/3498575295 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2940c5bd0 con 0x7ff2940746a0 2023-11-24T08:04:42.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.338+0000 7ff2990ec700 1 -- 172.21.15.153:0/3498575295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2940c5bd0 con 0x7ff2940746a0 2023-11-24T08:04:42.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.338+0000 7ff28b7fe700 1 -- 172.21.15.153:0/3498575295 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff2940c5bd0 con 0x7ff2940746a0 2023-11-24T08:04:42.340 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:42.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 -- 172.21.15.153:0/3498575295 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff27406aed0 msgr2=0x7ff27406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff27406aed0 0x7ff27406d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff29415b650 tx=0x7ff284009040 comp rx=0 tx=0).stop 2023-11-24T08:04:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 -- 172.21.15.153:0/3498575295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2940746a0 msgr2=0x7ff2940c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2940746a0 0x7ff2940c6570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0090b0 tx=0x7ff27c004750 comp rx=0 tx=0).stop 2023-11-24T08:04:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 -- 172.21.15.153:0/3498575295 shutdown_connections 2023-11-24T08:04:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff29415e160 0x7ff2941619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff27406aed0 0x7ff27406d390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2940746a0 0x7ff2940c6570 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 --2- 172.21.15.153:0/3498575295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2940afc90 0x7ff2941f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 -- 172.21.15.153:0/3498575295 >> 172.21.15.153:0/3498575295 conn(0x7ff2940d0bf0 msgr2=0x7ff2940aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 -- 172.21.15.153:0/3498575295 shutdown_connections 2023-11-24T08:04:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.340+0000 7ff2990ec700 1 -- 172.21.15.153:0/3498575295 wait complete. 2023-11-24T08:04:42.354 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:42.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.476+0000 7f0b27870700 1 Processor -- start 2023-11-24T08:04:42.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.476+0000 7f0b27870700 1 -- start start 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b27870700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b201587f0 0x7f0b2006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b27870700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0b2015b370 0x7f0b2015b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b27870700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2006b530 con 0x7f0b200b3c60 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b27870700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b200ae5e0 con 0x7f0b201587f0 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b27870700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2015be30 con 0x7f0b2015b370 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b2560c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b201587f0 0x7f0b2006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b25e0d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0b200b3c60 0x7f0b200af060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42534/0 (socket says 172.21.15.153:42534) 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b25e0d700 1 -- 172.21.15.153:0/1969006900 learned_addr learned my addr 172.21.15.153:0/1969006900 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b2560c700 1 -- 172.21.15.153:0/1969006900 >> v2:172.21.15.164:3300/0 conn(0x7f0b2015b370 msgr2=0x7f0b2015b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b24e0b700 1 --2- 172.21.15.153:0/1969006900 >> v2:172.21.15.164:3300/0 conn(0x7f0b2015b370 0x7f0b2015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b2560c700 1 --2- 172.21.15.153:0/1969006900 >> v2:172.21.15.164:3300/0 conn(0x7f0b2015b370 0x7f0b2015b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b17fff700 1 -- 172.21.15.153:0/1969006900 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022230392 0 0) 0x7f0b2006b530 con 0x7f0b200b3c60 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b2560c700 1 -- 172.21.15.153:0/1969006900 >> v1:172.21.15.153:6789/0 conn(0x7f0b200b3c60 legacy=0x7f0b200af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.477+0000 7f0b2560c700 1 -- 172.21.15.153:0/1969006900 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2015c110 con 0x7f0b201587f0 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b24e0b700 1 --2- 172.21.15.153:0/1969006900 >> v2:172.21.15.164:3300/0 conn(0x7f0b2015b370 0x7f0b2015b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b2560c700 1 --2- 172.21.15.153:0/1969006900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b201587f0 0x7f0b2006aff0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009840 tx=0x7f0b10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfcc6b744c4279d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b17fff700 1 -- 172.21.15.153:0/1969006900 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10011830 con 0x7f0b201587f0 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b17fff700 1 -- 172.21.15.153:0/1969006900 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b10011990 con 0x7f0b201587f0 2023-11-24T08:04:42.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b17fff700 1 -- 172.21.15.153:0/1969006900 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10011d20 con 0x7f0b201587f0 2023-11-24T08:04:42.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b27870700 1 -- 172.21.15.153:0/1969006900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b201587f0 msgr2=0x7f0b2006aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b27870700 1 --2- 172.21.15.153:0/1969006900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b201587f0 0x7f0b2006aff0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009840 tx=0x7f0b10009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:42.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b27870700 1 -- 172.21.15.153:0/1969006900 shutdown_connections 2023-11-24T08:04:42.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b27870700 1 --2- 172.21.15.153:0/1969006900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b201587f0 0x7f0b2006aff0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b27870700 1 --2- 172.21.15.153:0/1969006900 >> v2:172.21.15.164:3300/0 conn(0x7f0b2015b370 0x7f0b2015b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b27870700 1 -- 172.21.15.153:0/1969006900 >> 172.21.15.153:0/1969006900 conn(0x7f0b200d0bf0 msgr2=0x7f0b200d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b27870700 1 -- 172.21.15.153:0/1969006900 shutdown_connections 2023-11-24T08:04:42.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.478+0000 7f0b27870700 1 -- 172.21.15.153:0/1969006900 wait complete. 2023-11-24T08:04:42.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.480+0000 7f0b27870700 1 Processor -- start 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.480+0000 7f0b27870700 1 -- start start 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.480+0000 7f0b27870700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b200b3c60 0x7f0b201511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.480+0000 7f0b27870700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b201587f0 0x7f0b20154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.480+0000 7f0b27870700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b2015b370 0x7f0b2015db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.480+0000 7f0b27870700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b20151f30 con 0x7f0b201587f0 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.480+0000 7f0b27870700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b20154b50 con 0x7f0b2015b370 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.480+0000 7f0b27870700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b20154e30 con 0x7f0b200b3c60 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.480+0000 7f0b24e0b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b201587f0 0x7f0b20154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.480+0000 7f0b24e0b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b201587f0 0x7f0b20154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36434/0 (socket says 172.21.15.153:36434) 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.480+0000 7f0b24e0b700 1 -- 172.21.15.153:0/549486053 learned_addr learned my addr 172.21.15.153:0/549486053 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b2560c700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b200b3c60 0x7f0b201511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b25e0d700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b2015b370 0x7f0b2015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b24e0b700 1 -- 172.21.15.153:0/549486053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b200b3c60 msgr2=0x7f0b201511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b24e0b700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b200b3c60 0x7f0b201511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b24e0b700 1 -- 172.21.15.153:0/549486053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b2015b370 msgr2=0x7f0b2015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b24e0b700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b2015b370 0x7f0b2015db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b24e0b700 1 -- 172.21.15.153:0/549486053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b100094a0 con 0x7f0b201587f0 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b2560c700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b200b3c60 0x7f0b201511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b25e0d700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b2015b370 0x7f0b2015db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b24e0b700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b201587f0 0x7f0b20154250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00eb60 tx=0x7f0b1c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b15ffb700 1 -- 172.21.15.153:0/549486053 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c007af0 con 0x7f0b201587f0 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b15ffb700 1 -- 172.21.15.153:0/549486053 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c007c50 con 0x7f0b201587f0 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b27870700 1 -- 172.21.15.153:0/549486053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b20155110 con 0x7f0b201587f0 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b15ffb700 1 -- 172.21.15.153:0/549486053 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c010440 con 0x7f0b201587f0 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.481+0000 7f0b27870700 1 -- 172.21.15.153:0/549486053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b201516e0 con 0x7f0b201587f0 2023-11-24T08:04:42.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.482+0000 7f0b27870700 1 -- 172.21.15.153:0/549486053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b20068fb0 con 0x7f0b201587f0 2023-11-24T08:04:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.483+0000 7f0b15ffb700 1 -- 172.21.15.153:0/549486053 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b1c0105a0 con 0x7f0b201587f0 2023-11-24T08:04:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.483+0000 7f0b15ffb700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b0406aed0 0x7f0b0406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.483+0000 7f0b15ffb700 1 -- 172.21.15.153:0/549486053 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b1c014070 con 0x7f0b201587f0 2023-11-24T08:04:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.483+0000 7f0b2560c700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b0406aed0 0x7f0b0406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.484+0000 7f0b2560c700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b0406aed0 0x7f0b0406d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0b100090b0 tx=0x7f0b10008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.488+0000 7f0b15ffb700 1 -- 172.21.15.153:0/549486053 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b1c051e90 con 0x7f0b201587f0 2023-11-24T08:04:42.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.679+0000 7f0b27870700 1 -- 172.21.15.153:0/549486053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b2009eea0 con 0x7f0b201587f0 2023-11-24T08:04:42.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.680+0000 7f0b15ffb700 1 -- 172.21.15.153:0/549486053 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b1c056a00 con 0x7f0b201587f0 2023-11-24T08:04:42.682 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:42.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 -- 172.21.15.153:0/549486053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b0406aed0 msgr2=0x7f0b0406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b0406aed0 0x7f0b0406d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0b100090b0 tx=0x7f0b10008030 comp rx=0 tx=0).stop 2023-11-24T08:04:42.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 -- 172.21.15.153:0/549486053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b201587f0 msgr2=0x7f0b20154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b201587f0 0x7f0b20154250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00eb60 tx=0x7f0b1c00ef20 comp rx=0 tx=0).stop 2023-11-24T08:04:42.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 -- 172.21.15.153:0/549486053 shutdown_connections 2023-11-24T08:04:42.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b2015b370 0x7f0b2015db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b200b3c60 0x7f0b201511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b0406aed0 0x7f0b0406d390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 --2- 172.21.15.153:0/549486053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b201587f0 0x7f0b20154250 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 -- 172.21.15.153:0/549486053 >> 172.21.15.153:0/549486053 conn(0x7f0b200d0bf0 msgr2=0x7f0b2015c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 -- 172.21.15.153:0/549486053 shutdown_connections 2023-11-24T08:04:42.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.682+0000 7f0b27870700 1 -- 172.21.15.153:0/549486053 wait complete. 2023-11-24T08:04:42.696 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:04:42.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.815+0000 7f9b9d2dc700 1 Processor -- start 2023-11-24T08:04:42.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.815+0000 7f9b9d2dc700 1 -- start start 2023-11-24T08:04:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.816+0000 7f9b9d2dc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980d0870 0x7f9b980d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.816+0000 7f9b9d2dc700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b980d1210 con 0x7f9b980b6ef0 2023-11-24T08:04:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.816+0000 7f9b9d2dc700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b980d20b0 con 0x7f9b9815e1e0 2023-11-24T08:04:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.816+0000 7f9b9d2dc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980d3150 con 0x7f9b980d0870 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.816+0000 7f9b977fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9b980b6ef0 0x7f9b980b7380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42548/0 (socket says 172.21.15.153:42548) 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.816+0000 7f9b977fe700 1 -- 172.21.15.153:0/1615734963 learned_addr learned my addr 172.21.15.153:0/1615734963 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.816+0000 7f9b967fc700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980d0870 0x7f9b980d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.816+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876938752 0 0) 0x7f9b980d1210 con 0x7f9b980b6ef0 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.816+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b800035b0 con 0x7f9b980b6ef0 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2644155226 0 0) 0x7f9b800035b0 con 0x7f9b980b6ef0 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980d0870 msgr2=0x7f9b980d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980d0870 0x7f9b980d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 >> v1:172.21.15.164:6789/0 conn(0x7f9b9815e1e0 legacy=0x7f9b980d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b980d2390 con 0x7f9b980b6ef0 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f9b900019f0 con 0x7f9b980b6ef0 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 >> v1:172.21.15.153:6789/0 conn(0x7f9b980b6ef0 legacy=0x7f9b980b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980d0870 0x7f9b80003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80003f70 0x7f9b80004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b80004d90 0x7f9b80005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980d3150 con 0x7f9b80004d90 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8000ba70 con 0x7f9b80003f70 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8000bc30 con 0x7f9b980d0870 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b977fe700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b80004d90 0x7f9b80005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b96ffd700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980d0870 0x7f9b80003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b967fc700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80003f70 0x7f9b80004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b977fe700 1 -- 172.21.15.153:0/1615734963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980d0870 msgr2=0x7f9b80003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b977fe700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980d0870 0x7f9b80003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b977fe700 1 -- 172.21.15.153:0/1615734963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80003f70 msgr2=0x7f9b80004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b977fe700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80003f70 0x7f9b80004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b977fe700 1 -- 172.21.15.153:0/1615734963 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800035b0 con 0x7f9b80004d90 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b977fe700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b80004d90 0x7f9b80005210 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000a7d0 tx=0x7f9b80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f39797befc8fa1e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90012600 con 0x7f9b80004d90 2023-11-24T08:04:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b90012760 con 0x7f9b80004d90 2023-11-24T08:04:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.817+0000 7f9b95ffb700 1 -- 172.21.15.153:0/1615734963 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90012b10 con 0x7f9b80004d90 2023-11-24T08:04:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.818+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/1615734963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b80004d90 msgr2=0x7f9b80005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.818+0000 7f9b9d2dc700 1 --2- 172.21.15.153:0/1615734963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b80004d90 0x7f9b80005210 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000a7d0 tx=0x7f9b80005880 comp rx=0 tx=0).stop 2023-11-24T08:04:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.818+0000 7f9b977fe700 1 -- 172.21.15.153:0/1615734963 reap_dead start 2023-11-24T08:04:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.818+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/1615734963 shutdown_connections 2023-11-24T08:04:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.818+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/1615734963 >> 172.21.15.153:0/1615734963 conn(0x7f9b980b5b50 msgr2=0x7f9b980b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.818+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/1615734963 shutdown_connections 2023-11-24T08:04:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.818+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/1615734963 wait complete. 2023-11-24T08:04:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.819+0000 7f9b9d2dc700 1 Processor -- start 2023-11-24T08:04:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.819+0000 7f9b9d2dc700 1 -- start start 2023-11-24T08:04:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.820+0000 7f9b9d2dc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80004d90 0x7f9b980cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.820+0000 7f9b9d2dc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980ca8e0 0x7f9b98145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.820+0000 7f9b9d2dc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b980d0c50 0x7f9b980d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.820+0000 7f9b9d2dc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980d1610 con 0x7f9b980d0c50 2023-11-24T08:04:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.820+0000 7f9b9d2dc700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b98145e50 con 0x7f9b80004d90 2023-11-24T08:04:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.820+0000 7f9b9d2dc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b981551e0 con 0x7f9b980ca8e0 2023-11-24T08:04:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.820+0000 7f9b977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b980d0c50 0x7f9b980d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.820+0000 7f9b977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b980d0c50 0x7f9b980d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36454/0 (socket says 172.21.15.153:36454) 2023-11-24T08:04:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.820+0000 7f9b977fe700 1 -- 172.21.15.153:0/925909108 learned_addr learned my addr 172.21.15.153:0/925909108 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b967fc700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980ca8e0 0x7f9b98145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b977fe700 1 -- 172.21.15.153:0/925909108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980ca8e0 msgr2=0x7f9b98145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b96ffd700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80004d90 0x7f9b980cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b977fe700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980ca8e0 0x7f9b98145910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b977fe700 1 -- 172.21.15.153:0/925909108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80004d90 msgr2=0x7f9b980cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b977fe700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80004d90 0x7f9b980cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b977fe700 1 -- 172.21.15.153:0/925909108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b980cb080 con 0x7f9b980d0c50 2023-11-24T08:04:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b96ffd700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80004d90 0x7f9b980cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b977fe700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b980d0c50 0x7f9b980d10d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b90001c30 tx=0x7f9b90001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b7f7fe700 1 -- 172.21.15.153:0/925909108 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90027470 con 0x7f9b980d0c50 2023-11-24T08:04:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b7f7fe700 1 -- 172.21.15.153:0/925909108 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b900275f0 con 0x7f9b980d0c50 2023-11-24T08:04:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/925909108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b980cb360 con 0x7f9b980d0c50 2023-11-24T08:04:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b7f7fe700 1 -- 172.21.15.153:0/925909108 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900279a0 con 0x7f9b980d0c50 2023-11-24T08:04:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.821+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/925909108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b98155760 con 0x7f9b980d0c50 2023-11-24T08:04:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.822+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/925909108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b98155920 con 0x7f9b980d0c50 2023-11-24T08:04:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.822+0000 7f9b7f7fe700 1 -- 172.21.15.153:0/925909108 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b90024070 con 0x7f9b980d0c50 2023-11-24T08:04:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.823+0000 7f9b7f7fe700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9b8406aed0 0x7f9b8406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.823+0000 7f9b7f7fe700 1 -- 172.21.15.153:0/925909108 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b9008b9b0 con 0x7f9b980d0c50 2023-11-24T08:04:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.823+0000 7f9b96ffd700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9b8406aed0 0x7f9b8406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.823+0000 7f9b96ffd700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9b8406aed0 0x7f9b8406d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c007fd0 tx=0x7f9b8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:42.827+0000 7f9b7f7fe700 1 -- 172.21.15.153:0/925909108 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b90056c10 con 0x7f9b980d0c50 2023-11-24T08:04:43.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.096+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/925909108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f9b98155ab0 con 0x7f9b980d0c50 2023-11-24T08:04:43.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.228+0000 7f9b7f7fe700 1 -- 172.21.15.153:0/925909108 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v46) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9b9005a230 con 0x7f9b980d0c50 2023-11-24T08:04:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/925909108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9b8406aed0 msgr2=0x7f9b8406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9b8406aed0 0x7f9b8406d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c007fd0 tx=0x7f9b8c009040 comp rx=0 tx=0).stop 2023-11-24T08:04:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/925909108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b980d0c50 msgr2=0x7f9b980d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b980d0c50 0x7f9b980d10d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b90001c30 tx=0x7f9b90001d00 comp rx=0 tx=0).stop 2023-11-24T08:04:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/925909108 shutdown_connections 2023-11-24T08:04:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9b8406aed0 0x7f9b8406d390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b980d0c50 0x7f9b980d10d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80004d90 0x7f9b980cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 --2- 172.21.15.153:0/925909108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b980ca8e0 0x7f9b98145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/925909108 >> 172.21.15.153:0/925909108 conn(0x7f9b980b5b50 msgr2=0x7f9b980b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/925909108 shutdown_connections 2023-11-24T08:04:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.231+0000 7f9b9d2dc700 1 -- 172.21.15.153:0/925909108 wait complete. 2023-11-24T08:04:43.245 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:04:43.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.368+0000 7fa06608a700 1 Processor -- start 2023-11-24T08:04:43.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.368+0000 7fa06608a700 1 -- start start 2023-11-24T08:04:43.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.368+0000 7fa06608a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa060151660 0x7fa0600cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.368+0000 7fa06608a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600b2b00 con 0x7fa06006dec0 2023-11-24T08:04:43.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.368+0000 7fa06608a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06006e3a0 con 0x7fa06015e040 2023-11-24T08:04:43.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa06608a700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06006ee40 con 0x7fa060151660 2023-11-24T08:04:43.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05effd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa06006dec0 0x7fa060070b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42564/0 (socket says 172.21.15.153:42564) 2023-11-24T08:04:43.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05effd700 1 -- 172.21.15.153:0/340861094 learned_addr learned my addr 172.21.15.153:0/340861094 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:43.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05f7fe700 1 --2- 172.21.15.153:0/340861094 >> v2:172.21.15.164:3300/0 conn(0x7fa060151660 0x7fa0600cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381225316 0 0) 0x7fa0600b2b00 con 0x7fa06006dec0 2023-11-24T08:04:43.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa04c0034d0 con 0x7fa06006dec0 2023-11-24T08:04:43.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1939255539 0 0) 0x7fa04c0034d0 con 0x7fa06006dec0 2023-11-24T08:04:43.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 >> v2:172.21.15.164:3300/0 conn(0x7fa060151660 msgr2=0x7fa0600cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:43.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 --2- 172.21.15.153:0/340861094 >> v2:172.21.15.164:3300/0 conn(0x7fa060151660 0x7fa0600cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 >> v1:172.21.15.164:6789/0 conn(0x7fa06015e040 legacy=0x7fa0600b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600b2da0 con 0x7fa06006dec0 2023-11-24T08:04:43.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fa048001670 con 0x7fa06006dec0 2023-11-24T08:04:43.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 >> v1:172.21.15.153:6789/0 conn(0x7fa06006dec0 legacy=0x7fa060070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 --2- 172.21.15.153:0/340861094 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa04c003af0 0x7fa04c003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 --2- 172.21.15.153:0/340861094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa04c0088e0 0x7fa04c00acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 --2- 172.21.15.153:0/340861094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04c00b490 0x7fa04c00d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06006ee40 con 0x7fa04c00b490 2023-11-24T08:04:43.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c00e230 con 0x7fa04c0088e0 2023-11-24T08:04:43.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c00e3f0 con 0x7fa04c003af0 2023-11-24T08:04:43.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05ffff700 1 --2- 172.21.15.153:0/340861094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04c00b490 0x7fa04c00d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05effd700 1 --2- 172.21.15.153:0/340861094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa04c0088e0 0x7fa04c00acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.369+0000 7fa05f7fe700 1 --2- 172.21.15.153:0/340861094 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa04c003af0 0x7fa04c003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa05ffff700 1 -- 172.21.15.153:0/340861094 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa04c003af0 msgr2=0x7fa04c003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:43.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa05ffff700 1 --2- 172.21.15.153:0/340861094 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa04c003af0 0x7fa04c003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa05ffff700 1 -- 172.21.15.153:0/340861094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa04c0088e0 msgr2=0x7fa04c00acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:43.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa05ffff700 1 --2- 172.21.15.153:0/340861094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa04c0088e0 0x7fa04c00acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa05ffff700 1 -- 172.21.15.153:0/340861094 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c0034d0 con 0x7fa04c00b490 2023-11-24T08:04:43.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa05ffff700 1 -- 172.21.15.153:0/340861094 reap_dead start 2023-11-24T08:04:43.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa05ffff700 1 --2- 172.21.15.153:0/340861094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04c00b490 0x7fa04c00d950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa05800c260 tx=0x7fa04c003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d5520af6a6055d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058016070 con 0x7fa04c00b490 2023-11-24T08:04:43.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05800cc00 con 0x7fa04c00b490 2023-11-24T08:04:43.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa05e7fc700 1 -- 172.21.15.153:0/340861094 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058001e70 con 0x7fa04c00b490 2023-11-24T08:04:43.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa06608a700 1 -- 172.21.15.153:0/340861094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04c00b490 msgr2=0x7fa04c00d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa06608a700 1 --2- 172.21.15.153:0/340861094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04c00b490 0x7fa04c00d950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa05800c260 tx=0x7fa04c003780 comp rx=0 tx=0).stop 2023-11-24T08:04:43.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa06608a700 1 -- 172.21.15.153:0/340861094 shutdown_connections 2023-11-24T08:04:43.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa06608a700 1 --2- 172.21.15.153:0/340861094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04c00b490 0x7fa04c00d950 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.370+0000 7fa06608a700 1 -- 172.21.15.153:0/340861094 >> 172.21.15.153:0/340861094 conn(0x7fa06006b410 msgr2=0x7fa06006b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:43.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.371+0000 7fa06608a700 1 -- 172.21.15.153:0/340861094 shutdown_connections 2023-11-24T08:04:43.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.371+0000 7fa06608a700 1 -- 172.21.15.153:0/340861094 wait complete. 2023-11-24T08:04:43.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.372+0000 7fa06608a700 1 Processor -- start 2023-11-24T08:04:43.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.372+0000 7fa06608a700 1 -- start start 2023-11-24T08:04:43.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.373+0000 7fa06608a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa04c00b490 0x7fa0600ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.373+0000 7fa06608a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0601483c0 0x7fa0601e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.373+0000 7fa06608a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0601e4710 0x7fa0601e4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.373+0000 7fa06608a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600cd2a0 con 0x7fa0601e4710 2023-11-24T08:04:43.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.373+0000 7fa06608a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06014e440 con 0x7fa0601483c0 2023-11-24T08:04:43.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.373+0000 7fa06608a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600ce740 con 0x7fa04c00b490 2023-11-24T08:04:43.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.373+0000 7fa05ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0601e4710 0x7fa0601e4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.373+0000 7fa05ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0601e4710 0x7fa0601e4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36474/0 (socket says 172.21.15.153:36474) 2023-11-24T08:04:43.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.373+0000 7fa05ffff700 1 -- 172.21.15.153:0/3631513508 learned_addr learned my addr 172.21.15.153:0/3631513508 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:43.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa05effd700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0601483c0 0x7fa0601e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa05ffff700 1 -- 172.21.15.153:0/3631513508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa04c00b490 msgr2=0x7fa0600ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa05f7fe700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa04c00b490 0x7fa0600ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa05ffff700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa04c00b490 0x7fa0600ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa05ffff700 1 -- 172.21.15.153:0/3631513508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0601483c0 msgr2=0x7fa0601e41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa05ffff700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0601483c0 0x7fa0601e41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa05ffff700 1 -- 172.21.15.153:0/3631513508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06014db10 con 0x7fa0601e4710 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa05effd700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0601483c0 0x7fa0601e41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa05f7fe700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa04c00b490 0x7fa0600ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa05ffff700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0601e4710 0x7fa0601e4b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa05800c850 tx=0x7fa0580015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa057fff700 1 -- 172.21.15.153:0/3631513508 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058016040 con 0x7fa0601e4710 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa057fff700 1 -- 172.21.15.153:0/3631513508 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa058005070 con 0x7fa0601e4710 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa06608a700 1 -- 172.21.15.153:0/3631513508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06014ddf0 con 0x7fa0601e4710 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa057fff700 1 -- 172.21.15.153:0/3631513508 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058005420 con 0x7fa0601e4710 2023-11-24T08:04:43.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.374+0000 7fa06608a700 1 -- 172.21.15.153:0/3631513508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa060148840 con 0x7fa0601e4710 2023-11-24T08:04:43.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.375+0000 7fa06608a700 1 -- 172.21.15.153:0/3631513508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa060068480 con 0x7fa0601e4710 2023-11-24T08:04:43.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.375+0000 7fa057fff700 1 -- 172.21.15.153:0/3631513508 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa058005580 con 0x7fa0601e4710 2023-11-24T08:04:43.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.376+0000 7fa057fff700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa04006af00 0x7fa04006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.376+0000 7fa057fff700 1 -- 172.21.15.153:0/3631513508 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa05808a430 con 0x7fa0601e4710 2023-11-24T08:04:43.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.376+0000 7fa05f7fe700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa04006af00 0x7fa04006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.376+0000 7fa05f7fe700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa04006af00 0x7fa04006d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa050009ae0 tx=0x7fa050008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.380+0000 7fa057fff700 1 -- 172.21.15.153:0/3631513508 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa058055570 con 0x7fa0601e4710 2023-11-24T08:04:43.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.571+0000 7fa06608a700 1 -- 172.21.15.153:0/3631513508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa06014e5f0 con 0x7fa0601e4710 2023-11-24T08:04:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.574+0000 7fa057fff700 1 -- 172.21.15.153:0/3631513508 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa06014e5f0 con 0x7fa0601e4710 2023-11-24T08:04:43.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 -- 172.21.15.153:0/3631513508 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa04006af00 msgr2=0x7fa04006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa04006af00 0x7fa04006d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa050009ae0 tx=0x7fa050008040 comp rx=0 tx=0).stop 2023-11-24T08:04:43.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 -- 172.21.15.153:0/3631513508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0601e4710 msgr2=0x7fa0601e4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0601e4710 0x7fa0601e4b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa05800c850 tx=0x7fa0580015b0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 -- 172.21.15.153:0/3631513508 shutdown_connections 2023-11-24T08:04:43.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa04006af00 0x7fa04006d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0601e4710 0x7fa0601e4b90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa04c00b490 0x7fa0600ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 --2- 172.21.15.153:0/3631513508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0601483c0 0x7fa0601e41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 -- 172.21.15.153:0/3631513508 >> 172.21.15.153:0/3631513508 conn(0x7fa06006b410 msgr2=0x7fa0600cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:43.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 -- 172.21.15.153:0/3631513508 shutdown_connections 2023-11-24T08:04:43.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.576+0000 7fa06608a700 1 -- 172.21.15.153:0/3631513508 wait complete. 2023-11-24T08:04:43.590 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:04:43.590 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:04:43.627 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:04:43.673 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:04:43.673 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:04:43.673 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:43.691 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:04:43.691 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:43.749 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:04:43.749 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:43.809 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:43.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.967+0000 7fe2aca14700 1 Processor -- start 2023-11-24T08:04:43.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.967+0000 7fe2aca14700 1 -- start start 2023-11-24T08:04:43.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.968+0000 7fe2aca14700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2a81446a0 0x7fe2a80b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.968+0000 7fe2aca14700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe2a806c710 0x7fe2a80b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.968+0000 7fe2aca14700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a80af950 con 0x7fe2a80adf00 2023-11-24T08:04:43.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.968+0000 7fe2aca14700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a8144a80 con 0x7fe2a806c710 2023-11-24T08:04:43.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.968+0000 7fe2aca14700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a80afc30 con 0x7fe2a81446a0 2023-11-24T08:04:43.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.968+0000 7fe2a659c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2a81446a0 0x7fe2a80b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.968+0000 7fe2a6d9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe2a806c710 0x7fe2a80b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.968+0000 7fe2a5d9b700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fe2a80adf00 0x7fe2a806c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:50264/0 (socket says 172.21.15.153:50264) 2023-11-24T08:04:43.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.969+0000 7fe2a5d9b700 1 -- 172.21.15.153:0/2108093732 learned_addr learned my addr 172.21.15.153:0/2108093732 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:43.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.969+0000 7fe2a6d9d700 1 -- 172.21.15.153:0/2108093732 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2a81446a0 msgr2=0x7fe2a80b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:43.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.969+0000 7fe2a6d9d700 1 --2- 172.21.15.153:0/2108093732 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2a81446a0 0x7fe2a80b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.969+0000 7fe2a6d9d700 1 -- 172.21.15.153:0/2108093732 >> v1:172.21.15.164:6789/0 conn(0x7fe2a80adf00 legacy=0x7fe2a806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.969+0000 7fe2a6d9d700 1 -- 172.21.15.153:0/2108093732 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a80aff10 con 0x7fe2a806c710 2023-11-24T08:04:43.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.969+0000 7fe2a659c700 1 --2- 172.21.15.153:0/2108093732 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2a81446a0 0x7fe2a80b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:43.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.969+0000 7fe2a6d9d700 1 --2- 172.21.15.153:0/2108093732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2a806c710 0x7fe2a80b3d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009d90 tx=0x7fe2a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=983f77ea7cb810ff server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.969+0000 7fe2a559a700 1 -- 172.21.15.153:0/2108093732 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a000e070 con 0x7fe2a806c710 2023-11-24T08:04:43.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.969+0000 7fe2a559a700 1 -- 172.21.15.153:0/2108093732 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a000bb20 con 0x7fe2a806c710 2023-11-24T08:04:43.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.969+0000 7fe2a559a700 1 -- 172.21.15.153:0/2108093732 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0012430 con 0x7fe2a806c710 2023-11-24T08:04:43.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.970+0000 7fe2aca14700 1 -- 172.21.15.153:0/2108093732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2a806c710 msgr2=0x7fe2a80b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.970+0000 7fe2aca14700 1 --2- 172.21.15.153:0/2108093732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2a806c710 0x7fe2a80b3d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009d90 tx=0x7fe2a000b330 comp rx=0 tx=0).stop 2023-11-24T08:04:43.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.970+0000 7fe2aca14700 1 -- 172.21.15.153:0/2108093732 shutdown_connections 2023-11-24T08:04:43.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.970+0000 7fe2aca14700 1 --2- 172.21.15.153:0/2108093732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2a806c710 0x7fe2a80b3d40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.970+0000 7fe2aca14700 1 --2- 172.21.15.153:0/2108093732 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2a81446a0 0x7fe2a80b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.970+0000 7fe2aca14700 1 -- 172.21.15.153:0/2108093732 >> 172.21.15.153:0/2108093732 conn(0x7fe2a8071b90 msgr2=0x7fe2a8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:43.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.970+0000 7fe2aca14700 1 -- 172.21.15.153:0/2108093732 shutdown_connections 2023-11-24T08:04:43.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.970+0000 7fe2aca14700 1 -- 172.21.15.153:0/2108093732 wait complete. 2023-11-24T08:04:43.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.972+0000 7fe2aca14700 1 Processor -- start 2023-11-24T08:04:43.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.972+0000 7fe2aca14700 1 -- start start 2023-11-24T08:04:43.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2aca14700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2a806c710 0x7fe2a8154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2aca14700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2a80adf00 0x7fe2a813a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2aca14700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a81446a0 0x7fe2a80b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2aca14700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a813dfd0 con 0x7fe2a81446a0 2023-11-24T08:04:43.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2aca14700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a8135720 con 0x7fe2a806c710 2023-11-24T08:04:43.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2aca14700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a813d450 con 0x7fe2a80adf00 2023-11-24T08:04:43.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2a6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a81446a0 0x7fe2a80b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2a5d9b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2a80adf00 0x7fe2a813a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2a659c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2a806c710 0x7fe2a8154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2a6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a81446a0 0x7fe2a80b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36488/0 (socket says 172.21.15.153:36488) 2023-11-24T08:04:43.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2a6d9d700 1 -- 172.21.15.153:0/587404390 learned_addr learned my addr 172.21.15.153:0/587404390 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:43.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2a6d9d700 1 -- 172.21.15.153:0/587404390 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2a80adf00 msgr2=0x7fe2a813a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2a6d9d700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2a80adf00 0x7fe2a813a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2a6d9d700 1 -- 172.21.15.153:0/587404390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2a806c710 msgr2=0x7fe2a8154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2a6d9d700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2a806c710 0x7fe2a8154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2a6d9d700 1 -- 172.21.15.153:0/587404390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0094a0 con 0x7fe2a81446a0 2023-11-24T08:04:43.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2a6d9d700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a81446a0 0x7fe2a80b1990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0014040 tx=0x7fe2a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe296ffd700 1 -- 172.21.15.153:0/587404390 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0012430 con 0x7fe2a81446a0 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe296ffd700 1 -- 172.21.15.153:0/587404390 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a0020070 con 0x7fe2a81446a0 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2aca14700 1 -- 172.21.15.153:0/587404390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a0009a70 con 0x7fe2a81446a0 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe296ffd700 1 -- 172.21.15.153:0/587404390 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0003ea0 con 0x7fe2a81446a0 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.973+0000 7fe2aca14700 1 -- 172.21.15.153:0/587404390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a813da10 con 0x7fe2a81446a0 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.974+0000 7fe2aca14700 1 -- 172.21.15.153:0/587404390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a80753f0 con 0x7fe2a81446a0 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.975+0000 7fe296ffd700 1 -- 172.21.15.153:0/587404390 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2a0004040 con 0x7fe2a81446a0 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.975+0000 7fe296ffd700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe28806aed0 0x7fe28806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.975+0000 7fe296ffd700 1 -- 172.21.15.153:0/587404390 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2a0022070 con 0x7fe2a81446a0 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.975+0000 7fe2a659c700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe28806aed0 0x7fe28806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.976+0000 7fe2a659c700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe28806aed0 0x7fe28806d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009cd0 tx=0x7fe29c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:43.980+0000 7fe296ffd700 1 -- 172.21.15.153:0/587404390 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2a00566d0 con 0x7fe2a81446a0 2023-11-24T08:04:44.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.177+0000 7fe2aca14700 1 -- 172.21.15.153:0/587404390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2a8067f60 con 0x7fe2a81446a0 2023-11-24T08:04:44.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.178+0000 7fe296ffd700 1 -- 172.21.15.153:0/587404390 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fe2a0059cf0 con 0x7fe2a81446a0 2023-11-24T08:04:44.180 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:44.180 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:44.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 -- 172.21.15.153:0/587404390 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe28806aed0 msgr2=0x7fe28806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe28806aed0 0x7fe28806d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009cd0 tx=0x7fe29c009210 comp rx=0 tx=0).stop 2023-11-24T08:04:44.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 -- 172.21.15.153:0/587404390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a81446a0 msgr2=0x7fe2a80b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a81446a0 0x7fe2a80b1990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0014040 tx=0x7fe2a0004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 -- 172.21.15.153:0/587404390 shutdown_connections 2023-11-24T08:04:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe28806aed0 0x7fe28806d390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a81446a0 0x7fe2a80b1990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2a806c710 0x7fe2a8154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 --2- 172.21.15.153:0/587404390 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2a80adf00 0x7fe2a813a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 -- 172.21.15.153:0/587404390 >> 172.21.15.153:0/587404390 conn(0x7fe2a8071b90 msgr2=0x7fe2a806b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 -- 172.21.15.153:0/587404390 shutdown_connections 2023-11-24T08:04:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.180+0000 7fe2aca14700 1 -- 172.21.15.153:0/587404390 wait complete. 2023-11-24T08:04:44.195 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:44.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:44.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.318+0000 7f531c810700 1 Processor -- start 2023-11-24T08:04:44.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.318+0000 7f531c810700 1 -- start start 2023-11-24T08:04:44.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.318+0000 7f531c810700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f53180746a0 0x7f53180b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.318+0000 7f531c810700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53180afc90 0x7f531806d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f531c810700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53180b3c60 con 0x7f531815e160 2023-11-24T08:04:44.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f531c810700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53180b4500 con 0x7f53180746a0 2023-11-24T08:04:44.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f531c810700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53180b58c0 con 0x7f53180afc90 2023-11-24T08:04:44.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f5315d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f53180746a0 0x7f53180b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f531659c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f531815e160 0x7f5318073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42596/0 (socket says 172.21.15.153:42596) 2023-11-24T08:04:44.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f531659c700 1 -- 172.21.15.153:0/4288870168 learned_addr learned my addr 172.21.15.153:0/4288870168 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f5316d9d700 1 --2- 172.21.15.153:0/4288870168 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53180afc90 0x7f531806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f5315d9b700 1 -- 172.21.15.153:0/4288870168 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53180afc90 msgr2=0x7f531806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f5315d9b700 1 --2- 172.21.15.153:0/4288870168 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53180afc90 0x7f531806d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f5315d9b700 1 -- 172.21.15.153:0/4288870168 >> v1:172.21.15.153:6789/0 conn(0x7f531815e160 legacy=0x7f5318073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f531559a700 1 -- 172.21.15.153:0/4288870168 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200525903 0 0) 0x7f53180b3c60 con 0x7f531815e160 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f5315d9b700 1 -- 172.21.15.153:0/4288870168 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53180b0120 con 0x7f53180746a0 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f5316d9d700 1 --2- 172.21.15.153:0/4288870168 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53180afc90 0x7f531806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f5315d9b700 1 --2- 172.21.15.153:0/4288870168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53180746a0 0x7f53180b5da0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5308009840 tx=0x7f5308009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d2b9ffd2192dea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f531559a700 1 -- 172.21.15.153:0/4288870168 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308011830 con 0x7f53180746a0 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f531559a700 1 -- 172.21.15.153:0/4288870168 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308011990 con 0x7f53180746a0 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.319+0000 7f531559a700 1 -- 172.21.15.153:0/4288870168 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308011d20 con 0x7f53180746a0 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.320+0000 7f531c810700 1 -- 172.21.15.153:0/4288870168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53180746a0 msgr2=0x7f53180b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.320+0000 7f531c810700 1 --2- 172.21.15.153:0/4288870168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53180746a0 0x7f53180b5da0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5308009840 tx=0x7f5308009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:44.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.320+0000 7f531c810700 1 -- 172.21.15.153:0/4288870168 shutdown_connections 2023-11-24T08:04:44.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.320+0000 7f531c810700 1 --2- 172.21.15.153:0/4288870168 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53180afc90 0x7f531806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.320+0000 7f531c810700 1 --2- 172.21.15.153:0/4288870168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53180746a0 0x7f53180b5da0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.320+0000 7f531c810700 1 -- 172.21.15.153:0/4288870168 >> 172.21.15.153:0/4288870168 conn(0x7f53180d0bf0 msgr2=0x7f53180d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:44.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.320+0000 7f531c810700 1 -- 172.21.15.153:0/4288870168 shutdown_connections 2023-11-24T08:04:44.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.320+0000 7f531c810700 1 -- 172.21.15.153:0/4288870168 wait complete. 2023-11-24T08:04:44.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.321+0000 7f531c810700 1 Processor -- start 2023-11-24T08:04:44.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.321+0000 7f531c810700 1 -- start start 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f531c810700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53180746a0 0x7f5318142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f531c810700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53180afc90 0x7f5318158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f531c810700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f531815e160 0x7f53180ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f531c810700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5318159360 con 0x7f53180746a0 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f531c810700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531815ec60 con 0x7f53180afc90 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f531c810700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5318142b60 con 0x7f531815e160 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f531659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53180746a0 0x7f5318142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f531659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53180746a0 0x7f5318142620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36498/0 (socket says 172.21.15.153:36498) 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f531659c700 1 -- 172.21.15.153:0/117297999 learned_addr learned my addr 172.21.15.153:0/117297999 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f5316d9d700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f531815e160 0x7f53180ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f5315d9b700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53180afc90 0x7f5318158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f531659c700 1 -- 172.21.15.153:0/117297999 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f531815e160 msgr2=0x7f53180ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.322+0000 7f531659c700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f531815e160 0x7f53180ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.323+0000 7f531659c700 1 -- 172.21.15.153:0/117297999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53180afc90 msgr2=0x7f5318158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.323+0000 7f531659c700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53180afc90 0x7f5318158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.323+0000 7f531659c700 1 -- 172.21.15.153:0/117297999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080094a0 con 0x7f53180746a0 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.323+0000 7f531659c700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53180746a0 0x7f5318142620 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f530c00c580 tx=0x7f530c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.323+0000 7f5306ffd700 1 -- 172.21.15.153:0/117297999 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c004c80 con 0x7f53180746a0 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.323+0000 7f5306ffd700 1 -- 172.21.15.153:0/117297999 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c004e00 con 0x7f53180746a0 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.323+0000 7f531c810700 1 -- 172.21.15.153:0/117297999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5318158da0 con 0x7f53180746a0 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.323+0000 7f5306ffd700 1 -- 172.21.15.153:0/117297999 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c007310 con 0x7f53180746a0 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.323+0000 7f531c810700 1 -- 172.21.15.153:0/117297999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531815e8f0 con 0x7f53180746a0 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.324+0000 7f531c810700 1 -- 172.21.15.153:0/117297999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531815e750 con 0x7f53180746a0 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.324+0000 7f5306ffd700 1 -- 172.21.15.153:0/117297999 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f530c007470 con 0x7f53180746a0 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.325+0000 7f5306ffd700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f52f806aed0 0x7f52f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.325+0000 7f5306ffd700 1 -- 172.21.15.153:0/117297999 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f530c0890e0 con 0x7f53180746a0 2023-11-24T08:04:44.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.325+0000 7f5315d9b700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f52f806aed0 0x7f52f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.325+0000 7f5315d9b700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f52f806aed0 0x7f52f806d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f53080090b0 tx=0x7f5308008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:44.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.329+0000 7f5306ffd700 1 -- 172.21.15.153:0/117297999 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f531815e750 con 0x7f53180746a0 2023-11-24T08:04:44.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.519+0000 7f531c810700 1 -- 172.21.15.153:0/117297999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f531815e750 con 0x7f53180746a0 2023-11-24T08:04:44.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.519+0000 7f5306ffd700 1 -- 172.21.15.153:0/117297999 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f531815e750 con 0x7f53180746a0 2023-11-24T08:04:44.521 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 -- 172.21.15.153:0/117297999 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f52f806aed0 msgr2=0x7f52f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f52f806aed0 0x7f52f806d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f53080090b0 tx=0x7f5308008030 comp rx=0 tx=0).stop 2023-11-24T08:04:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 -- 172.21.15.153:0/117297999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53180746a0 msgr2=0x7f5318142620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53180746a0 0x7f5318142620 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f530c00c580 tx=0x7f530c00c890 comp rx=0 tx=0).stop 2023-11-24T08:04:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 -- 172.21.15.153:0/117297999 shutdown_connections 2023-11-24T08:04:44.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f531815e160 0x7f53180ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f52f806aed0 0x7f52f806d390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53180746a0 0x7f5318142620 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 --2- 172.21.15.153:0/117297999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53180afc90 0x7f5318158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 -- 172.21.15.153:0/117297999 >> 172.21.15.153:0/117297999 conn(0x7f53180d0bf0 msgr2=0x7f531806ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:44.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 -- 172.21.15.153:0/117297999 shutdown_connections 2023-11-24T08:04:44.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.521+0000 7f531c810700 1 -- 172.21.15.153:0/117297999 wait complete. 2023-11-24T08:04:44.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:44.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.658+0000 7fa5eebd0700 1 Processor -- start 2023-11-24T08:04:44.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.658+0000 7fa5eebd0700 1 -- start start 2023-11-24T08:04:44.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.658+0000 7fa5eebd0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5e815e160 0x7fa5e80b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.658+0000 7fa5eebd0700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa5e80afc90 0x7fa5e8073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5eebd0700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e80b3c60 con 0x7fa5e80744d0 2023-11-24T08:04:44.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5eebd0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e80b4500 con 0x7fa5e815e160 2023-11-24T08:04:44.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5eebd0700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e8074940 con 0x7fa5e80afc90 2023-11-24T08:04:44.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5ec96c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5e815e160 0x7fa5e80b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5ec96c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5e815e160 0x7fa5e80b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36506/0 (socket says 172.21.15.153:36506) 2023-11-24T08:04:44.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5ec96c700 1 -- 172.21.15.153:0/3171695907 learned_addr learned my addr 172.21.15.153:0/3171695907 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:44.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5e7fff700 1 --2- 172.21.15.153:0/3171695907 >> v2:172.21.15.164:3300/0 conn(0x7fa5e80afc90 0x7fa5e8073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5ec96c700 1 -- 172.21.15.153:0/3171695907 >> v2:172.21.15.164:3300/0 conn(0x7fa5e80afc90 msgr2=0x7fa5e8073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:44.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5ec96c700 1 --2- 172.21.15.153:0/3171695907 >> v2:172.21.15.164:3300/0 conn(0x7fa5e80afc90 0x7fa5e8073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5ec96c700 1 -- 172.21.15.153:0/3171695907 >> v1:172.21.15.164:6789/0 conn(0x7fa5e80744d0 legacy=0x7fa5e806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5ec96c700 1 -- 172.21.15.153:0/3171695907 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e80b58c0 con 0x7fa5e815e160 2023-11-24T08:04:44.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5ec96c700 1 --2- 172.21.15.153:0/3171695907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e815e160 0x7fa5e80b5da0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80d0880 tx=0x7fa5dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa6c0d77ae266e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:44.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5e77fe700 1 -- 172.21.15.153:0/3171695907 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00b860 con 0x7fa5e815e160 2023-11-24T08:04:44.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5e77fe700 1 -- 172.21.15.153:0/3171695907 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc00b9c0 con 0x7fa5e815e160 2023-11-24T08:04:44.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.659+0000 7fa5e77fe700 1 -- 172.21.15.153:0/3171695907 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00bd50 con 0x7fa5e815e160 2023-11-24T08:04:44.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.660+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3171695907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e815e160 msgr2=0x7fa5e80b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.660+0000 7fa5eebd0700 1 --2- 172.21.15.153:0/3171695907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e815e160 0x7fa5e80b5da0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80d0880 tx=0x7fa5dc009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:44.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.660+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3171695907 shutdown_connections 2023-11-24T08:04:44.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.660+0000 7fa5eebd0700 1 --2- 172.21.15.153:0/3171695907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e815e160 0x7fa5e80b5da0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.660+0000 7fa5eebd0700 1 --2- 172.21.15.153:0/3171695907 >> v2:172.21.15.164:3300/0 conn(0x7fa5e80afc90 0x7fa5e8073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.660+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3171695907 >> 172.21.15.153:0/3171695907 conn(0x7fa5e80d0bf0 msgr2=0x7fa5e80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:44.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.660+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3171695907 shutdown_connections 2023-11-24T08:04:44.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.660+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3171695907 wait complete. 2023-11-24T08:04:44.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.661+0000 7fa5eebd0700 1 Processor -- start 2023-11-24T08:04:44.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.661+0000 7fa5eebd0700 1 -- start start 2023-11-24T08:04:44.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5eebd0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e80744d0 0x7fa5e8147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5eebd0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e80afc90 0x7fa5e8161f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5eebd0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e815e160 0x7fa5e81624d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5eebd0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e8147e60 con 0x7fa5e80744d0 2023-11-24T08:04:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5eebd0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80c5fa0 con 0x7fa5e815e160 2023-11-24T08:04:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5eebd0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80c5c70 con 0x7fa5e80afc90 2023-11-24T08:04:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5ec96c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e80744d0 0x7fa5e8147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5ec96c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e80744d0 0x7fa5e8147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36512/0 (socket says 172.21.15.153:36512) 2023-11-24T08:04:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5ec96c700 1 -- 172.21.15.153:0/3106522306 learned_addr learned my addr 172.21.15.153:0/3106522306 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5ed16d700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e815e160 0x7fa5e81624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5e7fff700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e80afc90 0x7fa5e8161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.662+0000 7fa5ec96c700 1 -- 172.21.15.153:0/3106522306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e80afc90 msgr2=0x7fa5e8161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.663+0000 7fa5ec96c700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e80afc90 0x7fa5e8161f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.663+0000 7fa5ec96c700 1 -- 172.21.15.153:0/3106522306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e815e160 msgr2=0x7fa5e81624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.663+0000 7fa5ec96c700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e815e160 0x7fa5e81624d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.663+0000 7fa5ec96c700 1 -- 172.21.15.153:0/3106522306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc009550 con 0x7fa5e80744d0 2023-11-24T08:04:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.663+0000 7fa5ec96c700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e80744d0 0x7fa5e8147920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009c40 tx=0x7fa5dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.663+0000 7fa5e57fa700 1 -- 172.21.15.153:0/3106522306 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc004300 con 0x7fa5e80744d0 2023-11-24T08:04:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.663+0000 7fa5e57fa700 1 -- 172.21.15.153:0/3106522306 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc01f070 con 0x7fa5e80744d0 2023-11-24T08:04:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.663+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3106522306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e8160f80 con 0x7fa5e80744d0 2023-11-24T08:04:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.663+0000 7fa5e57fa700 1 -- 172.21.15.153:0/3106522306 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0036a0 con 0x7fa5e80744d0 2023-11-24T08:04:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.663+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3106522306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e8161540 con 0x7fa5e80744d0 2023-11-24T08:04:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.664+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3106522306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e80c6280 con 0x7fa5e80744d0 2023-11-24T08:04:44.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.664+0000 7fa5e57fa700 1 -- 172.21.15.153:0/3106522306 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa5dc021030 con 0x7fa5e80744d0 2023-11-24T08:04:44.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.665+0000 7fa5e57fa700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5cc06af00 0x7fa5cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.665+0000 7fa5e57fa700 1 -- 172.21.15.153:0/3106522306 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5dc08a820 con 0x7fa5e80744d0 2023-11-24T08:04:44.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.665+0000 7fa5e7fff700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5cc06af00 0x7fa5cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.665+0000 7fa5e7fff700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5cc06af00 0x7fa5cc06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80af030 tx=0x7fa5d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:44.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.669+0000 7fa5e57fa700 1 -- 172.21.15.153:0/3106522306 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5dc0558e0 con 0x7fa5e80744d0 2023-11-24T08:04:44.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.863+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3106522306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5e8068fb0 con 0x7fa5e80744d0 2023-11-24T08:04:44.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.864+0000 7fa5e57fa700 1 -- 172.21.15.153:0/3106522306 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5dc058f00 con 0x7fa5e80744d0 2023-11-24T08:04:44.865 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:44.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3106522306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5cc06af00 msgr2=0x7fa5cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5cc06af00 0x7fa5cc06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80af030 tx=0x7fa5d4008040 comp rx=0 tx=0).stop 2023-11-24T08:04:44.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3106522306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e80744d0 msgr2=0x7fa5e8147920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e80744d0 0x7fa5e8147920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009c40 tx=0x7fa5dc004750 comp rx=0 tx=0).stop 2023-11-24T08:04:44.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3106522306 shutdown_connections 2023-11-24T08:04:44.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e815e160 0x7fa5e81624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5cc06af00 0x7fa5cc06d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e80744d0 0x7fa5e8147920 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 --2- 172.21.15.153:0/3106522306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e80afc90 0x7fa5e8161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3106522306 >> 172.21.15.153:0/3106522306 conn(0x7fa5e80d0bf0 msgr2=0x7fa5e806e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:44.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3106522306 shutdown_connections 2023-11-24T08:04:44.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:44.866+0000 7fa5eebd0700 1 -- 172.21.15.153:0/3106522306 wait complete. 2023-11-24T08:04:44.879 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:45.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.001+0000 7f349f4dc700 1 Processor -- start 2023-11-24T08:04:45.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.001+0000 7f349f4dc700 1 -- start start 2023-11-24T08:04:45.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.002+0000 7f349f4dc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f349815a620 0x7f34980ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.002+0000 7f349f4dc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f349806ecf0 0x7f34980b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.002+0000 7f349f4dc700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34980b2f20 con 0x7f34980cc540 2023-11-24T08:04:45.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.002+0000 7f349f4dc700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34980ce690 con 0x7f349806ecf0 2023-11-24T08:04:45.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.002+0000 7f349f4dc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349815aa00 con 0x7f349815a620 2023-11-24T08:04:45.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.002+0000 7f349da79700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f349806ecf0 0x7f34980b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.002+0000 7f349ca77700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f34980cc540 0x7f349806e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:50306/0 (socket says 172.21.15.153:50306) 2023-11-24T08:04:45.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.002+0000 7f349ca77700 1 -- 172.21.15.153:0/2211799296 learned_addr learned my addr 172.21.15.153:0/2211799296 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:45.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.002+0000 7f349d278700 1 --2- 172.21.15.153:0/2211799296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f349815a620 0x7f34980ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.003+0000 7f349da79700 1 -- 172.21.15.153:0/2211799296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f349815a620 msgr2=0x7f34980ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.003+0000 7f349da79700 1 --2- 172.21.15.153:0/2211799296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f349815a620 0x7f34980ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.003+0000 7f349da79700 1 -- 172.21.15.153:0/2211799296 >> v1:172.21.15.164:6789/0 conn(0x7f34980cc540 legacy=0x7f349806e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.003+0000 7f349da79700 1 -- 172.21.15.153:0/2211799296 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34980ce960 con 0x7f349806ecf0 2023-11-24T08:04:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.003+0000 7f349da79700 1 --2- 172.21.15.153:0/2211799296 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f349806ecf0 0x7f34980b3350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3490009d90 tx=0x7f349000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed60fc4d3f2aed1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.003+0000 7f348ffff700 1 -- 172.21.15.153:0/2211799296 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000e070 con 0x7f349806ecf0 2023-11-24T08:04:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.003+0000 7f348ffff700 1 -- 172.21.15.153:0/2211799296 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349000bb20 con 0x7f349806ecf0 2023-11-24T08:04:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.003+0000 7f348ffff700 1 -- 172.21.15.153:0/2211799296 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490012430 con 0x7f349806ecf0 2023-11-24T08:04:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.003+0000 7f349f4dc700 1 -- 172.21.15.153:0/2211799296 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f349806ecf0 msgr2=0x7f34980b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.003+0000 7f349f4dc700 1 --2- 172.21.15.153:0/2211799296 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f349806ecf0 0x7f34980b3350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3490009d90 tx=0x7f349000b330 comp rx=0 tx=0).stop 2023-11-24T08:04:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.004+0000 7f349f4dc700 1 -- 172.21.15.153:0/2211799296 shutdown_connections 2023-11-24T08:04:45.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.004+0000 7f349f4dc700 1 --2- 172.21.15.153:0/2211799296 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f349806ecf0 0x7f34980b3350 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.004+0000 7f349f4dc700 1 --2- 172.21.15.153:0/2211799296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f349815a620 0x7f34980ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.004+0000 7f349f4dc700 1 -- 172.21.15.153:0/2211799296 >> 172.21.15.153:0/2211799296 conn(0x7f34980b2050 msgr2=0x7f34980b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:45.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.004+0000 7f349f4dc700 1 -- 172.21.15.153:0/2211799296 shutdown_connections 2023-11-24T08:04:45.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.004+0000 7f349f4dc700 1 -- 172.21.15.153:0/2211799296 wait complete. 2023-11-24T08:04:45.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.005+0000 7f349f4dc700 1 Processor -- start 2023-11-24T08:04:45.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.005+0000 7f349f4dc700 1 -- start start 2023-11-24T08:04:45.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.005+0000 7f349f4dc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f349806ecf0 0x7f349815cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.005+0000 7f349f4dc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980cc540 0x7f349813fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.005+0000 7f349f4dc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f349815a620 0x7f349814bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349f4dc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349814e0d0 con 0x7f349815a620 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349f4dc700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349815ac00 con 0x7f34980cc540 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349f4dc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34981468e0 con 0x7f349806ecf0 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349da79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f349815a620 0x7f349814bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349da79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f349815a620 0x7f349814bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36530/0 (socket says 172.21.15.153:36530) 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349da79700 1 -- 172.21.15.153:0/897673296 learned_addr learned my addr 172.21.15.153:0/897673296 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349d278700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f349806ecf0 0x7f349815cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349ca77700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980cc540 0x7f349813fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349da79700 1 -- 172.21.15.153:0/897673296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f349806ecf0 msgr2=0x7f349815cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349da79700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f349806ecf0 0x7f349815cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349da79700 1 -- 172.21.15.153:0/897673296 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980cc540 msgr2=0x7f349813fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349da79700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980cc540 0x7f349813fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349da79700 1 -- 172.21.15.153:0/897673296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009a70 con 0x7f349815a620 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349da79700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f349815a620 0x7f349814bf10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3490014040 tx=0x7f3490004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f348dffb700 1 -- 172.21.15.153:0/897673296 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490012430 con 0x7f349815a620 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f348dffb700 1 -- 172.21.15.153:0/897673296 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490020070 con 0x7f349815a620 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f349f4dc700 1 -- 172.21.15.153:0/897673296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349815d220 con 0x7f349815a620 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.006+0000 7f348dffb700 1 -- 172.21.15.153:0/897673296 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490003ea0 con 0x7f349815a620 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.007+0000 7f349f4dc700 1 -- 172.21.15.153:0/897673296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349815d7e0 con 0x7f349815a620 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.008+0000 7f349f4dc700 1 -- 172.21.15.153:0/897673296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3498068d90 con 0x7f349815a620 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.008+0000 7f348dffb700 1 -- 172.21.15.153:0/897673296 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3490004040 con 0x7f349815a620 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.008+0000 7f348dffb700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f347c06aed0 0x7f347c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.008+0000 7f348dffb700 1 -- 172.21.15.153:0/897673296 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3490022070 con 0x7f349815a620 2023-11-24T08:04:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.008+0000 7f349d278700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f347c06aed0 0x7f347c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.009+0000 7f349d278700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f347c06aed0 0x7f347c06d390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3494009b40 tx=0x7f3494009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.013+0000 7f348dffb700 1 -- 172.21.15.153:0/897673296 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34900566d0 con 0x7f349815a620 2023-11-24T08:04:45.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.205+0000 7f349f4dc700 1 -- 172.21.15.153:0/897673296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3498068fb0 con 0x7f349815a620 2023-11-24T08:04:45.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.205+0000 7f348dffb700 1 -- 172.21.15.153:0/897673296 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3490059cf0 con 0x7f349815a620 2023-11-24T08:04:45.208 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:45.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 -- 172.21.15.153:0/897673296 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f347c06aed0 msgr2=0x7f347c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f347c06aed0 0x7f347c06d390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3494009b40 tx=0x7f3494009210 comp rx=0 tx=0).stop 2023-11-24T08:04:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 -- 172.21.15.153:0/897673296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f349815a620 msgr2=0x7f349814bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f349815a620 0x7f349814bf10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3490014040 tx=0x7f3490004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 -- 172.21.15.153:0/897673296 shutdown_connections 2023-11-24T08:04:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f347c06aed0 0x7f347c06d390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f349815a620 0x7f349814bf10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f349806ecf0 0x7f349815cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 --2- 172.21.15.153:0/897673296 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980cc540 0x7f349813fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 -- 172.21.15.153:0/897673296 >> 172.21.15.153:0/897673296 conn(0x7f34980b2050 msgr2=0x7f349814ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 -- 172.21.15.153:0/897673296 shutdown_connections 2023-11-24T08:04:45.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.208+0000 7f349f4dc700 1 -- 172.21.15.153:0/897673296 wait complete. 2023-11-24T08:04:45.221 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:04:45.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.342+0000 7f305f4a9700 1 Processor -- start 2023-11-24T08:04:45.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.342+0000 7f305f4a9700 1 -- start start 2023-11-24T08:04:45.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f305f4a9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30580af4d0 0x7f30580b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f305f4a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580ae430 con 0x7f305806c710 2023-11-24T08:04:45.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f305f4a9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580ae710 con 0x7f305815e080 2023-11-24T08:04:45.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f305f4a9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580af0b0 con 0x7f30580af4d0 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f305ca44700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f305806c710 0x7f305806e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42640/0 (socket says 172.21.15.153:42640) 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f305ca44700 1 -- 172.21.15.153:0/1352632870 learned_addr learned my addr 172.21.15.153:0/1352632870 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f305da46700 1 --2- 172.21.15.153:0/1352632870 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30580af4d0 0x7f30580b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f304ffff700 1 -- 172.21.15.153:0/1352632870 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710763394 0 0) 0x7f30580ae430 con 0x7f305806c710 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f304ffff700 1 -- 172.21.15.153:0/1352632870 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30440035b0 con 0x7f305806c710 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f304ffff700 1 -- 172.21.15.153:0/1352632870 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020425886 0 0) 0x7f30580ae710 con 0x7f305815e080 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f304ffff700 1 -- 172.21.15.153:0/1352632870 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30580ae430 con 0x7f305815e080 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f304ffff700 1 -- 172.21.15.153:0/1352632870 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 79054240 0 0) 0x7f30440035b0 con 0x7f305806c710 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.343+0000 7f305da46700 1 -- 172.21.15.153:0/1352632870 >> v1:172.21.15.164:6789/0 conn(0x7f305815e080 legacy=0x7f305806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.344+0000 7f305da46700 1 -- 172.21.15.153:0/1352632870 >> v1:172.21.15.153:6789/0 conn(0x7f305806c710 legacy=0x7f305806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.344+0000 7f305da46700 1 -- 172.21.15.153:0/1352632870 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580ae9f0 con 0x7f30580af4d0 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.344+0000 7f305da46700 1 --2- 172.21.15.153:0/1352632870 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30580af4d0 0x7f30580b5050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3050009dc0 tx=0x7f305000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fee1100358444317 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.344+0000 7f304ffff700 1 -- 172.21.15.153:0/1352632870 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305000e070 con 0x7f30580af4d0 2023-11-24T08:04:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.344+0000 7f304ffff700 1 -- 172.21.15.153:0/1352632870 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050003a20 con 0x7f30580af4d0 2023-11-24T08:04:45.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.344+0000 7f304ffff700 1 -- 172.21.15.153:0/1352632870 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048001670 con 0x7f30580af4d0 2023-11-24T08:04:45.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.344+0000 7f305f4a9700 1 -- 172.21.15.153:0/1352632870 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30580af4d0 msgr2=0x7f30580b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.344+0000 7f305f4a9700 1 --2- 172.21.15.153:0/1352632870 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30580af4d0 0x7f30580b5050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3050009dc0 tx=0x7f305000b330 comp rx=0 tx=0).stop 2023-11-24T08:04:45.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.344+0000 7f305f4a9700 1 -- 172.21.15.153:0/1352632870 shutdown_connections 2023-11-24T08:04:45.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.344+0000 7f305f4a9700 1 --2- 172.21.15.153:0/1352632870 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30580af4d0 0x7f30580b5050 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.344+0000 7f305f4a9700 1 -- 172.21.15.153:0/1352632870 >> 172.21.15.153:0/1352632870 conn(0x7f3058071b90 msgr2=0x7f3058071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:45.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.345+0000 7f305f4a9700 1 -- 172.21.15.153:0/1352632870 shutdown_connections 2023-11-24T08:04:45.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.345+0000 7f305f4a9700 1 -- 172.21.15.153:0/1352632870 wait complete. 2023-11-24T08:04:45.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.346+0000 7f305f4a9700 1 Processor -- start 2023-11-24T08:04:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.346+0000 7f305f4a9700 1 -- start start 2023-11-24T08:04:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.346+0000 7f305f4a9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f305806c710 0x7f30581f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.346+0000 7f305f4a9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30580af4d0 0x7f3058156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.346+0000 7f305f4a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f305815e080 0x7f30581493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.346+0000 7f305f4a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3058152e20 con 0x7f305815e080 2023-11-24T08:04:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.346+0000 7f305f4a9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3058156f70 con 0x7f30580af4d0 2023-11-24T08:04:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.346+0000 7f305f4a9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3058156cb0 con 0x7f305806c710 2023-11-24T08:04:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305da46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f305815e080 0x7f30581493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305da46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f305815e080 0x7f30581493e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36544/0 (socket says 172.21.15.153:36544) 2023-11-24T08:04:45.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305da46700 1 -- 172.21.15.153:0/2226364709 learned_addr learned my addr 172.21.15.153:0/2226364709 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:45.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305d245700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f305806c710 0x7f30581f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305ca44700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30580af4d0 0x7f3058156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305da46700 1 -- 172.21.15.153:0/2226364709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f305806c710 msgr2=0x7f30581f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305da46700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f305806c710 0x7f30581f3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305da46700 1 -- 172.21.15.153:0/2226364709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30580af4d0 msgr2=0x7f3058156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305da46700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30580af4d0 0x7f3058156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305da46700 1 -- 172.21.15.153:0/2226364709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050009a70 con 0x7f305815e080 2023-11-24T08:04:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305da46700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f305815e080 0x7f30581493e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3050009d90 tx=0x7f3050004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f304dffb700 1 -- 172.21.15.153:0/2226364709 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30500046f0 con 0x7f305815e080 2023-11-24T08:04:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305f4a9700 1 -- 172.21.15.153:0/2226364709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305815f820 con 0x7f305815e080 2023-11-24T08:04:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f304dffb700 1 -- 172.21.15.153:0/2226364709 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050004850 con 0x7f305815e080 2023-11-24T08:04:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f304dffb700 1 -- 172.21.15.153:0/2226364709 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305001d670 con 0x7f305815e080 2023-11-24T08:04:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.347+0000 7f305f4a9700 1 -- 172.21.15.153:0/2226364709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305815fde0 con 0x7f305815e080 2023-11-24T08:04:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.348+0000 7f305f4a9700 1 -- 172.21.15.153:0/2226364709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580753f0 con 0x7f305815e080 2023-11-24T08:04:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.349+0000 7f304dffb700 1 -- 172.21.15.153:0/2226364709 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f305001d7d0 con 0x7f305815e080 2023-11-24T08:04:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.349+0000 7f304dffb700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f303c06aed0 0x7f303c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.349+0000 7f304dffb700 1 -- 172.21.15.153:0/2226364709 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f305008b380 con 0x7f305815e080 2023-11-24T08:04:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.349+0000 7f305d245700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f303c06aed0 0x7f303c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.349+0000 7f305d245700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f303c06aed0 0x7f303c06d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f30540010e0 tx=0x7f3054009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.353+0000 7f304dffb700 1 -- 172.21.15.153:0/2226364709 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3050056440 con 0x7f305815e080 2023-11-24T08:04:45.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.560+0000 7f305f4a9700 1 -- 172.21.15.153:0/2226364709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3058067f60 con 0x7f305815e080 2023-11-24T08:04:45.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.560+0000 7f304dffb700 1 -- 172.21.15.153:0/2226364709 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3050059a60 con 0x7f305815e080 2023-11-24T08:04:45.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 -- 172.21.15.153:0/2226364709 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f303c06aed0 msgr2=0x7f303c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f303c06aed0 0x7f303c06d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f30540010e0 tx=0x7f3054009040 comp rx=0 tx=0).stop 2023-11-24T08:04:45.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 -- 172.21.15.153:0/2226364709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f305815e080 msgr2=0x7f30581493e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f305815e080 0x7f30581493e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3050009d90 tx=0x7f3050004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 -- 172.21.15.153:0/2226364709 shutdown_connections 2023-11-24T08:04:45.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f303c06aed0 0x7f303c06d390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f305815e080 0x7f30581493e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f305806c710 0x7f30581f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 --2- 172.21.15.153:0/2226364709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30580af4d0 0x7f3058156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 -- 172.21.15.153:0/2226364709 >> 172.21.15.153:0/2226364709 conn(0x7f3058071b90 msgr2=0x7f30580b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:45.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 -- 172.21.15.153:0/2226364709 shutdown_connections 2023-11-24T08:04:45.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.563+0000 7f305f4a9700 1 -- 172.21.15.153:0/2226364709 wait complete. 2023-11-24T08:04:45.567 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2023-11-24T08:04:45.576 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T08:04:45.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:45.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-24T08:04:45.624 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:04:45.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:45.624 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:04:45.648 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:04:45.649 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:45.671 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:04:45.671 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:45.732 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:04:45.732 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:45.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:45.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.912+0000 7f6dd0ff1700 1 Processor -- start 2023-11-24T08:04:45.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.912+0000 7f6dd0ff1700 1 -- start start 2023-11-24T08:04:45.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dd0ff1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6dcc15bdd0 0x7f6dcc1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dd0ff1700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6dcc0d1c70 0x7f6dcc0d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dd0ff1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0b22d0 con 0x7f6dcc0b3370 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dd0ff1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc0b2f50 con 0x7f6dcc15bdd0 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dd0ff1700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc0d2640 con 0x7f6dcc0d1c70 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dca59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6dcc15bdd0 0x7f6dcc1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dc9d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6dcc0b3370 0x7f6dcc0b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42652/0 (socket says 172.21.15.153:42652) 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dc9d9b700 1 -- 172.21.15.153:0/1946112870 learned_addr learned my addr 172.21.15.153:0/1946112870 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dca59c700 1 -- 172.21.15.153:0/1946112870 >> v2:172.21.15.164:3300/0 conn(0x7f6dcc0d1c70 msgr2=0x7f6dcc0d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dca59c700 1 --2- 172.21.15.153:0/1946112870 >> v2:172.21.15.164:3300/0 conn(0x7f6dcc0d1c70 0x7f6dcc0d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dca59c700 1 -- 172.21.15.153:0/1946112870 >> v1:172.21.15.153:6789/0 conn(0x7f6dcc0b3370 legacy=0x7f6dcc0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dc959a700 1 -- 172.21.15.153:0/1946112870 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631115323 0 0) 0x7f6dcc0b22d0 con 0x7f6dcc0b3370 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.913+0000 7f6dca59c700 1 -- 172.21.15.153:0/1946112870 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc0b25b0 con 0x7f6dcc15bdd0 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dca59c700 1 --2- 172.21.15.153:0/1946112870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc15bdd0 0x7f6dcc1604e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc160a50 tx=0x7f6dc0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f63f35b389073a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dc959a700 1 -- 172.21.15.153:0/1946112870 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0011830 con 0x7f6dcc15bdd0 2023-11-24T08:04:45.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dc959a700 1 -- 172.21.15.153:0/1946112870 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc0011990 con 0x7f6dcc15bdd0 2023-11-24T08:04:45.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dc959a700 1 -- 172.21.15.153:0/1946112870 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0011d20 con 0x7f6dcc15bdd0 2023-11-24T08:04:45.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1946112870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc15bdd0 msgr2=0x7f6dcc1604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dd0ff1700 1 --2- 172.21.15.153:0/1946112870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc15bdd0 0x7f6dcc1604e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc160a50 tx=0x7f6dc0009b20 comp rx=0 tx=0).stop 2023-11-24T08:04:45.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1946112870 shutdown_connections 2023-11-24T08:04:45.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dd0ff1700 1 --2- 172.21.15.153:0/1946112870 >> v2:172.21.15.164:3300/0 conn(0x7f6dcc0d1c70 0x7f6dcc0d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dd0ff1700 1 --2- 172.21.15.153:0/1946112870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc15bdd0 0x7f6dcc1604e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1946112870 >> 172.21.15.153:0/1946112870 conn(0x7f6dcc0731a0 msgr2=0x7f6dcc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:45.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1946112870 shutdown_connections 2023-11-24T08:04:45.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.914+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1946112870 wait complete. 2023-11-24T08:04:45.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.916+0000 7f6dd0ff1700 1 Processor -- start 2023-11-24T08:04:45.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.916+0000 7f6dd0ff1700 1 -- start start 2023-11-24T08:04:45.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.916+0000 7f6dd0ff1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc0b3370 0x7f6dcc06c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.916+0000 7f6dd0ff1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6dcc0d1c70 0x7f6dcc14f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.916+0000 7f6dd0ff1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6dcc15bdd0 0x7f6dcc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.916+0000 7f6dd0ff1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc06be10 con 0x7f6dcc0b3370 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.916+0000 7f6dd0ff1700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc06c770 con 0x7f6dcc15bdd0 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.916+0000 7f6dd0ff1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc06b190 con 0x7f6dcc0d1c70 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dca59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc0b3370 0x7f6dcc06c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dca59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc0b3370 0x7f6dcc06c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36552/0 (socket says 172.21.15.153:36552) 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dca59c700 1 -- 172.21.15.153:0/1530720666 learned_addr learned my addr 172.21.15.153:0/1530720666 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dc9d9b700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6dcc0d1c70 0x7f6dcc14f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dca59c700 1 -- 172.21.15.153:0/1530720666 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6dcc0d1c70 msgr2=0x7f6dcc14f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dca59c700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6dcc0d1c70 0x7f6dcc14f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dca59c700 1 -- 172.21.15.153:0/1530720666 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6dcc15bdd0 msgr2=0x7f6dcc06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dca59c700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6dcc15bdd0 0x7f6dcc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dca59c700 1 -- 172.21.15.153:0/1530720666 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc00094a0 con 0x7f6dcc0b3370 2023-11-24T08:04:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dca59c700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc0b3370 0x7f6dcc06c230 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0014040 tx=0x7f6dc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dbaffd700 1 -- 172.21.15.153:0/1530720666 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00038a0 con 0x7f6dcc0b3370 2023-11-24T08:04:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dbaffd700 1 -- 172.21.15.153:0/1530720666 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc001e070 con 0x7f6dcc0b3370 2023-11-24T08:04:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1530720666 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc06b470 con 0x7f6dcc0b3370 2023-11-24T08:04:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dbaffd700 1 -- 172.21.15.153:0/1530720666 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0003c20 con 0x7f6dcc0b3370 2023-11-24T08:04:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.917+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1530720666 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc06ba30 con 0x7f6dcc0b3370 2023-11-24T08:04:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.918+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1530720666 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc0d1310 con 0x7f6dcc0b3370 2023-11-24T08:04:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.919+0000 7f6dbaffd700 1 -- 172.21.15.153:0/1530720666 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6dc002d450 con 0x7f6dcc0b3370 2023-11-24T08:04:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.919+0000 7f6dbaffd700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6dac06aed0 0x7f6dac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.919+0000 7f6dbaffd700 1 -- 172.21.15.153:0/1530720666 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dc008a700 con 0x7f6dcc0b3370 2023-11-24T08:04:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.919+0000 7f6dc9d9b700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6dac06aed0 0x7f6dac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.919+0000 7f6dc9d9b700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6dac06aed0 0x7f6dac06d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc06cb20 tx=0x7f6dbc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:45.923+0000 7f6dbaffd700 1 -- 172.21.15.153:0/1530720666 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6dc0055840 con 0x7f6dcc0b3370 2023-11-24T08:04:46.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.116+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1530720666 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6dcc06bf50 con 0x7f6dcc0b3370 2023-11-24T08:04:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.117+0000 7f6dbaffd700 1 -- 172.21.15.153:0/1530720666 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f6dc0020090 con 0x7f6dcc0b3370 2023-11-24T08:04:46.119 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:46.119 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:46.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1530720666 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6dac06aed0 msgr2=0x7f6dac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6dac06aed0 0x7f6dac06d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc06cb20 tx=0x7f6dbc009040 comp rx=0 tx=0).stop 2023-11-24T08:04:46.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1530720666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc0b3370 msgr2=0x7f6dcc06c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc0b3370 0x7f6dcc06c230 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0014040 tx=0x7f6dc0004750 comp rx=0 tx=0).stop 2023-11-24T08:04:46.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1530720666 shutdown_connections 2023-11-24T08:04:46.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6dcc15bdd0 0x7f6dcc06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6dac06aed0 0x7f6dac06d390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc0b3370 0x7f6dcc06c230 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 --2- 172.21.15.153:0/1530720666 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6dcc0d1c70 0x7f6dcc14f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1530720666 >> 172.21.15.153:0/1530720666 conn(0x7f6dcc0731a0 msgr2=0x7f6dcc0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1530720666 shutdown_connections 2023-11-24T08:04:46.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.119+0000 7f6dd0ff1700 1 -- 172.21.15.153:0/1530720666 wait complete. 2023-11-24T08:04:46.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:46.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:46.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.258+0000 7f82b69a8700 1 Processor -- start 2023-11-24T08:04:46.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.258+0000 7f82b69a8700 1 -- start start 2023-11-24T08:04:46.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.258+0000 7f82b69a8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f82b00cc540 0x7f82b006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.258+0000 7f82b69a8700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f82b006eb20 0x7f82b00b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.258+0000 7f82b69a8700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b006ef50 con 0x7f82b015a620 2023-11-24T08:04:46.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.258+0000 7f82b69a8700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b00b2f20 con 0x7f82b00cc540 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.258+0000 7f82b69a8700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b015aa00 con 0x7f82b006eb20 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82af7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f82b00cc540 0x7f82b006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82affff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f82b015a620 0x7f82b00ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42664/0 (socket says 172.21.15.153:42664) 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82affff700 1 -- 172.21.15.153:0/3519282345 learned_addr learned my addr 172.21.15.153:0/3519282345 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82b4f45700 1 --2- 172.21.15.153:0/3519282345 >> v2:172.21.15.164:3300/0 conn(0x7f82b006eb20 0x7f82b00b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82af7fe700 1 -- 172.21.15.153:0/3519282345 >> v2:172.21.15.164:3300/0 conn(0x7f82b006eb20 msgr2=0x7f82b00b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82af7fe700 1 --2- 172.21.15.153:0/3519282345 >> v2:172.21.15.164:3300/0 conn(0x7f82b006eb20 0x7f82b00b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82af7fe700 1 -- 172.21.15.153:0/3519282345 >> v1:172.21.15.153:6789/0 conn(0x7f82b015a620 legacy=0x7f82b00ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82af7fe700 1 -- 172.21.15.153:0/3519282345 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b00ce960 con 0x7f82b00cc540 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82aeffd700 1 -- 172.21.15.153:0/3519282345 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164021811 0 0) 0x7f82b006ef50 con 0x7f82b015a620 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82af7fe700 1 --2- 172.21.15.153:0/3519282345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b00cc540 0x7f82b006e5e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f82b0072520 tx=0x7f82a4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17d78df6321c04c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82aeffd700 1 -- 172.21.15.153:0/3519282345 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4011830 con 0x7f82b00cc540 2023-11-24T08:04:46.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82aeffd700 1 -- 172.21.15.153:0/3519282345 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a4011990 con 0x7f82b00cc540 2023-11-24T08:04:46.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.259+0000 7f82aeffd700 1 -- 172.21.15.153:0/3519282345 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4011d20 con 0x7f82b00cc540 2023-11-24T08:04:46.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.260+0000 7f82b69a8700 1 -- 172.21.15.153:0/3519282345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b00cc540 msgr2=0x7f82b006e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.260+0000 7f82b69a8700 1 --2- 172.21.15.153:0/3519282345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b00cc540 0x7f82b006e5e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f82b0072520 tx=0x7f82a4009b20 comp rx=0 tx=0).stop 2023-11-24T08:04:46.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.260+0000 7f82b69a8700 1 -- 172.21.15.153:0/3519282345 shutdown_connections 2023-11-24T08:04:46.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.260+0000 7f82b69a8700 1 --2- 172.21.15.153:0/3519282345 >> v2:172.21.15.164:3300/0 conn(0x7f82b006eb20 0x7f82b00b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.260+0000 7f82b69a8700 1 --2- 172.21.15.153:0/3519282345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b00cc540 0x7f82b006e5e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.260+0000 7f82b69a8700 1 -- 172.21.15.153:0/3519282345 >> 172.21.15.153:0/3519282345 conn(0x7f82b00b2050 msgr2=0x7f82b00b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.260+0000 7f82b69a8700 1 -- 172.21.15.153:0/3519282345 shutdown_connections 2023-11-24T08:04:46.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.260+0000 7f82b69a8700 1 -- 172.21.15.153:0/3519282345 wait complete. 2023-11-24T08:04:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.261+0000 7f82b69a8700 1 Processor -- start 2023-11-24T08:04:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.262+0000 7f82b69a8700 1 -- start start 2023-11-24T08:04:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.262+0000 7f82b69a8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b006eb20 0x7f82b015ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.262+0000 7f82b69a8700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82b00cc540 0x7f82b01e4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.262+0000 7f82b69a8700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82b015a620 0x7f82b0140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.262+0000 7f82b69a8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b015c190 con 0x7f82b006eb20 2023-11-24T08:04:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.262+0000 7f82b69a8700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b015b120 con 0x7f82b00cc540 2023-11-24T08:04:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.262+0000 7f82b69a8700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b015b400 con 0x7f82b015a620 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.262+0000 7f82affff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b006eb20 0x7f82b015ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.262+0000 7f82affff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b006eb20 0x7f82b015ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36566/0 (socket says 172.21.15.153:36566) 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.262+0000 7f82affff700 1 -- 172.21.15.153:0/2457096046 learned_addr learned my addr 172.21.15.153:0/2457096046 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82b4f45700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82b015a620 0x7f82b0140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82af7fe700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82b00cc540 0x7f82b01e4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82affff700 1 -- 172.21.15.153:0/2457096046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82b015a620 msgr2=0x7f82b0140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82affff700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82b015a620 0x7f82b0140b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82affff700 1 -- 172.21.15.153:0/2457096046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82b00cc540 msgr2=0x7f82b01e4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82affff700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82b00cc540 0x7f82b01e4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82affff700 1 -- 172.21.15.153:0/2457096046 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a40094a0 con 0x7f82b006eb20 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82b4f45700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82b015a620 0x7f82b0140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82affff700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b006eb20 0x7f82b015ab40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c550 tx=0x7f82a000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82acff9700 1 -- 172.21.15.153:0/2457096046 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0004c80 con 0x7f82b006eb20 2023-11-24T08:04:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82acff9700 1 -- 172.21.15.153:0/2457096046 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a0004e00 con 0x7f82b006eb20 2023-11-24T08:04:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82b69a8700 1 -- 172.21.15.153:0/2457096046 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b015b6e0 con 0x7f82b006eb20 2023-11-24T08:04:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82acff9700 1 -- 172.21.15.153:0/2457096046 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0007310 con 0x7f82b006eb20 2023-11-24T08:04:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.263+0000 7f82b69a8700 1 -- 172.21.15.153:0/2457096046 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b014dec0 con 0x7f82b006eb20 2023-11-24T08:04:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.264+0000 7f82b69a8700 1 -- 172.21.15.153:0/2457096046 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b0068d90 con 0x7f82b006eb20 2023-11-24T08:04:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.264+0000 7f82acff9700 1 -- 172.21.15.153:0/2457096046 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82a0007470 con 0x7f82b006eb20 2023-11-24T08:04:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.265+0000 7f82acff9700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f829c06aed0 0x7f829c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.265+0000 7f82acff9700 1 -- 172.21.15.153:0/2457096046 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82a0089210 con 0x7f82b006eb20 2023-11-24T08:04:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.265+0000 7f82af7fe700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f829c06aed0 0x7f829c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.265+0000 7f82af7fe700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f829c06aed0 0x7f829c06d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f82a40090b0 tx=0x7f82a4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.269+0000 7f82acff9700 1 -- 172.21.15.153:0/2457096046 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82a00542d0 con 0x7f82b006eb20 2023-11-24T08:04:46.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.459+0000 7f82b69a8700 1 -- 172.21.15.153:0/2457096046 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82b015c2d0 con 0x7f82b006eb20 2023-11-24T08:04:46.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.459+0000 7f82acff9700 1 -- 172.21.15.153:0/2457096046 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82b015c2d0 con 0x7f82b006eb20 2023-11-24T08:04:46.461 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.461+0000 7f82b69a8700 1 -- 172.21.15.153:0/2457096046 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f829c06aed0 msgr2=0x7f829c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.461+0000 7f82b69a8700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f829c06aed0 0x7f829c06d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f82a40090b0 tx=0x7f82a4008030 comp rx=0 tx=0).stop 2023-11-24T08:04:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.461+0000 7f82b69a8700 1 -- 172.21.15.153:0/2457096046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b006eb20 msgr2=0x7f82b015ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.461+0000 7f82b69a8700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b006eb20 0x7f82b015ab40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c550 tx=0x7f82a000c860 comp rx=0 tx=0).stop 2023-11-24T08:04:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.461+0000 7f82b69a8700 1 -- 172.21.15.153:0/2457096046 shutdown_connections 2023-11-24T08:04:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.461+0000 7f82b69a8700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82b015a620 0x7f82b0140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.461+0000 7f82b69a8700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f829c06aed0 0x7f829c06d390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.461+0000 7f82b69a8700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b006eb20 0x7f82b015ab40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.461+0000 7f82b69a8700 1 --2- 172.21.15.153:0/2457096046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82b00cc540 0x7f82b01e4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.461+0000 7f82b69a8700 1 -- 172.21.15.153:0/2457096046 >> 172.21.15.153:0/2457096046 conn(0x7f82b00b2050 msgr2=0x7f82b01591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.462+0000 7f82b69a8700 1 -- 172.21.15.153:0/2457096046 shutdown_connections 2023-11-24T08:04:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.462+0000 7f82b69a8700 1 -- 172.21.15.153:0/2457096046 wait complete. 2023-11-24T08:04:46.475 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:46.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.597+0000 7fc3fa21d700 1 Processor -- start 2023-11-24T08:04:46.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.597+0000 7fc3fa21d700 1 -- start start 2023-11-24T08:04:46.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3fa21d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3f415a620 0x7fc3f40ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3fa21d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3f406ecf0 0x7fc3f40b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3fa21d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f40b2f20 con 0x7fc3f40cc540 2023-11-24T08:04:46.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3fa21d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f40ce690 con 0x7fc3f406ecf0 2023-11-24T08:04:46.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3fa21d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f415aa00 con 0x7fc3f415a620 2023-11-24T08:04:46.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3f3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3f406ecf0 0x7fc3f40b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3f3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3f406ecf0 0x7fc3f40b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36578/0 (socket says 172.21.15.153:36578) 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3f3fff700 1 -- 172.21.15.153:0/2778282366 learned_addr learned my addr 172.21.15.153:0/2778282366 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3f37fe700 1 --2- 172.21.15.153:0/2778282366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3f415a620 0x7fc3f40ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3f3fff700 1 -- 172.21.15.153:0/2778282366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3f415a620 msgr2=0x7fc3f40ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3f3fff700 1 --2- 172.21.15.153:0/2778282366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3f415a620 0x7fc3f40ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3f3fff700 1 -- 172.21.15.153:0/2778282366 >> v1:172.21.15.164:6789/0 conn(0x7fc3f40cc540 legacy=0x7fc3f406e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3f3fff700 1 -- 172.21.15.153:0/2778282366 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f40ce960 con 0x7fc3f406ecf0 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3f37fe700 1 --2- 172.21.15.153:0/2778282366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3f415a620 0x7fc3f40ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3f3fff700 1 --2- 172.21.15.153:0/2778282366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3f406ecf0 0x7fc3f40b3350 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009e50 tx=0x7fc3ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81533dfb7ac9ed66 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.598+0000 7fc3f27fc700 1 -- 172.21.15.153:0/2778282366 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00e070 con 0x7fc3f406ecf0 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.599+0000 7fc3f27fc700 1 -- 172.21.15.153:0/2778282366 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec00b9c0 con 0x7fc3f406ecf0 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.599+0000 7fc3f27fc700 1 -- 172.21.15.153:0/2778282366 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00bd70 con 0x7fc3f406ecf0 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.599+0000 7fc3fa21d700 1 -- 172.21.15.153:0/2778282366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3f406ecf0 msgr2=0x7fc3f40b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.599+0000 7fc3fa21d700 1 --2- 172.21.15.153:0/2778282366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3f406ecf0 0x7fc3f40b3350 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009e50 tx=0x7fc3ec00b330 comp rx=0 tx=0).stop 2023-11-24T08:04:46.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.599+0000 7fc3fa21d700 1 -- 172.21.15.153:0/2778282366 shutdown_connections 2023-11-24T08:04:46.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.599+0000 7fc3fa21d700 1 --2- 172.21.15.153:0/2778282366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3f406ecf0 0x7fc3f40b3350 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.599+0000 7fc3fa21d700 1 --2- 172.21.15.153:0/2778282366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3f415a620 0x7fc3f40ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.599+0000 7fc3fa21d700 1 -- 172.21.15.153:0/2778282366 >> 172.21.15.153:0/2778282366 conn(0x7fc3f40b2050 msgr2=0x7fc3f40b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.599+0000 7fc3fa21d700 1 -- 172.21.15.153:0/2778282366 shutdown_connections 2023-11-24T08:04:46.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.599+0000 7fc3fa21d700 1 -- 172.21.15.153:0/2778282366 wait complete. 2023-11-24T08:04:46.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.600+0000 7fc3fa21d700 1 Processor -- start 2023-11-24T08:04:46.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.601+0000 7fc3fa21d700 1 -- start start 2023-11-24T08:04:46.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.601+0000 7fc3fa21d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3f406ecf0 0x7fc3f41f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.601+0000 7fc3fa21d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3f40cc540 0x7fc3f415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.601+0000 7fc3fa21d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3f415a620 0x7fc3f406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.601+0000 7fc3fa21d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f41f38c0 con 0x7fc3f40cc540 2023-11-24T08:04:46.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.601+0000 7fc3fa21d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4154560 con 0x7fc3f406ecf0 2023-11-24T08:04:46.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.601+0000 7fc3fa21d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f415cb50 con 0x7fc3f415a620 2023-11-24T08:04:46.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.601+0000 7fc3f2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3f40cc540 0x7fc3f415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.601+0000 7fc3f2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3f40cc540 0x7fc3f415ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36582/0 (socket says 172.21.15.153:36582) 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.601+0000 7fc3f2ffd700 1 -- 172.21.15.153:0/774145145 learned_addr learned my addr 172.21.15.153:0/774145145 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3f37fe700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3f406ecf0 0x7fc3f41f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3f3fff700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3f415a620 0x7fc3f406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3f2ffd700 1 -- 172.21.15.153:0/774145145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3f415a620 msgr2=0x7fc3f406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3f2ffd700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3f415a620 0x7fc3f406d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3f2ffd700 1 -- 172.21.15.153:0/774145145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3f406ecf0 msgr2=0x7fc3f41f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3f2ffd700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3f406ecf0 0x7fc3f41f3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3f2ffd700 1 -- 172.21.15.153:0/774145145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec009b30 con 0x7fc3f40cc540 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3f2ffd700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3f40cc540 0x7fc3f415ac00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400c4e0 tx=0x7fc3e400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3dbfff700 1 -- 172.21.15.153:0/774145145 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40052d0 con 0x7fc3f40cc540 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3dbfff700 1 -- 172.21.15.153:0/774145145 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e4005430 con 0x7fc3f40cc540 2023-11-24T08:04:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3fa21d700 1 -- 172.21.15.153:0/774145145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f415ce30 con 0x7fc3f40cc540 2023-11-24T08:04:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3dbfff700 1 -- 172.21.15.153:0/774145145 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40038c0 con 0x7fc3f40cc540 2023-11-24T08:04:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.602+0000 7fc3fa21d700 1 -- 172.21.15.153:0/774145145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f415d3f0 con 0x7fc3f40cc540 2023-11-24T08:04:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.603+0000 7fc3fa21d700 1 -- 172.21.15.153:0/774145145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f415da40 con 0x7fc3f40cc540 2023-11-24T08:04:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.604+0000 7fc3dbfff700 1 -- 172.21.15.153:0/774145145 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc3e4003a20 con 0x7fc3f40cc540 2023-11-24T08:04:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.604+0000 7fc3dbfff700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc3e006aed0 0x7fc3e006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.604+0000 7fc3dbfff700 1 -- 172.21.15.153:0/774145145 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3e4088b50 con 0x7fc3f40cc540 2023-11-24T08:04:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.604+0000 7fc3f37fe700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc3e006aed0 0x7fc3e006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.604+0000 7fc3f37fe700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc3e006aed0 0x7fc3e006d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800d8b0 tx=0x7fc3e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.608+0000 7fc3dbfff700 1 -- 172.21.15.153:0/774145145 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3e4053b70 con 0x7fc3f40cc540 2023-11-24T08:04:46.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.798+0000 7fc3fa21d700 1 -- 172.21.15.153:0/774145145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3f4068d90 con 0x7fc3f40cc540 2023-11-24T08:04:46.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.798+0000 7fc3dbfff700 1 -- 172.21.15.153:0/774145145 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3e40170a0 con 0x7fc3f40cc540 2023-11-24T08:04:46.800 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:46.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.800+0000 7fc3fa21d700 1 -- 172.21.15.153:0/774145145 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc3e006aed0 msgr2=0x7fc3e006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.800+0000 7fc3fa21d700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc3e006aed0 0x7fc3e006d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800d8b0 tx=0x7fc3e8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:46.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.800+0000 7fc3fa21d700 1 -- 172.21.15.153:0/774145145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3f40cc540 msgr2=0x7fc3f415ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.800+0000 7fc3fa21d700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3f40cc540 0x7fc3f415ac00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400c4e0 tx=0x7fc3e400c8a0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.800+0000 7fc3fa21d700 1 -- 172.21.15.153:0/774145145 shutdown_connections 2023-11-24T08:04:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.800+0000 7fc3fa21d700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3f415a620 0x7fc3f406d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.800+0000 7fc3fa21d700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3f406ecf0 0x7fc3f41f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.800+0000 7fc3fa21d700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc3e006aed0 0x7fc3e006d390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.800+0000 7fc3fa21d700 1 --2- 172.21.15.153:0/774145145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3f40cc540 0x7fc3f415ac00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.800+0000 7fc3fa21d700 1 -- 172.21.15.153:0/774145145 >> 172.21.15.153:0/774145145 conn(0x7fc3f40b2050 msgr2=0x7fc3f40b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.801+0000 7fc3fa21d700 1 -- 172.21.15.153:0/774145145 shutdown_connections 2023-11-24T08:04:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.801+0000 7fc3fa21d700 1 -- 172.21.15.153:0/774145145 wait complete. 2023-11-24T08:04:46.814 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:46.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.936+0000 7f375bf8b700 1 Processor -- start 2023-11-24T08:04:46.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.937+0000 7f375bf8b700 1 -- start start 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.937+0000 7f375bf8b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f375415e2d0 0x7f375406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.937+0000 7f375bf8b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37540ceb70 0x7f37540cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.937+0000 7f375bf8b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37540cf550 con 0x7f37540b4230 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.937+0000 7f375bf8b700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375415e6b0 con 0x7f375415e2d0 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.937+0000 7f375bf8b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37540cc9b0 con 0x7f37540ceb70 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.937+0000 7f3759526700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f37540b4230 0x7f37540ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42692/0 (socket says 172.21.15.153:42692) 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.937+0000 7f3759526700 1 -- 172.21.15.153:0/1834930655 learned_addr learned my addr 172.21.15.153:0/1834930655 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3759d27700 1 --2- 172.21.15.153:0/1834930655 >> v2:172.21.15.164:3300/0 conn(0x7f375415e2d0 0x7f375406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f375a528700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37540ceb70 0x7f37540cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591404566 0 0) 0x7f37540cf550 con 0x7f37540b4230 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37400035b0 con 0x7f37540b4230 2023-11-24T08:04:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4124727829 0 0) 0x7f37400035b0 con 0x7f37540b4230 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37540ceb70 msgr2=0x7f37540cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37540ceb70 0x7f37540cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 >> v2:172.21.15.164:3300/0 conn(0x7f375415e2d0 msgr2=0x7f375406ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 --2- 172.21.15.153:0/1834930655 >> v2:172.21.15.164:3300/0 conn(0x7f375415e2d0 0x7f375406ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37540cf000 con 0x7f37540b4230 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f3750001670 con 0x7f37540b4230 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 >> v1:172.21.15.153:6789/0 conn(0x7f37540b4230 legacy=0x7f37540ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3740003a00 0x7f3740003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3740004850 0x7f3740004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37540ceb70 0x7f3740005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375415e6b0 con 0x7f3740003a00 2023-11-24T08:04:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540cc9b0 con 0x7f3740004850 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374000ba40 con 0x7f37540ceb70 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3759d27700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3740003a00 0x7f3740003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f375a528700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37540ceb70 0x7f3740005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.938+0000 7f3759526700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3740004850 0x7f3740004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f3759d27700 1 -- 172.21.15.153:0/1834930655 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37540ceb70 msgr2=0x7f3740005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f3759d27700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37540ceb70 0x7f3740005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f3759d27700 1 -- 172.21.15.153:0/1834930655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3740004850 msgr2=0x7f3740004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f3759d27700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3740004850 0x7f3740004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f3759d27700 1 -- 172.21.15.153:0/1834930655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400035b0 con 0x7f3740003a00 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f3759d27700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3740003a00 0x7f3740003e20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3744009b40 tx=0x7f3740005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f7efbd4559abd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374400e660 con 0x7f3740003a00 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374400e7c0 con 0x7f3740003a00 2023-11-24T08:04:46.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f3758d25700 1 -- 172.21.15.153:0/1834930655 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374400eb50 con 0x7f3740003a00 2023-11-24T08:04:46.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f375bf8b700 1 -- 172.21.15.153:0/1834930655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3740003a00 msgr2=0x7f3740003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f375bf8b700 1 --2- 172.21.15.153:0/1834930655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3740003a00 0x7f3740003e20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3744009b40 tx=0x7f3740005880 comp rx=0 tx=0).stop 2023-11-24T08:04:46.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f375a528700 1 -- 172.21.15.153:0/1834930655 reap_dead start 2023-11-24T08:04:46.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f375bf8b700 1 -- 172.21.15.153:0/1834930655 shutdown_connections 2023-11-24T08:04:46.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f375bf8b700 1 -- 172.21.15.153:0/1834930655 >> 172.21.15.153:0/1834930655 conn(0x7f37540b3710 msgr2=0x7f37540b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f375bf8b700 1 -- 172.21.15.153:0/1834930655 shutdown_connections 2023-11-24T08:04:46.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.939+0000 7f375bf8b700 1 -- 172.21.15.153:0/1834930655 wait complete. 2023-11-24T08:04:46.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.941+0000 7f375bf8b700 1 Processor -- start 2023-11-24T08:04:46.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.941+0000 7f375bf8b700 1 -- start start 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.941+0000 7f375bf8b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3740003a00 0x7f37540cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.941+0000 7f375bf8b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37540ca4a0 0x7f37540c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.941+0000 7f375bf8b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37541521a0 0x7f37541602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.941+0000 7f375bf8b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540c91f0 con 0x7f37540ca4a0 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.941+0000 7f375bf8b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540ca010 con 0x7f3740003a00 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.941+0000 7f375bf8b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37540c9400 con 0x7f37541521a0 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.941+0000 7f3759526700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37540ca4a0 0x7f37540c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.941+0000 7f3759526700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37540ca4a0 0x7f37540c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36600/0 (socket says 172.21.15.153:36600) 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.941+0000 7f3759526700 1 -- 172.21.15.153:0/2669722518 learned_addr learned my addr 172.21.15.153:0/2669722518 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f3759d27700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3740003a00 0x7f37540cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f375a528700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37541521a0 0x7f37541602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f3759526700 1 -- 172.21.15.153:0/2669722518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37541521a0 msgr2=0x7f37541602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f3759526700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37541521a0 0x7f37541602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f3759526700 1 -- 172.21.15.153:0/2669722518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3740003a00 msgr2=0x7f37540cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f3759526700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3740003a00 0x7f37540cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f3759526700 1 -- 172.21.15.153:0/2669722518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37540c96e0 con 0x7f37540ca4a0 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f3759526700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37540ca4a0 0x7f37540c8cb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f375000e770 tx=0x7f375000eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f374a7fc700 1 -- 172.21.15.153:0/2669722518 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750012590 con 0x7f37540ca4a0 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f374a7fc700 1 -- 172.21.15.153:0/2669722518 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3750012710 con 0x7f37540ca4a0 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f375bf8b700 1 -- 172.21.15.153:0/2669722518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37540c99c0 con 0x7f37540ca4a0 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f374a7fc700 1 -- 172.21.15.153:0/2669722518 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750012ac0 con 0x7f37540ca4a0 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.942+0000 7f375bf8b700 1 -- 172.21.15.153:0/2669722518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3754152620 con 0x7f37540ca4a0 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.943+0000 7f375bf8b700 1 -- 172.21.15.153:0/2669722518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3754068fb0 con 0x7f37540ca4a0 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.943+0000 7f374a7fc700 1 -- 172.21.15.153:0/2669722518 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3750012c20 con 0x7f37540ca4a0 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.944+0000 7f374a7fc700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f373806aed0 0x7f373806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.944+0000 7f374a7fc700 1 -- 172.21.15.153:0/2669722518 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37500892e0 con 0x7f37540ca4a0 2023-11-24T08:04:46.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.944+0000 7f3759d27700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f373806aed0 0x7f373806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.944+0000 7f3759d27700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f373806aed0 0x7f373806d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f37440090b0 tx=0x7f3744008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:46.948+0000 7f374a7fc700 1 -- 172.21.15.153:0/2669722518 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3750057eb0 con 0x7f37540ca4a0 2023-11-24T08:04:47.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.141+0000 7f375bf8b700 1 -- 172.21.15.153:0/2669722518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37540ca150 con 0x7f37540ca4a0 2023-11-24T08:04:47.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.141+0000 7f374a7fc700 1 -- 172.21.15.153:0/2669722518 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37540ca150 con 0x7f37540ca4a0 2023-11-24T08:04:47.143 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:47.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.143+0000 7f375bf8b700 1 -- 172.21.15.153:0/2669722518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f373806aed0 msgr2=0x7f373806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.143+0000 7f375bf8b700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f373806aed0 0x7f373806d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f37440090b0 tx=0x7f3744008030 comp rx=0 tx=0).stop 2023-11-24T08:04:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.143+0000 7f375bf8b700 1 -- 172.21.15.153:0/2669722518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37540ca4a0 msgr2=0x7f37540c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.143+0000 7f375bf8b700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37540ca4a0 0x7f37540c8cb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f375000e770 tx=0x7f375000eb30 comp rx=0 tx=0).stop 2023-11-24T08:04:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.143+0000 7f375bf8b700 1 -- 172.21.15.153:0/2669722518 shutdown_connections 2023-11-24T08:04:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.143+0000 7f375bf8b700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37541521a0 0x7f37541602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.143+0000 7f375bf8b700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3740003a00 0x7f37540cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.143+0000 7f375bf8b700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f373806aed0 0x7f373806d390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.143+0000 7f375bf8b700 1 --2- 172.21.15.153:0/2669722518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37540ca4a0 0x7f37540c8cb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.143+0000 7f375bf8b700 1 -- 172.21.15.153:0/2669722518 >> 172.21.15.153:0/2669722518 conn(0x7f37540b3710 msgr2=0x7f37540d10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.144+0000 7f375bf8b700 1 -- 172.21.15.153:0/2669722518 shutdown_connections 2023-11-24T08:04:47.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.144+0000 7f375bf8b700 1 -- 172.21.15.153:0/2669722518 wait complete. 2023-11-24T08:04:47.158 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:04:47.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.279+0000 7f2681795700 1 Processor -- start 2023-11-24T08:04:47.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.279+0000 7f2681795700 1 -- start start 2023-11-24T08:04:47.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.280+0000 7f2681795700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f267c15e080 0x7f267c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.280+0000 7f2681795700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f267c0af4d0 0x7f267c0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.280+0000 7f2681795700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f267c06c000 0x7f267c06c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.280+0000 7f2681795700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c0af0b0 con 0x7f267c0af4d0 2023-11-24T08:04:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.280+0000 7f2681795700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c06c9f0 con 0x7f267c15e080 2023-11-24T08:04:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.280+0000 7f2681795700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0b05a0 con 0x7f267c06c000 2023-11-24T08:04:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.280+0000 7f267a7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f267c0af4d0 0x7f267c0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.280+0000 7f267a7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f267c0af4d0 0x7f267c0afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36608/0 (socket says 172.21.15.153:36608) 2023-11-24T08:04:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.280+0000 7f267a7fc700 1 -- 172.21.15.153:0/2925551142 learned_addr learned my addr 172.21.15.153:0/2925551142 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f267affd700 1 --2- 172.21.15.153:0/2925551142 >> v2:172.21.15.164:3300/0 conn(0x7f267c15e080 0x7f267c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f267b7fe700 1 --2- 172.21.15.153:0/2925551142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f267c06c000 0x7f267c06c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f267a7fc700 1 -- 172.21.15.153:0/2925551142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f267c06c000 msgr2=0x7f267c06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f267a7fc700 1 --2- 172.21.15.153:0/2925551142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f267c06c000 0x7f267c06c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f267a7fc700 1 -- 172.21.15.153:0/2925551142 >> v2:172.21.15.164:3300/0 conn(0x7f267c15e080 msgr2=0x7f267c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f267a7fc700 1 --2- 172.21.15.153:0/2925551142 >> v2:172.21.15.164:3300/0 conn(0x7f267c15e080 0x7f267c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f267a7fc700 1 -- 172.21.15.153:0/2925551142 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c0ae430 con 0x7f267c0af4d0 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f267affd700 1 --2- 172.21.15.153:0/2925551142 >> v2:172.21.15.164:3300/0 conn(0x7f267c15e080 0x7f267c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f267a7fc700 1 --2- 172.21.15.153:0/2925551142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c0af4d0 0x7f267c0afb90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f267c072a90 tx=0x7f266c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5d143980451811 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f2679ffb700 1 -- 172.21.15.153:0/2925551142 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00b870 con 0x7f267c0af4d0 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f2679ffb700 1 -- 172.21.15.153:0/2925551142 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c00b9d0 con 0x7f267c0af4d0 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.281+0000 7f2679ffb700 1 -- 172.21.15.153:0/2925551142 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00bd60 con 0x7f267c0af4d0 2023-11-24T08:04:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.282+0000 7f2681795700 1 -- 172.21.15.153:0/2925551142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c0af4d0 msgr2=0x7f267c0afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.282+0000 7f2681795700 1 --2- 172.21.15.153:0/2925551142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c0af4d0 0x7f267c0afb90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f267c072a90 tx=0x7f266c009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.282+0000 7f2681795700 1 -- 172.21.15.153:0/2925551142 shutdown_connections 2023-11-24T08:04:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.282+0000 7f2681795700 1 --2- 172.21.15.153:0/2925551142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f267c06c000 0x7f267c06c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.282+0000 7f2681795700 1 --2- 172.21.15.153:0/2925551142 >> v2:172.21.15.164:3300/0 conn(0x7f267c15e080 0x7f267c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.282+0000 7f2681795700 1 --2- 172.21.15.153:0/2925551142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c0af4d0 0x7f267c0afb90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.282+0000 7f2681795700 1 -- 172.21.15.153:0/2925551142 >> 172.21.15.153:0/2925551142 conn(0x7f267c071b90 msgr2=0x7f267c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.282+0000 7f2681795700 1 -- 172.21.15.153:0/2925551142 shutdown_connections 2023-11-24T08:04:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.282+0000 7f2681795700 1 -- 172.21.15.153:0/2925551142 wait complete. 2023-11-24T08:04:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.283+0000 7f2681795700 1 Processor -- start 2023-11-24T08:04:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.283+0000 7f2681795700 1 -- start start 2023-11-24T08:04:47.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f2681795700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f267c06c000 0x7f267c153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f2681795700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c0af4d0 0x7f267c1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f2681795700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f267c15e080 0x7f267c140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f2681795700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c141ec0 con 0x7f267c0af4d0 2023-11-24T08:04:47.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f2681795700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c155080 con 0x7f267c15e080 2023-11-24T08:04:47.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f2681795700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c153fe0 con 0x7f267c06c000 2023-11-24T08:04:47.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c0af4d0 0x7f267c1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c0af4d0 0x7f267c1537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36614/0 (socket says 172.21.15.153:36614) 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267a7fc700 1 -- 172.21.15.153:0/2366497187 learned_addr learned my addr 172.21.15.153:0/2366497187 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267affd700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f267c06c000 0x7f267c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267b7fe700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f267c15e080 0x7f267c140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267a7fc700 1 -- 172.21.15.153:0/2366497187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f267c06c000 msgr2=0x7f267c153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267a7fc700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f267c06c000 0x7f267c153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267a7fc700 1 -- 172.21.15.153:0/2366497187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f267c15e080 msgr2=0x7f267c140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267a7fc700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f267c15e080 0x7f267c140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267a7fc700 1 -- 172.21.15.153:0/2366497187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c009550 con 0x7f267c0af4d0 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267b7fe700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f267c15e080 0x7f267c140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f267a7fc700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c0af4d0 0x7f267c1537a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f266c013000 tx=0x7f266c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.284+0000 7f26637fe700 1 -- 172.21.15.153:0/2366497187 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c004310 con 0x7f267c0af4d0 2023-11-24T08:04:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.285+0000 7f26637fe700 1 -- 172.21.15.153:0/2366497187 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c01f070 con 0x7f267c0af4d0 2023-11-24T08:04:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.285+0000 7f2681795700 1 -- 172.21.15.153:0/2366497187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267c1542c0 con 0x7f267c0af4d0 2023-11-24T08:04:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.285+0000 7f26637fe700 1 -- 172.21.15.153:0/2366497187 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0036a0 con 0x7f267c0af4d0 2023-11-24T08:04:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.285+0000 7f2681795700 1 -- 172.21.15.153:0/2366497187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c154880 con 0x7f267c0af4d0 2023-11-24T08:04:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.285+0000 7f2681795700 1 -- 172.21.15.153:0/2366497187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267c0753f0 con 0x7f267c0af4d0 2023-11-24T08:04:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.286+0000 7f26637fe700 1 -- 172.21.15.153:0/2366497187 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f266c021030 con 0x7f267c0af4d0 2023-11-24T08:04:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.286+0000 7f26637fe700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f266806aed0 0x7f266806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.287+0000 7f267affd700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f266806aed0 0x7f266806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.287+0000 7f26637fe700 1 -- 172.21.15.153:0/2366497187 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f266c08a990 con 0x7f267c0af4d0 2023-11-24T08:04:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.287+0000 7f267affd700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f266806aed0 0x7f266806d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2670006fd0 tx=0x7f2670008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.291+0000 7f26637fe700 1 -- 172.21.15.153:0/2366497187 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f266c055b50 con 0x7f267c0af4d0 2023-11-24T08:04:47.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.496+0000 7f2681795700 1 -- 172.21.15.153:0/2366497187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f267c067f60 con 0x7f267c0af4d0 2023-11-24T08:04:47.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.496+0000 7f26637fe700 1 -- 172.21.15.153:0/2366497187 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f266c015080 con 0x7f267c0af4d0 2023-11-24T08:04:47.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.498+0000 7f2681795700 1 -- 172.21.15.153:0/2366497187 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f266806aed0 msgr2=0x7f266806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.499+0000 7f2681795700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f266806aed0 0x7f266806d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2670006fd0 tx=0x7f2670008040 comp rx=0 tx=0).stop 2023-11-24T08:04:47.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.499+0000 7f2681795700 1 -- 172.21.15.153:0/2366497187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c0af4d0 msgr2=0x7f267c1537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.499+0000 7f2681795700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c0af4d0 0x7f267c1537a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f266c013000 tx=0x7f266c004750 comp rx=0 tx=0).stop 2023-11-24T08:04:47.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.499+0000 7f2681795700 1 -- 172.21.15.153:0/2366497187 shutdown_connections 2023-11-24T08:04:47.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.499+0000 7f2681795700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f267c15e080 0x7f267c140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.499+0000 7f2681795700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f267c06c000 0x7f267c153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.499+0000 7f2681795700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f266806aed0 0x7f266806d390 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.499+0000 7f2681795700 1 --2- 172.21.15.153:0/2366497187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f267c0af4d0 0x7f267c1537a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.499+0000 7f2681795700 1 -- 172.21.15.153:0/2366497187 >> 172.21.15.153:0/2366497187 conn(0x7f267c071b90 msgr2=0x7f267c073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.499+0000 7f2681795700 1 -- 172.21.15.153:0/2366497187 shutdown_connections 2023-11-24T08:04:47.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.499+0000 7f2681795700 1 -- 172.21.15.153:0/2366497187 wait complete. 2023-11-24T08:04:47.502 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2023-11-24T08:04:47.512 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T08:04:47.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:47.513 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-24T08:04:47.579 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:04:47.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:47.579 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:04:47.604 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:04:47.604 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:47.622 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:04:47.622 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:47.680 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:04:47.680 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:47.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:47.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.895+0000 7ffa4ca4c700 1 Processor -- start 2023-11-24T08:04:47.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.895+0000 7ffa4ca4c700 1 -- start start 2023-11-24T08:04:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa4ca4c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa4806df20 0x7ffa4806e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa4ca4c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ffa4815ffb0 0x7ffa480cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa4ca4c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4806ee70 con 0x7ffa48145760 2023-11-24T08:04:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa4ca4c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4806d4d0 con 0x7ffa4806df20 2023-11-24T08:04:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa4ca4c700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa480cc5e0 con 0x7ffa4815ffb0 2023-11-24T08:04:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa45d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa4806df20 0x7ffa4806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa4659c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ffa48145760 0x7ffa4815f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42724/0 (socket says 172.21.15.153:42724) 2023-11-24T08:04:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa45d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa4806df20 0x7ffa4806e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36624/0 (socket says 172.21.15.153:36624) 2023-11-24T08:04:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa4659c700 1 -- 172.21.15.153:0/2874300773 learned_addr learned my addr 172.21.15.153:0/2874300773 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:47.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa45d9b700 1 -- 172.21.15.153:0/2874300773 >> v2:172.21.15.164:3300/0 conn(0x7ffa4815ffb0 msgr2=0x7ffa480cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:47.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa46d9d700 1 --2- 172.21.15.153:0/2874300773 >> v2:172.21.15.164:3300/0 conn(0x7ffa4815ffb0 0x7ffa480cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa4559a700 1 -- 172.21.15.153:0/2874300773 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243514917 0 0) 0x7ffa4806ee70 con 0x7ffa48145760 2023-11-24T08:04:47.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa45d9b700 1 --2- 172.21.15.153:0/2874300773 >> v2:172.21.15.164:3300/0 conn(0x7ffa4815ffb0 0x7ffa480cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa45d9b700 1 -- 172.21.15.153:0/2874300773 >> v1:172.21.15.153:6789/0 conn(0x7ffa48145760 legacy=0x7ffa4815f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa45d9b700 1 -- 172.21.15.153:0/2874300773 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa480cc8c0 con 0x7ffa4806df20 2023-11-24T08:04:47.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.896+0000 7ffa46d9d700 1 --2- 172.21.15.153:0/2874300773 >> v2:172.21.15.164:3300/0 conn(0x7ffa4815ffb0 0x7ffa480cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:47.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa45d9b700 1 --2- 172.21.15.153:0/2874300773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa4806df20 0x7ffa4806e930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa480cf960 tx=0x7ffa38009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326edee8501e1fbd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa4559a700 1 -- 172.21.15.153:0/2874300773 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38011830 con 0x7ffa4806df20 2023-11-24T08:04:47.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa4559a700 1 -- 172.21.15.153:0/2874300773 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa38011990 con 0x7ffa4806df20 2023-11-24T08:04:47.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa4559a700 1 -- 172.21.15.153:0/2874300773 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38011d20 con 0x7ffa4806df20 2023-11-24T08:04:47.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/2874300773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa4806df20 msgr2=0x7ffa4806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa4ca4c700 1 --2- 172.21.15.153:0/2874300773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa4806df20 0x7ffa4806e930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa480cf960 tx=0x7ffa38009b20 comp rx=0 tx=0).stop 2023-11-24T08:04:47.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/2874300773 shutdown_connections 2023-11-24T08:04:47.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa4ca4c700 1 --2- 172.21.15.153:0/2874300773 >> v2:172.21.15.164:3300/0 conn(0x7ffa4815ffb0 0x7ffa480cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa4ca4c700 1 --2- 172.21.15.153:0/2874300773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa4806df20 0x7ffa4806e930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/2874300773 >> 172.21.15.153:0/2874300773 conn(0x7ffa480b1740 msgr2=0x7ffa480b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/2874300773 shutdown_connections 2023-11-24T08:04:47.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.897+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/2874300773 wait complete. 2023-11-24T08:04:47.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.899+0000 7ffa4ca4c700 1 Processor -- start 2023-11-24T08:04:47.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.899+0000 7ffa4ca4c700 1 -- start start 2023-11-24T08:04:47.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.899+0000 7ffa4ca4c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa4806df20 0x7ffa48144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa4ca4c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa48145760 0x7ffa480b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa4ca4c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa4815ffb0 0x7ffa4815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa4ca4c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480ad870 con 0x7ffa48145760 2023-11-24T08:04:47.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa4ca4c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa48143b40 con 0x7ffa4815ffb0 2023-11-24T08:04:47.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa4ca4c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa48143e20 con 0x7ffa4806df20 2023-11-24T08:04:47.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa45d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa48145760 0x7ffa480b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa45d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa48145760 0x7ffa480b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36628/0 (socket says 172.21.15.153:36628) 2023-11-24T08:04:47.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa45d9b700 1 -- 172.21.15.153:0/3485914622 learned_addr learned my addr 172.21.15.153:0/3485914622 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:47.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa46d9d700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa4815ffb0 0x7ffa4815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa4659c700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa4806df20 0x7ffa48144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa45d9b700 1 -- 172.21.15.153:0/3485914622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa4806df20 msgr2=0x7ffa48144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa45d9b700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa4806df20 0x7ffa48144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa45d9b700 1 -- 172.21.15.153:0/3485914622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa4815ffb0 msgr2=0x7ffa4815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa45d9b700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa4815ffb0 0x7ffa4815b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa45d9b700 1 -- 172.21.15.153:0/3485914622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380094a0 con 0x7ffa48145760 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa46d9d700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa4815ffb0 0x7ffa4815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa45d9b700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa48145760 0x7ffa480b3840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffa38000c00 tx=0x7ffa38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa3effd700 1 -- 172.21.15.153:0/3485914622 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa380038a0 con 0x7ffa48145760 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa3effd700 1 -- 172.21.15.153:0/3485914622 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3801f070 con 0x7ffa48145760 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/3485914622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa480adac0 con 0x7ffa48145760 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa3effd700 1 -- 172.21.15.153:0/3485914622 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38003c60 con 0x7ffa48145760 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.900+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/3485914622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa48143760 con 0x7ffa48145760 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.901+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/3485914622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa481438f0 con 0x7ffa48145760 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.902+0000 7ffa3effd700 1 -- 172.21.15.153:0/3485914622 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa3801a430 con 0x7ffa48145760 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.902+0000 7ffa3effd700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa2806aed0 0x7ffa2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.902+0000 7ffa3effd700 1 -- 172.21.15.153:0/3485914622 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa38021070 con 0x7ffa48145760 2023-11-24T08:04:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.902+0000 7ffa4659c700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa2806aed0 0x7ffa2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.902+0000 7ffa4659c700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa2806aed0 0x7ffa2806d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa30000f60 tx=0x7ffa30007be0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:47.906+0000 7ffa3effd700 1 -- 172.21.15.153:0/3485914622 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa38056200 con 0x7ffa48145760 2023-11-24T08:04:48.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:48.030 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:48.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.102+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/3485914622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa480751e0 con 0x7ffa48145760 2023-11-24T08:04:48.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.103+0000 7ffa3effd700 1 -- 172.21.15.153:0/3485914622 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7ffa38015090 con 0x7ffa48145760 2023-11-24T08:04:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:48.105 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:48.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/3485914622 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa2806aed0 msgr2=0x7ffa2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa2806aed0 0x7ffa2806d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa30000f60 tx=0x7ffa30007be0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/3485914622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa48145760 msgr2=0x7ffa480b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa48145760 0x7ffa480b3840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffa38000c00 tx=0x7ffa38004750 comp rx=0 tx=0).stop 2023-11-24T08:04:48.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/3485914622 shutdown_connections 2023-11-24T08:04:48.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa4815ffb0 0x7ffa4815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa4806df20 0x7ffa48144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa2806aed0 0x7ffa2806d390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 --2- 172.21.15.153:0/3485914622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa48145760 0x7ffa480b3840 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/3485914622 >> 172.21.15.153:0/3485914622 conn(0x7ffa480b1740 msgr2=0x7ffa48071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:48.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/3485914622 shutdown_connections 2023-11-24T08:04:48.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.105+0000 7ffa4ca4c700 1 -- 172.21.15.153:0/3485914622 wait complete. 2023-11-24T08:04:48.119 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:48.120 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:48.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.284+0000 7f6431d6c700 1 Processor -- start 2023-11-24T08:04:48.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.284+0000 7f6431d6c700 1 -- start start 2023-11-24T08:04:48.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.284+0000 7f6431d6c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f642c0b3bf0 0x7f642c06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.284+0000 7f6431d6c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f642c073f90 0x7f642c074440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.284+0000 7f6431d6c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c0b0590 con 0x7f642c15e150 2023-11-24T08:04:48.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.284+0000 7f6431d6c700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642c074980 con 0x7f642c073f90 2023-11-24T08:04:48.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.284+0000 7f6431d6c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c0b4360 con 0x7f642c0b3bf0 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642b7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f642c15e150 0x7f642c06f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42738/0 (socket says 172.21.15.153:42738) 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642b7fe700 1 -- 172.21.15.153:0/2519791645 learned_addr learned my addr 172.21.15.153:0/2519791645 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785294749 0 0) 0x7f642c0b0590 con 0x7f642c15e150 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642bfff700 1 --2- 172.21.15.153:0/2519791645 >> v2:172.21.15.164:3300/0 conn(0x7f642c073f90 0x7f642c074440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64180035b0 con 0x7f642c15e150 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642affd700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f642c0b3bf0 0x7f642c06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1371138201 0 0) 0x7f64180035b0 con 0x7f642c15e150 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f642c0b3bf0 msgr2=0x7f642c06e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f642c0b3bf0 0x7f642c06e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 >> v2:172.21.15.164:3300/0 conn(0x7f642c073f90 msgr2=0x7f642c074440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 --2- 172.21.15.153:0/2519791645 >> v2:172.21.15.164:3300/0 conn(0x7f642c073f90 0x7f642c074440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c0b4080 con 0x7f642c15e150 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f641c001670 con 0x7f642c15e150 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642affd700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f642c0b3bf0 0x7f642c06e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642bfff700 1 --2- 172.21.15.153:0/2519791645 >> v2:172.21.15.164:3300/0 conn(0x7f642c073f90 0x7f642c074440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 >> v1:172.21.15.153:6789/0 conn(0x7f642c15e150 legacy=0x7f642c06f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6418003a00 0x7f6418003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6418004850 0x7f6418004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6418005210 0x7f641800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c074980 con 0x7f6418004850 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64180056e0 con 0x7f6418003a00 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641800bfa0 con 0x7f6418005210 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642affd700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6418004850 0x7f6418004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642b7fe700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6418003a00 0x7f6418003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.285+0000 7f642bfff700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6418005210 0x7f641800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f642affd700 1 -- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6418005210 msgr2=0x7f641800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f642affd700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6418005210 0x7f641800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f642affd700 1 -- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6418003a00 msgr2=0x7f6418003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f642affd700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6418003a00 0x7f6418003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f642affd700 1 -- 172.21.15.153:0/2519791645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64180035b0 con 0x7f6418004850 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f642affd700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6418004850 0x7f6418004cd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6414009980 tx=0x7f6418005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59438aeb5dd6b91 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641400c070 con 0x7f6418004850 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6414013610 con 0x7f6418004850 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f642a7fc700 1 -- 172.21.15.153:0/2519791645 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64140139a0 con 0x7f6418004850 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f6431d6c700 1 -- 172.21.15.153:0/2519791645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6418004850 msgr2=0x7f6418004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f6431d6c700 1 --2- 172.21.15.153:0/2519791645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6418004850 0x7f6418004cd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6414009980 tx=0x7f6418005880 comp rx=0 tx=0).stop 2023-11-24T08:04:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f642bfff700 1 -- 172.21.15.153:0/2519791645 reap_dead start 2023-11-24T08:04:48.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f6431d6c700 1 -- 172.21.15.153:0/2519791645 shutdown_connections 2023-11-24T08:04:48.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f6431d6c700 1 -- 172.21.15.153:0/2519791645 >> 172.21.15.153:0/2519791645 conn(0x7f642c0d0be0 msgr2=0x7f642c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:48.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f6431d6c700 1 -- 172.21.15.153:0/2519791645 shutdown_connections 2023-11-24T08:04:48.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.286+0000 7f6431d6c700 1 -- 172.21.15.153:0/2519791645 wait complete. 2023-11-24T08:04:48.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.288+0000 7f6431d6c700 1 Processor -- start 2023-11-24T08:04:48.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.288+0000 7f6431d6c700 1 -- start start 2023-11-24T08:04:48.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.288+0000 7f6431d6c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6418004850 0x7f642c1f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.288+0000 7f6431d6c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f642c159150 0x7f642c0b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.288+0000 7f6431d6c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f642c152b70 0x7f642c151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.288+0000 7f6431d6c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c1f37f0 con 0x7f642c152b70 2023-11-24T08:04:48.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f6431d6c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c161570 con 0x7f642c159150 2023-11-24T08:04:48.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f6431d6c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c153500 con 0x7f6418004850 2023-11-24T08:04:48.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f642c152b70 0x7f642c151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f642c152b70 0x7f642c151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36648/0 (socket says 172.21.15.153:36648) 2023-11-24T08:04:48.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642bfff700 1 -- 172.21.15.153:0/4214680853 learned_addr learned my addr 172.21.15.153:0/4214680853 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:48.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642b7fe700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6418004850 0x7f642c1f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642affd700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f642c159150 0x7f642c0b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642bfff700 1 -- 172.21.15.153:0/4214680853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6418004850 msgr2=0x7f642c1f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642bfff700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6418004850 0x7f642c1f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642bfff700 1 -- 172.21.15.153:0/4214680853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f642c159150 msgr2=0x7f642c0b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642bfff700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f642c159150 0x7f642c0b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642bfff700 1 -- 172.21.15.153:0/4214680853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c153d10 con 0x7f642c152b70 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642affd700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f642c159150 0x7f642c0b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f642bfff700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f642c152b70 0x7f642c151470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f642c0af8f0 tx=0x7f6424010440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f6423fff700 1 -- 172.21.15.153:0/4214680853 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642401b070 con 0x7f642c152b70 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f6423fff700 1 -- 172.21.15.153:0/4214680853 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6424010b30 con 0x7f642c152b70 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f6431d6c700 1 -- 172.21.15.153:0/4214680853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642c1f4720 con 0x7f642c152b70 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f6423fff700 1 -- 172.21.15.153:0/4214680853 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424010cc0 con 0x7f642c152b70 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.289+0000 7f6431d6c700 1 -- 172.21.15.153:0/4214680853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642c153a30 con 0x7f642c152b70 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.290+0000 7f6431d6c700 1 -- 172.21.15.153:0/4214680853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642c068fb0 con 0x7f642c152b70 2023-11-24T08:04:48.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.291+0000 7f6423fff700 1 -- 172.21.15.153:0/4214680853 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6424003a20 con 0x7f642c152b70 2023-11-24T08:04:48.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.291+0000 7f6423fff700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f640c06aed0 0x7f640c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.291+0000 7f6423fff700 1 -- 172.21.15.153:0/4214680853 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6424089b10 con 0x7f642c152b70 2023-11-24T08:04:48.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.291+0000 7f642b7fe700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f640c06aed0 0x7f640c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.291+0000 7f642b7fe700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f640c06aed0 0x7f640c06d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f641c0015d0 tx=0x7f641c007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.295+0000 7f6423fff700 1 -- 172.21.15.153:0/4214680853 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6424054bc0 con 0x7f642c152b70 2023-11-24T08:04:48.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.485+0000 7f6431d6c700 1 -- 172.21.15.153:0/4214680853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f642c161930 con 0x7f642c152b70 2023-11-24T08:04:48.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.485+0000 7f6423fff700 1 -- 172.21.15.153:0/4214680853 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64240581e0 con 0x7f642c152b70 2023-11-24T08:04:48.487 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:48.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 -- 172.21.15.153:0/4214680853 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f640c06aed0 msgr2=0x7f640c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f640c06aed0 0x7f640c06d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f641c0015d0 tx=0x7f641c007980 comp rx=0 tx=0).stop 2023-11-24T08:04:48.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 -- 172.21.15.153:0/4214680853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f642c152b70 msgr2=0x7f642c151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f642c152b70 0x7f642c151470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f642c0af8f0 tx=0x7f6424010440 comp rx=0 tx=0).stop 2023-11-24T08:04:48.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 -- 172.21.15.153:0/4214680853 shutdown_connections 2023-11-24T08:04:48.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f640c06aed0 0x7f640c06d390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f642c152b70 0x7f642c151470 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6418004850 0x7f642c1f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 --2- 172.21.15.153:0/4214680853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f642c159150 0x7f642c0b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 -- 172.21.15.153:0/4214680853 >> 172.21.15.153:0/4214680853 conn(0x7f642c0d0be0 msgr2=0x7f642c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:48.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 -- 172.21.15.153:0/4214680853 shutdown_connections 2023-11-24T08:04:48.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.487+0000 7f6431d6c700 1 -- 172.21.15.153:0/4214680853 wait complete. 2023-11-24T08:04:48.501 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:48.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.623+0000 7f34eae3e700 1 Processor -- start 2023-11-24T08:04:48.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.623+0000 7f34eae3e700 1 -- start start 2023-11-24T08:04:48.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.624+0000 7f34eae3e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34e4151c30 0x7f34e40ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.624+0000 7f34eae3e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f34e40cf0b0 0x7f34e415e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.624+0000 7f34eae3e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e40b55a0 con 0x7f34e406fab0 2023-11-24T08:04:48.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.624+0000 7f34eae3e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e4062900 con 0x7f34e40cf0b0 2023-11-24T08:04:48.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.624+0000 7f34eae3e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40b52c0 con 0x7f34e4151c30 2023-11-24T08:04:48.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.624+0000 7f34e8bda700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34e4151c30 0x7f34e40ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.624+0000 7f34e93db700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f34e40cf0b0 0x7f34e415e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.624+0000 7f34e3fff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f34e406fab0 0x7f34e40ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:50442/0 (socket says 172.21.15.153:50442) 2023-11-24T08:04:48.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.624+0000 7f34e3fff700 1 -- 172.21.15.153:0/167851409 learned_addr learned my addr 172.21.15.153:0/167851409 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:48.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.624+0000 7f34e93db700 1 -- 172.21.15.153:0/167851409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34e4151c30 msgr2=0x7f34e40ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:48.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.624+0000 7f34e93db700 1 --2- 172.21.15.153:0/167851409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34e4151c30 0x7f34e40ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34e93db700 1 -- 172.21.15.153:0/167851409 >> v1:172.21.15.164:6789/0 conn(0x7f34e406fab0 legacy=0x7f34e40ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34e93db700 1 -- 172.21.15.153:0/167851409 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e4062340 con 0x7f34e40cf0b0 2023-11-24T08:04:48.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34e8bda700 1 --2- 172.21.15.153:0/167851409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34e4151c30 0x7f34e40ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:48.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34e93db700 1 --2- 172.21.15.153:0/167851409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34e40cf0b0 0x7f34e415e860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009d90 tx=0x7f34dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5e8c85db3d4ccf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34e37fe700 1 -- 172.21.15.153:0/167851409 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00e070 con 0x7f34e40cf0b0 2023-11-24T08:04:48.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34e37fe700 1 -- 172.21.15.153:0/167851409 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc00bb20 con 0x7f34e40cf0b0 2023-11-24T08:04:48.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34e37fe700 1 -- 172.21.15.153:0/167851409 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc012430 con 0x7f34e40cf0b0 2023-11-24T08:04:48.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34eae3e700 1 -- 172.21.15.153:0/167851409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34e40cf0b0 msgr2=0x7f34e415e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34eae3e700 1 --2- 172.21.15.153:0/167851409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34e40cf0b0 0x7f34e415e860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009d90 tx=0x7f34dc00b330 comp rx=0 tx=0).stop 2023-11-24T08:04:48.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34eae3e700 1 -- 172.21.15.153:0/167851409 shutdown_connections 2023-11-24T08:04:48.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34eae3e700 1 --2- 172.21.15.153:0/167851409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34e40cf0b0 0x7f34e415e860 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34eae3e700 1 --2- 172.21.15.153:0/167851409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34e4151c30 0x7f34e40ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34eae3e700 1 -- 172.21.15.153:0/167851409 >> 172.21.15.153:0/167851409 conn(0x7f34e40b2050 msgr2=0x7f34e40b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:48.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.625+0000 7f34eae3e700 1 -- 172.21.15.153:0/167851409 shutdown_connections 2023-11-24T08:04:48.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.626+0000 7f34eae3e700 1 -- 172.21.15.153:0/167851409 wait complete. 2023-11-24T08:04:48.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.627+0000 7f34eae3e700 1 Processor -- start 2023-11-24T08:04:48.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.627+0000 7f34eae3e700 1 -- start start 2023-11-24T08:04:48.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.627+0000 7f34eae3e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34e406fab0 0x7f34e4149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.627+0000 7f34eae3e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34e40cf0b0 0x7f34e40ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.627+0000 7f34eae3e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e4151c30 0x7f34e41499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.627+0000 7f34eae3e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40ac660 con 0x7f34e4151c30 2023-11-24T08:04:48.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.627+0000 7f34eae3e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40ac940 con 0x7f34e406fab0 2023-11-24T08:04:48.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.627+0000 7f34eae3e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40acc20 con 0x7f34e40cf0b0 2023-11-24T08:04:48.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e93db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e4151c30 0x7f34e41499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e8bda700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34e406fab0 0x7f34e4149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e93db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e4151c30 0x7f34e41499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36664/0 (socket says 172.21.15.153:36664) 2023-11-24T08:04:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e93db700 1 -- 172.21.15.153:0/2009836132 learned_addr learned my addr 172.21.15.153:0/2009836132 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e3fff700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34e40cf0b0 0x7f34e40ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e93db700 1 -- 172.21.15.153:0/2009836132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34e40cf0b0 msgr2=0x7f34e40ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e93db700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34e40cf0b0 0x7f34e40ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e93db700 1 -- 172.21.15.153:0/2009836132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34e406fab0 msgr2=0x7f34e4149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e93db700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34e406fab0 0x7f34e4149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e93db700 1 -- 172.21.15.153:0/2009836132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d80094a0 con 0x7f34e4151c30 2023-11-24T08:04:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e93db700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e4151c30 0x7f34e41499b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f34dc014040 tx=0x7f34dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e17fa700 1 -- 172.21.15.153:0/2009836132 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc012430 con 0x7f34e4151c30 2023-11-24T08:04:48.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e17fa700 1 -- 172.21.15.153:0/2009836132 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc020070 con 0x7f34e4151c30 2023-11-24T08:04:48.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34eae3e700 1 -- 172.21.15.153:0/2009836132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc009a70 con 0x7f34e4151c30 2023-11-24T08:04:48.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34e17fa700 1 -- 172.21.15.153:0/2009836132 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc004280 con 0x7f34e4151c30 2023-11-24T08:04:48.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.628+0000 7f34eae3e700 1 -- 172.21.15.153:0/2009836132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e40ad1e0 con 0x7f34e4151c30 2023-11-24T08:04:48.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.629+0000 7f34eae3e700 1 -- 172.21.15.153:0/2009836132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e40ad3a0 con 0x7f34e4151c30 2023-11-24T08:04:48.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.630+0000 7f34e17fa700 1 -- 172.21.15.153:0/2009836132 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34dc0043e0 con 0x7f34e4151c30 2023-11-24T08:04:48.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.630+0000 7f34e17fa700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f34c806aed0 0x7f34c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.630+0000 7f34e17fa700 1 -- 172.21.15.153:0/2009836132 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34dc022070 con 0x7f34e4151c30 2023-11-24T08:04:48.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.630+0000 7f34e8bda700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f34c806aed0 0x7f34c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.631+0000 7f34e8bda700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f34c806aed0 0x7f34c806d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009d70 tx=0x7f34d8009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.635+0000 7f34e17fa700 1 -- 172.21.15.153:0/2009836132 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34dc0562f0 con 0x7f34e4151c30 2023-11-24T08:04:48.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.825+0000 7f34eae3e700 1 -- 172.21.15.153:0/2009836132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34e4068d90 con 0x7f34e4151c30 2023-11-24T08:04:48.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.825+0000 7f34e17fa700 1 -- 172.21.15.153:0/2009836132 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34dc012e60 con 0x7f34e4151c30 2023-11-24T08:04:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.827+0000 7f34eae3e700 1 -- 172.21.15.153:0/2009836132 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f34c806aed0 msgr2=0x7f34c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.827+0000 7f34eae3e700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f34c806aed0 0x7f34c806d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009d70 tx=0x7f34d8009210 comp rx=0 tx=0).stop 2023-11-24T08:04:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.827+0000 7f34eae3e700 1 -- 172.21.15.153:0/2009836132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e4151c30 msgr2=0x7f34e41499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.827+0000 7f34eae3e700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e4151c30 0x7f34e41499b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f34dc014040 tx=0x7f34dc004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.827+0000 7f34eae3e700 1 -- 172.21.15.153:0/2009836132 shutdown_connections 2023-11-24T08:04:48.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.827+0000 7f34eae3e700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f34c806aed0 0x7f34c806d390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.827+0000 7f34eae3e700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e4151c30 0x7f34e41499b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.827+0000 7f34eae3e700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34e406fab0 0x7f34e4149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.827+0000 7f34eae3e700 1 --2- 172.21.15.153:0/2009836132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34e40cf0b0 0x7f34e40ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.827+0000 7f34eae3e700 1 -- 172.21.15.153:0/2009836132 >> 172.21.15.153:0/2009836132 conn(0x7f34e40b2050 msgr2=0x7f34e406e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:48.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.827+0000 7f34eae3e700 1 -- 172.21.15.153:0/2009836132 shutdown_connections 2023-11-24T08:04:48.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.828+0000 7f34eae3e700 1 -- 172.21.15.153:0/2009836132 wait complete. 2023-11-24T08:04:48.841 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:48.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.963+0000 7ffa30ab9700 1 Processor -- start 2023-11-24T08:04:48.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.963+0000 7ffa30ab9700 1 -- start start 2023-11-24T08:04:48.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa30ab9700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ffa2c15e160 0x7ffa2c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa30ab9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa2c0746a0 0x7ffa2c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa30ab9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2c0b3c60 con 0x7ffa2c0afc90 2023-11-24T08:04:48.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa30ab9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2c0b4500 con 0x7ffa2c0746a0 2023-11-24T08:04:48.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa30ab9700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2c0b58c0 con 0x7ffa2c15e160 2023-11-24T08:04:48.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa2ad9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa2c0746a0 0x7ffa2c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa2ad9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa2c0746a0 0x7ffa2c06d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36672/0 (socket says 172.21.15.153:36672) 2023-11-24T08:04:48.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa29d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ffa2c0afc90 0x7ffa2c073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42772/0 (socket says 172.21.15.153:42772) 2023-11-24T08:04:48.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa2ad9d700 1 -- 172.21.15.153:0/2158467404 learned_addr learned my addr 172.21.15.153:0/2158467404 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:48.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa2a59c700 1 --2- 172.21.15.153:0/2158467404 >> v2:172.21.15.164:3300/0 conn(0x7ffa2c15e160 0x7ffa2c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa2ad9d700 1 -- 172.21.15.153:0/2158467404 >> v2:172.21.15.164:3300/0 conn(0x7ffa2c15e160 msgr2=0x7ffa2c0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:48.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa2ad9d700 1 --2- 172.21.15.153:0/2158467404 >> v2:172.21.15.164:3300/0 conn(0x7ffa2c15e160 0x7ffa2c0b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.964+0000 7ffa2ad9d700 1 -- 172.21.15.153:0/2158467404 >> v1:172.21.15.153:6789/0 conn(0x7ffa2c0afc90 legacy=0x7ffa2c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa2959a700 1 -- 172.21.15.153:0/2158467404 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283978483 0 0) 0x7ffa2c0b3c60 con 0x7ffa2c0afc90 2023-11-24T08:04:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa2ad9d700 1 -- 172.21.15.153:0/2158467404 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c0b0140 con 0x7ffa2c0746a0 2023-11-24T08:04:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa2ad9d700 1 --2- 172.21.15.153:0/2158467404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa2c0746a0 0x7ffa2c06d930 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c09efa0 tx=0x7ffa2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6427bb7c486e54d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa2959a700 1 -- 172.21.15.153:0/2158467404 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2400e070 con 0x7ffa2c0746a0 2023-11-24T08:04:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa2959a700 1 -- 172.21.15.153:0/2158467404 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2400b9c0 con 0x7ffa2c0746a0 2023-11-24T08:04:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa2959a700 1 -- 172.21.15.153:0/2158467404 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2400bd70 con 0x7ffa2c0746a0 2023-11-24T08:04:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa30ab9700 1 -- 172.21.15.153:0/2158467404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa2c0746a0 msgr2=0x7ffa2c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa30ab9700 1 --2- 172.21.15.153:0/2158467404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa2c0746a0 0x7ffa2c06d930 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c09efa0 tx=0x7ffa2400b330 comp rx=0 tx=0).stop 2023-11-24T08:04:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa30ab9700 1 -- 172.21.15.153:0/2158467404 shutdown_connections 2023-11-24T08:04:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa30ab9700 1 --2- 172.21.15.153:0/2158467404 >> v2:172.21.15.164:3300/0 conn(0x7ffa2c15e160 0x7ffa2c0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa30ab9700 1 --2- 172.21.15.153:0/2158467404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa2c0746a0 0x7ffa2c06d930 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa30ab9700 1 -- 172.21.15.153:0/2158467404 >> 172.21.15.153:0/2158467404 conn(0x7ffa2c0d0bf0 msgr2=0x7ffa2c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa30ab9700 1 -- 172.21.15.153:0/2158467404 shutdown_connections 2023-11-24T08:04:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.965+0000 7ffa30ab9700 1 -- 172.21.15.153:0/2158467404 wait complete. 2023-11-24T08:04:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.967+0000 7ffa30ab9700 1 Processor -- start 2023-11-24T08:04:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.967+0000 7ffa30ab9700 1 -- start start 2023-11-24T08:04:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa30ab9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa2c0746a0 0x7ffa2c152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa30ab9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa2c0afc90 0x7ffa2c159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa30ab9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa2c15e160 0x7ffa2c159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa30ab9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c160e20 con 0x7ffa2c0746a0 2023-11-24T08:04:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa30ab9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c160250 con 0x7ffa2c15e160 2023-11-24T08:04:48.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa30ab9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c1604f0 con 0x7ffa2c0afc90 2023-11-24T08:04:48.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa2a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa2c0746a0 0x7ffa2c152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa2a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa2c0746a0 0x7ffa2c152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36674/0 (socket says 172.21.15.153:36674) 2023-11-24T08:04:48.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa2a59c700 1 -- 172.21.15.153:0/1960259842 learned_addr learned my addr 172.21.15.153:0/1960259842 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:48.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa2ad9d700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa2c15e160 0x7ffa2c159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa29d9b700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa2c0afc90 0x7ffa2c159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa2a59c700 1 -- 172.21.15.153:0/1960259842 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa2c0afc90 msgr2=0x7ffa2c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa2a59c700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa2c0afc90 0x7ffa2c159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa2a59c700 1 -- 172.21.15.153:0/1960259842 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa2c15e160 msgr2=0x7ffa2c159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa2a59c700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa2c15e160 0x7ffa2c159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa2a59c700 1 -- 172.21.15.153:0/1960259842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa24009b30 con 0x7ffa2c0746a0 2023-11-24T08:04:48.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa2a59c700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa2c0746a0 0x7ffa2c152a40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000d800 tx=0x7ffa2000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa1affd700 1 -- 172.21.15.153:0/1960259842 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa200125f0 con 0x7ffa2c0746a0 2023-11-24T08:04:48.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa1affd700 1 -- 172.21.15.153:0/1960259842 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa20012750 con 0x7ffa2c0746a0 2023-11-24T08:04:48.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa1affd700 1 -- 172.21.15.153:0/1960259842 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20012b00 con 0x7ffa2c0746a0 2023-11-24T08:04:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa30ab9700 1 -- 172.21.15.153:0/1960259842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2c1607d0 con 0x7ffa2c0746a0 2023-11-24T08:04:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.968+0000 7ffa30ab9700 1 -- 172.21.15.153:0/1960259842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2c152f80 con 0x7ffa2c0746a0 2023-11-24T08:04:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.969+0000 7ffa30ab9700 1 -- 172.21.15.153:0/1960259842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2c068fb0 con 0x7ffa2c0746a0 2023-11-24T08:04:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.970+0000 7ffa1affd700 1 -- 172.21.15.153:0/1960259842 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa20012c60 con 0x7ffa2c0746a0 2023-11-24T08:04:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.970+0000 7ffa1affd700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa0c06aed0 0x7ffa0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.970+0000 7ffa1affd700 1 -- 172.21.15.153:0/1960259842 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa20089650 con 0x7ffa2c0746a0 2023-11-24T08:04:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.970+0000 7ffa29d9b700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa0c06aed0 0x7ffa0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.970+0000 7ffa29d9b700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa0c06aed0 0x7ffa0c06d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0d07c0 tx=0x7ffa1c007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:48.974+0000 7ffa1affd700 1 -- 172.21.15.153:0/1960259842 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa20054700 con 0x7ffa2c0746a0 2023-11-24T08:04:49.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.166+0000 7ffa30ab9700 1 -- 172.21.15.153:0/1960259842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa2c161100 con 0x7ffa2c0746a0 2023-11-24T08:04:49.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.166+0000 7ffa1affd700 1 -- 172.21.15.153:0/1960259842 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa20057d20 con 0x7ffa2c0746a0 2023-11-24T08:04:49.168 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:49.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 -- 172.21.15.153:0/1960259842 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa0c06aed0 msgr2=0x7ffa0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa0c06aed0 0x7ffa0c06d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0d07c0 tx=0x7ffa1c007de0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 -- 172.21.15.153:0/1960259842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa2c0746a0 msgr2=0x7ffa2c152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa2c0746a0 0x7ffa2c152a40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000d800 tx=0x7ffa2000db10 comp rx=0 tx=0).stop 2023-11-24T08:04:49.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 -- 172.21.15.153:0/1960259842 shutdown_connections 2023-11-24T08:04:49.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa2c15e160 0x7ffa2c159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa0c06aed0 0x7ffa0c06d390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa2c0746a0 0x7ffa2c152a40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 --2- 172.21.15.153:0/1960259842 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa2c0afc90 0x7ffa2c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 -- 172.21.15.153:0/1960259842 >> 172.21.15.153:0/1960259842 conn(0x7ffa2c0d0bf0 msgr2=0x7ffa2c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 -- 172.21.15.153:0/1960259842 shutdown_connections 2023-11-24T08:04:49.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.168+0000 7ffa30ab9700 1 -- 172.21.15.153:0/1960259842 wait complete. 2023-11-24T08:04:49.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:04:49.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.304+0000 7f77a11cf700 1 Processor -- start 2023-11-24T08:04:49.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.304+0000 7f77a11cf700 1 -- start start 2023-11-24T08:04:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.305+0000 7f77a11cf700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f779c06c710 0x7f779c165b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.305+0000 7f77a11cf700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c0af950 con 0x7f779c1446a0 2023-11-24T08:04:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.305+0000 7f77a11cf700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c0afc30 con 0x7f779c0adf00 2023-11-24T08:04:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.305+0000 7f77a11cf700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c144a80 con 0x7f779c06c710 2023-11-24T08:04:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.305+0000 7f779ad9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f779c1446a0 0x7f779c0b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42786/0 (socket says 172.21.15.153:42786) 2023-11-24T08:04:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.305+0000 7f779ad9d700 1 -- 172.21.15.153:0/3899369506 learned_addr learned my addr 172.21.15.153:0/3899369506 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.305+0000 7f779b59e700 1 --2- 172.21.15.153:0/3899369506 >> v2:172.21.15.153:3300/0 conn(0x7f779c06c710 0x7f779c165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.305+0000 7f7799d9b700 1 -- 172.21.15.153:0/3899369506 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751197494 0 0) 0x7f779c0af950 con 0x7f779c1446a0 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.305+0000 7f7799d9b700 1 -- 172.21.15.153:0/3899369506 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77840035b0 con 0x7f779c1446a0 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.305+0000 7f779b59e700 1 -- 172.21.15.153:0/3899369506 >> v1:172.21.15.164:6789/0 conn(0x7f779c0adf00 legacy=0x7f779c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f779b59e700 1 -- 172.21.15.153:0/3899369506 >> v1:172.21.15.153:6789/0 conn(0x7f779c1446a0 legacy=0x7f779c0b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f779b59e700 1 -- 172.21.15.153:0/3899369506 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0aff10 con 0x7f779c06c710 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f779b59e700 1 --2- 172.21.15.153:0/3899369506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f779c06c710 0x7f779c165b70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7794009d90 tx=0x7f779400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c59e35cb156bbce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f7799d9b700 1 -- 172.21.15.153:0/3899369506 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400e070 con 0x7f779c06c710 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f7799d9b700 1 -- 172.21.15.153:0/3899369506 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779400bb20 con 0x7f779c06c710 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f7799d9b700 1 -- 172.21.15.153:0/3899369506 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794012430 con 0x7f779c06c710 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f77a11cf700 1 -- 172.21.15.153:0/3899369506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f779c06c710 msgr2=0x7f779c165b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f77a11cf700 1 --2- 172.21.15.153:0/3899369506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f779c06c710 0x7f779c165b70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7794009d90 tx=0x7f779400b330 comp rx=0 tx=0).stop 2023-11-24T08:04:49.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f77a11cf700 1 -- 172.21.15.153:0/3899369506 shutdown_connections 2023-11-24T08:04:49.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f77a11cf700 1 --2- 172.21.15.153:0/3899369506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f779c06c710 0x7f779c165b70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f77a11cf700 1 -- 172.21.15.153:0/3899369506 >> 172.21.15.153:0/3899369506 conn(0x7f779c071b90 msgr2=0x7f779c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f77a11cf700 1 -- 172.21.15.153:0/3899369506 shutdown_connections 2023-11-24T08:04:49.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.306+0000 7f77a11cf700 1 -- 172.21.15.153:0/3899369506 wait complete. 2023-11-24T08:04:49.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.308+0000 7f77a11cf700 1 Processor -- start 2023-11-24T08:04:49.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.308+0000 7f77a11cf700 1 -- start start 2023-11-24T08:04:49.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.309+0000 7f77a11cf700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f779c06c710 0x7f779c14f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.309+0000 7f77a11cf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f779c0adf00 0x7f779c06b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.309+0000 7f77a11cf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f779c1446a0 0x7f779c06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.309+0000 7f77a11cf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0ceee0 con 0x7f779c1446a0 2023-11-24T08:04:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.309+0000 7f77a11cf700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c15b4e0 con 0x7f779c0adf00 2023-11-24T08:04:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.309+0000 7f77a11cf700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c15b7c0 con 0x7f779c06c710 2023-11-24T08:04:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.309+0000 7f779b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f779c1446a0 0x7f779c06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.309+0000 7f779b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f779c1446a0 0x7f779c06bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36692/0 (socket says 172.21.15.153:36692) 2023-11-24T08:04:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.309+0000 7f779b59e700 1 -- 172.21.15.153:0/1967516497 learned_addr learned my addr 172.21.15.153:0/1967516497 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.309+0000 7f779ad9d700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f779c06c710 0x7f779c14f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.309+0000 7f779a59c700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f779c0adf00 0x7f779c06b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.310+0000 7f779b59e700 1 -- 172.21.15.153:0/1967516497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f779c06c710 msgr2=0x7f779c14f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.310+0000 7f779b59e700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f779c06c710 0x7f779c14f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.310+0000 7f779b59e700 1 -- 172.21.15.153:0/1967516497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f779c0adf00 msgr2=0x7f779c06b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.310+0000 7f779b59e700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f779c0adf00 0x7f779c06b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.310+0000 7f779b59e700 1 -- 172.21.15.153:0/1967516497 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794009a70 con 0x7f779c1446a0 2023-11-24T08:04:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.310+0000 7f779b59e700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f779c1446a0 0x7f779c06bed0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7794013000 tx=0x7f7794004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.310+0000 7f77837fe700 1 -- 172.21.15.153:0/1967516497 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940098f0 con 0x7f779c1446a0 2023-11-24T08:04:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.310+0000 7f77837fe700 1 -- 172.21.15.153:0/1967516497 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7794020070 con 0x7f779c1446a0 2023-11-24T08:04:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.310+0000 7f77a11cf700 1 -- 172.21.15.153:0/1967516497 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c15baa0 con 0x7f779c1446a0 2023-11-24T08:04:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.310+0000 7f77837fe700 1 -- 172.21.15.153:0/1967516497 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940276c0 con 0x7f779c1446a0 2023-11-24T08:04:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.310+0000 7f77a11cf700 1 -- 172.21.15.153:0/1967516497 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c15c060 con 0x7f779c1446a0 2023-11-24T08:04:49.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.311+0000 7f77a11cf700 1 -- 172.21.15.153:0/1967516497 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c0753f0 con 0x7f779c1446a0 2023-11-24T08:04:49.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.311+0000 7f77837fe700 1 -- 172.21.15.153:0/1967516497 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7794012430 con 0x7f779c1446a0 2023-11-24T08:04:49.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.311+0000 7f77837fe700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f778806aed0 0x7f778806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.312+0000 7f77837fe700 1 -- 172.21.15.153:0/1967516497 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7794022070 con 0x7f779c1446a0 2023-11-24T08:04:49.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.312+0000 7f779ad9d700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f778806aed0 0x7f778806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.312+0000 7f779ad9d700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f778806aed0 0x7f778806d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f77900011e0 tx=0x7f7790009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.316+0000 7f77837fe700 1 -- 172.21.15.153:0/1967516497 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77940567d0 con 0x7f779c1446a0 2023-11-24T08:04:49.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.522+0000 7f77a11cf700 1 -- 172.21.15.153:0/1967516497 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f779c15c1f0 con 0x7f779c1446a0 2023-11-24T08:04:49.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.522+0000 7f77837fe700 1 -- 172.21.15.153:0/1967516497 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7794059df0 con 0x7f779c1446a0 2023-11-24T08:04:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 -- 172.21.15.153:0/1967516497 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f778806aed0 msgr2=0x7f778806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f778806aed0 0x7f778806d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f77900011e0 tx=0x7f7790009040 comp rx=0 tx=0).stop 2023-11-24T08:04:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 -- 172.21.15.153:0/1967516497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f779c1446a0 msgr2=0x7f779c06bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f779c1446a0 0x7f779c06bed0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7794013000 tx=0x7f7794004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 -- 172.21.15.153:0/1967516497 shutdown_connections 2023-11-24T08:04:49.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f778806aed0 0x7f778806d390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f779c1446a0 0x7f779c06bed0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f779c06c710 0x7f779c14f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 --2- 172.21.15.153:0/1967516497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f779c0adf00 0x7f779c06b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 -- 172.21.15.153:0/1967516497 >> 172.21.15.153:0/1967516497 conn(0x7f779c071b90 msgr2=0x7f779c071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 -- 172.21.15.153:0/1967516497 shutdown_connections 2023-11-24T08:04:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.524+0000 7f77a11cf700 1 -- 172.21.15.153:0/1967516497 wait complete. 2023-11-24T08:04:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2023-11-24T08:04:49.538 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-24T08:04:49.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:49.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-24T08:04:49.585 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:04:49.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:49.586 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T08:04:49.604 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:04:49.604 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:49.628 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:04:49.629 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:49.689 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:04:49.689 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:49.749 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:49.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.869+0000 7fa4a4f8b700 1 Processor -- start 2023-11-24T08:04:49.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.869+0000 7fa4a4f8b700 1 -- start start 2023-11-24T08:04:49.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.869+0000 7fa4a4f8b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa4a00b0fa0 0x7fa4a00afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa4a4f8b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa4a00d0c40 0x7fa4a00ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa4a4f8b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a00d10a0 con 0x7fa4a00b1380 2023-11-24T08:04:49.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa4a4f8b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00ca6d0 con 0x7fa4a00b0fa0 2023-11-24T08:04:49.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa4a4f8b700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00622a0 con 0x7fa4a00d0c40 2023-11-24T08:04:49.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa4a00b0fa0 0x7fa4a00afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa4a00b0fa0 0x7fa4a00afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36696/0 (socket says 172.21.15.153:36696) 2023-11-24T08:04:49.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49e59c700 1 -- 172.21.15.153:0/3471844085 learned_addr learned my addr 172.21.15.153:0/3471844085 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:49.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49dd9b700 1 --2- 172.21.15.153:0/3471844085 >> v2:172.21.15.164:3300/0 conn(0x7fa4a00d0c40 0x7fa4a00ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49e59c700 1 -- 172.21.15.153:0/3471844085 >> v2:172.21.15.164:3300/0 conn(0x7fa4a00d0c40 msgr2=0x7fa4a00ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49e59c700 1 --2- 172.21.15.153:0/3471844085 >> v2:172.21.15.164:3300/0 conn(0x7fa4a00d0c40 0x7fa4a00ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49e59c700 1 -- 172.21.15.153:0/3471844085 >> v1:172.21.15.164:6789/0 conn(0x7fa4a00b1380 legacy=0x7fa4a00ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49e59c700 1 -- 172.21.15.153:0/3471844085 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a0062580 con 0x7fa4a00b0fa0 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49e59c700 1 --2- 172.21.15.153:0/3471844085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4a00b0fa0 0x7fa4a00afc80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00d1340 tx=0x7fa490009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6758bfe549db5972 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49d59a700 1 -- 172.21.15.153:0/3471844085 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49000b870 con 0x7fa4a00b0fa0 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49d59a700 1 -- 172.21.15.153:0/3471844085 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49000b9d0 con 0x7fa4a00b0fa0 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.870+0000 7fa49d59a700 1 -- 172.21.15.153:0/3471844085 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49000bd60 con 0x7fa4a00b0fa0 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.871+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/3471844085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4a00b0fa0 msgr2=0x7fa4a00afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.871+0000 7fa4a4f8b700 1 --2- 172.21.15.153:0/3471844085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4a00b0fa0 0x7fa4a00afc80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00d1340 tx=0x7fa490009bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.871+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/3471844085 shutdown_connections 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.871+0000 7fa4a4f8b700 1 --2- 172.21.15.153:0/3471844085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4a00b0fa0 0x7fa4a00afc80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.871+0000 7fa4a4f8b700 1 --2- 172.21.15.153:0/3471844085 >> v2:172.21.15.164:3300/0 conn(0x7fa4a00d0c40 0x7fa4a00ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.871+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/3471844085 >> 172.21.15.153:0/3471844085 conn(0x7fa4a00b57b0 msgr2=0x7fa4a00b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.871+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/3471844085 shutdown_connections 2023-11-24T08:04:49.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.871+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/3471844085 wait complete. 2023-11-24T08:04:49.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.872+0000 7fa4a4f8b700 1 Processor -- start 2023-11-24T08:04:49.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.872+0000 7fa4a4f8b700 1 -- start start 2023-11-24T08:04:49.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa4a4f8b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4a00b0fa0 0x7fa4a0161110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa4a4f8b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4a00b1380 0x7fa4a015d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa4a4f8b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4a00d0c40 0x7fa4a013f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa4a4f8b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0161650 con 0x7fa4a00b1380 2023-11-24T08:04:49.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa4a4f8b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0160c80 con 0x7fa4a00d0c40 2023-11-24T08:04:49.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa4a4f8b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a015dc30 con 0x7fa4a00b0fa0 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa49dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4a00b1380 0x7fa4a015d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa49dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4a00b1380 0x7fa4a015d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36704/0 (socket says 172.21.15.153:36704) 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa49dd9b700 1 -- 172.21.15.153:0/4179292411 learned_addr learned my addr 172.21.15.153:0/4179292411 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa49e59c700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4a00b0fa0 0x7fa4a0161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa49ed9d700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4a00d0c40 0x7fa4a013f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa49dd9b700 1 -- 172.21.15.153:0/4179292411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4a00b0fa0 msgr2=0x7fa4a0161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa49dd9b700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4a00b0fa0 0x7fa4a0161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa49dd9b700 1 -- 172.21.15.153:0/4179292411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4a00d0c40 msgr2=0x7fa4a013f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa49dd9b700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4a00d0c40 0x7fa4a013f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa49dd9b700 1 -- 172.21.15.153:0/4179292411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa490009550 con 0x7fa4a00b1380 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.873+0000 7fa49ed9d700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4a00d0c40 0x7fa4a013f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.874+0000 7fa49dd9b700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4a00b1380 0x7fa4a015d6f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa49400d830 tx=0x7fa49400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.874+0000 7fa48effd700 1 -- 172.21.15.153:0/4179292411 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4940125f0 con 0x7fa4a00b1380 2023-11-24T08:04:49.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.874+0000 7fa48effd700 1 -- 172.21.15.153:0/4179292411 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa494012750 con 0x7fa4a00b1380 2023-11-24T08:04:49.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.874+0000 7fa48effd700 1 -- 172.21.15.153:0/4179292411 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494012b00 con 0x7fa4a00b1380 2023-11-24T08:04:49.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.874+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/4179292411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a0150c20 con 0x7fa4a00b1380 2023-11-24T08:04:49.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.874+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/4179292411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a0140200 con 0x7fa4a00b1380 2023-11-24T08:04:49.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.875+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/4179292411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a0160e30 con 0x7fa4a00b1380 2023-11-24T08:04:49.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.875+0000 7fa48effd700 1 -- 172.21.15.153:0/4179292411 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa494012c60 con 0x7fa4a00b1380 2023-11-24T08:04:49.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.875+0000 7fa48effd700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa48006aed0 0x7fa48006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.876+0000 7fa48effd700 1 -- 172.21.15.153:0/4179292411 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa494089710 con 0x7fa4a00b1380 2023-11-24T08:04:49.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.876+0000 7fa49e59c700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa48006aed0 0x7fa48006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.876+0000 7fa49e59c700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa48006aed0 0x7fa48006d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa490000c00 tx=0x7fa490008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:49.880+0000 7fa48effd700 1 -- 172.21.15.153:0/4179292411 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4a0160e30 con 0x7fa4a00b1380 2023-11-24T08:04:50.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.073+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/4179292411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4a0160df0 con 0x7fa4a00b1380 2023-11-24T08:04:50.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.074+0000 7fa48effd700 1 -- 172.21.15.153:0/4179292411 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fa4940547d0 con 0x7fa4a00b1380 2023-11-24T08:04:50.076 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:50.076 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/4179292411 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa48006aed0 msgr2=0x7fa48006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa48006aed0 0x7fa48006d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa490000c00 tx=0x7fa490008030 comp rx=0 tx=0).stop 2023-11-24T08:04:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/4179292411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4a00b1380 msgr2=0x7fa4a015d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4a00b1380 0x7fa4a015d6f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa49400d830 tx=0x7fa49400db40 comp rx=0 tx=0).stop 2023-11-24T08:04:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/4179292411 shutdown_connections 2023-11-24T08:04:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4a00d0c40 0x7fa4a013f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4a00b0fa0 0x7fa4a0161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa48006aed0 0x7fa48006d390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 --2- 172.21.15.153:0/4179292411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4a00b1380 0x7fa4a015d6f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/4179292411 >> 172.21.15.153:0/4179292411 conn(0x7fa4a00b57b0 msgr2=0x7fa4a00ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/4179292411 shutdown_connections 2023-11-24T08:04:50.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.076+0000 7fa4a4f8b700 1 -- 172.21.15.153:0/4179292411 wait complete. 2023-11-24T08:04:50.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:50.090 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:50.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.213+0000 7ff610b11700 1 Processor -- start 2023-11-24T08:04:50.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.213+0000 7ff610b11700 1 -- start start 2023-11-24T08:04:50.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff610b11700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff60c0c6c30 0x7ff60c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff610b11700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff60c0cef40 0x7ff60c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff610b11700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c0d0140 con 0x7ff60c15bf50 2023-11-24T08:04:50.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff610b11700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c15c330 con 0x7ff60c0cef40 2023-11-24T08:04:50.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff610b11700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c0cf3d0 con 0x7ff60c0c6c30 2023-11-24T08:04:50.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff60ad9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff60c0cef40 0x7ff60c0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff60ad9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff60c0cef40 0x7ff60c0cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36714/0 (socket says 172.21.15.153:36714) 2023-11-24T08:04:50.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff60ad9d700 1 -- 172.21.15.153:0/1129825545 learned_addr learned my addr 172.21.15.153:0/1129825545 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:50.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff609d9b700 1 --2- 172.21.15.153:0/1129825545 >> v2:172.21.15.164:3300/0 conn(0x7ff60c0c6c30 0x7ff60c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff60ad9d700 1 -- 172.21.15.153:0/1129825545 >> v2:172.21.15.164:3300/0 conn(0x7ff60c0c6c30 msgr2=0x7ff60c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:50.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff60ad9d700 1 --2- 172.21.15.153:0/1129825545 >> v2:172.21.15.164:3300/0 conn(0x7ff60c0c6c30 0x7ff60c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff60ad9d700 1 -- 172.21.15.153:0/1129825545 >> v1:172.21.15.164:6789/0 conn(0x7ff60c15bf50 legacy=0x7ff60c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff60ad9d700 1 -- 172.21.15.153:0/1129825545 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c0d03e0 con 0x7ff60c0cef40 2023-11-24T08:04:50.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.214+0000 7ff60ad9d700 1 --2- 172.21.15.153:0/1129825545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff60c0cef40 0x7ff60c0cc6c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff60c072420 tx=0x7ff60400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190f1591f6664d8f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.215+0000 7ff60959a700 1 -- 172.21.15.153:0/1129825545 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400e070 con 0x7ff60c0cef40 2023-11-24T08:04:50.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.215+0000 7ff60959a700 1 -- 172.21.15.153:0/1129825545 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400b910 con 0x7ff60c0cef40 2023-11-24T08:04:50.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.215+0000 7ff60959a700 1 -- 172.21.15.153:0/1129825545 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400bcc0 con 0x7ff60c0cef40 2023-11-24T08:04:50.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.215+0000 7ff610b11700 1 -- 172.21.15.153:0/1129825545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff60c0cef40 msgr2=0x7ff60c0cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.215+0000 7ff610b11700 1 --2- 172.21.15.153:0/1129825545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff60c0cef40 0x7ff60c0cc6c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff60c072420 tx=0x7ff60400b330 comp rx=0 tx=0).stop 2023-11-24T08:04:50.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.215+0000 7ff610b11700 1 -- 172.21.15.153:0/1129825545 shutdown_connections 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.215+0000 7ff610b11700 1 --2- 172.21.15.153:0/1129825545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff60c0cef40 0x7ff60c0cc6c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.215+0000 7ff610b11700 1 --2- 172.21.15.153:0/1129825545 >> v2:172.21.15.164:3300/0 conn(0x7ff60c0c6c30 0x7ff60c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.215+0000 7ff610b11700 1 -- 172.21.15.153:0/1129825545 >> 172.21.15.153:0/1129825545 conn(0x7ff60c0b3780 msgr2=0x7ff60c0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.215+0000 7ff610b11700 1 -- 172.21.15.153:0/1129825545 shutdown_connections 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.215+0000 7ff610b11700 1 -- 172.21.15.153:0/1129825545 wait complete. 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.216+0000 7ff610b11700 1 Processor -- start 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.217+0000 7ff610b11700 1 -- start start 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.217+0000 7ff610b11700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff60c0c6c30 0x7ff60c0b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.217+0000 7ff610b11700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff60c0cef40 0x7ff60c06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.217+0000 7ff610b11700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff60c15bf50 0x7ff60c09d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.217+0000 7ff610b11700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c06d040 con 0x7ff60c0c6c30 2023-11-24T08:04:50.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.217+0000 7ff610b11700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c09f2d0 con 0x7ff60c0cef40 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.217+0000 7ff610b11700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c09e230 con 0x7ff60c15bf50 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.217+0000 7ff60a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff60c0c6c30 0x7ff60c0b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.217+0000 7ff60a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff60c0c6c30 0x7ff60c0b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36716/0 (socket says 172.21.15.153:36716) 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.217+0000 7ff60a59c700 1 -- 172.21.15.153:0/1475510353 learned_addr learned my addr 172.21.15.153:0/1475510353 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.217+0000 7ff60ad9d700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff60c15bf50 0x7ff60c09d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff609d9b700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff60c0cef40 0x7ff60c06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff60a59c700 1 -- 172.21.15.153:0/1475510353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff60c15bf50 msgr2=0x7ff60c09d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff60a59c700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff60c15bf50 0x7ff60c09d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff60a59c700 1 -- 172.21.15.153:0/1475510353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff60c0cef40 msgr2=0x7ff60c06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff60a59c700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff60c0cef40 0x7ff60c06cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff60a59c700 1 -- 172.21.15.153:0/1475510353 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604009b30 con 0x7ff60c0c6c30 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff609d9b700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff60c0cef40 0x7ff60c06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff60a59c700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff60c0c6c30 0x7ff60c0b74d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00c450 tx=0x7ff5fc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff5faffd700 1 -- 172.21.15.153:0/1475510353 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0052d0 con 0x7ff60c0c6c30 2023-11-24T08:04:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff5faffd700 1 -- 172.21.15.153:0/1475510353 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc005430 con 0x7ff60c0c6c30 2023-11-24T08:04:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff610b11700 1 -- 172.21.15.153:0/1475510353 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c09e510 con 0x7ff60c0c6c30 2023-11-24T08:04:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff5faffd700 1 -- 172.21.15.153:0/1475510353 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0038c0 con 0x7ff60c0c6c30 2023-11-24T08:04:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.218+0000 7ff610b11700 1 -- 172.21.15.153:0/1475510353 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c09ead0 con 0x7ff60c0c6c30 2023-11-24T08:04:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.219+0000 7ff610b11700 1 -- 172.21.15.153:0/1475510353 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c068fb0 con 0x7ff60c0c6c30 2023-11-24T08:04:50.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.219+0000 7ff5faffd700 1 -- 172.21.15.153:0/1475510353 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5fc003a20 con 0x7ff60c0c6c30 2023-11-24T08:04:50.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.220+0000 7ff5faffd700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5ec06aed0 0x7ff5ec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.220+0000 7ff5faffd700 1 -- 172.21.15.153:0/1475510353 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5fc088930 con 0x7ff60c0c6c30 2023-11-24T08:04:50.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.220+0000 7ff609d9b700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5ec06aed0 0x7ff5ec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.220+0000 7ff609d9b700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5ec06aed0 0x7ff5ec06d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0cd930 tx=0x7ff600008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.224+0000 7ff5faffd700 1 -- 172.21.15.153:0/1475510353 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff5fc0539e0 con 0x7ff60c0c6c30 2023-11-24T08:04:50.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.414+0000 7ff610b11700 1 -- 172.21.15.153:0/1475510353 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff60c062630 con 0x7ff60c0c6c30 2023-11-24T08:04:50.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.414+0000 7ff5faffd700 1 -- 172.21.15.153:0/1475510353 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5fc057000 con 0x7ff60c0c6c30 2023-11-24T08:04:50.416 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.416+0000 7ff610b11700 1 -- 172.21.15.153:0/1475510353 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5ec06aed0 msgr2=0x7ff5ec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.416+0000 7ff610b11700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5ec06aed0 0x7ff5ec06d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0cd930 tx=0x7ff600008040 comp rx=0 tx=0).stop 2023-11-24T08:04:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.417+0000 7ff610b11700 1 -- 172.21.15.153:0/1475510353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff60c0c6c30 msgr2=0x7ff60c0b74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.417+0000 7ff610b11700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff60c0c6c30 0x7ff60c0b74d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00c450 tx=0x7ff5fc00c810 comp rx=0 tx=0).stop 2023-11-24T08:04:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.417+0000 7ff610b11700 1 -- 172.21.15.153:0/1475510353 shutdown_connections 2023-11-24T08:04:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.417+0000 7ff610b11700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff60c15bf50 0x7ff60c09d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.417+0000 7ff610b11700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff5ec06aed0 0x7ff5ec06d390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.417+0000 7ff610b11700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff60c0c6c30 0x7ff60c0b74d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.417+0000 7ff610b11700 1 --2- 172.21.15.153:0/1475510353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff60c0cef40 0x7ff60c06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.417+0000 7ff610b11700 1 -- 172.21.15.153:0/1475510353 >> 172.21.15.153:0/1475510353 conn(0x7ff60c0b3780 msgr2=0x7ff60c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.417+0000 7ff610b11700 1 -- 172.21.15.153:0/1475510353 shutdown_connections 2023-11-24T08:04:50.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.417+0000 7ff610b11700 1 -- 172.21.15.153:0/1475510353 wait complete. 2023-11-24T08:04:50.431 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:50.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.554+0000 7f0afa44f700 1 Processor -- start 2023-11-24T08:04:50.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.554+0000 7f0afa44f700 1 -- start start 2023-11-24T08:04:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.555+0000 7f0afa44f700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0af41587f0 0x7f0af406aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.555+0000 7f0afa44f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0af415b370 0x7f0af415b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.555+0000 7f0afa44f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af406b530 con 0x7f0af40b3c60 2023-11-24T08:04:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.555+0000 7f0afa44f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af40ae5e0 con 0x7f0af415b370 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.555+0000 7f0afa44f700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af415be30 con 0x7f0af41587f0 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.555+0000 7f0af37fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0af415b370 0x7f0af415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.555+0000 7f0af37fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0af415b370 0x7f0af415b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36724/0 (socket says 172.21.15.153:36724) 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.555+0000 7f0af37fe700 1 -- 172.21.15.153:0/748815783 learned_addr learned my addr 172.21.15.153:0/748815783 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.556+0000 7f0af3fff700 1 --2- 172.21.15.153:0/748815783 >> v2:172.21.15.164:3300/0 conn(0x7f0af41587f0 0x7f0af406aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.556+0000 7f0af37fe700 1 -- 172.21.15.153:0/748815783 >> v2:172.21.15.164:3300/0 conn(0x7f0af41587f0 msgr2=0x7f0af406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.556+0000 7f0af37fe700 1 --2- 172.21.15.153:0/748815783 >> v2:172.21.15.164:3300/0 conn(0x7f0af41587f0 0x7f0af406aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.556+0000 7f0af37fe700 1 -- 172.21.15.153:0/748815783 >> v1:172.21.15.164:6789/0 conn(0x7f0af40b3c60 legacy=0x7f0af40af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.556+0000 7f0af37fe700 1 -- 172.21.15.153:0/748815783 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af415c110 con 0x7f0af415b370 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.556+0000 7f0af37fe700 1 --2- 172.21.15.153:0/748815783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0af415b370 0x7f0af415b800 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40098f0 tx=0x7f0ae4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a674d7c9e84d0e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.556+0000 7f0af2ffd700 1 -- 172.21.15.153:0/748815783 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4004230 con 0x7f0af415b370 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.556+0000 7f0af2ffd700 1 -- 172.21.15.153:0/748815783 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae4004390 con 0x7f0af415b370 2023-11-24T08:04:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.556+0000 7f0af2ffd700 1 -- 172.21.15.153:0/748815783 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40036a0 con 0x7f0af415b370 2023-11-24T08:04:50.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.557+0000 7f0afa44f700 1 -- 172.21.15.153:0/748815783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0af415b370 msgr2=0x7f0af415b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.557+0000 7f0afa44f700 1 --2- 172.21.15.153:0/748815783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0af415b370 0x7f0af415b800 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40098f0 tx=0x7f0ae4009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:50.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.557+0000 7f0afa44f700 1 -- 172.21.15.153:0/748815783 shutdown_connections 2023-11-24T08:04:50.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.557+0000 7f0afa44f700 1 --2- 172.21.15.153:0/748815783 >> v2:172.21.15.164:3300/0 conn(0x7f0af41587f0 0x7f0af406aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.557+0000 7f0afa44f700 1 --2- 172.21.15.153:0/748815783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0af415b370 0x7f0af415b800 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.557+0000 7f0afa44f700 1 -- 172.21.15.153:0/748815783 >> 172.21.15.153:0/748815783 conn(0x7f0af40d0bf0 msgr2=0x7f0af40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.557+0000 7f0afa44f700 1 -- 172.21.15.153:0/748815783 shutdown_connections 2023-11-24T08:04:50.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.557+0000 7f0afa44f700 1 -- 172.21.15.153:0/748815783 wait complete. 2023-11-24T08:04:50.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.558+0000 7f0afa44f700 1 Processor -- start 2023-11-24T08:04:50.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.558+0000 7f0afa44f700 1 -- start start 2023-11-24T08:04:50.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0afa44f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0af40b3c60 0x7f0af4150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0afa44f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0af41587f0 0x7f0af413b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0afa44f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0af415b370 0x7f0af406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0afa44f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af414efa0 con 0x7f0af41587f0 2023-11-24T08:04:50.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0afa44f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af414e3f0 con 0x7f0af40b3c60 2023-11-24T08:04:50.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0afa44f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af41506b0 con 0x7f0af415b370 2023-11-24T08:04:50.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0af37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0af41587f0 0x7f0af413b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0af37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0af41587f0 0x7f0af413b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36730/0 (socket says 172.21.15.153:36730) 2023-11-24T08:04:50.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0af37fe700 1 -- 172.21.15.153:0/3579388260 learned_addr learned my addr 172.21.15.153:0/3579388260 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:50.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0af89ec700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0af415b370 0x7f0af406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0af3fff700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0af40b3c60 0x7f0af4150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0af37fe700 1 -- 172.21.15.153:0/3579388260 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0af415b370 msgr2=0x7f0af406ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0af37fe700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0af415b370 0x7f0af406ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0af37fe700 1 -- 172.21.15.153:0/3579388260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0af40b3c60 msgr2=0x7f0af4150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0af37fe700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0af40b3c60 0x7f0af4150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0af37fe700 1 -- 172.21.15.153:0/3579388260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae4009550 con 0x7f0af41587f0 2023-11-24T08:04:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.559+0000 7f0af37fe700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0af41587f0 0x7f0af413b480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009130 tx=0x7f0ae4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.560+0000 7f0af0ff9700 1 -- 172.21.15.153:0/3579388260 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4011630 con 0x7f0af41587f0 2023-11-24T08:04:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.560+0000 7f0af0ff9700 1 -- 172.21.15.153:0/3579388260 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae4011790 con 0x7f0af41587f0 2023-11-24T08:04:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.560+0000 7f0af0ff9700 1 -- 172.21.15.153:0/3579388260 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4011b40 con 0x7f0af41587f0 2023-11-24T08:04:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.560+0000 7f0afa44f700 1 -- 172.21.15.153:0/3579388260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af41508e0 con 0x7f0af41587f0 2023-11-24T08:04:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.560+0000 7f0afa44f700 1 -- 172.21.15.153:0/3579388260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af414e8e0 con 0x7f0af41587f0 2023-11-24T08:04:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.560+0000 7f0afa44f700 1 -- 172.21.15.153:0/3579388260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af4068fb0 con 0x7f0af41587f0 2023-11-24T08:04:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.561+0000 7f0af0ff9700 1 -- 172.21.15.153:0/3579388260 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ae4011ca0 con 0x7f0af41587f0 2023-11-24T08:04:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.561+0000 7f0af0ff9700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0ae006aed0 0x7f0ae006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.561+0000 7f0af0ff9700 1 -- 172.21.15.153:0/3579388260 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ae408af60 con 0x7f0af41587f0 2023-11-24T08:04:50.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.561+0000 7f0af3fff700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0ae006aed0 0x7f0ae006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.562+0000 7f0af3fff700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0ae006aed0 0x7f0ae006d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009930 tx=0x7f0ae8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.566+0000 7f0af0ff9700 1 -- 172.21.15.153:0/3579388260 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ae4056000 con 0x7f0af41587f0 2023-11-24T08:04:50.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.755+0000 7f0afa44f700 1 -- 172.21.15.153:0/3579388260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0af40d0360 con 0x7f0af41587f0 2023-11-24T08:04:50.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.755+0000 7f0af0ff9700 1 -- 172.21.15.153:0/3579388260 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ae4059620 con 0x7f0af41587f0 2023-11-24T08:04:50.757 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:50.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 -- 172.21.15.153:0/3579388260 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0ae006aed0 msgr2=0x7f0ae006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0ae006aed0 0x7f0ae006d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009930 tx=0x7f0ae8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:50.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 -- 172.21.15.153:0/3579388260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0af41587f0 msgr2=0x7f0af413b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0af41587f0 0x7f0af413b480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009130 tx=0x7f0ae4004750 comp rx=0 tx=0).stop 2023-11-24T08:04:50.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 -- 172.21.15.153:0/3579388260 shutdown_connections 2023-11-24T08:04:50.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0af415b370 0x7f0af406ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0af40b3c60 0x7f0af4150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0ae006aed0 0x7f0ae006d390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 --2- 172.21.15.153:0/3579388260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0af41587f0 0x7f0af413b480 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 -- 172.21.15.153:0/3579388260 >> 172.21.15.153:0/3579388260 conn(0x7f0af40d0bf0 msgr2=0x7f0af40747f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 -- 172.21.15.153:0/3579388260 shutdown_connections 2023-11-24T08:04:50.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.757+0000 7f0afa44f700 1 -- 172.21.15.153:0/3579388260 wait complete. 2023-11-24T08:04:50.771 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:50.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.895+0000 7fb8d67f6700 1 Processor -- start 2023-11-24T08:04:50.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.895+0000 7fb8d67f6700 1 -- start start 2023-11-24T08:04:50.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.895+0000 7fb8d67f6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8d015b370 0x7fb8d015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.895+0000 7fb8d67f6700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb8d00b3c60 0x7fb8d00b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.895+0000 7fb8d67f6700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d00ae5e0 con 0x7fb8d01587f0 2023-11-24T08:04:50.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.895+0000 7fb8d67f6700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d00b4610 con 0x7fb8d00b3c60 2023-11-24T08:04:50.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.895+0000 7fb8d67f6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d015be30 con 0x7fb8d015b370 2023-11-24T08:04:50.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.896+0000 7fb8d4d93700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb8d00b3c60 0x7fb8d00b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.896+0000 7fb8cf7fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8d015b370 0x7fb8d015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.896+0000 7fb8cffff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fb8d01587f0 0x7fb8d006aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:50522/0 (socket says 172.21.15.153:50522) 2023-11-24T08:04:50.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.896+0000 7fb8cffff700 1 -- 172.21.15.153:0/507547281 learned_addr learned my addr 172.21.15.153:0/507547281 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:50.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.896+0000 7fb8cf7fe700 1 -- 172.21.15.153:0/507547281 >> v2:172.21.15.164:3300/0 conn(0x7fb8d00b3c60 msgr2=0x7fb8d00b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:50.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.896+0000 7fb8cf7fe700 1 --2- 172.21.15.153:0/507547281 >> v2:172.21.15.164:3300/0 conn(0x7fb8d00b3c60 0x7fb8d00b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.896+0000 7fb8cf7fe700 1 -- 172.21.15.153:0/507547281 >> v1:172.21.15.164:6789/0 conn(0x7fb8d01587f0 legacy=0x7fb8d006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.896+0000 7fb8ceffd700 1 -- 172.21.15.153:0/507547281 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210278589 0 0) 0x7fb8d00ae5e0 con 0x7fb8d01587f0 2023-11-24T08:04:50.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.896+0000 7fb8cf7fe700 1 -- 172.21.15.153:0/507547281 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d015c110 con 0x7fb8d015b370 2023-11-24T08:04:50.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.896+0000 7fb8d4d93700 1 --2- 172.21.15.153:0/507547281 >> v2:172.21.15.164:3300/0 conn(0x7fb8d00b3c60 0x7fb8d00b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:50.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.896+0000 7fb8cf7fe700 1 --2- 172.21.15.153:0/507547281 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8d015b370 0x7fb8d015b7d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009840 tx=0x7fb8b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9732af39245379c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.897+0000 7fb8ceffd700 1 -- 172.21.15.153:0/507547281 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8011830 con 0x7fb8d015b370 2023-11-24T08:04:50.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.897+0000 7fb8ceffd700 1 -- 172.21.15.153:0/507547281 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b8011990 con 0x7fb8d015b370 2023-11-24T08:04:50.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.897+0000 7fb8ceffd700 1 -- 172.21.15.153:0/507547281 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8011d20 con 0x7fb8d015b370 2023-11-24T08:04:50.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.897+0000 7fb8d67f6700 1 -- 172.21.15.153:0/507547281 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8d015b370 msgr2=0x7fb8d015b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.897+0000 7fb8d67f6700 1 --2- 172.21.15.153:0/507547281 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8d015b370 0x7fb8d015b7d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009840 tx=0x7fb8b8009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:50.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.897+0000 7fb8d67f6700 1 -- 172.21.15.153:0/507547281 shutdown_connections 2023-11-24T08:04:50.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.897+0000 7fb8d67f6700 1 --2- 172.21.15.153:0/507547281 >> v2:172.21.15.164:3300/0 conn(0x7fb8d00b3c60 0x7fb8d00b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.897+0000 7fb8d67f6700 1 --2- 172.21.15.153:0/507547281 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8d015b370 0x7fb8d015b7d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.897+0000 7fb8d67f6700 1 -- 172.21.15.153:0/507547281 >> 172.21.15.153:0/507547281 conn(0x7fb8d00d0bf0 msgr2=0x7fb8d00d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.897+0000 7fb8d67f6700 1 -- 172.21.15.153:0/507547281 shutdown_connections 2023-11-24T08:04:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.897+0000 7fb8d67f6700 1 -- 172.21.15.153:0/507547281 wait complete. 2023-11-24T08:04:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.898+0000 7fb8d67f6700 1 Processor -- start 2023-11-24T08:04:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.899+0000 7fb8d67f6700 1 -- start start 2023-11-24T08:04:50.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.899+0000 7fb8d67f6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8d00b3c60 0x7fb8d0153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.899+0000 7fb8d67f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8d01587f0 0x7fb8d00b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.899+0000 7fb8d67f6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8d015b370 0x7fb8d00b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.899+0000 7fb8d67f6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d009b7b0 con 0x7fb8d01587f0 2023-11-24T08:04:50.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.899+0000 7fb8d67f6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d01535b0 con 0x7fb8d00b3c60 2023-11-24T08:04:50.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.899+0000 7fb8d67f6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d009d0f0 con 0x7fb8d015b370 2023-11-24T08:04:50.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8cf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8d01587f0 0x7fb8d00b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8cf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8d01587f0 0x7fb8d00b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36744/0 (socket says 172.21.15.153:36744) 2023-11-24T08:04:50.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8cf7fe700 1 -- 172.21.15.153:0/1779091165 learned_addr learned my addr 172.21.15.153:0/1779091165 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:50.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8cffff700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8d00b3c60 0x7fb8d0153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8d4d93700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8d015b370 0x7fb8d00b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8cf7fe700 1 -- 172.21.15.153:0/1779091165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8d015b370 msgr2=0x7fb8d00b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8cf7fe700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8d015b370 0x7fb8d00b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8cf7fe700 1 -- 172.21.15.153:0/1779091165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8d00b3c60 msgr2=0x7fb8d0153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8cf7fe700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8d00b3c60 0x7fb8d0153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8cf7fe700 1 -- 172.21.15.153:0/1779091165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c8009a70 con 0x7fb8d01587f0 2023-11-24T08:04:50.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8cf7fe700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8d01587f0 0x7fb8d00b1c60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009fd0 tx=0x7fb8b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8ccff9700 1 -- 172.21.15.153:0/1779091165 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80036a0 con 0x7fb8d01587f0 2023-11-24T08:04:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8ccff9700 1 -- 172.21.15.153:0/1779091165 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b801e070 con 0x7fb8d01587f0 2023-11-24T08:04:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8d67f6700 1 -- 172.21.15.153:0/1779091165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b80094a0 con 0x7fb8d01587f0 2023-11-24T08:04:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8ccff9700 1 -- 172.21.15.153:0/1779091165 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8003a60 con 0x7fb8d01587f0 2023-11-24T08:04:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.900+0000 7fb8d67f6700 1 -- 172.21.15.153:0/1779091165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d009ae10 con 0x7fb8d01587f0 2023-11-24T08:04:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.901+0000 7fb8d67f6700 1 -- 172.21.15.153:0/1779091165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d0068fb0 con 0x7fb8d01587f0 2023-11-24T08:04:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.902+0000 7fb8ccff9700 1 -- 172.21.15.153:0/1779091165 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8b8003bc0 con 0x7fb8d01587f0 2023-11-24T08:04:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.902+0000 7fb8ccff9700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb8b006aed0 0x7fb8b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.902+0000 7fb8ccff9700 1 -- 172.21.15.153:0/1779091165 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8b808a550 con 0x7fb8d01587f0 2023-11-24T08:04:50.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.902+0000 7fb8cffff700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb8b006aed0 0x7fb8b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.903+0000 7fb8cffff700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb8b006aed0 0x7fb8b006d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000f60 tx=0x7fb8c0007be0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:50.907+0000 7fb8ccff9700 1 -- 172.21.15.153:0/1779091165 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8b8055690 con 0x7fb8d01587f0 2023-11-24T08:04:51.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.096+0000 7fb8d67f6700 1 -- 172.21.15.153:0/1779091165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8d00b5300 con 0x7fb8d01587f0 2023-11-24T08:04:51.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.096+0000 7fb8ccff9700 1 -- 172.21.15.153:0/1779091165 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8b8058cb0 con 0x7fb8d01587f0 2023-11-24T08:04:51.099 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:51.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 -- 172.21.15.153:0/1779091165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb8b006aed0 msgr2=0x7fb8b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb8b006aed0 0x7fb8b006d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000f60 tx=0x7fb8c0007be0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 -- 172.21.15.153:0/1779091165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8d01587f0 msgr2=0x7fb8d00b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8d01587f0 0x7fb8d00b1c60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009fd0 tx=0x7fb8b8004750 comp rx=0 tx=0).stop 2023-11-24T08:04:51.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 -- 172.21.15.153:0/1779091165 shutdown_connections 2023-11-24T08:04:51.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8d015b370 0x7fb8d00b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8d00b3c60 0x7fb8d0153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb8b006aed0 0x7fb8b006d390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 --2- 172.21.15.153:0/1779091165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8d01587f0 0x7fb8d00b1c60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 -- 172.21.15.153:0/1779091165 >> 172.21.15.153:0/1779091165 conn(0x7fb8d00d0bf0 msgr2=0x7fb8d00aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:51.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 -- 172.21.15.153:0/1779091165 shutdown_connections 2023-11-24T08:04:51.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.099+0000 7fb8d67f6700 1 -- 172.21.15.153:0/1779091165 wait complete. 2023-11-24T08:04:51.113 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:04:51.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.232+0000 7f4198f29700 1 Processor -- start 2023-11-24T08:04:51.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.232+0000 7f4198f29700 1 -- start start 2023-11-24T08:04:51.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.233+0000 7f4198f29700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f41940adf00 0x7f419406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.233+0000 7f4198f29700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f419406c540 0x7f41940b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.233+0000 7f4198f29700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41940af950 con 0x7f41941446a0 2023-11-24T08:04:51.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.233+0000 7f4198f29700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419406c9f0 con 0x7f419406c540 2023-11-24T08:04:51.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.233+0000 7f4198f29700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4194144a80 con 0x7f41940adf00 2023-11-24T08:04:51.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.233+0000 7f4192d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f419406c540 0x7f41940b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.233+0000 7f419259c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f41941446a0 0x7f41940b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42854/0 (socket says 172.21.15.153:42854) 2023-11-24T08:04:51.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.233+0000 7f419259c700 1 -- 172.21.15.153:0/3573305521 learned_addr learned my addr 172.21.15.153:0/3573305521 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:51.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.233+0000 7f4191d9b700 1 --2- 172.21.15.153:0/3573305521 >> v2:172.21.15.164:3300/0 conn(0x7f41940adf00 0x7f419406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.234+0000 7f4192d9d700 1 -- 172.21.15.153:0/3573305521 >> v2:172.21.15.164:3300/0 conn(0x7f41940adf00 msgr2=0x7f419406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:51.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.234+0000 7f4192d9d700 1 --2- 172.21.15.153:0/3573305521 >> v2:172.21.15.164:3300/0 conn(0x7f41940adf00 0x7f419406c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.234+0000 7f4192d9d700 1 -- 172.21.15.153:0/3573305521 >> v1:172.21.15.153:6789/0 conn(0x7f41941446a0 legacy=0x7f41940b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.234+0000 7f419159a700 1 -- 172.21.15.153:0/3573305521 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557002730 0 0) 0x7f41940af950 con 0x7f41941446a0 2023-11-24T08:04:51.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.234+0000 7f4192d9d700 1 -- 172.21.15.153:0/3573305521 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41940afc30 con 0x7f419406c540 2023-11-24T08:04:51.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.234+0000 7f4192d9d700 1 --2- 172.21.15.153:0/3573305521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f419406c540 0x7f41940b3d40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f419409f030 tx=0x7f418c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675c2be50b1c9176 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.234+0000 7f419159a700 1 -- 172.21.15.153:0/3573305521 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c00e070 con 0x7f419406c540 2023-11-24T08:04:51.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.234+0000 7f419159a700 1 -- 172.21.15.153:0/3573305521 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c00bb90 con 0x7f419406c540 2023-11-24T08:04:51.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.234+0000 7f419159a700 1 -- 172.21.15.153:0/3573305521 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c012430 con 0x7f419406c540 2023-11-24T08:04:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.234+0000 7f4198f29700 1 -- 172.21.15.153:0/3573305521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f419406c540 msgr2=0x7f41940b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.234+0000 7f4198f29700 1 --2- 172.21.15.153:0/3573305521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f419406c540 0x7f41940b3d40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f419409f030 tx=0x7f418c00b330 comp rx=0 tx=0).stop 2023-11-24T08:04:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.235+0000 7f4198f29700 1 -- 172.21.15.153:0/3573305521 shutdown_connections 2023-11-24T08:04:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.235+0000 7f4198f29700 1 --2- 172.21.15.153:0/3573305521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f419406c540 0x7f41940b3d40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.235+0000 7f4198f29700 1 --2- 172.21.15.153:0/3573305521 >> v2:172.21.15.164:3300/0 conn(0x7f41940adf00 0x7f419406c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.235+0000 7f4198f29700 1 -- 172.21.15.153:0/3573305521 >> 172.21.15.153:0/3573305521 conn(0x7f4194071b90 msgr2=0x7f4194071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.235+0000 7f4198f29700 1 -- 172.21.15.153:0/3573305521 shutdown_connections 2023-11-24T08:04:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.235+0000 7f4198f29700 1 -- 172.21.15.153:0/3573305521 wait complete. 2023-11-24T08:04:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.236+0000 7f4198f29700 1 Processor -- start 2023-11-24T08:04:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.236+0000 7f4198f29700 1 -- start start 2023-11-24T08:04:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4198f29700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f419406c540 0x7f419413dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4198f29700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41940adf00 0x7f419415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4198f29700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41941446a0 0x7f419413bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4198f29700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4194138c10 con 0x7f41941446a0 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4198f29700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419413c0e0 con 0x7f41940adf00 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4198f29700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419413c360 con 0x7f419406c540 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4192d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41941446a0 0x7f419413bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4192d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41941446a0 0x7f419413bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36760/0 (socket says 172.21.15.153:36760) 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4192d9d700 1 -- 172.21.15.153:0/2496269873 learned_addr learned my addr 172.21.15.153:0/2496269873 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f419259c700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f419406c540 0x7f419413dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4191d9b700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41940adf00 0x7f419415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4192d9d700 1 -- 172.21.15.153:0/2496269873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f419406c540 msgr2=0x7f419413dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4192d9d700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f419406c540 0x7f419413dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4192d9d700 1 -- 172.21.15.153:0/2496269873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41940adf00 msgr2=0x7f419415a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4192d9d700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41940adf00 0x7f419415a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4192d9d700 1 -- 172.21.15.153:0/2496269873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c009a70 con 0x7f41941446a0 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4192d9d700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41941446a0 0x7f419413bba0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f418c014040 tx=0x7f418c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4182ffd700 1 -- 172.21.15.153:0/2496269873 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c020070 con 0x7f41941446a0 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4182ffd700 1 -- 172.21.15.153:0/2496269873 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c0098f0 con 0x7f41941446a0 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.237+0000 7f4182ffd700 1 -- 172.21.15.153:0/2496269873 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c012430 con 0x7f41941446a0 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.238+0000 7f4198f29700 1 -- 172.21.15.153:0/2496269873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419413c640 con 0x7f41941446a0 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.238+0000 7f4198f29700 1 -- 172.21.15.153:0/2496269873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419413cc00 con 0x7f41941446a0 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.238+0000 7f4198f29700 1 -- 172.21.15.153:0/2496269873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41940753f0 con 0x7f41941446a0 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.239+0000 7f4182ffd700 1 -- 172.21.15.153:0/2496269873 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f418c024070 con 0x7f41941446a0 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.239+0000 7f4182ffd700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f417406aed0 0x7f417406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.239+0000 7f4182ffd700 1 -- 172.21.15.153:0/2496269873 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f418c08c4c0 con 0x7f41941446a0 2023-11-24T08:04:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.239+0000 7f419259c700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f417406aed0 0x7f417406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.240+0000 7f419259c700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f417406aed0 0x7f417406d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4188000f60 tx=0x7f4188007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.244+0000 7f4182ffd700 1 -- 172.21.15.153:0/2496269873 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f418c057680 con 0x7f41941446a0 2023-11-24T08:04:51.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.452+0000 7f4198f29700 1 -- 172.21.15.153:0/2496269873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f419413cd90 con 0x7f41941446a0 2023-11-24T08:04:51.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.452+0000 7f4182ffd700 1 -- 172.21.15.153:0/2496269873 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f418c05aca0 con 0x7f41941446a0 2023-11-24T08:04:51.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 -- 172.21.15.153:0/2496269873 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f417406aed0 msgr2=0x7f417406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f417406aed0 0x7f417406d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4188000f60 tx=0x7f4188007e70 comp rx=0 tx=0).stop 2023-11-24T08:04:51.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 -- 172.21.15.153:0/2496269873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41941446a0 msgr2=0x7f419413bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41941446a0 0x7f419413bba0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f418c014040 tx=0x7f418c004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 -- 172.21.15.153:0/2496269873 shutdown_connections 2023-11-24T08:04:51.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f417406aed0 0x7f417406d390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41941446a0 0x7f419413bba0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f419406c540 0x7f419413dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 --2- 172.21.15.153:0/2496269873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41940adf00 0x7f419415a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 -- 172.21.15.153:0/2496269873 >> 172.21.15.153:0/2496269873 conn(0x7f4194071b90 msgr2=0x7f41940b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:51.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 -- 172.21.15.153:0/2496269873 shutdown_connections 2023-11-24T08:04:51.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.454+0000 7f4198f29700 1 -- 172.21.15.153:0/2496269873 wait complete. 2023-11-24T08:04:51.457 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2023-11-24T08:04:51.468 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-24T08:04:51.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:51.468 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-24T08:04:51.509 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:04:51.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:51.510 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T08:04:51.569 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T08:04:51.570 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:51.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.690+0000 7f3a387b5700 1 Processor -- start 2023-11-24T08:04:51.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.690+0000 7f3a387b5700 1 -- start start 2023-11-24T08:04:51.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a387b5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a3015e080 0x7f3a300b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a387b5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a300af4d0 0x7f3a300afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a387b5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a300ae430 con 0x7f3a3006c000 2023-11-24T08:04:51.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a387b5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300af0b0 con 0x7f3a3015e080 2023-11-24T08:04:51.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a387b5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300b05a0 con 0x7f3a300af4d0 2023-11-24T08:04:51.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a36551700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a3015e080 0x7f3a300b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a36d52700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3a3006c000 0x7f3a30073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42872/0 (socket says 172.21.15.153:42872) 2023-11-24T08:04:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a36d52700 1 -- 172.21.15.153:0/1345021979 learned_addr learned my addr 172.21.15.153:0/1345021979 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a35d50700 1 --2- 172.21.15.153:0/1345021979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a300af4d0 0x7f3a300afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a36551700 1 -- 172.21.15.153:0/1345021979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a300af4d0 msgr2=0x7f3a300afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a36551700 1 --2- 172.21.15.153:0/1345021979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a300af4d0 0x7f3a300afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a36551700 1 -- 172.21.15.153:0/1345021979 >> v1:172.21.15.153:6789/0 conn(0x7f3a3006c000 legacy=0x7f3a30073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a3554f700 1 -- 172.21.15.153:0/1345021979 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706080426 0 0) 0x7f3a300ae430 con 0x7f3a3006c000 2023-11-24T08:04:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a36551700 1 -- 172.21.15.153:0/1345021979 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a300ae710 con 0x7f3a3015e080 2023-11-24T08:04:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a36551700 1 --2- 172.21.15.153:0/1345021979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3015e080 0x7f3a300b5050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009870 tx=0x7f3a2c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a550a37c0cfa6c9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.691+0000 7f3a3554f700 1 -- 172.21.15.153:0/1345021979 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c011830 con 0x7f3a3015e080 2023-11-24T08:04:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.692+0000 7f3a3554f700 1 -- 172.21.15.153:0/1345021979 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c011990 con 0x7f3a3015e080 2023-11-24T08:04:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.692+0000 7f3a3554f700 1 -- 172.21.15.153:0/1345021979 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c011d20 con 0x7f3a3015e080 2023-11-24T08:04:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.692+0000 7f3a387b5700 1 -- 172.21.15.153:0/1345021979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3015e080 msgr2=0x7f3a300b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.692+0000 7f3a387b5700 1 --2- 172.21.15.153:0/1345021979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3015e080 0x7f3a300b5050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009870 tx=0x7f3a2c009b80 comp rx=0 tx=0).stop 2023-11-24T08:04:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.692+0000 7f3a387b5700 1 -- 172.21.15.153:0/1345021979 shutdown_connections 2023-11-24T08:04:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.692+0000 7f3a387b5700 1 --2- 172.21.15.153:0/1345021979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3015e080 0x7f3a300b5050 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.692+0000 7f3a387b5700 1 --2- 172.21.15.153:0/1345021979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a300af4d0 0x7f3a300afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.692+0000 7f3a387b5700 1 -- 172.21.15.153:0/1345021979 >> 172.21.15.153:0/1345021979 conn(0x7f3a30071b90 msgr2=0x7f3a30071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.692+0000 7f3a387b5700 1 -- 172.21.15.153:0/1345021979 shutdown_connections 2023-11-24T08:04:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.692+0000 7f3a387b5700 1 -- 172.21.15.153:0/1345021979 wait complete. 2023-11-24T08:04:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.693+0000 7f3a387b5700 1 Processor -- start 2023-11-24T08:04:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.693+0000 7f3a387b5700 1 -- start start 2023-11-24T08:04:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a387b5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3006c000 0x7f3a301f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a387b5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a300af4d0 0x7f3a301474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a387b5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3015e080 0x7f3a30159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a387b5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300cefb0 con 0x7f3a3006c000 2023-11-24T08:04:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a387b5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30147a10 con 0x7f3a300af4d0 2023-11-24T08:04:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a387b5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30157e20 con 0x7f3a3015e080 2023-11-24T08:04:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a36551700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3006c000 0x7f3a301f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a36551700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3006c000 0x7f3a301f4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36770/0 (socket says 172.21.15.153:36770) 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a36551700 1 -- 172.21.15.153:0/1217366693 learned_addr learned my addr 172.21.15.153:0/1217366693 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a36d52700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3015e080 0x7f3a30159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a35d50700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a300af4d0 0x7f3a301474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a36551700 1 -- 172.21.15.153:0/1217366693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3015e080 msgr2=0x7f3a30159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a36551700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3015e080 0x7f3a30159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a36551700 1 -- 172.21.15.153:0/1217366693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a300af4d0 msgr2=0x7f3a301474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a36551700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a300af4d0 0x7f3a301474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.694+0000 7f3a36551700 1 -- 172.21.15.153:0/1217366693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0094a0 con 0x7f3a3006c000 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.695+0000 7f3a36551700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3006c000 0x7f3a301f4a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0097c0 tx=0x7f3a2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.695+0000 7f3a26ffd700 1 -- 172.21.15.153:0/1217366693 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0036a0 con 0x7f3a3006c000 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.695+0000 7f3a26ffd700 1 -- 172.21.15.153:0/1217366693 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c01e070 con 0x7f3a3006c000 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.695+0000 7f3a26ffd700 1 -- 172.21.15.153:0/1217366693 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c003a80 con 0x7f3a3006c000 2023-11-24T08:04:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.695+0000 7f3a387b5700 1 -- 172.21.15.153:0/1217366693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a30158100 con 0x7f3a3006c000 2023-11-24T08:04:51.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.695+0000 7f3a387b5700 1 -- 172.21.15.153:0/1217366693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a301586c0 con 0x7f3a3006c000 2023-11-24T08:04:51.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.696+0000 7f3a387b5700 1 -- 172.21.15.153:0/1217366693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a30158a30 con 0x7f3a3006c000 2023-11-24T08:04:51.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.696+0000 7f3a26ffd700 1 -- 172.21.15.153:0/1217366693 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a2c003be0 con 0x7f3a3006c000 2023-11-24T08:04:51.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.697+0000 7f3a26ffd700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1406aed0 0x7f3a1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.697+0000 7f3a26ffd700 1 -- 172.21.15.153:0/1217366693 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a2c08a4b0 con 0x7f3a3006c000 2023-11-24T08:04:51.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.697+0000 7f3a35d50700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1406aed0 0x7f3a1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.697+0000 7f3a35d50700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1406aed0 0x7f3a1406d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3a30154820 tx=0x7f3a20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.701+0000 7f3a26ffd700 1 -- 172.21.15.153:0/1217366693 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a2c0555f0 con 0x7f3a3006c000 2023-11-24T08:04:51.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.939+0000 7f3a387b5700 1 -- 172.21.15.153:0/1217366693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a300753f0 con 0x7f3a3006c000 2023-11-24T08:04:51.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.939+0000 7f3a26ffd700 1 -- 172.21.15.153:0/1217366693 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f3a2c058c10 con 0x7f3a3006c000 2023-11-24T08:04:51.996 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:51.996 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/157182640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":157182640},{"type":"v1","addr":"172.21.15.153:6837","nonce":157182640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2853134113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2853134113},{"type":"v1","addr":"172.21.15.153:6836","nonce":2853134113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1191113201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1191113201},{"type":"v1","addr":"172.21.15.164:6833","nonce":1191113201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:12.137876+0000","modified":"2023-11-24T08:04:15.171907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1557353565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1557353565},{"type":"v1","addr":"172.21.15.164:6835","nonce":1557353565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:51.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 -- 172.21.15.153:0/1217366693 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1406aed0 msgr2=0x7f3a1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1406aed0 0x7f3a1406d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3a30154820 tx=0x7f3a20008040 comp rx=0 tx=0).stop 2023-11-24T08:04:51.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 -- 172.21.15.153:0/1217366693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3006c000 msgr2=0x7f3a301f4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3006c000 0x7f3a301f4a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0097c0 tx=0x7f3a2c004750 comp rx=0 tx=0).stop 2023-11-24T08:04:51.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 -- 172.21.15.153:0/1217366693 shutdown_connections 2023-11-24T08:04:51.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3015e080 0x7f3a30159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1406aed0 0x7f3a1406d390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3006c000 0x7f3a301f4a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 --2- 172.21.15.153:0/1217366693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a300af4d0 0x7f3a301474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 -- 172.21.15.153:0/1217366693 >> 172.21.15.153:0/1217366693 conn(0x7f3a30071b90 msgr2=0x7f3a300b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:51.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 -- 172.21.15.153:0/1217366693 shutdown_connections 2023-11-24T08:04:51.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:51.941+0000 7f3a387b5700 1 -- 172.21.15.153:0/1217366693 wait complete. 2023-11-24T08:04:51.999 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2023-11-24T08:04:51.999 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:52.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.120+0000 7f18f389d700 1 Processor -- start 2023-11-24T08:04:52.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.120+0000 7f18f389d700 1 -- start start 2023-11-24T08:04:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f389d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f18ec13e000 0x7f18ec15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f389d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18ec15efb0 0x7f18ec0cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f389d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18ec0cfd40 0x7f18ec15b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f389d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ec15f430 con 0x7f18ec0cfd40 2023-11-24T08:04:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f389d700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ec0b4290 con 0x7f18ec13e000 2023-11-24T08:04:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f389d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec13e570 con 0x7f18ec15efb0 2023-11-24T08:04:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f1e3a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18ec0cfd40 0x7f18ec15b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f1e3a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18ec0cfd40 0x7f18ec15b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36782/0 (socket says 172.21.15.153:36782) 2023-11-24T08:04:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f1e3a700 1 -- 172.21.15.153:0/144408978 learned_addr learned my addr 172.21.15.153:0/144408978 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f1e3a700 1 -- 172.21.15.153:0/144408978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18ec15efb0 msgr2=0x7f18ec0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f1639700 1 --2- 172.21.15.153:0/144408978 >> v2:172.21.15.164:3300/0 conn(0x7f18ec13e000 0x7f18ec15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f0e38700 1 --2- 172.21.15.153:0/144408978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18ec15efb0 0x7f18ec0cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f1e3a700 1 --2- 172.21.15.153:0/144408978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18ec15efb0 0x7f18ec0cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f1e3a700 1 -- 172.21.15.153:0/144408978 >> v2:172.21.15.164:3300/0 conn(0x7f18ec13e000 msgr2=0x7f18ec15ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f1e3a700 1 --2- 172.21.15.153:0/144408978 >> v2:172.21.15.164:3300/0 conn(0x7f18ec13e000 0x7f18ec15ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f1e3a700 1 -- 172.21.15.153:0/144408978 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec0d05d0 con 0x7f18ec0cfd40 2023-11-24T08:04:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f1639700 1 --2- 172.21.15.153:0/144408978 >> v2:172.21.15.164:3300/0 conn(0x7f18ec13e000 0x7f18ec15ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18f1e3a700 1 --2- 172.21.15.153:0/144408978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18ec0cfd40 0x7f18ec15b430 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0b5a10 tx=0x7f18e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2f4d8bfa5dcc47 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18e3fff700 1 -- 172.21.15.153:0/144408978 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e400e070 con 0x7f18ec0cfd40 2023-11-24T08:04:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18e3fff700 1 -- 172.21.15.153:0/144408978 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e400b9c0 con 0x7f18ec0cfd40 2023-11-24T08:04:52.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.121+0000 7f18e3fff700 1 -- 172.21.15.153:0/144408978 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e400bd70 con 0x7f18ec0cfd40 2023-11-24T08:04:52.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.122+0000 7f18f389d700 1 -- 172.21.15.153:0/144408978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18ec0cfd40 msgr2=0x7f18ec15b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.122+0000 7f18f389d700 1 --2- 172.21.15.153:0/144408978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18ec0cfd40 0x7f18ec15b430 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0b5a10 tx=0x7f18e400b330 comp rx=0 tx=0).stop 2023-11-24T08:04:52.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.122+0000 7f18f389d700 1 -- 172.21.15.153:0/144408978 shutdown_connections 2023-11-24T08:04:52.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.122+0000 7f18f389d700 1 --2- 172.21.15.153:0/144408978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18ec0cfd40 0x7f18ec15b430 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.122+0000 7f18f389d700 1 --2- 172.21.15.153:0/144408978 >> v2:172.21.15.164:3300/0 conn(0x7f18ec13e000 0x7f18ec15ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.122+0000 7f18f389d700 1 --2- 172.21.15.153:0/144408978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18ec15efb0 0x7f18ec0cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.122+0000 7f18f389d700 1 -- 172.21.15.153:0/144408978 >> 172.21.15.153:0/144408978 conn(0x7f18ec072990 msgr2=0x7f18ec06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.122+0000 7f18f389d700 1 -- 172.21.15.153:0/144408978 shutdown_connections 2023-11-24T08:04:52.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.122+0000 7f18f389d700 1 -- 172.21.15.153:0/144408978 wait complete. 2023-11-24T08:04:52.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.123+0000 7f18f389d700 1 Processor -- start 2023-11-24T08:04:52.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.123+0000 7f18f389d700 1 -- start start 2023-11-24T08:04:52.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f389d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18ec0cfd40 0x7f18ec143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f389d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18ec13e000 0x7f18ec13ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f389d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18ec15efb0 0x7f18ec13b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f389d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec13b9e0 con 0x7f18ec13e000 2023-11-24T08:04:52.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f389d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec13bcc0 con 0x7f18ec15efb0 2023-11-24T08:04:52.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f389d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec13bfa0 con 0x7f18ec0cfd40 2023-11-24T08:04:52.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f0e38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18ec13e000 0x7f18ec13ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f0e38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18ec13e000 0x7f18ec13ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36786/0 (socket says 172.21.15.153:36786) 2023-11-24T08:04:52.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f0e38700 1 -- 172.21.15.153:0/431730646 learned_addr learned my addr 172.21.15.153:0/431730646 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:52.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f1e3a700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18ec15efb0 0x7f18ec13b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f1639700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18ec0cfd40 0x7f18ec143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f0e38700 1 -- 172.21.15.153:0/431730646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18ec0cfd40 msgr2=0x7f18ec143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f0e38700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18ec0cfd40 0x7f18ec143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f0e38700 1 -- 172.21.15.153:0/431730646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18ec15efb0 msgr2=0x7f18ec13b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f0e38700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18ec15efb0 0x7f18ec13b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f0e38700 1 -- 172.21.15.153:0/431730646 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4009b30 con 0x7f18ec13e000 2023-11-24T08:04:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.124+0000 7f18f1e3a700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18ec15efb0 0x7f18ec13b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.125+0000 7f18f0e38700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18ec13e000 0x7f18ec13ca80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00c7f0 tx=0x7f18dc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.125+0000 7f18e1ffb700 1 -- 172.21.15.153:0/431730646 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc004220 con 0x7f18ec13e000 2023-11-24T08:04:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.125+0000 7f18e1ffb700 1 -- 172.21.15.153:0/431730646 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc004380 con 0x7f18ec13e000 2023-11-24T08:04:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.125+0000 7f18f389d700 1 -- 172.21.15.153:0/431730646 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec13c280 con 0x7f18ec13e000 2023-11-24T08:04:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.125+0000 7f18e1ffb700 1 -- 172.21.15.153:0/431730646 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc0036a0 con 0x7f18ec13e000 2023-11-24T08:04:52.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.125+0000 7f18f389d700 1 -- 172.21.15.153:0/431730646 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec144320 con 0x7f18ec13e000 2023-11-24T08:04:52.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.126+0000 7f18f389d700 1 -- 172.21.15.153:0/431730646 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec067f60 con 0x7f18ec13e000 2023-11-24T08:04:52.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.126+0000 7f18e1ffb700 1 -- 172.21.15.153:0/431730646 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f18dc003800 con 0x7f18ec13e000 2023-11-24T08:04:52.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.126+0000 7f18e1ffb700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f18d006af00 0x7f18d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.127+0000 7f18e1ffb700 1 -- 172.21.15.153:0/431730646 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18dc089150 con 0x7f18ec13e000 2023-11-24T08:04:52.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.127+0000 7f18f1639700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f18d006af00 0x7f18d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.127+0000 7f18f1639700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f18d006af00 0x7f18d006d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f18e8006fd0 tx=0x7f18e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.131+0000 7f18e1ffb700 1 -- 172.21.15.153:0/431730646 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18dc054170 con 0x7f18ec13e000 2023-11-24T08:04:52.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.327+0000 7f18f389d700 1 -- 172.21.15.153:0/431730646 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18ec0b5fb0 con 0x7f18ec13e000 2023-11-24T08:04:52.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.328+0000 7f18e1ffb700 1 -- 172.21.15.153:0/431730646 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f18dc057790 con 0x7f18ec13e000 2023-11-24T08:04:52.330 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:52.330 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:52.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 -- 172.21.15.153:0/431730646 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f18d006af00 msgr2=0x7f18d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f18d006af00 0x7f18d006d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f18e8006fd0 tx=0x7f18e8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:52.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 -- 172.21.15.153:0/431730646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18ec13e000 msgr2=0x7f18ec13ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18ec13e000 0x7f18ec13ca80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00c7f0 tx=0x7f18dc00cb00 comp rx=0 tx=0).stop 2023-11-24T08:04:52.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 -- 172.21.15.153:0/431730646 shutdown_connections 2023-11-24T08:04:52.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18ec15efb0 0x7f18ec13b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18ec0cfd40 0x7f18ec143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f18d006af00 0x7f18d006d3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 --2- 172.21.15.153:0/431730646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18ec13e000 0x7f18ec13ca80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 -- 172.21.15.153:0/431730646 >> 172.21.15.153:0/431730646 conn(0x7f18ec072990 msgr2=0x7f18ec140c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 -- 172.21.15.153:0/431730646 shutdown_connections 2023-11-24T08:04:52.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.330+0000 7f18f389d700 1 -- 172.21.15.153:0/431730646 wait complete. 2023-11-24T08:04:52.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:09.853312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:11.105065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:52.345 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:52.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.469+0000 7fa5baadf700 1 Processor -- start 2023-11-24T08:04:52.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.469+0000 7fa5baadf700 1 -- start start 2023-11-24T08:04:52.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5baadf700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa5b415e160 0x7fa5b40b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5baadf700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5b40746a0 0x7fa5b406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5baadf700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b40b3c60 con 0x7fa5b40afc90 2023-11-24T08:04:52.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5baadf700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b40b4500 con 0x7fa5b40746a0 2023-11-24T08:04:52.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5baadf700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b40b58c0 con 0x7fa5b415e160 2023-11-24T08:04:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5b907c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5b40746a0 0x7fa5b406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5b907c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5b40746a0 0x7fa5b406d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36794/0 (socket says 172.21.15.153:36794) 2023-11-24T08:04:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5b907c700 1 -- 172.21.15.153:0/893298613 learned_addr learned my addr 172.21.15.153:0/893298613 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5b907c700 1 -- 172.21.15.153:0/893298613 >> v2:172.21.15.164:3300/0 conn(0x7fa5b415e160 msgr2=0x7fa5b40b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5b907c700 1 --2- 172.21.15.153:0/893298613 >> v2:172.21.15.164:3300/0 conn(0x7fa5b415e160 0x7fa5b40b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5b907c700 1 -- 172.21.15.153:0/893298613 >> v1:172.21.15.164:6789/0 conn(0x7fa5b40afc90 legacy=0x7fa5b4073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5b907c700 1 -- 172.21.15.153:0/893298613 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b40b0140 con 0x7fa5b40746a0 2023-11-24T08:04:52.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5b907c700 1 --2- 172.21.15.153:0/893298613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b40746a0 0x7fa5b406d930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa5b409efa0 tx=0x7fa5ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0377ab193d5b1e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.470+0000 7fa5b37fe700 1 -- 172.21.15.153:0/893298613 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00e070 con 0x7fa5b40746a0 2023-11-24T08:04:52.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.471+0000 7fa5b37fe700 1 -- 172.21.15.153:0/893298613 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac003a20 con 0x7fa5b40746a0 2023-11-24T08:04:52.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.471+0000 7fa5b37fe700 1 -- 172.21.15.153:0/893298613 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac003dd0 con 0x7fa5b40746a0 2023-11-24T08:04:52.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.471+0000 7fa5baadf700 1 -- 172.21.15.153:0/893298613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b40746a0 msgr2=0x7fa5b406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.471+0000 7fa5baadf700 1 --2- 172.21.15.153:0/893298613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b40746a0 0x7fa5b406d930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa5b409efa0 tx=0x7fa5ac00b330 comp rx=0 tx=0).stop 2023-11-24T08:04:52.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.471+0000 7fa5baadf700 1 -- 172.21.15.153:0/893298613 shutdown_connections 2023-11-24T08:04:52.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.471+0000 7fa5baadf700 1 --2- 172.21.15.153:0/893298613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b40746a0 0x7fa5b406d930 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.471+0000 7fa5baadf700 1 --2- 172.21.15.153:0/893298613 >> v2:172.21.15.164:3300/0 conn(0x7fa5b415e160 0x7fa5b40b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.471+0000 7fa5baadf700 1 -- 172.21.15.153:0/893298613 >> 172.21.15.153:0/893298613 conn(0x7fa5b40d0bf0 msgr2=0x7fa5b40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.471+0000 7fa5baadf700 1 -- 172.21.15.153:0/893298613 shutdown_connections 2023-11-24T08:04:52.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.471+0000 7fa5baadf700 1 -- 172.21.15.153:0/893298613 wait complete. 2023-11-24T08:04:52.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.472+0000 7fa5baadf700 1 Processor -- start 2023-11-24T08:04:52.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.472+0000 7fa5baadf700 1 -- start start 2023-11-24T08:04:52.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.473+0000 7fa5baadf700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5b40746a0 0x7fa5b41f7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.473+0000 7fa5baadf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b40afc90 0x7fa5b4155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.473+0000 7fa5baadf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b415e160 0x7fa5b41520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.473+0000 7fa5baadf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b41f80a0 con 0x7fa5b415e160 2023-11-24T08:04:52.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.473+0000 7fa5baadf700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b415e750 con 0x7fa5b40afc90 2023-11-24T08:04:52.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.473+0000 7fa5baadf700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b415f5b0 con 0x7fa5b40746a0 2023-11-24T08:04:52.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.473+0000 7fa5b907c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b415e160 0x7fa5b41520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.473+0000 7fa5b907c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b415e160 0x7fa5b41520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36800/0 (socket says 172.21.15.153:36800) 2023-11-24T08:04:52.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.473+0000 7fa5b907c700 1 -- 172.21.15.153:0/76298063 learned_addr learned my addr 172.21.15.153:0/76298063 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:52.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.473+0000 7fa5b3fff700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b40afc90 0x7fa5b4155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.473+0000 7fa5b887b700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5b40746a0 0x7fa5b41f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.474+0000 7fa5b907c700 1 -- 172.21.15.153:0/76298063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5b40746a0 msgr2=0x7fa5b41f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.474+0000 7fa5b907c700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5b40746a0 0x7fa5b41f7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.474+0000 7fa5b907c700 1 -- 172.21.15.153:0/76298063 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b40afc90 msgr2=0x7fa5b4155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.474+0000 7fa5b907c700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b40afc90 0x7fa5b4155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.474+0000 7fa5b907c700 1 -- 172.21.15.153:0/76298063 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac009b30 con 0x7fa5b415e160 2023-11-24T08:04:52.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.474+0000 7fa5b907c700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b415e160 0x7fa5b41520d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac015040 tx=0x7fa5ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.474+0000 7fa5b17fa700 1 -- 172.21.15.153:0/76298063 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0094f0 con 0x7fa5b415e160 2023-11-24T08:04:52.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.474+0000 7fa5b17fa700 1 -- 172.21.15.153:0/76298063 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac004240 con 0x7fa5b415e160 2023-11-24T08:04:52.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.474+0000 7fa5baadf700 1 -- 172.21.15.153:0/76298063 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b415e9a0 con 0x7fa5b415e160 2023-11-24T08:04:52.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.474+0000 7fa5b17fa700 1 -- 172.21.15.153:0/76298063 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0045f0 con 0x7fa5b415e160 2023-11-24T08:04:52.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.474+0000 7fa5baadf700 1 -- 172.21.15.153:0/76298063 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b415f240 con 0x7fa5b415e160 2023-11-24T08:04:52.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.475+0000 7fa5baadf700 1 -- 172.21.15.153:0/76298063 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b4068fb0 con 0x7fa5b415e160 2023-11-24T08:04:52.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.475+0000 7fa5b17fa700 1 -- 172.21.15.153:0/76298063 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa5ac019070 con 0x7fa5b415e160 2023-11-24T08:04:52.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.476+0000 7fa5b17fa700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa59806aed0 0x7fa59806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.476+0000 7fa5b17fa700 1 -- 172.21.15.153:0/76298063 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5ac08a440 con 0x7fa5b415e160 2023-11-24T08:04:52.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.476+0000 7fa5b887b700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa59806aed0 0x7fa59806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.476+0000 7fa5b887b700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa59806aed0 0x7fa59806d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009970 tx=0x7fa5a8009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.480+0000 7fa5b17fa700 1 -- 172.21.15.153:0/76298063 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5ac059010 con 0x7fa5b415e160 2023-11-24T08:04:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.669+0000 7fa5baadf700 1 -- 172.21.15.153:0/76298063 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5b415f6f0 con 0x7fa5b415e160 2023-11-24T08:04:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.669+0000 7fa5b17fa700 1 -- 172.21.15.153:0/76298063 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5ac020020 con 0x7fa5b415e160 2023-11-24T08:04:52.671 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:04:52.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 -- 172.21.15.153:0/76298063 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa59806aed0 msgr2=0x7fa59806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa59806aed0 0x7fa59806d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009970 tx=0x7fa5a8009110 comp rx=0 tx=0).stop 2023-11-24T08:04:52.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 -- 172.21.15.153:0/76298063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b415e160 msgr2=0x7fa5b41520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b415e160 0x7fa5b41520d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac015040 tx=0x7fa5ac004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 -- 172.21.15.153:0/76298063 shutdown_connections 2023-11-24T08:04:52.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa59806aed0 0x7fa59806d390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b415e160 0x7fa5b41520d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5b40746a0 0x7fa5b41f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 --2- 172.21.15.153:0/76298063 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b40afc90 0x7fa5b4155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 -- 172.21.15.153:0/76298063 >> 172.21.15.153:0/76298063 conn(0x7fa5b40d0bf0 msgr2=0x7fa5b406e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 -- 172.21.15.153:0/76298063 shutdown_connections 2023-11-24T08:04:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.671+0000 7fa5baadf700 1 -- 172.21.15.153:0/76298063 wait complete. 2023-11-24T08:04:52.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:52.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.810+0000 7fe910fd5700 1 Processor -- start 2023-11-24T08:04:52.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.810+0000 7fe910fd5700 1 -- start start 2023-11-24T08:04:52.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe910fd5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe90c1587f0 0x7fe90c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe910fd5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe90c15b370 0x7fe90c15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe910fd5700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90c06b530 con 0x7fe90c0b3c60 2023-11-24T08:04:52.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe910fd5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90c0ae5e0 con 0x7fe90c1587f0 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe910fd5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c15be30 con 0x7fe90c15b370 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe90a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe90c1587f0 0x7fe90c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe90a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe90c1587f0 0x7fe90c06aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36804/0 (socket says 172.21.15.153:36804) 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe90a59c700 1 -- 172.21.15.153:0/458112993 learned_addr learned my addr 172.21.15.153:0/458112993 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe909d9b700 1 --2- 172.21.15.153:0/458112993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe90c15b370 0x7fe90c15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe90a59c700 1 -- 172.21.15.153:0/458112993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe90c15b370 msgr2=0x7fe90c15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe90a59c700 1 --2- 172.21.15.153:0/458112993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe90c15b370 0x7fe90c15b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe90a59c700 1 -- 172.21.15.153:0/458112993 >> v1:172.21.15.164:6789/0 conn(0x7fe90c0b3c60 legacy=0x7fe90c0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe90a59c700 1 -- 172.21.15.153:0/458112993 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c15c110 con 0x7fe90c1587f0 2023-11-24T08:04:52.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.811+0000 7fe90a59c700 1 --2- 172.21.15.153:0/458112993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe90c1587f0 0x7fe90c06aff0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe9000098f0 tx=0x7fe900009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af93ee1df39eeff6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.812+0000 7fe90959a700 1 -- 172.21.15.153:0/458112993 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000b8a0 con 0x7fe90c1587f0 2023-11-24T08:04:52.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.812+0000 7fe90959a700 1 -- 172.21.15.153:0/458112993 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90000ba00 con 0x7fe90c1587f0 2023-11-24T08:04:52.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.812+0000 7fe90959a700 1 -- 172.21.15.153:0/458112993 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000bd90 con 0x7fe90c1587f0 2023-11-24T08:04:52.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.812+0000 7fe910fd5700 1 -- 172.21.15.153:0/458112993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe90c1587f0 msgr2=0x7fe90c06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.812+0000 7fe910fd5700 1 --2- 172.21.15.153:0/458112993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe90c1587f0 0x7fe90c06aff0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe9000098f0 tx=0x7fe900009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:52.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.812+0000 7fe910fd5700 1 -- 172.21.15.153:0/458112993 shutdown_connections 2023-11-24T08:04:52.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.812+0000 7fe910fd5700 1 --2- 172.21.15.153:0/458112993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe90c1587f0 0x7fe90c06aff0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.812+0000 7fe910fd5700 1 --2- 172.21.15.153:0/458112993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe90c15b370 0x7fe90c15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.812+0000 7fe910fd5700 1 -- 172.21.15.153:0/458112993 >> 172.21.15.153:0/458112993 conn(0x7fe90c0d0bf0 msgr2=0x7fe90c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.812+0000 7fe910fd5700 1 -- 172.21.15.153:0/458112993 shutdown_connections 2023-11-24T08:04:52.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.812+0000 7fe910fd5700 1 -- 172.21.15.153:0/458112993 wait complete. 2023-11-24T08:04:52.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.814+0000 7fe910fd5700 1 Processor -- start 2023-11-24T08:04:52.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.814+0000 7fe910fd5700 1 -- start start 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.814+0000 7fe910fd5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe90c0b3c60 0x7fe90c1f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.814+0000 7fe910fd5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe90c1587f0 0x7fe90c1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.814+0000 7fe910fd5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe90c15b370 0x7fe90c09d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.814+0000 7fe910fd5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c1f4b60 con 0x7fe90c0b3c60 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.814+0000 7fe910fd5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c09cd80 con 0x7fe90c1587f0 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.814+0000 7fe910fd5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c0afca0 con 0x7fe90c15b370 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.814+0000 7fe90a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe90c0b3c60 0x7fe90c1f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.814+0000 7fe90a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe90c0b3c60 0x7fe90c1f4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36810/0 (socket says 172.21.15.153:36810) 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.814+0000 7fe90a59c700 1 -- 172.21.15.153:0/212647037 learned_addr learned my addr 172.21.15.153:0/212647037 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe90a59c700 1 -- 172.21.15.153:0/212647037 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe90c15b370 msgr2=0x7fe90c09d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe90a59c700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe90c15b370 0x7fe90c09d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe90a59c700 1 -- 172.21.15.153:0/212647037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe90c1587f0 msgr2=0x7fe90c1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe909d9b700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe90c1587f0 0x7fe90c1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe90a59c700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe90c1587f0 0x7fe90c1566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe90a59c700 1 -- 172.21.15.153:0/212647037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900009550 con 0x7fe90c0b3c60 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe909d9b700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe90c1587f0 0x7fe90c1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe90a59c700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe90c0b3c60 0x7fe90c1f4620 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe900000c00 tx=0x7fe900004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe8faffd700 1 -- 172.21.15.153:0/212647037 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900004480 con 0x7fe90c0b3c60 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe8faffd700 1 -- 172.21.15.153:0/212647037 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90001f070 con 0x7fe90c0b3c60 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe910fd5700 1 -- 172.21.15.153:0/212647037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90c0aff80 con 0x7fe90c0b3c60 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe8faffd700 1 -- 172.21.15.153:0/212647037 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000038c0 con 0x7fe90c0b3c60 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.815+0000 7fe910fd5700 1 -- 172.21.15.153:0/212647037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90c0b0540 con 0x7fe90c0b3c60 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.816+0000 7fe910fd5700 1 -- 172.21.15.153:0/212647037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90c15ad80 con 0x7fe90c0b3c60 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.816+0000 7fe8faffd700 1 -- 172.21.15.153:0/212647037 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe900021030 con 0x7fe90c0b3c60 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.817+0000 7fe8faffd700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe8ec06aed0 0x7fe8ec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.817+0000 7fe8faffd700 1 -- 172.21.15.153:0/212647037 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe90008ab20 con 0x7fe90c0b3c60 2023-11-24T08:04:52.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.817+0000 7fe909d9b700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe8ec06aed0 0x7fe8ec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.817+0000 7fe909d9b700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe8ec06aed0 0x7fe8ec06d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009820 tx=0x7fe8fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:52.821+0000 7fe8faffd700 1 -- 172.21.15.153:0/212647037 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe900055d80 con 0x7fe90c0b3c60 2023-11-24T08:04:53.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.008+0000 7fe910fd5700 1 -- 172.21.15.153:0/212647037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe90c0b2210 con 0x7fe90c0b3c60 2023-11-24T08:04:53.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.009+0000 7fe8faffd700 1 -- 172.21.15.153:0/212647037 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe9000593a0 con 0x7fe90c0b3c60 2023-11-24T08:04:53.011 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:04:53.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 -- 172.21.15.153:0/212647037 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe8ec06aed0 msgr2=0x7fe8ec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe8ec06aed0 0x7fe8ec06d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009820 tx=0x7fe8fc008040 comp rx=0 tx=0).stop 2023-11-24T08:04:53.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 -- 172.21.15.153:0/212647037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe90c0b3c60 msgr2=0x7fe90c1f4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe90c0b3c60 0x7fe90c1f4620 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe900000c00 tx=0x7fe900004750 comp rx=0 tx=0).stop 2023-11-24T08:04:53.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 -- 172.21.15.153:0/212647037 shutdown_connections 2023-11-24T08:04:53.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe90c15b370 0x7fe90c09d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe8ec06aed0 0x7fe8ec06d390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe90c0b3c60 0x7fe90c1f4620 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 --2- 172.21.15.153:0/212647037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe90c1587f0 0x7fe90c1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 -- 172.21.15.153:0/212647037 >> 172.21.15.153:0/212647037 conn(0x7fe90c0d0bf0 msgr2=0x7fe90c0b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 -- 172.21.15.153:0/212647037 shutdown_connections 2023-11-24T08:04:53.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.011+0000 7fe910fd5700 1 -- 172.21.15.153:0/212647037 wait complete. 2023-11-24T08:04:53.025 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.147+0000 7fc6c97a0700 1 Processor -- start 2023-11-24T08:04:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.147+0000 7fc6c97a0700 1 -- start start 2023-11-24T08:04:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c97a0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc6c40b2270 0x7fc6c406aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c97a0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6c40b28b0 0x7fc6c406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c97a0700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40b2650 con 0x7fc6c406ba70 2023-11-24T08:04:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c97a0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c40d1240 con 0x7fc6c40b2270 2023-11-24T08:04:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c97a0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40b43d0 con 0x7fc6c40b28b0 2023-11-24T08:04:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c2ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc6c40b2270 0x7fc6c406aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c2ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc6c40b2270 0x7fc6c406aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36818/0 (socket says 172.21.15.153:36818) 2023-11-24T08:04:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c2ffd700 1 -- 172.21.15.153:0/1795221730 learned_addr learned my addr 172.21.15.153:0/1795221730 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c27fc700 1 --2- 172.21.15.153:0/1795221730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6c40b28b0 0x7fc6c406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c2ffd700 1 -- 172.21.15.153:0/1795221730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6c40b28b0 msgr2=0x7fc6c406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c2ffd700 1 --2- 172.21.15.153:0/1795221730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6c40b28b0 0x7fc6c406b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c2ffd700 1 -- 172.21.15.153:0/1795221730 >> v1:172.21.15.164:6789/0 conn(0x7fc6c406ba70 legacy=0x7fc6c4161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c2ffd700 1 -- 172.21.15.153:0/1795221730 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40b46b0 con 0x7fc6c40b2270 2023-11-24T08:04:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c2ffd700 1 --2- 172.21.15.153:0/1795221730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c40b2270 0x7fc6c406aff0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc6b40098f0 tx=0x7fc6b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f7b72e7459199e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c1ffb700 1 -- 172.21.15.153:0/1795221730 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b400b8a0 con 0x7fc6c40b2270 2023-11-24T08:04:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c1ffb700 1 -- 172.21.15.153:0/1795221730 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b400ba00 con 0x7fc6c40b2270 2023-11-24T08:04:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.148+0000 7fc6c1ffb700 1 -- 172.21.15.153:0/1795221730 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b400bd90 con 0x7fc6c40b2270 2023-11-24T08:04:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.149+0000 7fc6c97a0700 1 -- 172.21.15.153:0/1795221730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c40b2270 msgr2=0x7fc6c406aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.149+0000 7fc6c97a0700 1 --2- 172.21.15.153:0/1795221730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c40b2270 0x7fc6c406aff0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc6b40098f0 tx=0x7fc6b4009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.149+0000 7fc6c97a0700 1 -- 172.21.15.153:0/1795221730 shutdown_connections 2023-11-24T08:04:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.149+0000 7fc6c97a0700 1 --2- 172.21.15.153:0/1795221730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c40b2270 0x7fc6c406aff0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.149+0000 7fc6c97a0700 1 --2- 172.21.15.153:0/1795221730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6c40b28b0 0x7fc6c406b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.149+0000 7fc6c97a0700 1 -- 172.21.15.153:0/1795221730 >> 172.21.15.153:0/1795221730 conn(0x7fc6c40b3810 msgr2=0x7fc6c40b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.149+0000 7fc6c97a0700 1 -- 172.21.15.153:0/1795221730 shutdown_connections 2023-11-24T08:04:53.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.149+0000 7fc6c97a0700 1 -- 172.21.15.153:0/1795221730 wait complete. 2023-11-24T08:04:53.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.150+0000 7fc6c97a0700 1 Processor -- start 2023-11-24T08:04:53.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.150+0000 7fc6c97a0700 1 -- start start 2023-11-24T08:04:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c97a0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6c406ba70 0x7fc6c40cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c97a0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c40b2270 0x7fc6c41f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c97a0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6c40b28b0 0x7fc6c41458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c97a0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40cf3a0 con 0x7fc6c40b2270 2023-11-24T08:04:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c97a0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40c6710 con 0x7fc6c40b28b0 2023-11-24T08:04:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c97a0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40cede0 con 0x7fc6c406ba70 2023-11-24T08:04:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c27fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c40b2270 0x7fc6c41f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c27fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c40b2270 0x7fc6c41f3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36824/0 (socket says 172.21.15.153:36824) 2023-11-24T08:04:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c27fc700 1 -- 172.21.15.153:0/2524697380 learned_addr learned my addr 172.21.15.153:0/2524697380 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c2ffd700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6c406ba70 0x7fc6c40cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c37fe700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6c40b28b0 0x7fc6c41458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c27fc700 1 -- 172.21.15.153:0/2524697380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6c406ba70 msgr2=0x7fc6c40cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c27fc700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6c406ba70 0x7fc6c40cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c27fc700 1 -- 172.21.15.153:0/2524697380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6c40b28b0 msgr2=0x7fc6c41458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c27fc700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6c40b28b0 0x7fc6c41458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.151+0000 7fc6c27fc700 1 -- 172.21.15.153:0/2524697380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b4009550 con 0x7fc6c40b2270 2023-11-24T08:04:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.152+0000 7fc6c27fc700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c40b2270 0x7fc6c41f3920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800d800 tx=0x7fc6b800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.152+0000 7fc6ab7fe700 1 -- 172.21.15.153:0/2524697380 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80125f0 con 0x7fc6c40b2270 2023-11-24T08:04:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.152+0000 7fc6ab7fe700 1 -- 172.21.15.153:0/2524697380 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b8012750 con 0x7fc6c40b2270 2023-11-24T08:04:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.152+0000 7fc6c97a0700 1 -- 172.21.15.153:0/2524697380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c40cf0c0 con 0x7fc6c40b2270 2023-11-24T08:04:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.152+0000 7fc6ab7fe700 1 -- 172.21.15.153:0/2524697380 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8012b00 con 0x7fc6c40b2270 2023-11-24T08:04:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.152+0000 7fc6c97a0700 1 -- 172.21.15.153:0/2524697380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c41f3e60 con 0x7fc6c40b2270 2023-11-24T08:04:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.153+0000 7fc6c97a0700 1 -- 172.21.15.153:0/2524697380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c40c64e0 con 0x7fc6c40b2270 2023-11-24T08:04:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.153+0000 7fc6ab7fe700 1 -- 172.21.15.153:0/2524697380 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6b8012c60 con 0x7fc6c40b2270 2023-11-24T08:04:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.153+0000 7fc6ab7fe700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc6b006aed0 0x7fc6b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.153+0000 7fc6ab7fe700 1 -- 172.21.15.153:0/2524697380 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6b8089940 con 0x7fc6c40b2270 2023-11-24T08:04:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.154+0000 7fc6c2ffd700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc6b006aed0 0x7fc6b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.154+0000 7fc6c2ffd700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc6b006aed0 0x7fc6b006d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009c40 tx=0x7fc6b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.158+0000 7fc6ab7fe700 1 -- 172.21.15.153:0/2524697380 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6c40c64e0 con 0x7fc6c40b2270 2023-11-24T08:04:53.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.349+0000 7fc6c97a0700 1 -- 172.21.15.153:0/2524697380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6c40c64e0 con 0x7fc6c40b2270 2023-11-24T08:04:53.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.349+0000 7fc6ab7fe700 1 -- 172.21.15.153:0/2524697380 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6c40c64e0 con 0x7fc6c40b2270 2023-11-24T08:04:53.351 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:04:53.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.351+0000 7fc6c97a0700 1 -- 172.21.15.153:0/2524697380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc6b006aed0 msgr2=0x7fc6b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.351+0000 7fc6c97a0700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc6b006aed0 0x7fc6b006d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009c40 tx=0x7fc6b4008030 comp rx=0 tx=0).stop 2023-11-24T08:04:53.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.351+0000 7fc6c97a0700 1 -- 172.21.15.153:0/2524697380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c40b2270 msgr2=0x7fc6c41f3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.351+0000 7fc6c97a0700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c40b2270 0x7fc6c41f3920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800d800 tx=0x7fc6b800dbc0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.351+0000 7fc6c97a0700 1 -- 172.21.15.153:0/2524697380 shutdown_connections 2023-11-24T08:04:53.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.351+0000 7fc6c97a0700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6c40b28b0 0x7fc6c41458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.351+0000 7fc6c97a0700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6c406ba70 0x7fc6c40cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.352+0000 7fc6c97a0700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc6b006aed0 0x7fc6b006d390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.352+0000 7fc6c97a0700 1 --2- 172.21.15.153:0/2524697380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c40b2270 0x7fc6c41f3920 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.352+0000 7fc6c97a0700 1 -- 172.21.15.153:0/2524697380 >> 172.21.15.153:0/2524697380 conn(0x7fc6c40b3810 msgr2=0x7fc6c40b7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.352+0000 7fc6c97a0700 1 -- 172.21.15.153:0/2524697380 shutdown_connections 2023-11-24T08:04:53.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.352+0000 7fc6c97a0700 1 -- 172.21.15.153:0/2524697380 wait complete. 2023-11-24T08:04:53.366 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:53.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.486+0000 7fb70de2e700 1 Processor -- start 2023-11-24T08:04:53.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.486+0000 7fb70de2e700 1 -- start start 2023-11-24T08:04:53.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb70de2e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb7080b0f80 0x7fb70815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb70de2e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7080cd770 0x7fb70815a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb70de2e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7080b2bd0 con 0x7fb7080b0ba0 2023-11-24T08:04:53.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb70de2e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7080b1fc0 con 0x7fb7080b0f80 2023-11-24T08:04:53.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb70de2e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080b22a0 con 0x7fb7080cd770 2023-11-24T08:04:53.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7077fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb7080b0ba0 0x7fb7080af5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42936/0 (socket says 172.21.15.153:42936) 2023-11-24T08:04:53.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7077fe700 1 -- 172.21.15.153:0/3716751339 learned_addr learned my addr 172.21.15.153:0/3716751339 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:53.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb707fff700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7080cd770 0x7fb70815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb706ffd700 1 --2- 172.21.15.153:0/3716751339 >> v2:172.21.15.164:3300/0 conn(0x7fb7080b0f80 0x7fb70815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891655574 0 0) 0x7fb7080b2bd0 con 0x7fb7080b0ba0 2023-11-24T08:04:53.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f00035b0 con 0x7fb7080b0ba0 2023-11-24T08:04:53.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1493505934 0 0) 0x7fb6f00035b0 con 0x7fb7080b0ba0 2023-11-24T08:04:53.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7080cd770 msgr2=0x7fb70815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7067fc700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7080cd770 0x7fb70815a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 >> v2:172.21.15.164:3300/0 conn(0x7fb7080b0f80 msgr2=0x7fb70815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7067fc700 1 --2- 172.21.15.153:0/3716751339 >> v2:172.21.15.164:3300/0 conn(0x7fb7080b0f80 0x7fb70815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7080b2580 con 0x7fb7080b0ba0 2023-11-24T08:04:53.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fb6fc001670 con 0x7fb7080b0ba0 2023-11-24T08:04:53.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 >> v1:172.21.15.153:6789/0 conn(0x7fb7080b0ba0 legacy=0x7fb7080af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.487+0000 7fb7067fc700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6f0003a00 0x7fb6f0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7067fc700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7080cd770 0x7fb6f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7067fc700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6f0004d90 0x7fb6f0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080b1fc0 con 0x7fb6f0003a00 2023-11-24T08:04:53.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080b22a0 con 0x7fb6f0004d90 2023-11-24T08:04:53.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f000ba10 con 0x7fb7080cd770 2023-11-24T08:04:53.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7077fe700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6f0003a00 0x7fb6f0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb706ffd700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7080cd770 0x7fb6f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb707fff700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6f0004d90 0x7fb6f0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7077fe700 1 -- 172.21.15.153:0/3716751339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7080cd770 msgr2=0x7fb6f0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7077fe700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7080cd770 0x7fb6f0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7077fe700 1 -- 172.21.15.153:0/3716751339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6f0004d90 msgr2=0x7fb6f0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7077fe700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6f0004d90 0x7fb6f0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7077fe700 1 -- 172.21.15.153:0/3716751339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f00035b0 con 0x7fb6f0003a00 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7077fe700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6f0003a00 0x7fb6f0003e20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c370 tx=0x7fb6f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17c6c5f596ea34b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc007c60 con 0x7fb6f0003a00 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc005960 con 0x7fb6f0003a00 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.488+0000 7fb7067fc700 1 -- 172.21.15.153:0/3716751339 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc005d10 con 0x7fb6f0003a00 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.489+0000 7fb70de2e700 1 -- 172.21.15.153:0/3716751339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6f0003a00 msgr2=0x7fb6f0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.489+0000 7fb70de2e700 1 --2- 172.21.15.153:0/3716751339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6f0003a00 0x7fb6f0003e20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c370 tx=0x7fb6f0005880 comp rx=0 tx=0).stop 2023-11-24T08:04:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.489+0000 7fb707fff700 1 -- 172.21.15.153:0/3716751339 reap_dead start 2023-11-24T08:04:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.489+0000 7fb70de2e700 1 -- 172.21.15.153:0/3716751339 shutdown_connections 2023-11-24T08:04:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.489+0000 7fb70de2e700 1 -- 172.21.15.153:0/3716751339 >> 172.21.15.153:0/3716751339 conn(0x7fb7080b57b0 msgr2=0x7fb7080b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.489+0000 7fb70de2e700 1 -- 172.21.15.153:0/3716751339 shutdown_connections 2023-11-24T08:04:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.489+0000 7fb70de2e700 1 -- 172.21.15.153:0/3716751339 wait complete. 2023-11-24T08:04:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.490+0000 7fb70de2e700 1 Processor -- start 2023-11-24T08:04:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.490+0000 7fb70de2e700 1 -- start start 2023-11-24T08:04:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb70de2e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6f0003a00 0x7fb7081579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb70de2e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb708158260 0x7fb70815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb70de2e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb70815bd40 0x7fb7080b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb70de2e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70815c6b0 con 0x7fb708158260 2023-11-24T08:04:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb70de2e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70815c990 con 0x7fb6f0003a00 2023-11-24T08:04:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb70de2e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70815a340 con 0x7fb70815bd40 2023-11-24T08:04:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb706ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb708158260 0x7fb70815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb706ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb708158260 0x7fb70815ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36844/0 (socket says 172.21.15.153:36844) 2023-11-24T08:04:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb706ffd700 1 -- 172.21.15.153:0/2054395173 learned_addr learned my addr 172.21.15.153:0/2054395173 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb707fff700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb70815bd40 0x7fb7080b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb7077fe700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6f0003a00 0x7fb7081579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb706ffd700 1 -- 172.21.15.153:0/2054395173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb70815bd40 msgr2=0x7fb7080b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb706ffd700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb70815bd40 0x7fb7080b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb706ffd700 1 -- 172.21.15.153:0/2054395173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6f0003a00 msgr2=0x7fb7081579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb706ffd700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6f0003a00 0x7fb7081579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb706ffd700 1 -- 172.21.15.153:0/2054395173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70815a620 con 0x7fb708158260 2023-11-24T08:04:53.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb7077fe700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6f0003a00 0x7fb7081579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:53.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.491+0000 7fb706ffd700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb708158260 0x7fb70815ab40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8011aa0 tx=0x7fb6f8011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.492+0000 7fb6effff700 1 -- 172.21.15.153:0/2054395173 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800f940 con 0x7fb708158260 2023-11-24T08:04:53.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.492+0000 7fb6effff700 1 -- 172.21.15.153:0/2054395173 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f800faa0 con 0x7fb708158260 2023-11-24T08:04:53.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.492+0000 7fb6effff700 1 -- 172.21.15.153:0/2054395173 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800fe50 con 0x7fb708158260 2023-11-24T08:04:53.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.492+0000 7fb70de2e700 1 -- 172.21.15.153:0/2054395173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70815cc70 con 0x7fb708158260 2023-11-24T08:04:53.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.492+0000 7fb70de2e700 1 -- 172.21.15.153:0/2054395173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70815b080 con 0x7fb708158260 2023-11-24T08:04:53.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.493+0000 7fb70de2e700 1 -- 172.21.15.153:0/2054395173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70815a990 con 0x7fb708158260 2023-11-24T08:04:53.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.493+0000 7fb6effff700 1 -- 172.21.15.153:0/2054395173 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6f8014440 con 0x7fb708158260 2023-11-24T08:04:53.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.494+0000 7fb6effff700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb6f406aed0 0x7fb6f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.494+0000 7fb6effff700 1 -- 172.21.15.153:0/2054395173 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6f8089cb0 con 0x7fb708158260 2023-11-24T08:04:53.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.494+0000 7fb7077fe700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb6f406aed0 0x7fb6f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.494+0000 7fb7077fe700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb6f406aed0 0x7fb6f406d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc015040 tx=0x7fb6fc00a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.498+0000 7fb6effff700 1 -- 172.21.15.153:0/2054395173 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6f8054ec0 con 0x7fb708158260 2023-11-24T08:04:53.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.731+0000 7fb70de2e700 1 -- 172.21.15.153:0/2054395173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7080b1d70 con 0x7fb708158260 2023-11-24T08:04:53.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.731+0000 7fb6effff700 1 -- 172.21.15.153:0/2054395173 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fb6f8022020 con 0x7fb708158260 2023-11-24T08:04:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/157182640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":157182640},{"type":"v1","addr":"172.21.15.153:6837","nonce":157182640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2853134113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2853134113},{"type":"v1","addr":"172.21.15.153:6836","nonce":2853134113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1191113201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1191113201},{"type":"v1","addr":"172.21.15.164:6833","nonce":1191113201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:12.137876+0000","modified":"2023-11-24T08:04:15.171907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1557353565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1557353565},{"type":"v1","addr":"172.21.15.164:6835","nonce":1557353565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:53.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 -- 172.21.15.153:0/2054395173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb6f406aed0 msgr2=0x7fb6f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb6f406aed0 0x7fb6f406d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc015040 tx=0x7fb6fc00a000 comp rx=0 tx=0).stop 2023-11-24T08:04:53.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 -- 172.21.15.153:0/2054395173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb708158260 msgr2=0x7fb70815ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb708158260 0x7fb70815ab40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8011aa0 tx=0x7fb6f8011db0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 -- 172.21.15.153:0/2054395173 shutdown_connections 2023-11-24T08:04:53.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb70815bd40 0x7fb7080b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6f0003a00 0x7fb7081579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb6f406aed0 0x7fb6f406d390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 --2- 172.21.15.153:0/2054395173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb708158260 0x7fb70815ab40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 -- 172.21.15.153:0/2054395173 >> 172.21.15.153:0/2054395173 conn(0x7fb7080b57b0 msgr2=0x7fb7081594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 -- 172.21.15.153:0/2054395173 shutdown_connections 2023-11-24T08:04:53.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.733+0000 7fb70de2e700 1 -- 172.21.15.153:0/2054395173 wait complete. 2023-11-24T08:04:53.738 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2023-11-24T08:04:53.747 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:53.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.866+0000 7fc9bd42e700 1 Processor -- start 2023-11-24T08:04:53.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.866+0000 7fc9bd42e700 1 -- start start 2023-11-24T08:04:53.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.867+0000 7fc9bd42e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9b81446a0 0x7fc9b80b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.867+0000 7fc9bd42e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc9b80adf00 0x7fc9b806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.867+0000 7fc9bd42e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b806c540 0x7fc9b806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.867+0000 7fc9bd42e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b8144a80 con 0x7fc9b81446a0 2023-11-24T08:04:53.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.867+0000 7fc9bd42e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b806c9c0 con 0x7fc9b80adf00 2023-11-24T08:04:53.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.867+0000 7fc9bd42e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80af950 con 0x7fc9b806c540 2023-11-24T08:04:53.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.867+0000 7fc9b6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9b81446a0 0x7fc9b80b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.867+0000 7fc9b6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9b81446a0 0x7fc9b80b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36852/0 (socket says 172.21.15.153:36852) 2023-11-24T08:04:53.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.867+0000 7fc9b6ffd700 1 -- 172.21.15.153:0/1987745381 learned_addr learned my addr 172.21.15.153:0/1987745381 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:53.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b77fe700 1 --2- 172.21.15.153:0/1987745381 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b806c540 0x7fc9b806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b67fc700 1 --2- 172.21.15.153:0/1987745381 >> v2:172.21.15.164:3300/0 conn(0x7fc9b80adf00 0x7fc9b806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b6ffd700 1 -- 172.21.15.153:0/1987745381 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b806c540 msgr2=0x7fc9b806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b6ffd700 1 --2- 172.21.15.153:0/1987745381 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b806c540 0x7fc9b806da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b6ffd700 1 -- 172.21.15.153:0/1987745381 >> v2:172.21.15.164:3300/0 conn(0x7fc9b80adf00 msgr2=0x7fc9b806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b6ffd700 1 --2- 172.21.15.153:0/1987745381 >> v2:172.21.15.164:3300/0 conn(0x7fc9b80adf00 0x7fc9b806c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b6ffd700 1 -- 172.21.15.153:0/1987745381 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80afc30 con 0x7fc9b81446a0 2023-11-24T08:04:53.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b67fc700 1 --2- 172.21.15.153:0/1987745381 >> v2:172.21.15.164:3300/0 conn(0x7fc9b80adf00 0x7fc9b806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:53.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b6ffd700 1 --2- 172.21.15.153:0/1987745381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b81446a0 0x7fc9b80b5ae0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc9b809f030 tx=0x7fc9ac00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e82730c92ac9fc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b5ffb700 1 -- 172.21.15.153:0/1987745381 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00dc70 con 0x7fc9b81446a0 2023-11-24T08:04:53.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b5ffb700 1 -- 172.21.15.153:0/1987745381 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac00ddd0 con 0x7fc9b81446a0 2023-11-24T08:04:53.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.868+0000 7fc9b5ffb700 1 -- 172.21.15.153:0/1987745381 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac010690 con 0x7fc9b81446a0 2023-11-24T08:04:53.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.869+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1987745381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b81446a0 msgr2=0x7fc9b80b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.869+0000 7fc9bd42e700 1 --2- 172.21.15.153:0/1987745381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b81446a0 0x7fc9b80b5ae0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc9b809f030 tx=0x7fc9ac00be70 comp rx=0 tx=0).stop 2023-11-24T08:04:53.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.869+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1987745381 shutdown_connections 2023-11-24T08:04:53.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.869+0000 7fc9bd42e700 1 --2- 172.21.15.153:0/1987745381 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b806c540 0x7fc9b806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.869+0000 7fc9bd42e700 1 --2- 172.21.15.153:0/1987745381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b81446a0 0x7fc9b80b5ae0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.869+0000 7fc9bd42e700 1 --2- 172.21.15.153:0/1987745381 >> v2:172.21.15.164:3300/0 conn(0x7fc9b80adf00 0x7fc9b806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.869+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1987745381 >> 172.21.15.153:0/1987745381 conn(0x7fc9b8071b90 msgr2=0x7fc9b8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.869+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1987745381 shutdown_connections 2023-11-24T08:04:53.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.869+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1987745381 wait complete. 2023-11-24T08:04:53.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.870+0000 7fc9bd42e700 1 Processor -- start 2023-11-24T08:04:53.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.870+0000 7fc9bd42e700 1 -- start start 2023-11-24T08:04:53.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9bd42e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b806c540 0x7fc9b809ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9bd42e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b80adf00 0x7fc9b8142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9bd42e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b81446a0 0x7fc9b81f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9bd42e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b81f3c20 con 0x7fc9b806c540 2023-11-24T08:04:53.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9bd42e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b809e590 con 0x7fc9b80adf00 2023-11-24T08:04:53.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9bd42e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b809e870 con 0x7fc9b81446a0 2023-11-24T08:04:53.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9b6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b806c540 0x7fc9b809ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9b6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b806c540 0x7fc9b809ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36858/0 (socket says 172.21.15.153:36858) 2023-11-24T08:04:53.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9b6ffd700 1 -- 172.21.15.153:0/1113603734 learned_addr learned my addr 172.21.15.153:0/1113603734 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:53.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9b77fe700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b81446a0 0x7fc9b81f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9b67fc700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b80adf00 0x7fc9b8142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9b6ffd700 1 -- 172.21.15.153:0/1113603734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b81446a0 msgr2=0x7fc9b81f43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9b6ffd700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b81446a0 0x7fc9b81f43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9b6ffd700 1 -- 172.21.15.153:0/1113603734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b80adf00 msgr2=0x7fc9b8142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9b6ffd700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b80adf00 0x7fc9b8142f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9b6ffd700 1 -- 172.21.15.153:0/1113603734 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac00b7f0 con 0x7fc9b806c540 2023-11-24T08:04:53.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9b6ffd700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b806c540 0x7fc9b809ded0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00beb0 tx=0x7fc9ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc99f7fe700 1 -- 172.21.15.153:0/1113603734 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac003c70 con 0x7fc9b806c540 2023-11-24T08:04:53.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc99f7fe700 1 -- 172.21.15.153:0/1113603734 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac003df0 con 0x7fc9b806c540 2023-11-24T08:04:53.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1113603734 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b81f3e90 con 0x7fc9b806c540 2023-11-24T08:04:53.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.871+0000 7fc99f7fe700 1 -- 172.21.15.153:0/1113603734 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0106b0 con 0x7fc9b806c540 2023-11-24T08:04:53.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.872+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1113603734 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b809eb50 con 0x7fc9b806c540 2023-11-24T08:04:53.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.872+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1113603734 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b80753f0 con 0x7fc9b806c540 2023-11-24T08:04:53.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.873+0000 7fc99f7fe700 1 -- 172.21.15.153:0/1113603734 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9ac019400 con 0x7fc9b806c540 2023-11-24T08:04:53.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.873+0000 7fc99f7fe700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc9a406aed0 0x7fc9a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.873+0000 7fc9b67fc700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc9a406aed0 0x7fc9a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.873+0000 7fc99f7fe700 1 -- 172.21.15.153:0/1113603734 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9ac08afd0 con 0x7fc9b806c540 2023-11-24T08:04:53.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.874+0000 7fc9b67fc700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc9a406aed0 0x7fc9a406d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc9b806f1d0 tx=0x7fc9a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:53.878+0000 7fc99f7fe700 1 -- 172.21.15.153:0/1113603734 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9ac056110 con 0x7fc9b806c540 2023-11-24T08:04:54.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.071+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1113603734 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9b8067f60 con 0x7fc9b806c540 2023-11-24T08:04:54.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.072+0000 7fc99f7fe700 1 -- 172.21.15.153:0/1113603734 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fc9ac059730 con 0x7fc9b806c540 2023-11-24T08:04:54.074 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:54.074 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:54.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1113603734 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc9a406aed0 msgr2=0x7fc9a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc9a406aed0 0x7fc9a406d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc9b806f1d0 tx=0x7fc9a8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:54.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1113603734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b806c540 msgr2=0x7fc9b809ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b806c540 0x7fc9b809ded0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00beb0 tx=0x7fc9ac004750 comp rx=0 tx=0).stop 2023-11-24T08:04:54.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1113603734 shutdown_connections 2023-11-24T08:04:54.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b81446a0 0x7fc9b81f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc9a406aed0 0x7fc9a406d390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b806c540 0x7fc9b809ded0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 --2- 172.21.15.153:0/1113603734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b80adf00 0x7fc9b8142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1113603734 >> 172.21.15.153:0/1113603734 conn(0x7fc9b8071b90 msgr2=0x7fc9b80b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:54.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1113603734 shutdown_connections 2023-11-24T08:04:54.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.074+0000 7fc9bd42e700 1 -- 172.21.15.153:0/1113603734 wait complete. 2023-11-24T08:04:54.088 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:04:54.088 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:54.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.208+0000 7f32618d5700 1 Processor -- start 2023-11-24T08:04:54.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.208+0000 7f32618d5700 1 -- start start 2023-11-24T08:04:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f32618d5700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f325c15e1e0 0x7f325c0d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f32618d5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f325c0d0f80 0x7f325c0b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f32618d5700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325c0d20b0 con 0x7f325c0d3a00 2023-11-24T08:04:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f32618d5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325c0d3150 con 0x7f325c0d0f80 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f32618d5700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325c15e5c0 con 0x7f325c15e1e0 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f325b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f325c0d0f80 0x7f325c0b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f325b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f325c0d0f80 0x7f325c0b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36870/0 (socket says 172.21.15.153:36870) 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f325b7fe700 1 -- 172.21.15.153:0/2933780665 learned_addr learned my addr 172.21.15.153:0/2933780665 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f325affd700 1 --2- 172.21.15.153:0/2933780665 >> v2:172.21.15.164:3300/0 conn(0x7f325c15e1e0 0x7f325c0d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f325b7fe700 1 -- 172.21.15.153:0/2933780665 >> v2:172.21.15.164:3300/0 conn(0x7f325c15e1e0 msgr2=0x7f325c0d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f325b7fe700 1 --2- 172.21.15.153:0/2933780665 >> v2:172.21.15.164:3300/0 conn(0x7f325c15e1e0 0x7f325c0d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f325b7fe700 1 -- 172.21.15.153:0/2933780665 >> v1:172.21.15.164:6789/0 conn(0x7f325c0d3a00 legacy=0x7f325c0d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f325b7fe700 1 -- 172.21.15.153:0/2933780665 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c0d2390 con 0x7f325c0d0f80 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f325b7fe700 1 --2- 172.21.15.153:0/2933780665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f325c0d0f80 0x7f325c0b6ef0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f325c0d0840 tx=0x7f325400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6570710adc5abcd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.209+0000 7f3259ffb700 1 -- 172.21.15.153:0/2933780665 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400e070 con 0x7f325c0d0f80 2023-11-24T08:04:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.210+0000 7f3259ffb700 1 -- 172.21.15.153:0/2933780665 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254003a20 con 0x7f325c0d0f80 2023-11-24T08:04:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.210+0000 7f3259ffb700 1 -- 172.21.15.153:0/2933780665 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254003dd0 con 0x7f325c0d0f80 2023-11-24T08:04:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.210+0000 7f32618d5700 1 -- 172.21.15.153:0/2933780665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f325c0d0f80 msgr2=0x7f325c0b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.210+0000 7f32618d5700 1 --2- 172.21.15.153:0/2933780665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f325c0d0f80 0x7f325c0b6ef0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f325c0d0840 tx=0x7f325400b330 comp rx=0 tx=0).stop 2023-11-24T08:04:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.210+0000 7f32618d5700 1 -- 172.21.15.153:0/2933780665 shutdown_connections 2023-11-24T08:04:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.210+0000 7f32618d5700 1 --2- 172.21.15.153:0/2933780665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f325c0d0f80 0x7f325c0b6ef0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.210+0000 7f32618d5700 1 --2- 172.21.15.153:0/2933780665 >> v2:172.21.15.164:3300/0 conn(0x7f325c15e1e0 0x7f325c0d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.210+0000 7f32618d5700 1 -- 172.21.15.153:0/2933780665 >> 172.21.15.153:0/2933780665 conn(0x7f325c0b5b50 msgr2=0x7f325c0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.210+0000 7f32618d5700 1 -- 172.21.15.153:0/2933780665 shutdown_connections 2023-11-24T08:04:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.210+0000 7f32618d5700 1 -- 172.21.15.153:0/2933780665 wait complete. 2023-11-24T08:04:54.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.211+0000 7f32618d5700 1 Processor -- start 2023-11-24T08:04:54.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.211+0000 7f32618d5700 1 -- start start 2023-11-24T08:04:54.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.212+0000 7f32618d5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f325c0d0f80 0x7f325c158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.212+0000 7f32618d5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f325c0d3a00 0x7f325c15f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.212+0000 7f32618d5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f325c15e1e0 0x7f325c15fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.212+0000 7f32618d5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c15e700 con 0x7f325c0d3a00 2023-11-24T08:04:54.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.212+0000 7f32618d5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c15e950 con 0x7f325c15e1e0 2023-11-24T08:04:54.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.212+0000 7f32618d5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c15ec30 con 0x7f325c0d0f80 2023-11-24T08:04:54.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.212+0000 7f325a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f325c0d3a00 0x7f325c15f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.212+0000 7f325a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f325c0d3a00 0x7f325c15f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36874/0 (socket says 172.21.15.153:36874) 2023-11-24T08:04:54.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.212+0000 7f325a7fc700 1 -- 172.21.15.153:0/1865483133 learned_addr learned my addr 172.21.15.153:0/1865483133 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:54.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.212+0000 7f325affd700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f325c0d0f80 0x7f325c158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.212+0000 7f325b7fe700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f325c15e1e0 0x7f325c15fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.213+0000 7f325a7fc700 1 -- 172.21.15.153:0/1865483133 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f325c0d0f80 msgr2=0x7f325c158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.213+0000 7f325a7fc700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f325c0d0f80 0x7f325c158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.213+0000 7f325a7fc700 1 -- 172.21.15.153:0/1865483133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f325c15e1e0 msgr2=0x7f325c15fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.213+0000 7f325a7fc700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f325c15e1e0 0x7f325c15fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.213+0000 7f325a7fc700 1 -- 172.21.15.153:0/1865483133 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3254009b30 con 0x7f325c0d3a00 2023-11-24T08:04:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.213+0000 7f325a7fc700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f325c0d3a00 0x7f325c15f710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c4a0 tx=0x7f324c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.213+0000 7f3243fff700 1 -- 172.21.15.153:0/1865483133 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c011790 con 0x7f325c0d3a00 2023-11-24T08:04:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.213+0000 7f3243fff700 1 -- 172.21.15.153:0/1865483133 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c0118f0 con 0x7f325c0d3a00 2023-11-24T08:04:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.213+0000 7f32618d5700 1 -- 172.21.15.153:0/1865483133 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325c15ef10 con 0x7f325c0d3a00 2023-11-24T08:04:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.213+0000 7f3243fff700 1 -- 172.21.15.153:0/1865483133 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c011ca0 con 0x7f325c0d3a00 2023-11-24T08:04:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.213+0000 7f32618d5700 1 -- 172.21.15.153:0/1865483133 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c161170 con 0x7f325c0d3a00 2023-11-24T08:04:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.214+0000 7f32618d5700 1 -- 172.21.15.153:0/1865483133 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c1613f0 con 0x7f325c0d3a00 2023-11-24T08:04:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.214+0000 7f3243fff700 1 -- 172.21.15.153:0/1865483133 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f324c01c460 con 0x7f325c0d3a00 2023-11-24T08:04:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.215+0000 7f3243fff700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f324806aed0 0x7f324806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.215+0000 7f325affd700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f324806aed0 0x7f324806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.215+0000 7f3243fff700 1 -- 172.21.15.153:0/1865483133 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f324c089300 con 0x7f325c0d3a00 2023-11-24T08:04:54.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.215+0000 7f325affd700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f324806aed0 0x7f324806d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f325c0d38d0 tx=0x7f3250008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.219+0000 7f3243fff700 1 -- 172.21.15.153:0/1865483133 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f324c0543a0 con 0x7f325c0d3a00 2023-11-24T08:04:54.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.454+0000 7f32618d5700 1 -- 172.21.15.153:0/1865483133 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f325c0751e0 con 0x7f325c0d3a00 2023-11-24T08:04:54.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.454+0000 7f3243fff700 1 -- 172.21.15.153:0/1865483133 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f324c0579c0 con 0x7f325c0d3a00 2023-11-24T08:04:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:54.457 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/157182640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":157182640},{"type":"v1","addr":"172.21.15.153:6837","nonce":157182640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2853134113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2853134113},{"type":"v1","addr":"172.21.15.153:6836","nonce":2853134113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1191113201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1191113201},{"type":"v1","addr":"172.21.15.164:6833","nonce":1191113201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:12.137876+0000","modified":"2023-11-24T08:04:15.171907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1557353565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1557353565},{"type":"v1","addr":"172.21.15.164:6835","nonce":1557353565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 -- 172.21.15.153:0/1865483133 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f324806aed0 msgr2=0x7f324806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f324806aed0 0x7f324806d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f325c0d38d0 tx=0x7f3250008040 comp rx=0 tx=0).stop 2023-11-24T08:04:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 -- 172.21.15.153:0/1865483133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f325c0d3a00 msgr2=0x7f325c15f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f325c0d3a00 0x7f325c15f710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c4a0 tx=0x7f324c00c7b0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 -- 172.21.15.153:0/1865483133 shutdown_connections 2023-11-24T08:04:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f325c15e1e0 0x7f325c15fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f325c0d0f80 0x7f325c158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f324806aed0 0x7f324806d390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 --2- 172.21.15.153:0/1865483133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f325c0d3a00 0x7f325c15f710 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 -- 172.21.15.153:0/1865483133 >> 172.21.15.153:0/1865483133 conn(0x7f325c0b5b50 msgr2=0x7f325c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 -- 172.21.15.153:0/1865483133 shutdown_connections 2023-11-24T08:04:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.457+0000 7f32618d5700 1 -- 172.21.15.153:0/1865483133 wait complete. 2023-11-24T08:04:54.461 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2023-11-24T08:04:54.471 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:54.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.589+0000 7f8f4a0e3700 1 Processor -- start 2023-11-24T08:04:54.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.590+0000 7f8f4a0e3700 1 -- start start 2023-11-24T08:04:54.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.590+0000 7f8f4a0e3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8f441446a0 0x7f8f440b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.590+0000 7f8f4a0e3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f4406c710 0x7f8f440b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.590+0000 7f8f4a0e3700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f440af950 con 0x7f8f440adf00 2023-11-24T08:04:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.590+0000 7f8f4a0e3700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f44144a80 con 0x7f8f441446a0 2023-11-24T08:04:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.590+0000 7f8f4a0e3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440afc30 con 0x7f8f4406c710 2023-11-24T08:04:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.590+0000 7f8f437fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8f441446a0 0x7f8f440b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.590+0000 7f8f437fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8f441446a0 0x7f8f440b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36880/0 (socket says 172.21.15.153:36880) 2023-11-24T08:04:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.590+0000 7f8f437fe700 1 -- 172.21.15.153:0/3350831040 learned_addr learned my addr 172.21.15.153:0/3350831040 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.591+0000 7f8f43fff700 1 --2- 172.21.15.153:0/3350831040 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f4406c710 0x7f8f440b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.591+0000 7f8f437fe700 1 -- 172.21.15.153:0/3350831040 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f4406c710 msgr2=0x7f8f440b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.591+0000 7f8f437fe700 1 --2- 172.21.15.153:0/3350831040 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f4406c710 0x7f8f440b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.591+0000 7f8f437fe700 1 -- 172.21.15.153:0/3350831040 >> v1:172.21.15.164:6789/0 conn(0x7f8f440adf00 legacy=0x7f8f4406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.591+0000 7f8f437fe700 1 -- 172.21.15.153:0/3350831040 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f440aff10 con 0x7f8f441446a0 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.591+0000 7f8f437fe700 1 --2- 172.21.15.153:0/3350831040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f441446a0 0x7f8f440b5ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0098f0 tx=0x7f8f2c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53a173dfcb22898 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.591+0000 7f8f427fc700 1 -- 172.21.15.153:0/3350831040 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c004230 con 0x7f8f441446a0 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.591+0000 7f8f427fc700 1 -- 172.21.15.153:0/3350831040 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c004390 con 0x7f8f441446a0 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.591+0000 7f8f427fc700 1 -- 172.21.15.153:0/3350831040 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0036a0 con 0x7f8f441446a0 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.592+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/3350831040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f441446a0 msgr2=0x7f8f440b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.592+0000 7f8f4a0e3700 1 --2- 172.21.15.153:0/3350831040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f441446a0 0x7f8f440b5ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0098f0 tx=0x7f8f2c009c00 comp rx=0 tx=0).stop 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.592+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/3350831040 shutdown_connections 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.592+0000 7f8f4a0e3700 1 --2- 172.21.15.153:0/3350831040 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f4406c710 0x7f8f440b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.592+0000 7f8f4a0e3700 1 --2- 172.21.15.153:0/3350831040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f441446a0 0x7f8f440b5ae0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.592+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/3350831040 >> 172.21.15.153:0/3350831040 conn(0x7f8f44071b90 msgr2=0x7f8f44071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.592+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/3350831040 shutdown_connections 2023-11-24T08:04:54.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.592+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/3350831040 wait complete. 2023-11-24T08:04:54.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.593+0000 7f8f4a0e3700 1 Processor -- start 2023-11-24T08:04:54.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.593+0000 7f8f4a0e3700 1 -- start start 2023-11-24T08:04:54.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f4a0e3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f4406c710 0x7f8f44159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f4a0e3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f440adf00 0x7f8f4409df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f4a0e3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f441446a0 0x7f8f44143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f4a0e3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4409c770 con 0x7f8f4406c710 2023-11-24T08:04:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f4a0e3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4409aa00 con 0x7f8f441446a0 2023-11-24T08:04:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f4a0e3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4415a250 con 0x7f8f440adf00 2023-11-24T08:04:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f437fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f4406c710 0x7f8f44159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f437fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f4406c710 0x7f8f44159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36886/0 (socket says 172.21.15.153:36886) 2023-11-24T08:04:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f437fe700 1 -- 172.21.15.153:0/2767375702 learned_addr learned my addr 172.21.15.153:0/2767375702 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f43fff700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f441446a0 0x7f8f44143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f42ffd700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f440adf00 0x7f8f4409df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f437fe700 1 -- 172.21.15.153:0/2767375702 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f440adf00 msgr2=0x7f8f4409df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f437fe700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f440adf00 0x7f8f4409df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f437fe700 1 -- 172.21.15.153:0/2767375702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f441446a0 msgr2=0x7f8f44143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f437fe700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f441446a0 0x7f8f44143330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f437fe700 1 -- 172.21.15.153:0/2767375702 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c009550 con 0x7f8f4406c710 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f43fff700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f441446a0 0x7f8f44143330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f437fe700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f4406c710 0x7f8f44159d10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8f440729d0 tx=0x7f8f2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f3bfff700 1 -- 172.21.15.153:0/2767375702 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00b660 con 0x7f8f4406c710 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f3bfff700 1 -- 172.21.15.153:0/2767375702 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c00b7e0 con 0x7f8f4406c710 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/2767375702 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4409e9f0 con 0x7f8f4406c710 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.594+0000 7f8f3bfff700 1 -- 172.21.15.153:0/2767375702 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00bb90 con 0x7f8f4406c710 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.595+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/2767375702 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4409acc0 con 0x7f8f4406c710 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.595+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/2767375702 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f440753f0 con 0x7f8f4406c710 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.596+0000 7f8f3bfff700 1 -- 172.21.15.153:0/2767375702 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f2c00bcf0 con 0x7f8f4406c710 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.596+0000 7f8f3bfff700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8f2406aed0 0x7f8f2406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.597+0000 7f8f3bfff700 1 -- 172.21.15.153:0/2767375702 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f2c08b240 con 0x7f8f4406c710 2023-11-24T08:04:54.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.597+0000 7f8f42ffd700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8f2406aed0 0x7f8f2406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.597+0000 7f8f42ffd700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8f2406aed0 0x7f8f2406d390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f4415a980 tx=0x7f8f34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.600+0000 7f8f3bfff700 1 -- 172.21.15.153:0/2767375702 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f2c056460 con 0x7f8f4406c710 2023-11-24T08:04:54.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.832+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/2767375702 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f440ae6a0 con 0x7f8f4406c710 2023-11-24T08:04:54.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.832+0000 7f8f3bfff700 1 -- 172.21.15.153:0/2767375702 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f8f2c059a80 con 0x7f8f4406c710 2023-11-24T08:04:54.834 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:54.834 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/157182640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":157182640},{"type":"v1","addr":"172.21.15.153:6837","nonce":157182640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2853134113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2853134113},{"type":"v1","addr":"172.21.15.153:6836","nonce":2853134113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1191113201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1191113201},{"type":"v1","addr":"172.21.15.164:6833","nonce":1191113201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:12.137876+0000","modified":"2023-11-24T08:04:15.171907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1557353565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1557353565},{"type":"v1","addr":"172.21.15.164:6835","nonce":1557353565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:54.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.834+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/2767375702 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8f2406aed0 msgr2=0x7f8f2406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.834+0000 7f8f4a0e3700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8f2406aed0 0x7f8f2406d390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f4415a980 tx=0x7f8f34009040 comp rx=0 tx=0).stop 2023-11-24T08:04:54.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.834+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/2767375702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f4406c710 msgr2=0x7f8f44159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.834+0000 7f8f4a0e3700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f4406c710 0x7f8f44159d10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8f440729d0 tx=0x7f8f2c004750 comp rx=0 tx=0).stop 2023-11-24T08:04:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.834+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/2767375702 shutdown_connections 2023-11-24T08:04:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.834+0000 7f8f4a0e3700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f441446a0 0x7f8f44143330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.834+0000 7f8f4a0e3700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8f2406aed0 0x7f8f2406d390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.834+0000 7f8f4a0e3700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f4406c710 0x7f8f44159d10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.834+0000 7f8f4a0e3700 1 --2- 172.21.15.153:0/2767375702 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f440adf00 0x7f8f4409df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.834+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/2767375702 >> 172.21.15.153:0/2767375702 conn(0x7f8f44071b90 msgr2=0x7f8f440b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.834+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/2767375702 shutdown_connections 2023-11-24T08:04:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.835+0000 7f8f4a0e3700 1 -- 172.21.15.153:0/2767375702 wait complete. 2023-11-24T08:04:54.838 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2023-11-24T08:04:54.848 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:54.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.967+0000 7feef7ea1700 1 Processor -- start 2023-11-24T08:04:54.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.967+0000 7feef7ea1700 1 -- start start 2023-11-24T08:04:54.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.968+0000 7feef7ea1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feef00b04b0 0x7feef00622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.968+0000 7feef7ea1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef015c540 con 0x7feef015c160 2023-11-24T08:04:54.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.968+0000 7feef7ea1700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef00b2ee0 con 0x7feef00af1e0 2023-11-24T08:04:54.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.968+0000 7feef7ea1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef00add40 con 0x7feef00b04b0 2023-11-24T08:04:54.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.968+0000 7feef5c3d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7feef015c160 0x7feef00afda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42998/0 (socket says 172.21.15.153:42998) 2023-11-24T08:04:54.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.968+0000 7feef5c3d700 1 -- 172.21.15.153:0/1169741095 learned_addr learned my addr 172.21.15.153:0/1169741095 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:54.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309735741 0 0) 0x7feef015c540 con 0x7feef015c160 2023-11-24T08:04:54.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef543c700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feef00b04b0 0x7feef00622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feedc0035b0 con 0x7feef015c160 2023-11-24T08:04:54.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1703292102 0 0) 0x7feedc0035b0 con 0x7feef015c160 2023-11-24T08:04:54.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feef00b04b0 msgr2=0x7feef00622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:54.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feef00b04b0 0x7feef00622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 >> v1:172.21.15.164:6789/0 conn(0x7feef00af1e0 legacy=0x7feef0165c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00ad410 con 0x7feef015c160 2023-11-24T08:04:54.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7feee0001670 con 0x7feef015c160 2023-11-24T08:04:54.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 >> v1:172.21.15.153:6789/0 conn(0x7feef015c160 legacy=0x7feef00afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feef00b04b0 0x7feedc003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feedc003f70 0x7feedc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feedc004d90 0x7feedc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef00add40 con 0x7feedc004d90 2023-11-24T08:04:54.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc00ba70 con 0x7feedc003f70 2023-11-24T08:04:54.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feedc00bc30 con 0x7feef00b04b0 2023-11-24T08:04:54.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef643e700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feedc004d90 0x7feedc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef5c3d700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feef00b04b0 0x7feedc003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef543c700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feedc003f70 0x7feedc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef643e700 1 -- 172.21.15.153:0/1169741095 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feef00b04b0 msgr2=0x7feedc003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:54.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef643e700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feef00b04b0 0x7feedc003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef643e700 1 -- 172.21.15.153:0/1169741095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feedc003f70 msgr2=0x7feedc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:54.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef643e700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feedc003f70 0x7feedc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.969+0000 7feef643e700 1 -- 172.21.15.153:0/1169741095 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc0035b0 con 0x7feedc004d90 2023-11-24T08:04:54.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.970+0000 7feef643e700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feedc004d90 0x7feedc005210 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feee800c260 tx=0x7feedc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1173d76952b7948d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.970+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8002000 con 0x7feedc004d90 2023-11-24T08:04:54.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.970+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee800ce00 con 0x7feedc004d90 2023-11-24T08:04:54.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.970+0000 7feef4c3b700 1 -- 172.21.15.153:0/1169741095 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8012660 con 0x7feedc004d90 2023-11-24T08:04:54.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.970+0000 7feef7ea1700 1 -- 172.21.15.153:0/1169741095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feedc004d90 msgr2=0x7feedc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.970+0000 7feef7ea1700 1 --2- 172.21.15.153:0/1169741095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feedc004d90 0x7feedc005210 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feee800c260 tx=0x7feedc005880 comp rx=0 tx=0).stop 2023-11-24T08:04:54.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.970+0000 7feef643e700 1 -- 172.21.15.153:0/1169741095 reap_dead start 2023-11-24T08:04:54.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.970+0000 7feef7ea1700 1 -- 172.21.15.153:0/1169741095 shutdown_connections 2023-11-24T08:04:54.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.970+0000 7feef7ea1700 1 -- 172.21.15.153:0/1169741095 >> 172.21.15.153:0/1169741095 conn(0x7feef00b57b0 msgr2=0x7feef00b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:54.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.970+0000 7feef7ea1700 1 -- 172.21.15.153:0/1169741095 shutdown_connections 2023-11-24T08:04:54.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.970+0000 7feef7ea1700 1 -- 172.21.15.153:0/1169741095 wait complete. 2023-11-24T08:04:54.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.972+0000 7feef7ea1700 1 Processor -- start 2023-11-24T08:04:54.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.972+0000 7feef7ea1700 1 -- start start 2023-11-24T08:04:54.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.972+0000 7feef7ea1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feedc004d90 0x7feef015e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.972+0000 7feef7ea1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0154650 0x7feef015e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.972+0000 7feef7ea1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feef01f4e30 0x7feef015ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.972+0000 7feef7ea1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef01535b0 con 0x7feef0154650 2023-11-24T08:04:54.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.972+0000 7feef7ea1700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef0153890 con 0x7feef01f4e30 2023-11-24T08:04:54.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.972+0000 7feef7ea1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef0153b70 con 0x7feedc004d90 2023-11-24T08:04:54.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.972+0000 7feef543c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0154650 0x7feef015e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef543c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0154650 0x7feef015e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36908/0 (socket says 172.21.15.153:36908) 2023-11-24T08:04:54.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef543c700 1 -- 172.21.15.153:0/1370451347 learned_addr learned my addr 172.21.15.153:0/1370451347 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:54.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef5c3d700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feedc004d90 0x7feef015e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef643e700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feef01f4e30 0x7feef015ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef543c700 1 -- 172.21.15.153:0/1370451347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feedc004d90 msgr2=0x7feef015e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef543c700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feedc004d90 0x7feef015e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef543c700 1 -- 172.21.15.153:0/1370451347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feef01f4e30 msgr2=0x7feef015ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef543c700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feef01f4e30 0x7feef015ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef543c700 1 -- 172.21.15.153:0/1370451347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0153e50 con 0x7feef0154650 2023-11-24T08:04:54.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef543c700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0154650 0x7feef015e9d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feeec011aa0 tx=0x7feeec011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feee67fc700 1 -- 172.21.15.153:0/1370451347 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec011ee0 con 0x7feef0154650 2023-11-24T08:04:54.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feee67fc700 1 -- 172.21.15.153:0/1370451347 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec00f940 con 0x7feef0154650 2023-11-24T08:04:54.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feee67fc700 1 -- 172.21.15.153:0/1370451347 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00fcf0 con 0x7feef0154650 2023-11-24T08:04:54.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef7ea1700 1 -- 172.21.15.153:0/1370451347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef0154130 con 0x7feef0154650 2023-11-24T08:04:54.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.973+0000 7feef7ea1700 1 -- 172.21.15.153:0/1370451347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef01531f0 con 0x7feef0154650 2023-11-24T08:04:54.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.974+0000 7feef7ea1700 1 -- 172.21.15.153:0/1370451347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef0067f60 con 0x7feef0154650 2023-11-24T08:04:54.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.974+0000 7feee67fc700 1 -- 172.21.15.153:0/1370451347 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feeec014440 con 0x7feef0154650 2023-11-24T08:04:54.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.975+0000 7feee67fc700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7feed406aed0 0x7feed406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.975+0000 7feee67fc700 1 -- 172.21.15.153:0/1370451347 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feeec089c00 con 0x7feef0154650 2023-11-24T08:04:54.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.975+0000 7feef5c3d700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7feed406aed0 0x7feed406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.975+0000 7feef5c3d700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7feed406aed0 0x7feed406d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feee0001050 tx=0x7feee0000f80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:54.979+0000 7feee67fc700 1 -- 172.21.15.153:0/1370451347 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feeec090080 con 0x7feef0154650 2023-11-24T08:04:55.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.173+0000 7feef7ea1700 1 -- 172.21.15.153:0/1370451347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feef006d430 con 0x7feef0154650 2023-11-24T08:04:55.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.174+0000 7feee67fc700 1 -- 172.21.15.153:0/1370451347 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7feeec022020 con 0x7feef0154650 2023-11-24T08:04:55.176 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:04:55.177 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":20,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:04:13.753371+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:09.853312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:11.105065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:55.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.176+0000 7feef7ea1700 1 -- 172.21.15.153:0/1370451347 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7feed406aed0 msgr2=0x7feed406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.176+0000 7feef7ea1700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7feed406aed0 0x7feed406d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feee0001050 tx=0x7feee0000f80 comp rx=0 tx=0).stop 2023-11-24T08:04:55.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.176+0000 7feef7ea1700 1 -- 172.21.15.153:0/1370451347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0154650 msgr2=0x7feef015e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.176+0000 7feef7ea1700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0154650 0x7feef015e9d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feeec011aa0 tx=0x7feeec011db0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.176+0000 7feef7ea1700 1 -- 172.21.15.153:0/1370451347 shutdown_connections 2023-11-24T08:04:55.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.176+0000 7feef7ea1700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feef01f4e30 0x7feef015ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.176+0000 7feef7ea1700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feedc004d90 0x7feef015e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.176+0000 7feef7ea1700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7feed406aed0 0x7feed406d390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.176+0000 7feef7ea1700 1 --2- 172.21.15.153:0/1370451347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0154650 0x7feef015e9d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.176+0000 7feef7ea1700 1 -- 172.21.15.153:0/1370451347 >> 172.21.15.153:0/1370451347 conn(0x7feef00b57b0 msgr2=0x7feef00b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:55.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.177+0000 7feef7ea1700 1 -- 172.21.15.153:0/1370451347 shutdown_connections 2023-11-24T08:04:55.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.177+0000 7feef7ea1700 1 -- 172.21.15.153:0/1370451347 wait complete. 2023-11-24T08:04:55.191 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:04:55.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.311+0000 7f6ab7dd3700 1 Processor -- start 2023-11-24T08:04:55.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.311+0000 7f6ab7dd3700 1 -- start start 2023-11-24T08:04:55.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.312+0000 7f6ab7dd3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ab015bdd0 0x7f6ab01604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.312+0000 7f6ab7dd3700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab00b22d0 con 0x7f6ab00d1c70 2023-11-24T08:04:55.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.312+0000 7f6ab7dd3700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab00b25b0 con 0x7f6ab00b3370 2023-11-24T08:04:55.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.312+0000 7f6ab7dd3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00b2f50 con 0x7f6ab015bdd0 2023-11-24T08:04:55.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.312+0000 7f6ab6370700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6ab00d1c70 0x7f6ab0165ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43020/0 (socket says 172.21.15.153:43020) 2023-11-24T08:04:55.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.312+0000 7f6ab6370700 1 -- 172.21.15.153:0/2972886819 learned_addr learned my addr 172.21.15.153:0/2972886819 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:55.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.312+0000 7f6ab5b6f700 1 --2- 172.21.15.153:0/2972886819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ab015bdd0 0x7f6ab01604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab4b6d700 1 -- 172.21.15.153:0/2972886819 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010969151 0 0) 0x7f6ab00b22d0 con 0x7f6ab00d1c70 2023-11-24T08:04:55.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab4b6d700 1 -- 172.21.15.153:0/2972886819 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c0035b0 con 0x7f6ab00d1c70 2023-11-24T08:04:55.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab4b6d700 1 -- 172.21.15.153:0/2972886819 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393097428 0 0) 0x7f6ab00b25b0 con 0x7f6ab00b3370 2023-11-24T08:04:55.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab4b6d700 1 -- 172.21.15.153:0/2972886819 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab00b22d0 con 0x7f6ab00b3370 2023-11-24T08:04:55.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab4b6d700 1 -- 172.21.15.153:0/2972886819 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2582490943 0 0) 0x7f6a9c0035b0 con 0x7f6ab00d1c70 2023-11-24T08:04:55.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab5b6f700 1 -- 172.21.15.153:0/2972886819 >> v1:172.21.15.164:6789/0 conn(0x7f6ab00b3370 legacy=0x7f6ab00b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab5b6f700 1 -- 172.21.15.153:0/2972886819 >> v1:172.21.15.153:6789/0 conn(0x7f6ab00d1c70 legacy=0x7f6ab0165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab5b6f700 1 -- 172.21.15.153:0/2972886819 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00b2890 con 0x7f6ab015bdd0 2023-11-24T08:04:55.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab5b6f700 1 --2- 172.21.15.153:0/2972886819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ab015bdd0 0x7f6ab01604e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009870 tx=0x7f6aa0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7b4c681fc1734 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab4b6d700 1 -- 172.21.15.153:0/2972886819 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8001970 con 0x7f6ab015bdd0 2023-11-24T08:04:55.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab4b6d700 1 -- 172.21.15.153:0/2972886819 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa0004030 con 0x7f6ab015bdd0 2023-11-24T08:04:55.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.313+0000 7f6ab4b6d700 1 -- 172.21.15.153:0/2972886819 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00043c0 con 0x7f6ab015bdd0 2023-11-24T08:04:55.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.314+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/2972886819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ab015bdd0 msgr2=0x7f6ab01604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.314+0000 7f6ab7dd3700 1 --2- 172.21.15.153:0/2972886819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ab015bdd0 0x7f6ab01604e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009870 tx=0x7f6aa0009b80 comp rx=0 tx=0).stop 2023-11-24T08:04:55.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.314+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/2972886819 shutdown_connections 2023-11-24T08:04:55.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.314+0000 7f6ab7dd3700 1 --2- 172.21.15.153:0/2972886819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ab015bdd0 0x7f6ab01604e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.314+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/2972886819 >> 172.21.15.153:0/2972886819 conn(0x7f6ab00731a0 msgr2=0x7f6ab009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:55.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.314+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/2972886819 shutdown_connections 2023-11-24T08:04:55.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.314+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/2972886819 wait complete. 2023-11-24T08:04:55.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.315+0000 7f6ab7dd3700 1 Processor -- start 2023-11-24T08:04:55.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.315+0000 7f6ab7dd3700 1 -- start start 2023-11-24T08:04:55.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab7dd3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ab00b3370 0x7f6ab01571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab7dd3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab00d1c70 0x7f6ab00cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab7dd3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ab015bdd0 0x7f6ab00cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab7dd3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00cb930 con 0x7f6ab00d1c70 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab7dd3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0157710 con 0x7f6ab00b3370 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab7dd3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00cad20 con 0x7f6ab015bdd0 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab536e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab00d1c70 0x7f6ab00cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab536e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab00d1c70 0x7f6ab00cd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36920/0 (socket says 172.21.15.153:36920) 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab536e700 1 -- 172.21.15.153:0/828461817 learned_addr learned my addr 172.21.15.153:0/828461817 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab5b6f700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ab00b3370 0x7f6ab01571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab6370700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ab015bdd0 0x7f6ab00cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab536e700 1 -- 172.21.15.153:0/828461817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ab015bdd0 msgr2=0x7f6ab00cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab536e700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ab015bdd0 0x7f6ab00cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab536e700 1 -- 172.21.15.153:0/828461817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ab00b3370 msgr2=0x7f6ab01571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab536e700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ab00b3370 0x7f6ab01571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab536e700 1 -- 172.21.15.153:0/828461817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa00094a0 con 0x7f6ab00d1c70 2023-11-24T08:04:55.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab536e700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab00d1c70 0x7f6ab00cd6d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c730 tx=0x7f6aac00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6aa67fc700 1 -- 172.21.15.153:0/828461817 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0052d0 con 0x7f6ab00d1c70 2023-11-24T08:04:55.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6aa67fc700 1 -- 172.21.15.153:0/828461817 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac005450 con 0x7f6ab00d1c70 2023-11-24T08:04:55.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/828461817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab00cb000 con 0x7f6ab00d1c70 2023-11-24T08:04:55.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.316+0000 7f6aa67fc700 1 -- 172.21.15.153:0/828461817 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0038c0 con 0x7f6ab00d1c70 2023-11-24T08:04:55.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.317+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/828461817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab00cb5c0 con 0x7f6ab00d1c70 2023-11-24T08:04:55.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.317+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/828461817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab0067f60 con 0x7f6ab00d1c70 2023-11-24T08:04:55.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.318+0000 7f6aa67fc700 1 -- 172.21.15.153:0/828461817 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6aac003a20 con 0x7f6ab00d1c70 2023-11-24T08:04:55.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.318+0000 7f6aa67fc700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a9406aed0 0x7f6a9406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.318+0000 7f6aa67fc700 1 -- 172.21.15.153:0/828461817 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6aac088bb0 con 0x7f6ab00d1c70 2023-11-24T08:04:55.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.318+0000 7f6ab5b6f700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a9406aed0 0x7f6a9406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.319+0000 7f6ab5b6f700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a9406aed0 0x7f6a9406d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00097c0 tx=0x7f6aa0013040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.323+0000 7f6aa67fc700 1 -- 172.21.15.153:0/828461817 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6aac053c60 con 0x7f6ab00d1c70 2023-11-24T08:04:55.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.557+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/828461817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6ab00b7c60 con 0x7f6ab00d1c70 2023-11-24T08:04:55.560 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-11-24T08:04:55.558+0000 7f3f0fc90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:04:55.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.559+0000 7f6aa67fc700 1 -- 172.21.15.153:0/828461817 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6aac017090 con 0x7f6ab00d1c70 2023-11-24T08:04:55.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.562+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/828461817 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a9406aed0 msgr2=0x7f6a9406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.562+0000 7f6ab7dd3700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a9406aed0 0x7f6a9406d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00097c0 tx=0x7f6aa0013040 comp rx=0 tx=0).stop 2023-11-24T08:04:55.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.562+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/828461817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab00d1c70 msgr2=0x7f6ab00cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.562+0000 7f6ab7dd3700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab00d1c70 0x7f6ab00cd6d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c730 tx=0x7f6aac00caf0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.562+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/828461817 shutdown_connections 2023-11-24T08:04:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.562+0000 7f6ab7dd3700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ab015bdd0 0x7f6ab00cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.562+0000 7f6ab7dd3700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ab00b3370 0x7f6ab01571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.562+0000 7f6ab7dd3700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a9406aed0 0x7f6a9406d390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.562+0000 7f6ab7dd3700 1 --2- 172.21.15.153:0/828461817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab00d1c70 0x7f6ab00cd6d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.562+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/828461817 >> 172.21.15.153:0/828461817 conn(0x7f6ab00731a0 msgr2=0x7f6ab00af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:55.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.563+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/828461817 shutdown_connections 2023-11-24T08:04:55.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.563+0000 7f6ab7dd3700 1 -- 172.21.15.153:0/828461817 wait complete. 2023-11-24T08:04:55.568 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:04:55.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:04:55.603 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-11-24T08:04:55.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.699+0000 7fc100214700 1 Processor -- start 2023-11-24T08:04:55.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.699+0000 7fc100214700 1 -- start start 2023-11-24T08:04:55.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc100214700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0f80afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc100214700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f80b3c60 con 0x7fc0f815e160 2023-11-24T08:04:55.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc100214700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f80b58c0 con 0x7fc0f80746a0 2023-11-24T08:04:55.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc100214700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80b4500 con 0x7fc0f80b5da0 2023-11-24T08:04:55.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fdfb0700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc0f815e160 0x7fc0f8073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43030/0 (socket says 172.21.15.153:43030) 2023-11-24T08:04:55.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fdfb0700 1 -- 172.21.15.153:0/1256317541 learned_addr learned my addr 172.21.15.153:0/1256317541 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:55.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fe7b1700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0f80afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007379193 0 0) 0x7fc0f80b3c60 con 0x7fc0f815e160 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e40035b0 con 0x7fc0f815e160 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2110495717 0 0) 0x7fc0e40035b0 con 0x7fc0f815e160 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 msgr2=0x7fc0f80afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0f80afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 >> v1:172.21.15.164:6789/0 conn(0x7fc0f80746a0 legacy=0x7fc0f806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f806bdc0 con 0x7fc0f815e160 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fc0e8001670 con 0x7fc0f815e160 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 >> v1:172.21.15.153:6789/0 conn(0x7fc0f815e160 legacy=0x7fc0f8073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0e4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0e4003fb0 0x7fc0e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0e4004d90 0x7fc0e4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80b4500 con 0x7fc0e4004d90 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e400baf0 con 0x7fc0e4003fb0 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e400bcb0 con 0x7fc0f80b5da0 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fdfb0700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0e4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fe7b1700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0e4004d90 0x7fc0e4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.700+0000 7fc0fd7af700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0e4003fb0 0x7fc0e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc0fdfb0700 1 -- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0e4003fb0 msgr2=0x7fc0e4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc0fdfb0700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0e4003fb0 0x7fc0e4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc0fdfb0700 1 -- 172.21.15.153:0/1256317541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0e4004d90 msgr2=0x7fc0e4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc0fdfb0700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0e4004d90 0x7fc0e4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc0fdfb0700 1 -- 172.21.15.153:0/1256317541 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e40035b0 con 0x7fc0f80b5da0 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc0fe7b1700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0e4004d90 0x7fc0e4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc0fdfb0700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0e4003a30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800c240 tx=0x7fc0e4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2590c909f2f5dfe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8007c10 con 0x7fc0f80b5da0 2023-11-24T08:04:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e800ce00 con 0x7fc0f80b5da0 2023-11-24T08:04:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc0fcfae700 1 -- 172.21.15.153:0/1256317541 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8005ba0 con 0x7fc0f80b5da0 2023-11-24T08:04:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc100214700 1 -- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 msgr2=0x7fc0e4003a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.701+0000 7fc100214700 1 --2- 172.21.15.153:0/1256317541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0e4003a30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800c240 tx=0x7fc0e4005880 comp rx=0 tx=0).stop 2023-11-24T08:04:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.702+0000 7fc0fe7b1700 1 -- 172.21.15.153:0/1256317541 reap_dead start 2023-11-24T08:04:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.702+0000 7fc100214700 1 -- 172.21.15.153:0/1256317541 shutdown_connections 2023-11-24T08:04:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.702+0000 7fc100214700 1 -- 172.21.15.153:0/1256317541 >> 172.21.15.153:0/1256317541 conn(0x7fc0f80d0bf0 msgr2=0x7fc0f80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.702+0000 7fc100214700 1 -- 172.21.15.153:0/1256317541 shutdown_connections 2023-11-24T08:04:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.702+0000 7fc100214700 1 -- 172.21.15.153:0/1256317541 wait complete. 2023-11-24T08:04:55.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.703+0000 7fc100214700 1 Processor -- start 2023-11-24T08:04:55.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.703+0000 7fc100214700 1 -- start start 2023-11-24T08:04:55.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc100214700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0f8155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc100214700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0f81579e0 0x7fc0f8157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc100214700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0f81560e0 0x7fc0f8156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc100214700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f81583a0 con 0x7fc0f81560e0 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc100214700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f81576f0 con 0x7fc0f81579e0 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc100214700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f8155d70 con 0x7fc0f80b5da0 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fdfb0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0f8155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fe7b1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0f81560e0 0x7fc0f8156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fdfb0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0f8155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:49008/0 (socket says 172.21.15.153:49008) 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fe7b1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0f81560e0 0x7fc0f8156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36942/0 (socket says 172.21.15.153:36942) 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fdfb0700 1 -- 172.21.15.153:0/2318768877 learned_addr learned my addr 172.21.15.153:0/2318768877 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fd7af700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0f81579e0 0x7fc0f8157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fe7b1700 1 -- 172.21.15.153:0/2318768877 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 msgr2=0x7fc0f8155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fe7b1700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0f8155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fe7b1700 1 -- 172.21.15.153:0/2318768877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0f81579e0 msgr2=0x7fc0f8157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fe7b1700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0f81579e0 0x7fc0f8157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fe7b1700 1 -- 172.21.15.153:0/2318768877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f8156e50 con 0x7fc0f81560e0 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0fe7b1700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0f81560e0 0x7fc0f8156560 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8072d60 tx=0x7fc0f000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0ee7fc700 1 -- 172.21.15.153:0/2318768877 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f001c070 con 0x7fc0f81560e0 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0ee7fc700 1 -- 172.21.15.153:0/2318768877 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f000f040 con 0x7fc0f81560e0 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc100214700 1 -- 172.21.15.153:0/2318768877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f8157130 con 0x7fc0f81560e0 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc0ee7fc700 1 -- 172.21.15.153:0/2318768877 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000e040 con 0x7fc0f81560e0 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.704+0000 7fc100214700 1 -- 172.21.15.153:0/2318768877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f815e7d0 con 0x7fc0f81560e0 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.705+0000 7fc100214700 1 -- 172.21.15.153:0/2318768877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f815eb40 con 0x7fc0f81560e0 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.706+0000 7fc0ee7fc700 1 -- 172.21.15.153:0/2318768877 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0f0015430 con 0x7fc0f81560e0 2023-11-24T08:04:55.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.706+0000 7fc0ee7fc700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc0dc06af00 0x7fc0dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.706+0000 7fc0ee7fc700 1 -- 172.21.15.153:0/2318768877 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc0f00890e0 con 0x7fc0f81560e0 2023-11-24T08:04:55.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.706+0000 7fc0fdfb0700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc0dc06af00 0x7fc0dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.707+0000 7fc0fdfb0700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc0dc06af00 0x7fc0dc06d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800d010 tx=0x7fc0e8007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.710+0000 7fc0ee7fc700 1 -- 172.21.15.153:0/2318768877 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc0f0054130 con 0x7fc0f81560e0 2023-11-24T08:04:55.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:55.944+0000 7fc100214700 1 -- 172.21.15.153:0/2318768877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc0f815e960 con 0x7fc0f81560e0 2023-11-24T08:04:56.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.567+0000 7fc0ee7fc700 1 -- 172.21.15.153:0/2318768877 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc0f0057750 con 0x7fc0f81560e0 2023-11-24T08:04:56.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 -- 172.21.15.153:0/2318768877 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc0dc06af00 msgr2=0x7fc0dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc0dc06af00 0x7fc0dc06d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800d010 tx=0x7fc0e8007000 comp rx=0 tx=0).stop 2023-11-24T08:04:56.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 -- 172.21.15.153:0/2318768877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0f81560e0 msgr2=0x7fc0f8156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0f81560e0 0x7fc0f8156560 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8072d60 tx=0x7fc0f000f6c0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 -- 172.21.15.153:0/2318768877 shutdown_connections 2023-11-24T08:04:56.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc0dc06af00 0x7fc0dc06d3c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0f81560e0 0x7fc0f8156560 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0f80b5da0 0x7fc0f8155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 --2- 172.21.15.153:0/2318768877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0f81579e0 0x7fc0f8157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 -- 172.21.15.153:0/2318768877 >> 172.21.15.153:0/2318768877 conn(0x7fc0f80d0bf0 msgr2=0x7fc0f806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 -- 172.21.15.153:0/2318768877 shutdown_connections 2023-11-24T08:04:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.570+0000 7fc100214700 1 -- 172.21.15.153:0/2318768877 wait complete. 2023-11-24T08:04:56.586 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:04:56.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.712+0000 7fd7e4e31700 1 Processor -- start 2023-11-24T08:04:56.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.712+0000 7fd7e4e31700 1 -- start start 2023-11-24T08:04:56.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.713+0000 7fd7e4e31700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e00b01e0 0x7fd7e006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.713+0000 7fd7e4e31700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd7e00b59c0 0x7fd7e00b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.713+0000 7fd7e4e31700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e00b5e40 con 0x7fd7e0073f90 2023-11-24T08:04:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.713+0000 7fd7e4e31700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e01470a0 con 0x7fd7e00b59c0 2023-11-24T08:04:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.713+0000 7fd7e4e31700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00b05c0 con 0x7fd7e00b01e0 2023-11-24T08:04:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.713+0000 7fd7ddd9b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd7e00b59c0 0x7fd7e00b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.713+0000 7fd7de59c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e00b01e0 0x7fd7e006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.713+0000 7fd7ded9d700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fd7e0073f90 0x7fd7e006aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:50732/0 (socket says 172.21.15.153:50732) 2023-11-24T08:04:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.713+0000 7fd7ded9d700 1 -- 172.21.15.153:0/2956705142 learned_addr learned my addr 172.21.15.153:0/2956705142 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.714+0000 7fd7ddd9b700 1 -- 172.21.15.153:0/2956705142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e00b01e0 msgr2=0x7fd7e006e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.714+0000 7fd7ddd9b700 1 --2- 172.21.15.153:0/2956705142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e00b01e0 0x7fd7e006e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.714+0000 7fd7ddd9b700 1 -- 172.21.15.153:0/2956705142 >> v1:172.21.15.164:6789/0 conn(0x7fd7e0073f90 legacy=0x7fd7e006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.714+0000 7fd7ddd9b700 1 -- 172.21.15.153:0/2956705142 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e00b4250 con 0x7fd7e00b59c0 2023-11-24T08:04:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.714+0000 7fd7dd59a700 1 -- 172.21.15.153:0/2956705142 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972127598 0 0) 0x7fd7e00b5e40 con 0x7fd7e0073f90 2023-11-24T08:04:56.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.714+0000 7fd7de59c700 1 --2- 172.21.15.153:0/2956705142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e00b01e0 0x7fd7e006e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:56.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.714+0000 7fd7ddd9b700 1 --2- 172.21.15.153:0/2956705142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e00b59c0 0x7fd7e00b3b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009840 tx=0x7fd7d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=953d65008e70d845 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.714+0000 7fd7dd59a700 1 -- 172.21.15.153:0/2956705142 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0011830 con 0x7fd7e00b59c0 2023-11-24T08:04:56.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.714+0000 7fd7dd59a700 1 -- 172.21.15.153:0/2956705142 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d0011990 con 0x7fd7e00b59c0 2023-11-24T08:04:56.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.714+0000 7fd7dd59a700 1 -- 172.21.15.153:0/2956705142 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0011d20 con 0x7fd7e00b59c0 2023-11-24T08:04:56.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.715+0000 7fd7e4e31700 1 -- 172.21.15.153:0/2956705142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e00b59c0 msgr2=0x7fd7e00b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.715+0000 7fd7e4e31700 1 --2- 172.21.15.153:0/2956705142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e00b59c0 0x7fd7e00b3b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009840 tx=0x7fd7d0009b50 comp rx=0 tx=0).stop 2023-11-24T08:04:56.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.715+0000 7fd7e4e31700 1 -- 172.21.15.153:0/2956705142 shutdown_connections 2023-11-24T08:04:56.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.715+0000 7fd7e4e31700 1 --2- 172.21.15.153:0/2956705142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e00b01e0 0x7fd7e006e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.715+0000 7fd7e4e31700 1 --2- 172.21.15.153:0/2956705142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e00b59c0 0x7fd7e00b3b50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.715+0000 7fd7e4e31700 1 -- 172.21.15.153:0/2956705142 >> 172.21.15.153:0/2956705142 conn(0x7fd7e00d0b40 msgr2=0x7fd7e00d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.715+0000 7fd7e4e31700 1 -- 172.21.15.153:0/2956705142 shutdown_connections 2023-11-24T08:04:56.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.715+0000 7fd7e4e31700 1 -- 172.21.15.153:0/2956705142 wait complete. 2023-11-24T08:04:56.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.716+0000 7fd7e4e31700 1 Processor -- start 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.716+0000 7fd7e4e31700 1 -- start start 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7e4e31700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e0073f90 0x7fd7e015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7e4e31700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e00b01e0 0x7fd7e0142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7e4e31700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e00b59c0 0x7fd7e0143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7e4e31700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e015b980 con 0x7fd7e00b01e0 2023-11-24T08:04:56.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7e4e31700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e015bc60 con 0x7fd7e0073f90 2023-11-24T08:04:56.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7e4e31700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e015bf40 con 0x7fd7e00b59c0 2023-11-24T08:04:56.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ddd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e00b01e0 0x7fd7e0142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ddd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e00b01e0 0x7fd7e0142330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36954/0 (socket says 172.21.15.153:36954) 2023-11-24T08:04:56.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ddd9b700 1 -- 172.21.15.153:0/311305518 learned_addr learned my addr 172.21.15.153:0/311305518 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:56.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ded9d700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e00b59c0 0x7fd7e0143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7de59c700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e0073f90 0x7fd7e015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ddd9b700 1 -- 172.21.15.153:0/311305518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e00b59c0 msgr2=0x7fd7e0143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ddd9b700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e00b59c0 0x7fd7e0143580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ddd9b700 1 -- 172.21.15.153:0/311305518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e0073f90 msgr2=0x7fd7e015ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ddd9b700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e0073f90 0x7fd7e015ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ddd9b700 1 -- 172.21.15.153:0/311305518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40094a0 con 0x7fd7e00b01e0 2023-11-24T08:04:56.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ddd9b700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e00b01e0 0x7fd7e0142330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009fd0 tx=0x7fd7d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ceffd700 1 -- 172.21.15.153:0/311305518 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0004590 con 0x7fd7e00b01e0 2023-11-24T08:04:56.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7ceffd700 1 -- 172.21.15.153:0/311305518 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d00036a0 con 0x7fd7e00b01e0 2023-11-24T08:04:56.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.717+0000 7fd7e4e31700 1 -- 172.21.15.153:0/311305518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d00094a0 con 0x7fd7e00b01e0 2023-11-24T08:04:56.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.718+0000 7fd7ceffd700 1 -- 172.21.15.153:0/311305518 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0003a30 con 0x7fd7e00b01e0 2023-11-24T08:04:56.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.718+0000 7fd7e4e31700 1 -- 172.21.15.153:0/311305518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e015c500 con 0x7fd7e00b01e0 2023-11-24T08:04:56.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.718+0000 7fd7e4e31700 1 -- 172.21.15.153:0/311305518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e00b4810 con 0x7fd7e00b01e0 2023-11-24T08:04:56.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.719+0000 7fd7ceffd700 1 -- 172.21.15.153:0/311305518 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7d0003b90 con 0x7fd7e00b01e0 2023-11-24T08:04:56.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.719+0000 7fd7ceffd700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7c006aed0 0x7fd7c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.719+0000 7fd7ceffd700 1 -- 172.21.15.153:0/311305518 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd7d008a830 con 0x7fd7e00b01e0 2023-11-24T08:04:56.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.719+0000 7fd7de59c700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7c006aed0 0x7fd7c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.720+0000 7fd7de59c700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7c006aed0 0x7fd7c006d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009d70 tx=0x7fd7d4009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.724+0000 7fd7ceffd700 1 -- 172.21.15.153:0/311305518 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7d0055a30 con 0x7fd7e00b01e0 2023-11-24T08:04:56.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:56.915+0000 7fd7e4e31700 1 -- 172.21.15.153:0/311305518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd7e0067f60 con 0x7fd7e00b01e0 2023-11-24T08:04:57.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.568+0000 7fd7ceffd700 1 -- 172.21.15.153:0/311305518 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd7d00150d0 con 0x7fd7e00b01e0 2023-11-24T08:04:57.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 -- 172.21.15.153:0/311305518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7c006aed0 msgr2=0x7fd7c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7c006aed0 0x7fd7c006d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009d70 tx=0x7fd7d4009210 comp rx=0 tx=0).stop 2023-11-24T08:04:57.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 -- 172.21.15.153:0/311305518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e00b01e0 msgr2=0x7fd7e0142330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e00b01e0 0x7fd7e0142330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009fd0 tx=0x7fd7d0004750 comp rx=0 tx=0).stop 2023-11-24T08:04:57.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 -- 172.21.15.153:0/311305518 shutdown_connections 2023-11-24T08:04:57.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e00b59c0 0x7fd7e0143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e0073f90 0x7fd7e015ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7c006aed0 0x7fd7c006d390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 --2- 172.21.15.153:0/311305518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7e00b01e0 0x7fd7e0142330 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 -- 172.21.15.153:0/311305518 >> 172.21.15.153:0/311305518 conn(0x7fd7e00d0b40 msgr2=0x7fd7e00b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 -- 172.21.15.153:0/311305518 shutdown_connections 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.572+0000 7fd7e4e31700 1 -- 172.21.15.153:0/311305518 wait complete. 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:04:57.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:04:57.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.712+0000 7fb47b694700 1 Processor -- start 2023-11-24T08:04:57.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.712+0000 7fb47b694700 1 -- start start 2023-11-24T08:04:57.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb47b694700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4740b01e0 0x7fb47406e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb47b694700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb4740b59c0 0x7fb4740b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb47b694700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb474073f90 0x7fb4740743e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb47b694700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4741470a0 con 0x7fb474073f90 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb47b694700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb474074920 con 0x7fb4740b59c0 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb47b694700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4740b5e40 con 0x7fb4740b01e0 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb479c31700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb474073f90 0x7fb4740743e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb479c31700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb474073f90 0x7fb4740743e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36964/0 (socket says 172.21.15.153:36964) 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb479c31700 1 -- 172.21.15.153:0/2556251775 learned_addr learned my addr 172.21.15.153:0/2556251775 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb479430700 1 --2- 172.21.15.153:0/2556251775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4740b01e0 0x7fb47406e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb479c31700 1 -- 172.21.15.153:0/2556251775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4740b01e0 msgr2=0x7fb47406e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb479c31700 1 --2- 172.21.15.153:0/2556251775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4740b01e0 0x7fb47406e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb479c31700 1 -- 172.21.15.153:0/2556251775 >> v2:172.21.15.164:3300/0 conn(0x7fb4740b59c0 msgr2=0x7fb4740b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb478c2f700 1 --2- 172.21.15.153:0/2556251775 >> v2:172.21.15.164:3300/0 conn(0x7fb4740b59c0 0x7fb4740b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb479c31700 1 --2- 172.21.15.153:0/2556251775 >> v2:172.21.15.164:3300/0 conn(0x7fb4740b59c0 0x7fb4740b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb479c31700 1 -- 172.21.15.153:0/2556251775 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4740b05c0 con 0x7fb474073f90 2023-11-24T08:04:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb478c2f700 1 --2- 172.21.15.153:0/2556251775 >> v2:172.21.15.164:3300/0 conn(0x7fb4740b59c0 0x7fb4740b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.713+0000 7fb479c31700 1 --2- 172.21.15.153:0/2556251775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb474073f90 0x7fb4740743e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb474073320 tx=0x7fb46c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8550b6205689598a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb46bfff700 1 -- 172.21.15.153:0/2556251775 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c00e070 con 0x7fb474073f90 2023-11-24T08:04:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb46bfff700 1 -- 172.21.15.153:0/2556251775 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c00b9c0 con 0x7fb474073f90 2023-11-24T08:04:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb46bfff700 1 -- 172.21.15.153:0/2556251775 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c00bd70 con 0x7fb474073f90 2023-11-24T08:04:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb47b694700 1 -- 172.21.15.153:0/2556251775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb474073f90 msgr2=0x7fb4740743e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb47b694700 1 --2- 172.21.15.153:0/2556251775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb474073f90 0x7fb4740743e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb474073320 tx=0x7fb46c00b330 comp rx=0 tx=0).stop 2023-11-24T08:04:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb47b694700 1 -- 172.21.15.153:0/2556251775 shutdown_connections 2023-11-24T08:04:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb47b694700 1 --2- 172.21.15.153:0/2556251775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb474073f90 0x7fb4740743e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb47b694700 1 --2- 172.21.15.153:0/2556251775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4740b01e0 0x7fb47406e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb47b694700 1 --2- 172.21.15.153:0/2556251775 >> v2:172.21.15.164:3300/0 conn(0x7fb4740b59c0 0x7fb4740b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb47b694700 1 -- 172.21.15.153:0/2556251775 >> 172.21.15.153:0/2556251775 conn(0x7fb4740d0b40 msgr2=0x7fb4740d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:57.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb47b694700 1 -- 172.21.15.153:0/2556251775 shutdown_connections 2023-11-24T08:04:57.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.714+0000 7fb47b694700 1 -- 172.21.15.153:0/2556251775 wait complete. 2023-11-24T08:04:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.716+0000 7fb47b694700 1 Processor -- start 2023-11-24T08:04:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.716+0000 7fb47b694700 1 -- start start 2023-11-24T08:04:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb47b694700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb474073f90 0x7fb47415f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb47b694700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4740b01e0 0x7fb47413f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb47b694700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4740b59c0 0x7fb474145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb47b694700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47415f550 con 0x7fb4740b59c0 2023-11-24T08:04:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb47b694700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47415df90 con 0x7fb474073f90 2023-11-24T08:04:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb47b694700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4740c5e80 con 0x7fb4740b01e0 2023-11-24T08:04:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb479c31700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4740b59c0 0x7fb474145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb479c31700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4740b59c0 0x7fb474145180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36968/0 (socket says 172.21.15.153:36968) 2023-11-24T08:04:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb479c31700 1 -- 172.21.15.153:0/1656275394 learned_addr learned my addr 172.21.15.153:0/1656275394 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb479430700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb474073f90 0x7fb47415f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb479c31700 1 -- 172.21.15.153:0/1656275394 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4740b01e0 msgr2=0x7fb47413f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb478c2f700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4740b01e0 0x7fb47413f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb479c31700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4740b01e0 0x7fb47413f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb479c31700 1 -- 172.21.15.153:0/1656275394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb474073f90 msgr2=0x7fb47415f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb479c31700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb474073f90 0x7fb47415f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb479c31700 1 -- 172.21.15.153:0/1656275394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c009b30 con 0x7fb4740b59c0 2023-11-24T08:04:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb479430700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb474073f90 0x7fb47415f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb478c2f700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4740b01e0 0x7fb47413f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb479c31700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4740b59c0 0x7fb474145180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00b370 tx=0x7fb46c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.717+0000 7fb469ffb700 1 -- 172.21.15.153:0/1656275394 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c004390 con 0x7fb4740b59c0 2023-11-24T08:04:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.718+0000 7fb469ffb700 1 -- 172.21.15.153:0/1656275394 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c004510 con 0x7fb4740b59c0 2023-11-24T08:04:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.718+0000 7fb47b694700 1 -- 172.21.15.153:0/1656275394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4740c6160 con 0x7fb4740b59c0 2023-11-24T08:04:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.718+0000 7fb469ffb700 1 -- 172.21.15.153:0/1656275394 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0048c0 con 0x7fb4740b59c0 2023-11-24T08:04:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.718+0000 7fb47b694700 1 -- 172.21.15.153:0/1656275394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4740c6720 con 0x7fb4740b59c0 2023-11-24T08:04:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.719+0000 7fb47b694700 1 -- 172.21.15.153:0/1656275394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4740b5430 con 0x7fb4740b59c0 2023-11-24T08:04:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.719+0000 7fb469ffb700 1 -- 172.21.15.153:0/1656275394 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb46c01c440 con 0x7fb4740b59c0 2023-11-24T08:04:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.719+0000 7fb469ffb700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb45806aed0 0x7fb45806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.720+0000 7fb469ffb700 1 -- 172.21.15.153:0/1656275394 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fb46c08ae10 con 0x7fb4740b59c0 2023-11-24T08:04:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.720+0000 7fb479430700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb45806aed0 0x7fb45806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.720+0000 7fb479430700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb45806aed0 0x7fb45806d390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb470006fd0 tx=0x7fb470008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.724+0000 7fb469ffb700 1 -- 172.21.15.153:0/1656275394 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb46c08e030 con 0x7fb4740b59c0 2023-11-24T08:04:57.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:57.922+0000 7fb47b694700 1 -- 172.21.15.153:0/1656275394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb474068670 con 0x7fb4740b59c0 2023-11-24T08:04:58.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.573+0000 7fb469ffb700 1 -- 172.21.15.153:0/1656275394 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb46c0200d0 con 0x7fb4740b59c0 2023-11-24T08:04:58.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.577+0000 7fb47b694700 1 -- 172.21.15.153:0/1656275394 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb45806aed0 msgr2=0x7fb45806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.577+0000 7fb47b694700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb45806aed0 0x7fb45806d390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb470006fd0 tx=0x7fb470008040 comp rx=0 tx=0).stop 2023-11-24T08:04:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.577+0000 7fb47b694700 1 -- 172.21.15.153:0/1656275394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4740b59c0 msgr2=0x7fb474145180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.577+0000 7fb47b694700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4740b59c0 0x7fb474145180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00b370 tx=0x7fb46c004ad0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.577+0000 7fb47b694700 1 -- 172.21.15.153:0/1656275394 shutdown_connections 2023-11-24T08:04:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.577+0000 7fb47b694700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb45806aed0 0x7fb45806d390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.577+0000 7fb47b694700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4740b59c0 0x7fb474145180 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.577+0000 7fb47b694700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb474073f90 0x7fb47415f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.577+0000 7fb47b694700 1 --2- 172.21.15.153:0/1656275394 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4740b01e0 0x7fb47413f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.578+0000 7fb47b694700 1 -- 172.21.15.153:0/1656275394 >> 172.21.15.153:0/1656275394 conn(0x7fb4740d0b40 msgr2=0x7fb4740b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.578+0000 7fb47b694700 1 -- 172.21.15.153:0/1656275394 shutdown_connections 2023-11-24T08:04:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.578+0000 7fb47b694700 1 -- 172.21.15.153:0/1656275394 wait complete. 2023-11-24T08:04:58.581 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-11-24T08:04:58.595 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:04:58.595 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T08:04:58.595 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:04:58.595 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:58.595 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:04:58.595 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T08:04:58.596 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:04:58.596 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:58.596 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:04:58.596 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T08:04:58.596 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:04:58.596 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:58.597 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:04:58.597 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T08:04:58.597 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:04:58.597 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:58.605 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:04:58.605 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:04:58.606 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:04:58.606 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:04:58.609 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:04:58.609 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:04:58.610 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:04:58.610 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:04:58.648 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:04:58.648 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:58.649 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:04:58.649 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:58.652 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:04:58.652 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:58.653 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:04:58.653 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:58.653 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T08:04:58.729 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-11-24T08:04:58.730 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-11-24T08:04:58.737 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-11-24T08:04:58.737 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-11-24T08:04:58.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.780+0000 7f0031ff5700 1 Processor -- start 2023-11-24T08:04:58.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.780+0000 7f0031ff5700 1 -- start start 2023-11-24T08:04:58.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f0031ff5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f002c161660 0x7f002c0b9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f0031ff5700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f002c0b65d0 0x7f002c0d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f0031ff5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002c161a40 con 0x7f002c161cf0 2023-11-24T08:04:58.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f0031ff5700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002c0b6fb0 con 0x7f002c0b65d0 2023-11-24T08:04:58.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f0031ff5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0d0210 con 0x7f002c161660 2023-11-24T08:04:58.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002affd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f002c161cf0 0x7f002c0b5ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43104/0 (socket says 172.21.15.153:43104) 2023-11-24T08:04:58.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002affd700 1 -- 172.21.15.153:0/629806043 learned_addr learned my addr 172.21.15.153:0/629806043 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:04:58.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002bfff700 1 --2- 172.21.15.153:0/629806043 >> v2:172.21.15.164:3300/0 conn(0x7f002c0b65d0 0x7f002c0d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002b7fe700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f002c161660 0x7f002c0b9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675785229 0 0) 0x7f002c161a40 con 0x7f002c161cf0 2023-11-24T08:04:58.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00140035b0 con 0x7f002c161cf0 2023-11-24T08:04:58.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 206359831 0 0) 0x7f00140035b0 con 0x7f002c161cf0 2023-11-24T08:04:58.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f002c161660 msgr2=0x7f002c0b9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002a7fc700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f002c161660 0x7f002c0b9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 >> v2:172.21.15.164:3300/0 conn(0x7f002c0b65d0 msgr2=0x7f002c0d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002a7fc700 1 --2- 172.21.15.153:0/629806043 >> v2:172.21.15.164:3300/0 conn(0x7f002c0b65d0 0x7f002c0d29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c162540 con 0x7f002c161cf0 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f001c001670 con 0x7f002c161cf0 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002bfff700 1 --2- 172.21.15.153:0/629806043 >> v2:172.21.15.164:3300/0 conn(0x7f002c0b65d0 0x7f002c0d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 >> v1:172.21.15.153:6789/0 conn(0x7f002c161cf0 legacy=0x7f002c0b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.781+0000 7f002a7fc700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f002c161660 0x7f0014003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002a7fc700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0014003f80 0x7f0014004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002a7fc700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0014004d90 0x7f0014005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0b6fb0 con 0x7f0014003f80 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0d0210 con 0x7f0014004d90 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001400ba10 con 0x7f002c161660 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002affd700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0014003f80 0x7f0014004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002bfff700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0014004d90 0x7f0014005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002b7fe700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f002c161660 0x7f0014003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002affd700 1 -- 172.21.15.153:0/629806043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f002c161660 msgr2=0x7f0014003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002affd700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f002c161660 0x7f0014003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002affd700 1 -- 172.21.15.153:0/629806043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0014004d90 msgr2=0x7f0014005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002affd700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0014004d90 0x7f0014005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002affd700 1 -- 172.21.15.153:0/629806043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00140035b0 con 0x7f0014003f80 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002affd700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0014003f80 0x7f0014004850 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f001c00c320 tx=0x7f0014005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91effc5f7d863358 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c00ce00 con 0x7f0014003f80 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c005960 con 0x7f0014003f80 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.782+0000 7f002a7fc700 1 -- 172.21.15.153:0/629806043 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c005d10 con 0x7f0014003f80 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.783+0000 7f0031ff5700 1 -- 172.21.15.153:0/629806043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0014003f80 msgr2=0x7f0014004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.783+0000 7f0031ff5700 1 --2- 172.21.15.153:0/629806043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0014003f80 0x7f0014004850 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f001c00c320 tx=0x7f0014005880 comp rx=0 tx=0).stop 2023-11-24T08:04:58.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.783+0000 7f002bfff700 1 -- 172.21.15.153:0/629806043 reap_dead start 2023-11-24T08:04:58.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.783+0000 7f0031ff5700 1 -- 172.21.15.153:0/629806043 shutdown_connections 2023-11-24T08:04:58.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.783+0000 7f0031ff5700 1 -- 172.21.15.153:0/629806043 >> 172.21.15.153:0/629806043 conn(0x7f002c0d42a0 msgr2=0x7f002c0d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.783+0000 7f0031ff5700 1 -- 172.21.15.153:0/629806043 shutdown_connections 2023-11-24T08:04:58.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.783+0000 7f0031ff5700 1 -- 172.21.15.153:0/629806043 wait complete. 2023-11-24T08:04:58.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.784+0000 7f0031ff5700 1 Processor -- start 2023-11-24T08:04:58.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.784+0000 7f0031ff5700 1 -- start start 2023-11-24T08:04:58.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.785+0000 7f0031ff5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0014003f80 0x7f002c1f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.785+0000 7f0031ff5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f002c0b8b80 0x7f002c1f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.785+0000 7f0031ff5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c15dfe0 0x7f002c160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.785+0000 7f0031ff5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0c9000 con 0x7f002c15dfe0 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.785+0000 7f0031ff5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0b9000 con 0x7f002c0b8b80 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.785+0000 7f0031ff5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0ce740 con 0x7f0014003f80 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.785+0000 7f002bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c15dfe0 0x7f002c160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.785+0000 7f002bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c15dfe0 0x7f002c160330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37014/0 (socket says 172.21.15.153:37014) 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.785+0000 7f002bfff700 1 -- 172.21.15.153:0/1803230685 learned_addr learned my addr 172.21.15.153:0/1803230685 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.785+0000 7f002b7fe700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0014003f80 0x7f002c1f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.785+0000 7f002affd700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f002c0b8b80 0x7f002c1f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.786+0000 7f002bfff700 1 -- 172.21.15.153:0/1803230685 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0014003f80 msgr2=0x7f002c1f6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.786+0000 7f002bfff700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0014003f80 0x7f002c1f6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.786+0000 7f002bfff700 1 -- 172.21.15.153:0/1803230685 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f002c0b8b80 msgr2=0x7f002c1f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.786+0000 7f002bfff700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f002c0b8b80 0x7f002c1f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.786+0000 7f002bfff700 1 -- 172.21.15.153:0/1803230685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c1f75d0 con 0x7f002c15dfe0 2023-11-24T08:04:58.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.786+0000 7f002bfff700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c15dfe0 0x7f002c160330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f002c0b38b0 tx=0x7f002400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.786+0000 7f0013fff700 1 -- 172.21.15.153:0/1803230685 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002401c070 con 0x7f002c15dfe0 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.786+0000 7f0013fff700 1 -- 172.21.15.153:0/1803230685 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002400f040 con 0x7f002c15dfe0 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.786+0000 7f0031ff5700 1 -- 172.21.15.153:0/1803230685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002c1f78b0 con 0x7f002c15dfe0 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.786+0000 7f0013fff700 1 -- 172.21.15.153:0/1803230685 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002400e040 con 0x7f002c15dfe0 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.786+0000 7f0031ff5700 1 -- 172.21.15.153:0/1803230685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c1f7e70 con 0x7f002c15dfe0 2023-11-24T08:04:58.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.787+0000 7f0031ff5700 1 -- 172.21.15.153:0/1803230685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002c0c9140 con 0x7f002c15dfe0 2023-11-24T08:04:58.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.787+0000 7f0013fff700 1 -- 172.21.15.153:0/1803230685 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0024015430 con 0x7f002c15dfe0 2023-11-24T08:04:58.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.788+0000 7f0013fff700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f001806aed0 0x7f001806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.788+0000 7f0013fff700 1 -- 172.21.15.153:0/1803230685 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0024089010 con 0x7f002c15dfe0 2023-11-24T08:04:58.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.788+0000 7f002b7fe700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f001806aed0 0x7f001806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.788+0000 7f002b7fe700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f001806aed0 0x7f001806d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f002c0b6150 tx=0x7f0020008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.792+0000 7f0013fff700 1 -- 172.21.15.153:0/1803230685 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f002c0c9140 con 0x7f002c15dfe0 2023-11-24T08:04:58.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:04:58.996+0000 7f0031ff5700 1 -- 172.21.15.153:0/1803230685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f002c0c9140 con 0x7f002c15dfe0 2023-11-24T08:05:00.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.158+0000 7f0013fff700 1 -- 172.21.15.153:0/1803230685 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f002c0c9140 con 0x7f002c15dfe0 2023-11-24T08:05:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 -- 172.21.15.153:0/1803230685 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f001806aed0 msgr2=0x7f001806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f001806aed0 0x7f001806d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f002c0b6150 tx=0x7f0020008040 comp rx=0 tx=0).stop 2023-11-24T08:05:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 -- 172.21.15.153:0/1803230685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c15dfe0 msgr2=0x7f002c160330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c15dfe0 0x7f002c160330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f002c0b38b0 tx=0x7f002400f490 comp rx=0 tx=0).stop 2023-11-24T08:05:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 -- 172.21.15.153:0/1803230685 shutdown_connections 2023-11-24T08:05:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f001806aed0 0x7f001806d390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c15dfe0 0x7f002c160330 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0014003f80 0x7f002c1f6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 --2- 172.21.15.153:0/1803230685 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f002c0b8b80 0x7f002c1f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 -- 172.21.15.153:0/1803230685 >> 172.21.15.153:0/1803230685 conn(0x7f002c0d42a0 msgr2=0x7f002c0d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 -- 172.21.15.153:0/1803230685 shutdown_connections 2023-11-24T08:05:00.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.161+0000 7f0031ff5700 1 -- 172.21.15.153:0/1803230685 wait complete. 2023-11-24T08:05:00.164 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-11-24T08:05:00.178 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T08:05:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.303+0000 7f262155d700 1 Processor -- start 2023-11-24T08:05:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.303+0000 7f262155d700 1 -- start start 2023-11-24T08:05:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.303+0000 7f262155d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f261c145740 0x7f261c06e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.303+0000 7f262155d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f261c15ff40 0x7f261c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.303+0000 7f262155d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c070ac0 con 0x7f261c1603d0 2023-11-24T08:05:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.303+0000 7f262155d700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c06ede0 con 0x7f261c15ff40 2023-11-24T08:05:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.303+0000 7f262155d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c06d670 con 0x7f261c145740 2023-11-24T08:05:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.304+0000 7f261b7fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f261c15ff40 0x7f261c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.304+0000 7f261affd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f261c145740 0x7f261c06e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.304+0000 7f261a7fc700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f261c1603d0 0x7f261c15f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:50810/0 (socket says 172.21.15.153:50810) 2023-11-24T08:05:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.304+0000 7f261a7fc700 1 -- 172.21.15.153:0/852027206 learned_addr learned my addr 172.21.15.153:0/852027206 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.304+0000 7f261b7fe700 1 -- 172.21.15.153:0/852027206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f261c145740 msgr2=0x7f261c06e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.304+0000 7f261b7fe700 1 --2- 172.21.15.153:0/852027206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f261c145740 0x7f261c06e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.304+0000 7f261b7fe700 1 -- 172.21.15.153:0/852027206 >> v1:172.21.15.164:6789/0 conn(0x7f261c1603d0 legacy=0x7f261c15f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.304+0000 7f261b7fe700 1 -- 172.21.15.153:0/852027206 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c06d950 con 0x7f261c15ff40 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.304+0000 7f261affd700 1 --2- 172.21.15.153:0/852027206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f261c145740 0x7f261c06e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.304+0000 7f261b7fe700 1 --2- 172.21.15.153:0/852027206 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f261c15ff40 0x7f261c070f50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2614009d90 tx=0x7f261400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38cece94bf7eb3a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.304+0000 7f2619ffb700 1 -- 172.21.15.153:0/852027206 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400e070 con 0x7f261c15ff40 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.305+0000 7f2619ffb700 1 -- 172.21.15.153:0/852027206 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261400bb20 con 0x7f261c15ff40 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.305+0000 7f2619ffb700 1 -- 172.21.15.153:0/852027206 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614012430 con 0x7f261c15ff40 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.305+0000 7f262155d700 1 -- 172.21.15.153:0/852027206 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f261c15ff40 msgr2=0x7f261c070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.305+0000 7f262155d700 1 --2- 172.21.15.153:0/852027206 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f261c15ff40 0x7f261c070f50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2614009d90 tx=0x7f261400b330 comp rx=0 tx=0).stop 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.305+0000 7f262155d700 1 -- 172.21.15.153:0/852027206 shutdown_connections 2023-11-24T08:05:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.305+0000 7f262155d700 1 --2- 172.21.15.153:0/852027206 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f261c15ff40 0x7f261c070f50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.305+0000 7f262155d700 1 --2- 172.21.15.153:0/852027206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f261c145740 0x7f261c06e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.305+0000 7f262155d700 1 -- 172.21.15.153:0/852027206 >> 172.21.15.153:0/852027206 conn(0x7f261c0b1740 msgr2=0x7f261c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.305+0000 7f262155d700 1 -- 172.21.15.153:0/852027206 shutdown_connections 2023-11-24T08:05:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.305+0000 7f262155d700 1 -- 172.21.15.153:0/852027206 wait complete. 2023-11-24T08:05:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.306+0000 7f262155d700 1 Processor -- start 2023-11-24T08:05:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.307+0000 7f262155d700 1 -- start start 2023-11-24T08:05:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.307+0000 7f262155d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f261c145740 0x7f261c138570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.307+0000 7f262155d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f261c15ff40 0x7f261c1e5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.307+0000 7f262155d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f261c1603d0 0x7f261c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.307+0000 7f262155d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c139600 con 0x7f261c1603d0 2023-11-24T08:05:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.307+0000 7f262155d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c1e7050 con 0x7f261c145740 2023-11-24T08:05:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.307+0000 7f262155d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c1e67b0 con 0x7f261c15ff40 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.307+0000 7f261b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f261c1603d0 0x7f261c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.307+0000 7f261b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f261c1603d0 0x7f261c13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37032/0 (socket says 172.21.15.153:37032) 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.307+0000 7f261b7fe700 1 -- 172.21.15.153:0/1472518285 learned_addr learned my addr 172.21.15.153:0/1472518285 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f261a7fc700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f261c15ff40 0x7f261c1e5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f261affd700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f261c145740 0x7f261c138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f261b7fe700 1 -- 172.21.15.153:0/1472518285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f261c15ff40 msgr2=0x7f261c1e5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f261b7fe700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f261c15ff40 0x7f261c1e5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f261b7fe700 1 -- 172.21.15.153:0/1472518285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f261c145740 msgr2=0x7f261c138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f261b7fe700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f261c145740 0x7f261c138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f261b7fe700 1 -- 172.21.15.153:0/1472518285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0094a0 con 0x7f261c1603d0 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f261b7fe700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f261c1603d0 0x7f261c13db50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2614014040 tx=0x7f2614004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f26037fe700 1 -- 172.21.15.153:0/1472518285 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614012430 con 0x7f261c1603d0 2023-11-24T08:05:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f26037fe700 1 -- 172.21.15.153:0/1472518285 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614020070 con 0x7f261c1603d0 2023-11-24T08:05:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f262155d700 1 -- 172.21.15.153:0/1472518285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2614009a70 con 0x7f261c1603d0 2023-11-24T08:05:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f26037fe700 1 -- 172.21.15.153:0/1472518285 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614004280 con 0x7f261c1603d0 2023-11-24T08:05:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.308+0000 7f262155d700 1 -- 172.21.15.153:0/1472518285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c1e6d70 con 0x7f261c1603d0 2023-11-24T08:05:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.309+0000 7f262155d700 1 -- 172.21.15.153:0/1472518285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c0751e0 con 0x7f261c1603d0 2023-11-24T08:05:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.310+0000 7f26037fe700 1 -- 172.21.15.153:0/1472518285 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f26140043e0 con 0x7f261c1603d0 2023-11-24T08:05:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.310+0000 7f26037fe700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f260806aed0 0x7f260806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.310+0000 7f26037fe700 1 -- 172.21.15.153:0/1472518285 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2614022070 con 0x7f261c1603d0 2023-11-24T08:05:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.310+0000 7f261affd700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f260806aed0 0x7f260806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.310+0000 7f261affd700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f260806aed0 0x7f260806d390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f260c009d70 tx=0x7f260c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.314+0000 7f26037fe700 1 -- 172.21.15.153:0/1472518285 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26140bde90 con 0x7f261c1603d0 2023-11-24T08:05:00.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.584+0000 7f262155d700 1 -- 172.21.15.153:0/1472518285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f261c0727e0 con 0x7f261c1603d0 2023-11-24T08:05:00.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.585+0000 7f26037fe700 1 -- 172.21.15.153:0/1472518285 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f26140565c0 con 0x7f261c1603d0 2023-11-24T08:05:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:00.587 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:05:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-11-24T08:05:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlx+KYHxAAFmTb68c8Q+OPuEy1aTPrRA==", 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlYf05LBAAG8lBFt4GsIw9WCLOz1Nb6w==", 2023-11-24T08:05:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlVGztJhAAEqdk6SYM6OJ4VTgapBBIvA==", 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:05:00.590 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:05:00.590 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.590 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.590 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-11-24T08:05:00.590 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBle4zFMxAAsrvbC5k9Zj3Dz46bnOU0Pw==", 2023-11-24T08:05:00.590 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.590 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:00.590 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:05:00.590 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDMWGBlqA2SFBAAO/T01CTkjA4nWupGuLvJfA==", 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.592 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-11-24T08:05:00.592 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDPWGBl1D4rFBAAsB5U6NIJd1MnxnYz7iNsbg==", 2023-11-24T08:05:00.592 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.592 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:00.592 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:00.592 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.592 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.593 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-11-24T08:05:00.593 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDSWGBlh+SCExAAWteEjpmcESWppG2uGuvRhA==", 2023-11-24T08:05:00.593 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.593 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:00.593 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:00.594 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.594 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.594 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-11-24T08:05:00.595 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDVWGBlEjPOEhAA6fy3O+YzwFZ625c8GvAdww==", 2023-11-24T08:05:00.595 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.595 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:00.595 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:00.595 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.595 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.596 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-11-24T08:05:00.596 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDbWGBlE8p6FxAA49f3frFNrFYxTVgvUn/UNA==", 2023-11-24T08:05:00.596 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.597 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:00.597 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:00.597 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.598 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-11-24T08:05:00.598 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDeWGBlNlnlFhAAD8/M/46F/1PmYqMFPvatSQ==", 2023-11-24T08:05:00.598 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.598 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:00.599 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:00.599 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.599 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-11-24T08:05:00.599 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDhWGBlqQlSFhAAj8WBN4TrdU4xhBALj5+4JQ==", 2023-11-24T08:05:00.599 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.600 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:00.600 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:00.600 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.600 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.600 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-11-24T08:05:00.600 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDkWGBljhGHFhAAhYVbRp1+nSzfgBwpHAzvKA==", 2023-11-24T08:05:00.600 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.600 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:00.600 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:00.601 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.601 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.601 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-11-24T08:05:00.601 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlu28wOBAATnuO3XTplxrcn9JD3ta5XQ==", 2023-11-24T08:05:00.601 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.601 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:00.601 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-11-24T08:05:00.601 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-11-24T08:05:00.601 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-11-24T08:05:00.602 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.602 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-11-24T08:05:00.602 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDJWGBlT7tPAxAAl1DsWQCIaZcKFC5TNkWxoA==", 2023-11-24T08:05:00.602 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.602 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:00.602 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-11-24T08:05:00.602 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlSJ+FOxAAphdCFULGDZbuhcHaYu318A==", 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-11-24T08:05:00.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDJWGBliyYXCRAA/QCK4goQ9KvHf+XNyGoVnA==", 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlGYiFARAAFj/se3SGAKuQG/xAyzbo9A==", 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-mds", 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDqWGBlDmKAFRAAjI0dQbNCSc/VMvGJeHTpJw==", 2023-11-24T08:05:00.605 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-mds" 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-mgr", 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDqWGBlBWuAFRAA1hlhMz48dkT4BXRJE6XwMA==", 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-osd", 2023-11-24T08:05:00.606 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDqWGBlI3WAFRAASYAXoZvuW/kLjT1rQFolaA==", 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-osd" 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rbd", 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDqWGBllHyAFRAAwH6rdXgJCHfJzndCvaAVMw==", 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDqWGBl+4OAFRAACVisuP/YNkIh3Pdp7dU82A==", 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rgw", 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDqWGBloIuAFRAAY9QO95G53j6MoFHFL1vyDQ==", 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-24T08:05:00.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBle/UvHBAAeeyUHoDjzbEwVnrh42R/pQ==", 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-11-24T08:05:00.610 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlXSmiFxAA7jtMExuEpOroMzEOELomPg==", 2023-11-24T08:05:00.610 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:00.610 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-11-24T08:05:00.610 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-11-24T08:05:00.610 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:00.610 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.610 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:00.610 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-11-24T08:05:00.610 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:05:00.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 -- 172.21.15.153:0/1472518285 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f260806aed0 msgr2=0x7f260806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f260806aed0 0x7f260806d390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f260c009d70 tx=0x7f260c009210 comp rx=0 tx=0).stop 2023-11-24T08:05:00.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 -- 172.21.15.153:0/1472518285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f261c1603d0 msgr2=0x7f261c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f261c1603d0 0x7f261c13db50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2614014040 tx=0x7f2614004ad0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 -- 172.21.15.153:0/1472518285 shutdown_connections 2023-11-24T08:05:00.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f260806aed0 0x7f260806d390 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f261c1603d0 0x7f261c13db50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f261c145740 0x7f261c138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 --2- 172.21.15.153:0/1472518285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f261c15ff40 0x7f261c1e5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 -- 172.21.15.153:0/1472518285 >> 172.21.15.153:0/1472518285 conn(0x7f261c0b1740 msgr2=0x7f261c0ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:00.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 -- 172.21.15.153:0/1472518285 shutdown_connections 2023-11-24T08:05:00.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.588+0000 7f262155d700 1 -- 172.21.15.153:0/1472518285 wait complete. 2023-11-24T08:05:00.613 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-24T08:05:00.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.733+0000 7fbe713ca700 1 Processor -- start 2023-11-24T08:05:00.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.734+0000 7fbe713ca700 1 -- start start 2023-11-24T08:05:00.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.734+0000 7fbe713ca700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbe6c15e080 0x7fbe6c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.734+0000 7fbe713ca700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbe6c06c710 0x7fbe6c0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.734+0000 7fbe713ca700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c0ae430 con 0x7fbe6c0af4d0 2023-11-24T08:05:00.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.734+0000 7fbe713ca700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c0af0b0 con 0x7fbe6c06c710 2023-11-24T08:05:00.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.734+0000 7fbe713ca700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c0b05a0 con 0x7fbe6c15e080 2023-11-24T08:05:00.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.734+0000 7fbe6b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbe6c06c710 0x7fbe6c0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.735+0000 7fbe6b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbe6c06c710 0x7fbe6c0afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37040/0 (socket says 172.21.15.153:37040) 2023-11-24T08:05:00.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.735+0000 7fbe6b7fe700 1 -- 172.21.15.153:0/2158665210 learned_addr learned my addr 172.21.15.153:0/2158665210 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:00.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.735+0000 7fbe6affd700 1 --2- 172.21.15.153:0/2158665210 >> v2:172.21.15.164:3300/0 conn(0x7fbe6c15e080 0x7fbe6c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.735+0000 7fbe6b7fe700 1 -- 172.21.15.153:0/2158665210 >> v2:172.21.15.164:3300/0 conn(0x7fbe6c15e080 msgr2=0x7fbe6c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:00.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.735+0000 7fbe6b7fe700 1 --2- 172.21.15.153:0/2158665210 >> v2:172.21.15.164:3300/0 conn(0x7fbe6c15e080 0x7fbe6c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.735+0000 7fbe6b7fe700 1 -- 172.21.15.153:0/2158665210 >> v1:172.21.15.164:6789/0 conn(0x7fbe6c0af4d0 legacy=0x7fbe6c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:00.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.735+0000 7fbe6b7fe700 1 -- 172.21.15.153:0/2158665210 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0ae710 con 0x7fbe6c06c710 2023-11-24T08:05:00.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.735+0000 7fbe6b7fe700 1 --2- 172.21.15.153:0/2158665210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c06c710 0x7fbe6c0afb90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c072a90 tx=0x7fbe6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c37bb6f4d0bccc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.735+0000 7fbe69ffb700 1 -- 172.21.15.153:0/2158665210 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6400e070 con 0x7fbe6c06c710 2023-11-24T08:05:00.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.735+0000 7fbe69ffb700 1 -- 172.21.15.153:0/2158665210 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe64003a20 con 0x7fbe6c06c710 2023-11-24T08:05:00.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.735+0000 7fbe69ffb700 1 -- 172.21.15.153:0/2158665210 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64003dd0 con 0x7fbe6c06c710 2023-11-24T08:05:00.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.736+0000 7fbe713ca700 1 -- 172.21.15.153:0/2158665210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c06c710 msgr2=0x7fbe6c0afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.736+0000 7fbe713ca700 1 --2- 172.21.15.153:0/2158665210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c06c710 0x7fbe6c0afb90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c072a90 tx=0x7fbe6400b330 comp rx=0 tx=0).stop 2023-11-24T08:05:00.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.736+0000 7fbe713ca700 1 -- 172.21.15.153:0/2158665210 shutdown_connections 2023-11-24T08:05:00.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.736+0000 7fbe713ca700 1 --2- 172.21.15.153:0/2158665210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c06c710 0x7fbe6c0afb90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.736+0000 7fbe713ca700 1 --2- 172.21.15.153:0/2158665210 >> v2:172.21.15.164:3300/0 conn(0x7fbe6c15e080 0x7fbe6c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.736+0000 7fbe713ca700 1 -- 172.21.15.153:0/2158665210 >> 172.21.15.153:0/2158665210 conn(0x7fbe6c071b90 msgr2=0x7fbe6c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:00.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.736+0000 7fbe713ca700 1 -- 172.21.15.153:0/2158665210 shutdown_connections 2023-11-24T08:05:00.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.736+0000 7fbe713ca700 1 -- 172.21.15.153:0/2158665210 wait complete. 2023-11-24T08:05:00.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.737+0000 7fbe713ca700 1 Processor -- start 2023-11-24T08:05:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.737+0000 7fbe713ca700 1 -- start start 2023-11-24T08:05:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe713ca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c06c710 0x7fbe6c14c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe713ca700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe6c0af4d0 0x7fbe6c1f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe713ca700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6c15e080 0x7fbe6c0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe713ca700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0ce6d0 con 0x7fbe6c06c710 2023-11-24T08:05:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe713ca700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0ce9b0 con 0x7fbe6c0af4d0 2023-11-24T08:05:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe713ca700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0cec90 con 0x7fbe6c15e080 2023-11-24T08:05:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe6affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c06c710 0x7fbe6c14c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe6affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c06c710 0x7fbe6c14c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37042/0 (socket says 172.21.15.153:37042) 2023-11-24T08:05:00.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe6affd700 1 -- 172.21.15.153:0/2007434545 learned_addr learned my addr 172.21.15.153:0/2007434545 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:00.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe6affd700 1 -- 172.21.15.153:0/2007434545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6c15e080 msgr2=0x7fbe6c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe6affd700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6c15e080 0x7fbe6c0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe6affd700 1 -- 172.21.15.153:0/2007434545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe6c0af4d0 msgr2=0x7fbe6c1f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe6a7fc700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe6c0af4d0 0x7fbe6c1f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe6affd700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe6c0af4d0 0x7fbe6c1f41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe6affd700 1 -- 172.21.15.153:0/2007434545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64009b30 con 0x7fbe6c06c710 2023-11-24T08:05:00.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe6affd700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c06c710 0x7fbe6c14c5d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00d800 tx=0x7fbe5c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe537fe700 1 -- 172.21.15.153:0/2007434545 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c0125f0 con 0x7fbe6c06c710 2023-11-24T08:05:00.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe537fe700 1 -- 172.21.15.153:0/2007434545 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c012750 con 0x7fbe6c06c710 2023-11-24T08:05:00.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe537fe700 1 -- 172.21.15.153:0/2007434545 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c012b00 con 0x7fbe6c06c710 2023-11-24T08:05:00.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.738+0000 7fbe713ca700 1 -- 172.21.15.153:0/2007434545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c0cef70 con 0x7fbe6c06c710 2023-11-24T08:05:00.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.739+0000 7fbe713ca700 1 -- 172.21.15.153:0/2007434545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c1f3b30 con 0x7fbe6c06c710 2023-11-24T08:05:00.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.739+0000 7fbe713ca700 1 -- 172.21.15.153:0/2007434545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c0753f0 con 0x7fbe6c06c710 2023-11-24T08:05:00.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.740+0000 7fbe537fe700 1 -- 172.21.15.153:0/2007434545 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe5c012c60 con 0x7fbe6c06c710 2023-11-24T08:05:00.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.740+0000 7fbe537fe700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 0x7fbe5806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.740+0000 7fbe6a7fc700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 0x7fbe5806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.740+0000 7fbe537fe700 1 -- 172.21.15.153:0/2007434545 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe5c0896d0 con 0x7fbe6c06c710 2023-11-24T08:05:00.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.741+0000 7fbe6a7fc700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 0x7fbe5806d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0c96a0 tx=0x7fbe60009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:00.745+0000 7fbe537fe700 1 -- 172.21.15.153:0/2007434545 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe5c054a30 con 0x7fbe6c06c710 2023-11-24T08:05:01.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.014+0000 7fbe713ca700 1 -- 172.21.15.153:0/2007434545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fbe6c1f3cc0 con 0x7fbe6c06c710 2023-11-24T08:05:01.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.016+0000 7fbe537fe700 1 -- 172.21.15.153:0/2007434545 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbe5c058050 con 0x7fbe6c06c710 2023-11-24T08:05:01.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 -- 172.21.15.153:0/2007434545 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 msgr2=0x7fbe5806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 0x7fbe5806d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0c96a0 tx=0x7fbe60009040 comp rx=0 tx=0).stop 2023-11-24T08:05:01.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 -- 172.21.15.153:0/2007434545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c06c710 msgr2=0x7fbe6c14c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c06c710 0x7fbe6c14c5d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00d800 tx=0x7fbe5c00dbc0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 -- 172.21.15.153:0/2007434545 shutdown_connections 2023-11-24T08:05:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6c15e080 0x7fbe6c0cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 0x7fbe5806d390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c06c710 0x7fbe6c14c5d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 --2- 172.21.15.153:0/2007434545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe6c0af4d0 0x7fbe6c1f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 -- 172.21.15.153:0/2007434545 >> 172.21.15.153:0/2007434545 conn(0x7fbe6c071b90 msgr2=0x7fbe6c0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 -- 172.21.15.153:0/2007434545 shutdown_connections 2023-11-24T08:05:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.018+0000 7fbe713ca700 1 -- 172.21.15.153:0/2007434545 wait complete. 2023-11-24T08:05:01.032 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-24T08:05:01.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.155+0000 7f3202ab6700 1 Processor -- start 2023-11-24T08:05:01.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.155+0000 7f3202ab6700 1 -- start start 2023-11-24T08:05:01.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.155+0000 7f3202ab6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31fc15bc90 0x7f31fc0d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.155+0000 7f3202ab6700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f31fc15c070 0x7f31fc0d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.155+0000 7f3202ab6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31fc06f060 0x7f31fc06f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.155+0000 7f3202ab6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc06fdd0 con 0x7f31fc15bc90 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.155+0000 7f3202ab6700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc0700b0 con 0x7f31fc15c070 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.155+0000 7f3202ab6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc070390 con 0x7f31fc06f060 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f3200852700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31fc15bc90 0x7f31fc0d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f3200852700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31fc15bc90 0x7f31fc0d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37050/0 (socket says 172.21.15.153:37050) 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f3200852700 1 -- 172.21.15.153:0/2131743514 learned_addr learned my addr 172.21.15.153:0/2131743514 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f3201053700 1 --2- 172.21.15.153:0/2131743514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31fc06f060 0x7f31fc06f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f31fbfff700 1 --2- 172.21.15.153:0/2131743514 >> v2:172.21.15.164:3300/0 conn(0x7f31fc15c070 0x7f31fc0d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f3200852700 1 -- 172.21.15.153:0/2131743514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31fc06f060 msgr2=0x7f31fc06f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:01.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f3200852700 1 --2- 172.21.15.153:0/2131743514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31fc06f060 0x7f31fc06f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f3200852700 1 -- 172.21.15.153:0/2131743514 >> v2:172.21.15.164:3300/0 conn(0x7f31fc15c070 msgr2=0x7f31fc0d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f3200852700 1 --2- 172.21.15.153:0/2131743514 >> v2:172.21.15.164:3300/0 conn(0x7f31fc15c070 0x7f31fc0d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f3200852700 1 -- 172.21.15.153:0/2131743514 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc070670 con 0x7f31fc15bc90 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f3200852700 1 --2- 172.21.15.153:0/2131743514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15bc90 0x7f31fc0d01a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f31fc09b710 tx=0x7f31f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65ed873a0316a53 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f31fb7fe700 1 -- 172.21.15.153:0/2131743514 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0011830 con 0x7f31fc15bc90 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f31fb7fe700 1 -- 172.21.15.153:0/2131743514 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f0011990 con 0x7f31fc15bc90 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.156+0000 7f31fb7fe700 1 -- 172.21.15.153:0/2131743514 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0011d20 con 0x7f31fc15bc90 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.157+0000 7f3202ab6700 1 -- 172.21.15.153:0/2131743514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15bc90 msgr2=0x7f31fc0d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.157+0000 7f3202ab6700 1 --2- 172.21.15.153:0/2131743514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15bc90 0x7f31fc0d01a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f31fc09b710 tx=0x7f31f0009bd0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.157+0000 7f3202ab6700 1 -- 172.21.15.153:0/2131743514 shutdown_connections 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.157+0000 7f3202ab6700 1 --2- 172.21.15.153:0/2131743514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31fc06f060 0x7f31fc06f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.157+0000 7f3202ab6700 1 --2- 172.21.15.153:0/2131743514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15bc90 0x7f31fc0d01a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.157+0000 7f3202ab6700 1 --2- 172.21.15.153:0/2131743514 >> v2:172.21.15.164:3300/0 conn(0x7f31fc15c070 0x7f31fc0d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.157+0000 7f3202ab6700 1 -- 172.21.15.153:0/2131743514 >> 172.21.15.153:0/2131743514 conn(0x7f31fc073130 msgr2=0x7f31fc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:01.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.157+0000 7f3202ab6700 1 -- 172.21.15.153:0/2131743514 shutdown_connections 2023-11-24T08:05:01.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.157+0000 7f3202ab6700 1 -- 172.21.15.153:0/2131743514 wait complete. 2023-11-24T08:05:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.158+0000 7f3202ab6700 1 Processor -- start 2023-11-24T08:05:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.158+0000 7f3202ab6700 1 -- start start 2023-11-24T08:05:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f3202ab6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31fc06f060 0x7f31fc1f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f3202ab6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15bc90 0x7f31fc09e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f3202ab6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31fc15c070 0x7f31fc09eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f3202ab6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0cae00 con 0x7f31fc15bc90 2023-11-24T08:05:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f3202ab6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc14e3e0 con 0x7f31fc15c070 2023-11-24T08:05:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f3202ab6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0cab20 con 0x7f31fc06f060 2023-11-24T08:05:01.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f31fbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15bc90 0x7f31fc09e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f31fbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15bc90 0x7f31fc09e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37056/0 (socket says 172.21.15.153:37056) 2023-11-24T08:05:01.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f31fbfff700 1 -- 172.21.15.153:0/856980182 learned_addr learned my addr 172.21.15.153:0/856980182 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:01.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f3200852700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31fc06f060 0x7f31fc1f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f3201053700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31fc15c070 0x7f31fc09eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f31fbfff700 1 -- 172.21.15.153:0/856980182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31fc06f060 msgr2=0x7f31fc1f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f31fbfff700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31fc06f060 0x7f31fc1f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f31fbfff700 1 -- 172.21.15.153:0/856980182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31fc15c070 msgr2=0x7f31fc09eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f31fbfff700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31fc15c070 0x7f31fc09eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.159+0000 7f31fbfff700 1 -- 172.21.15.153:0/856980182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0009550 con 0x7f31fc15bc90 2023-11-24T08:05:01.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.160+0000 7f31fbfff700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15bc90 0x7f31fc09e5e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f31e800e840 tx=0x7f31e800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.160+0000 7f31f97fa700 1 -- 172.21.15.153:0/856980182 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8009590 con 0x7f31fc15bc90 2023-11-24T08:05:01.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.160+0000 7f31f97fa700 1 -- 172.21.15.153:0/856980182 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e8013680 con 0x7f31fc15bc90 2023-11-24T08:05:01.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.160+0000 7f3202ab6700 1 -- 172.21.15.153:0/856980182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31fc14dd90 con 0x7f31fc15bc90 2023-11-24T08:05:01.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.160+0000 7f31f97fa700 1 -- 172.21.15.153:0/856980182 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8013a30 con 0x7f31fc15bc90 2023-11-24T08:05:01.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.160+0000 7f3202ab6700 1 -- 172.21.15.153:0/856980182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31fc0c9df0 con 0x7f31fc15bc90 2023-11-24T08:05:01.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.161+0000 7f3202ab6700 1 -- 172.21.15.153:0/856980182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31fc14dbf0 con 0x7f31fc15bc90 2023-11-24T08:05:01.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.161+0000 7f31f97fa700 1 -- 172.21.15.153:0/856980182 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31e8013b90 con 0x7f31fc15bc90 2023-11-24T08:05:01.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.162+0000 7f31f97fa700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f31e006af00 0x7f31e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.162+0000 7f3200852700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f31e006af00 0x7f31e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.162+0000 7f31f97fa700 1 -- 172.21.15.153:0/856980182 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f31e8089140 con 0x7f31fc15bc90 2023-11-24T08:05:01.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.162+0000 7f3200852700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f31e006af00 0x7f31e006d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009c10 tx=0x7f31f0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.166+0000 7f31f97fa700 1 -- 172.21.15.153:0/856980182 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31fc14dbf0 con 0x7f31fc15bc90 2023-11-24T08:05:01.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.436+0000 7f3202ab6700 1 -- 172.21.15.153:0/856980182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f31fc14dbf0 con 0x7f31fc15bc90 2023-11-24T08:05:01.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.437+0000 7f31f97fa700 1 -- 172.21.15.153:0/856980182 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f31fc14dbf0 con 0x7f31fc15bc90 2023-11-24T08:05:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 -- 172.21.15.153:0/856980182 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f31e006af00 msgr2=0x7f31e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f31e006af00 0x7f31e006d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009c10 tx=0x7f31f0008030 comp rx=0 tx=0).stop 2023-11-24T08:05:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 -- 172.21.15.153:0/856980182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15bc90 msgr2=0x7f31fc09e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15bc90 0x7f31fc09e5e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f31e800e840 tx=0x7f31e800ec00 comp rx=0 tx=0).stop 2023-11-24T08:05:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 -- 172.21.15.153:0/856980182 shutdown_connections 2023-11-24T08:05:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31fc15c070 0x7f31fc09eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31fc06f060 0x7f31fc1f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f31e006af00 0x7f31e006d3c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 --2- 172.21.15.153:0/856980182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc15bc90 0x7f31fc09e5e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 -- 172.21.15.153:0/856980182 >> 172.21.15.153:0/856980182 conn(0x7f31fc073130 msgr2=0x7f31fc0ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:01.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 -- 172.21.15.153:0/856980182 shutdown_connections 2023-11-24T08:05:01.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.440+0000 7f3202ab6700 1 -- 172.21.15.153:0/856980182 wait complete. 2023-11-24T08:05:01.454 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-24T08:05:01.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.577+0000 7fe70292a700 1 Processor -- start 2023-11-24T08:05:01.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.577+0000 7fe70292a700 1 -- start start 2023-11-24T08:05:01.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe70292a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe6fc0b3370 0x7fe6fc1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe70292a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6fc0d1c70 0x7fe6fc0d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe70292a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6fc0b22d0 con 0x7fe6fc15bdd0 2023-11-24T08:05:01.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe70292a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0b2f50 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe70292a700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0d2640 con 0x7fe6fc0b3370 2023-11-24T08:05:01.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe700ec7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6fc0d1c70 0x7fe6fc0d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe700ec7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6fc0d1c70 0x7fe6fc0d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37066/0 (socket says 172.21.15.153:37066) 2023-11-24T08:05:01.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe700ec7700 1 -- 172.21.15.153:0/2452255261 learned_addr learned my addr 172.21.15.153:0/2452255261 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:01.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe6fb7fe700 1 --2- 172.21.15.153:0/2452255261 >> v2:172.21.15.164:3300/0 conn(0x7fe6fc0b3370 0x7fe6fc1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe700ec7700 1 -- 172.21.15.153:0/2452255261 >> v2:172.21.15.164:3300/0 conn(0x7fe6fc0b3370 msgr2=0x7fe6fc1604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe700ec7700 1 --2- 172.21.15.153:0/2452255261 >> v2:172.21.15.164:3300/0 conn(0x7fe6fc0b3370 0x7fe6fc1604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe700ec7700 1 -- 172.21.15.153:0/2452255261 >> v1:172.21.15.164:6789/0 conn(0x7fe6fc15bdd0 legacy=0x7fe6fc0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe700ec7700 1 -- 172.21.15.153:0/2452255261 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc0b25b0 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.578+0000 7fe700ec7700 1 --2- 172.21.15.153:0/2452255261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6fc0d1c70 0x7fe6fc0d2100 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc15f910 tx=0x7fe6f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475d3c4756cd1152 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.579+0000 7fe6faffd700 1 -- 172.21.15.153:0/2452255261 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400e070 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.579+0000 7fe6faffd700 1 -- 172.21.15.153:0/2452255261 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f400b910 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.579+0000 7fe6faffd700 1 -- 172.21.15.153:0/2452255261 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400bcc0 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.579+0000 7fe70292a700 1 -- 172.21.15.153:0/2452255261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6fc0d1c70 msgr2=0x7fe6fc0d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.579+0000 7fe70292a700 1 --2- 172.21.15.153:0/2452255261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6fc0d1c70 0x7fe6fc0d2100 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc15f910 tx=0x7fe6f400b330 comp rx=0 tx=0).stop 2023-11-24T08:05:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.579+0000 7fe70292a700 1 -- 172.21.15.153:0/2452255261 shutdown_connections 2023-11-24T08:05:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.579+0000 7fe70292a700 1 --2- 172.21.15.153:0/2452255261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6fc0d1c70 0x7fe6fc0d2100 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.579+0000 7fe70292a700 1 --2- 172.21.15.153:0/2452255261 >> v2:172.21.15.164:3300/0 conn(0x7fe6fc0b3370 0x7fe6fc1604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.579+0000 7fe70292a700 1 -- 172.21.15.153:0/2452255261 >> 172.21.15.153:0/2452255261 conn(0x7fe6fc0731a0 msgr2=0x7fe6fc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.579+0000 7fe70292a700 1 -- 172.21.15.153:0/2452255261 shutdown_connections 2023-11-24T08:05:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.579+0000 7fe70292a700 1 -- 172.21.15.153:0/2452255261 wait complete. 2023-11-24T08:05:01.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.580+0000 7fe70292a700 1 Processor -- start 2023-11-24T08:05:01.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.581+0000 7fe70292a700 1 -- start start 2023-11-24T08:05:01.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.581+0000 7fe70292a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6fc0b3370 0x7fe6fc1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.581+0000 7fe70292a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6fc0d1c70 0x7fe6fc1f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.581+0000 7fe70292a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6fc15bdd0 0x7fe6fc0ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.581+0000 7fe70292a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc0b4cb0 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.581+0000 7fe70292a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc1f6010 con 0x7fe6fc15bdd0 2023-11-24T08:05:01.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.581+0000 7fe70292a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc1f5a50 con 0x7fe6fc0b3370 2023-11-24T08:05:01.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.581+0000 7fe6fb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6fc0d1c70 0x7fe6fc1f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.581+0000 7fe6fb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6fc0d1c70 0x7fe6fc1f5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37070/0 (socket says 172.21.15.153:37070) 2023-11-24T08:05:01.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.581+0000 7fe6fb7fe700 1 -- 172.21.15.153:0/699122608 learned_addr learned my addr 172.21.15.153:0/699122608 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:01.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe6fbfff700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6fc0b3370 0x7fe6fc1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe700ec7700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6fc15bdd0 0x7fe6fc0ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe6fb7fe700 1 -- 172.21.15.153:0/699122608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6fc0b3370 msgr2=0x7fe6fc1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe6fb7fe700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6fc0b3370 0x7fe6fc1571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe6fb7fe700 1 -- 172.21.15.153:0/699122608 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6fc15bdd0 msgr2=0x7fe6fc0ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe6fb7fe700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6fc15bdd0 0x7fe6fc0ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe6fb7fe700 1 -- 172.21.15.153:0/699122608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f4009b30 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe6fbfff700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6fc0b3370 0x7fe6fc1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:01.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe700ec7700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6fc15bdd0 0x7fe6fc0ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:01.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe6fb7fe700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6fc0d1c70 0x7fe6fc1f5100 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00e9b0 tx=0x7fe6ec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe6f8ff9700 1 -- 172.21.15.153:0/699122608 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec009710 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe6f8ff9700 1 -- 172.21.15.153:0/699122608 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec00c850 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe70292a700 1 -- 172.21.15.153:0/699122608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc1f5d30 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe6f8ff9700 1 -- 172.21.15.153:0/699122608 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00cbc0 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.582+0000 7fe70292a700 1 -- 172.21.15.153:0/699122608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc157710 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.583+0000 7fe70292a700 1 -- 172.21.15.153:0/699122608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6fc0b4e20 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.584+0000 7fe6f8ff9700 1 -- 172.21.15.153:0/699122608 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6ec00cd20 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.584+0000 7fe6f8ff9700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6e806aed0 0x7fe6e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.584+0000 7fe6fbfff700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6e806aed0 0x7fe6e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.584+0000 7fe6f8ff9700 1 -- 172.21.15.153:0/699122608 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe6ec089380 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.584+0000 7fe6fbfff700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6e806aed0 0x7fe6e806d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000f60 tx=0x7fe6f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.589+0000 7fe6f8ff9700 1 -- 172.21.15.153:0/699122608 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6ec054780 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.859+0000 7fe70292a700 1 -- 172.21.15.153:0/699122608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe6fc067f60 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.861+0000 7fe6f8ff9700 1 -- 172.21.15.153:0/699122608 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe6ec057da0 con 0x7fe6fc0d1c70 2023-11-24T08:05:01.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 -- 172.21.15.153:0/699122608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6e806aed0 msgr2=0x7fe6e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6e806aed0 0x7fe6e806d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000f60 tx=0x7fe6f0009040 comp rx=0 tx=0).stop 2023-11-24T08:05:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 -- 172.21.15.153:0/699122608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6fc0d1c70 msgr2=0x7fe6fc1f5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6fc0d1c70 0x7fe6fc1f5100 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00e9b0 tx=0x7fe6ec00ed70 comp rx=0 tx=0).stop 2023-11-24T08:05:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 -- 172.21.15.153:0/699122608 shutdown_connections 2023-11-24T08:05:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6fc15bdd0 0x7fe6fc0ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6fc0b3370 0x7fe6fc1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe6e806aed0 0x7fe6e806d390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 --2- 172.21.15.153:0/699122608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6fc0d1c70 0x7fe6fc1f5100 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 -- 172.21.15.153:0/699122608 >> 172.21.15.153:0/699122608 conn(0x7fe6fc0731a0 msgr2=0x7fe6fc0b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 -- 172.21.15.153:0/699122608 shutdown_connections 2023-11-24T08:05:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.863+0000 7fe70292a700 1 -- 172.21.15.153:0/699122608 wait complete. 2023-11-24T08:05:01.878 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-24T08:05:02.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.998+0000 7fc8c2abc700 1 Processor -- start 2023-11-24T08:05:02.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.998+0000 7fc8c2abc700 1 -- start start 2023-11-24T08:05:02.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8c2abc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8bc0b3370 0x7fc8bc1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8c2abc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc8bc0d1c70 0x7fc8bc0d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8c2abc700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc0b22d0 con 0x7fc8bc15bdd0 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8c2abc700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0b2f50 con 0x7fc8bc0b3370 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8c2abc700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0d2640 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8bbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8bc0b3370 0x7fc8bc1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8c0858700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc8bc15bdd0 0x7fc8bc0b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43180/0 (socket says 172.21.15.153:43180) 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8bbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8bc0b3370 0x7fc8bc1604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37078/0 (socket says 172.21.15.153:37078) 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8c0858700 1 -- 172.21.15.153:0/1261591384 learned_addr learned my addr 172.21.15.153:0/1261591384 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8c1059700 1 --2- 172.21.15.153:0/1261591384 >> v2:172.21.15.164:3300/0 conn(0x7fc8bc0d1c70 0x7fc8bc0d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8bbfff700 1 -- 172.21.15.153:0/1261591384 >> v2:172.21.15.164:3300/0 conn(0x7fc8bc0d1c70 msgr2=0x7fc8bc0d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8bbfff700 1 --2- 172.21.15.153:0/1261591384 >> v2:172.21.15.164:3300/0 conn(0x7fc8bc0d1c70 0x7fc8bc0d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8bbfff700 1 -- 172.21.15.153:0/1261591384 >> v1:172.21.15.153:6789/0 conn(0x7fc8bc15bdd0 legacy=0x7fc8bc0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8bb7fe700 1 -- 172.21.15.153:0/1261591384 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361291660 0 0) 0x7fc8bc0b22d0 con 0x7fc8bc15bdd0 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:01.999+0000 7fc8bbfff700 1 -- 172.21.15.153:0/1261591384 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0b25b0 con 0x7fc8bc0b3370 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8bbfff700 1 --2- 172.21.15.153:0/1261591384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8bc0b3370 0x7fc8bc1604e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc160a50 tx=0x7fc8a8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de857fa1a2ea3f92 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8bb7fe700 1 -- 172.21.15.153:0/1261591384 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8011830 con 0x7fc8bc0b3370 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8bb7fe700 1 -- 172.21.15.153:0/1261591384 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a8011990 con 0x7fc8bc0b3370 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8bb7fe700 1 -- 172.21.15.153:0/1261591384 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8011d20 con 0x7fc8bc0b3370 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8c2abc700 1 -- 172.21.15.153:0/1261591384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8bc0b3370 msgr2=0x7fc8bc1604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8c2abc700 1 --2- 172.21.15.153:0/1261591384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8bc0b3370 0x7fc8bc1604e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc160a50 tx=0x7fc8a8009b20 comp rx=0 tx=0).stop 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8c2abc700 1 -- 172.21.15.153:0/1261591384 shutdown_connections 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8c2abc700 1 --2- 172.21.15.153:0/1261591384 >> v2:172.21.15.164:3300/0 conn(0x7fc8bc0d1c70 0x7fc8bc0d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8c2abc700 1 --2- 172.21.15.153:0/1261591384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8bc0b3370 0x7fc8bc1604e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8c2abc700 1 -- 172.21.15.153:0/1261591384 >> 172.21.15.153:0/1261591384 conn(0x7fc8bc0731a0 msgr2=0x7fc8bc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8c2abc700 1 -- 172.21.15.153:0/1261591384 shutdown_connections 2023-11-24T08:05:02.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.000+0000 7fc8c2abc700 1 -- 172.21.15.153:0/1261591384 wait complete. 2023-11-24T08:05:02.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.002+0000 7fc8c2abc700 1 Processor -- start 2023-11-24T08:05:02.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.002+0000 7fc8c2abc700 1 -- start start 2023-11-24T08:05:02.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.002+0000 7fc8c2abc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8bc0b3370 0x7fc8bc157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.002+0000 7fc8c2abc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8bc0d1c70 0x7fc8bc0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.002+0000 7fc8c2abc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8bc15bdd0 0x7fc8bc0c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.002+0000 7fc8c2abc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0ca1c0 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.002+0000 7fc8c2abc700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1e5fc0 con 0x7fc8bc0b3370 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.002+0000 7fc8c2abc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc06c610 con 0x7fc8bc15bdd0 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8bbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8bc0d1c70 0x7fc8bc0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8bbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8bc0d1c70 0x7fc8bc0c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37084/0 (socket says 172.21.15.153:37084) 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8bbfff700 1 -- 172.21.15.153:0/3071315148 learned_addr learned my addr 172.21.15.153:0/3071315148 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8c0858700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8bc0b3370 0x7fc8bc157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8c1059700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8bc15bdd0 0x7fc8bc0c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8bbfff700 1 -- 172.21.15.153:0/3071315148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8bc15bdd0 msgr2=0x7fc8bc0c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8bbfff700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8bc15bdd0 0x7fc8bc0c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8bbfff700 1 -- 172.21.15.153:0/3071315148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8bc0b3370 msgr2=0x7fc8bc157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8bbfff700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8bc0b3370 0x7fc8bc157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8bbfff700 1 -- 172.21.15.153:0/3071315148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80094a0 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8bbfff700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8bc0d1c70 0x7fc8bc0c8db0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8000c00 tx=0x7fc8a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8b97fa700 1 -- 172.21.15.153:0/3071315148 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80036a0 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8b97fa700 1 -- 172.21.15.153:0/3071315148 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a801f070 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8c2abc700 1 -- 172.21.15.153:0/3071315148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc0c9920 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8b97fa700 1 -- 172.21.15.153:0/3071315148 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8003a60 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.003+0000 7fc8c2abc700 1 -- 172.21.15.153:0/3071315148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc0c9ee0 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.004+0000 7fc8c2abc700 1 -- 172.21.15.153:0/3071315148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc067f60 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.005+0000 7fc8b97fa700 1 -- 172.21.15.153:0/3071315148 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc8a8003bc0 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.005+0000 7fc8b97fa700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc8a006aed0 0x7fc8a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.005+0000 7fc8b97fa700 1 -- 172.21.15.153:0/3071315148 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc8a8021070 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.005+0000 7fc8c0858700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc8a006aed0 0x7fc8a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.005+0000 7fc8c0858700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc8a006aed0 0x7fc8a006d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000f60 tx=0x7fc8b0007c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.009+0000 7fc8b97fa700 1 -- 172.21.15.153:0/3071315148 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc8a80560b0 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.277+0000 7fc8c2abc700 1 -- 172.21.15.153:0/3071315148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc8bc0b7c60 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.281+0000 7fc8b97fa700 1 -- 172.21.15.153:0/3071315148 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc8a80150a0 con 0x7fc8bc0d1c70 2023-11-24T08:05:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 -- 172.21.15.153:0/3071315148 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc8a006aed0 msgr2=0x7fc8a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc8a006aed0 0x7fc8a006d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000f60 tx=0x7fc8b0007c90 comp rx=0 tx=0).stop 2023-11-24T08:05:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 -- 172.21.15.153:0/3071315148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8bc0d1c70 msgr2=0x7fc8bc0c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8bc0d1c70 0x7fc8bc0c8db0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8000c00 tx=0x7fc8a8004750 comp rx=0 tx=0).stop 2023-11-24T08:05:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 -- 172.21.15.153:0/3071315148 shutdown_connections 2023-11-24T08:05:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8bc15bdd0 0x7fc8bc0c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8bc0b3370 0x7fc8bc157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc8a006aed0 0x7fc8a006d390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 --2- 172.21.15.153:0/3071315148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8bc0d1c70 0x7fc8bc0c8db0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 -- 172.21.15.153:0/3071315148 >> 172.21.15.153:0/3071315148 conn(0x7fc8bc0731a0 msgr2=0x7fc8bc15a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 -- 172.21.15.153:0/3071315148 shutdown_connections 2023-11-24T08:05:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.283+0000 7fc8c2abc700 1 -- 172.21.15.153:0/3071315148 wait complete. 2023-11-24T08:05:02.297 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-24T08:05:02.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.418+0000 7fc046a60700 1 Processor -- start 2023-11-24T08:05:02.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.418+0000 7fc046a60700 1 -- start start 2023-11-24T08:05:02.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.418+0000 7fc046a60700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400d1570 0x7fc0400d34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.418+0000 7fc046a60700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc0400b2fc0 0x7fc0400d3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.418+0000 7fc046a60700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400d2d10 con 0x7fc04015dfc0 2023-11-24T08:05:02.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.418+0000 7fc046a60700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400cefd0 con 0x7fc0400b2fc0 2023-11-24T08:05:02.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.418+0000 7fc046a60700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400cf2b0 con 0x7fc0400d1570 2023-11-24T08:05:02.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc04015dfc0 0x7fc0400d0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43194/0 (socket says 172.21.15.153:43194) 2023-11-24T08:05:02.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03ffff700 1 -- 172.21.15.153:0/1583496052 learned_addr learned my addr 172.21.15.153:0/1583496052 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:02.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03f7fe700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400d1570 0x7fc0400d34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368715056 0 0) 0x7fc0400d2d10 con 0x7fc04015dfc0 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc044ffd700 1 --2- 172.21.15.153:0/1583496052 >> v2:172.21.15.164:3300/0 conn(0x7fc0400b2fc0 0x7fc0400d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0280035b0 con 0x7fc04015dfc0 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 969649901 0 0) 0x7fc0280035b0 con 0x7fc04015dfc0 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400d1570 msgr2=0x7fc0400d34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400d1570 0x7fc0400d34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 >> v2:172.21.15.164:3300/0 conn(0x7fc0400b2fc0 msgr2=0x7fc0400d3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 --2- 172.21.15.153:0/1583496052 >> v2:172.21.15.164:3300/0 conn(0x7fc0400b2fc0 0x7fc0400d3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400d2fb0 con 0x7fc04015dfc0 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fc030001670 con 0x7fc04015dfc0 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 >> v1:172.21.15.153:6789/0 conn(0x7fc04015dfc0 legacy=0x7fc0400d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400d1570 0x7fc028003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc028003f80 0x7fc028004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc028004d90 0x7fc028005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400cefd0 con 0x7fc028004d90 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400cf2b0 con 0x7fc028003f80 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02800ba60 con 0x7fc0400d1570 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc044ffd700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc028004d90 0x7fc028005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03f7fe700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc028003f80 0x7fc028004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.419+0000 7fc03ffff700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400d1570 0x7fc028003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc044ffd700 1 -- 172.21.15.153:0/1583496052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400d1570 msgr2=0x7fc028003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc044ffd700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400d1570 0x7fc028003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc044ffd700 1 -- 172.21.15.153:0/1583496052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc028003f80 msgr2=0x7fc028004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc044ffd700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc028003f80 0x7fc028004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc044ffd700 1 -- 172.21.15.153:0/1583496052 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0280035b0 con 0x7fc028004d90 2023-11-24T08:05:02.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc044ffd700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc028004d90 0x7fc028005210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc038009fc0 tx=0x7fc028005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769fa32bfaa670a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800ec30 con 0x7fc028004d90 2023-11-24T08:05:02.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800f040 con 0x7fc028004d90 2023-11-24T08:05:02.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc03effd700 1 -- 172.21.15.153:0/1583496052 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038014480 con 0x7fc028004d90 2023-11-24T08:05:02.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc046a60700 1 -- 172.21.15.153:0/1583496052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc028004d90 msgr2=0x7fc028005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc046a60700 1 --2- 172.21.15.153:0/1583496052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc028004d90 0x7fc028005210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc038009fc0 tx=0x7fc028005880 comp rx=0 tx=0).stop 2023-11-24T08:05:02.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc044ffd700 1 -- 172.21.15.153:0/1583496052 reap_dead start 2023-11-24T08:05:02.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc046a60700 1 -- 172.21.15.153:0/1583496052 shutdown_connections 2023-11-24T08:05:02.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc046a60700 1 -- 172.21.15.153:0/1583496052 >> 172.21.15.153:0/1583496052 conn(0x7fc04006b410 msgr2=0x7fc04006b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc046a60700 1 -- 172.21.15.153:0/1583496052 shutdown_connections 2023-11-24T08:05:02.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.420+0000 7fc046a60700 1 -- 172.21.15.153:0/1583496052 wait complete. 2023-11-24T08:05:02.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.422+0000 7fc046a60700 1 Processor -- start 2023-11-24T08:05:02.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.422+0000 7fc046a60700 1 -- start start 2023-11-24T08:05:02.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.422+0000 7fc046a60700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0400ab240 0x7fc040153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc046a60700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc040153f70 0x7fc0400cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc046a60700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400cda90 0x7fc0401f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc046a60700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400cdf40 con 0x7fc0400ab240 2023-11-24T08:05:02.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc046a60700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04014dbd0 con 0x7fc040153f70 2023-11-24T08:05:02.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc046a60700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc040150e60 con 0x7fc0400cda90 2023-11-24T08:05:02.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0400ab240 0x7fc040153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0400ab240 0x7fc040153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37102/0 (socket says 172.21.15.153:37102) 2023-11-24T08:05:02.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03ffff700 1 -- 172.21.15.153:0/2790026061 learned_addr learned my addr 172.21.15.153:0/2790026061 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:02.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03f7fe700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc040153f70 0x7fc0400cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc044ffd700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400cda90 0x7fc0401f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03ffff700 1 -- 172.21.15.153:0/2790026061 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400cda90 msgr2=0x7fc0401f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03ffff700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400cda90 0x7fc0401f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03ffff700 1 -- 172.21.15.153:0/2790026061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc040153f70 msgr2=0x7fc0400cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03ffff700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc040153f70 0x7fc0400cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03ffff700 1 -- 172.21.15.153:0/2790026061 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400ab620 con 0x7fc0400ab240 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03f7fe700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc040153f70 0x7fc0400cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03ffff700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0400ab240 0x7fc040153a30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc030000fb0 tx=0x7fc03000f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03cff9700 1 -- 172.21.15.153:0/2790026061 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030007d00 con 0x7fc0400ab240 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03cff9700 1 -- 172.21.15.153:0/2790026061 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc030007e80 con 0x7fc0400ab240 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc046a60700 1 -- 172.21.15.153:0/2790026061 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0401502e0 con 0x7fc0400ab240 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc03cff9700 1 -- 172.21.15.153:0/2790026061 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000fc70 con 0x7fc0400ab240 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.423+0000 7fc046a60700 1 -- 172.21.15.153:0/2790026061 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0401508a0 con 0x7fc0400ab240 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.424+0000 7fc046a60700 1 -- 172.21.15.153:0/2790026061 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc040067f60 con 0x7fc0400ab240 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.425+0000 7fc03cff9700 1 -- 172.21.15.153:0/2790026061 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc03001d460 con 0x7fc0400ab240 2023-11-24T08:05:02.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.425+0000 7fc03cff9700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc02c06aed0 0x7fc02c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.425+0000 7fc03cff9700 1 -- 172.21.15.153:0/2790026061 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc030089330 con 0x7fc0400ab240 2023-11-24T08:05:02.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.425+0000 7fc03f7fe700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc02c06aed0 0x7fc02c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.425+0000 7fc03f7fe700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc02c06aed0 0x7fc02c06d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc040154350 tx=0x7fc034008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.429+0000 7fc03cff9700 1 -- 172.21.15.153:0/2790026061 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc030058250 con 0x7fc0400ab240 2023-11-24T08:05:02.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.708+0000 7fc046a60700 1 -- 172.21.15.153:0/2790026061 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc04014de70 con 0x7fc0400ab240 2023-11-24T08:05:02.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.712+0000 7fc03cff9700 1 -- 172.21.15.153:0/2790026061 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc030057de0 con 0x7fc0400ab240 2023-11-24T08:05:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 -- 172.21.15.153:0/2790026061 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc02c06aed0 msgr2=0x7fc02c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc02c06aed0 0x7fc02c06d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc040154350 tx=0x7fc034008040 comp rx=0 tx=0).stop 2023-11-24T08:05:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 -- 172.21.15.153:0/2790026061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0400ab240 msgr2=0x7fc040153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0400ab240 0x7fc040153a30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc030000fb0 tx=0x7fc03000f4b0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 -- 172.21.15.153:0/2790026061 shutdown_connections 2023-11-24T08:05:02.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc0400cda90 0x7fc0401f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc02c06aed0 0x7fc02c06d390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0400ab240 0x7fc040153a30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 --2- 172.21.15.153:0/2790026061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc040153f70 0x7fc0400cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 -- 172.21.15.153:0/2790026061 >> 172.21.15.153:0/2790026061 conn(0x7fc04006b410 msgr2=0x7fc0400b74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 -- 172.21.15.153:0/2790026061 shutdown_connections 2023-11-24T08:05:02.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.714+0000 7fc046a60700 1 -- 172.21.15.153:0/2790026061 wait complete. 2023-11-24T08:05:02.729 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-24T08:05:02.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.850+0000 7f4e95f43700 1 Processor -- start 2023-11-24T08:05:02.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.850+0000 7f4e95f43700 1 -- start start 2023-11-24T08:05:02.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e95f43700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4e900cf360 0x7f4e900b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e95f43700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9015a790 con 0x7f4e9015deb0 2023-11-24T08:05:02.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e95f43700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e900b4c40 con 0x7f4e9015a3b0 2023-11-24T08:05:02.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e95f43700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e900cf8b0 con 0x7f4e900cf360 2023-11-24T08:05:02.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e8ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4e9015deb0 0x7f4e9015e340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43218/0 (socket says 172.21.15.153:43218) 2023-11-24T08:05:02.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e8effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4e900cf360 0x7f4e900b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e8ffff700 1 -- 172.21.15.153:0/2955502434 learned_addr learned my addr 172.21.15.153:0/2955502434 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:02.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e8e7fc700 1 -- 172.21.15.153:0/2955502434 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577790483 0 0) 0x7f4e9015a790 con 0x7f4e9015deb0 2023-11-24T08:05:02.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e8e7fc700 1 -- 172.21.15.153:0/2955502434 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e7c0035b0 con 0x7f4e9015deb0 2023-11-24T08:05:02.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e8effd700 1 -- 172.21.15.153:0/2955502434 >> v1:172.21.15.164:6789/0 conn(0x7f4e9015a3b0 legacy=0x7f4e900b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e8effd700 1 -- 172.21.15.153:0/2955502434 >> v1:172.21.15.153:6789/0 conn(0x7f4e9015deb0 legacy=0x7f4e9015e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.851+0000 7f4e8effd700 1 -- 172.21.15.153:0/2955502434 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e90070c60 con 0x7f4e900cf360 2023-11-24T08:05:02.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.852+0000 7f4e8effd700 1 --2- 172.21.15.153:0/2955502434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e900cf360 0x7f4e900b3a30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000a9e0 tx=0x7f4e8000acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89546e7766f16d74 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.852+0000 7f4e8e7fc700 1 -- 172.21.15.153:0/2955502434 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000cb30 con 0x7f4e900cf360 2023-11-24T08:05:02.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.852+0000 7f4e8e7fc700 1 -- 172.21.15.153:0/2955502434 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8000cc90 con 0x7f4e900cf360 2023-11-24T08:05:02.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.852+0000 7f4e8e7fc700 1 -- 172.21.15.153:0/2955502434 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000ae80 con 0x7f4e900cf360 2023-11-24T08:05:02.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.852+0000 7f4e95f43700 1 -- 172.21.15.153:0/2955502434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e900cf360 msgr2=0x7f4e900b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.852+0000 7f4e95f43700 1 --2- 172.21.15.153:0/2955502434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e900cf360 0x7f4e900b3a30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000a9e0 tx=0x7f4e8000acf0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.852+0000 7f4e95f43700 1 -- 172.21.15.153:0/2955502434 shutdown_connections 2023-11-24T08:05:02.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.852+0000 7f4e95f43700 1 --2- 172.21.15.153:0/2955502434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e900cf360 0x7f4e900b3a30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.852+0000 7f4e95f43700 1 -- 172.21.15.153:0/2955502434 >> 172.21.15.153:0/2955502434 conn(0x7f4e900b1740 msgr2=0x7f4e900b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.852+0000 7f4e95f43700 1 -- 172.21.15.153:0/2955502434 shutdown_connections 2023-11-24T08:05:02.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.852+0000 7f4e95f43700 1 -- 172.21.15.153:0/2955502434 wait complete. 2023-11-24T08:05:02.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.853+0000 7f4e95f43700 1 Processor -- start 2023-11-24T08:05:02.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.854+0000 7f4e95f43700 1 -- start start 2023-11-24T08:05:02.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.854+0000 7f4e95f43700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e900cf360 0x7f4e90152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.854+0000 7f4e95f43700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e9015a3b0 0x7f4e90141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.854+0000 7f4e95f43700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e9015deb0 0x7f4e90150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.854+0000 7f4e95f43700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900cc6e0 con 0x7f4e9015a3b0 2023-11-24T08:05:02.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.854+0000 7f4e95f43700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900cc9c0 con 0x7f4e9015deb0 2023-11-24T08:05:02.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.854+0000 7f4e95f43700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900ccca0 con 0x7f4e900cf360 2023-11-24T08:05:02.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e8effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e9015a3b0 0x7f4e90141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e8effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e9015a3b0 0x7f4e90141110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37118/0 (socket says 172.21.15.153:37118) 2023-11-24T08:05:02.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e8effd700 1 -- 172.21.15.153:0/3342977267 learned_addr learned my addr 172.21.15.153:0/3342977267 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:02.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e8ffff700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e9015deb0 0x7f4e90150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e8f7fe700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e900cf360 0x7f4e90152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e8effd700 1 -- 172.21.15.153:0/3342977267 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e900cf360 msgr2=0x7f4e90152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e8effd700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e900cf360 0x7f4e90152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e8effd700 1 -- 172.21.15.153:0/3342977267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e9015deb0 msgr2=0x7f4e90150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e8effd700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e9015deb0 0x7f4e90150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e8effd700 1 -- 172.21.15.153:0/3342977267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8000a640 con 0x7f4e9015a3b0 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e8effd700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e9015a3b0 0x7f4e90141110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000a1c0 tx=0x7f4e80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e87fff700 1 -- 172.21.15.153:0/3342977267 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8001d070 con 0x7f4e9015a3b0 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e87fff700 1 -- 172.21.15.153:0/3342977267 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8000cb20 con 0x7f4e9015a3b0 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e95f43700 1 -- 172.21.15.153:0/3342977267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e900ccf80 con 0x7f4e9015a3b0 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e87fff700 1 -- 172.21.15.153:0/3342977267 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80003af0 con 0x7f4e9015a3b0 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.855+0000 7f4e95f43700 1 -- 172.21.15.153:0/3342977267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e900cd540 con 0x7f4e9015a3b0 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.856+0000 7f4e95f43700 1 -- 172.21.15.153:0/3342977267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e900751e0 con 0x7f4e9015a3b0 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.857+0000 7f4e87fff700 1 -- 172.21.15.153:0/3342977267 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e80003c50 con 0x7f4e9015a3b0 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.857+0000 7f4e87fff700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4e7006aed0 0x7f4e7006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.857+0000 7f4e87fff700 1 -- 172.21.15.153:0/3342977267 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4e8008a570 con 0x7f4e9015a3b0 2023-11-24T08:05:02.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.857+0000 7f4e8f7fe700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4e7006aed0 0x7f4e7006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.858+0000 7f4e8f7fe700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4e7006aed0 0x7f4e7006d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4e900b4670 tx=0x7f4e78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:02.862+0000 7f4e87fff700 1 -- 172.21.15.153:0/3342977267 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e80055a00 con 0x7f4e9015a3b0 2023-11-24T08:05:03.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.128+0000 7f4e95f43700 1 -- 172.21.15.153:0/3342977267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f4e900b3100 con 0x7f4e9015a3b0 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.132+0000 7f4e87fff700 1 -- 172.21.15.153:0/3342977267 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4e80059020 con 0x7f4e9015a3b0 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.134+0000 7f4e95f43700 1 -- 172.21.15.153:0/3342977267 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4e7006aed0 msgr2=0x7f4e7006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.134+0000 7f4e95f43700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4e7006aed0 0x7f4e7006d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4e900b4670 tx=0x7f4e78008040 comp rx=0 tx=0).stop 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.134+0000 7f4e95f43700 1 -- 172.21.15.153:0/3342977267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e9015a3b0 msgr2=0x7f4e90141110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.134+0000 7f4e95f43700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e9015a3b0 0x7f4e90141110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000a1c0 tx=0x7f4e80004750 comp rx=0 tx=0).stop 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.135+0000 7f4e95f43700 1 -- 172.21.15.153:0/3342977267 shutdown_connections 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.135+0000 7f4e95f43700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e9015deb0 0x7f4e90150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.135+0000 7f4e95f43700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e900cf360 0x7f4e90152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.135+0000 7f4e95f43700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4e7006aed0 0x7f4e7006d390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.135+0000 7f4e95f43700 1 --2- 172.21.15.153:0/3342977267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e9015a3b0 0x7f4e90141110 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.135+0000 7f4e95f43700 1 -- 172.21.15.153:0/3342977267 >> 172.21.15.153:0/3342977267 conn(0x7f4e900b1740 msgr2=0x7f4e9006da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:03.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.135+0000 7f4e95f43700 1 -- 172.21.15.153:0/3342977267 shutdown_connections 2023-11-24T08:05:03.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.135+0000 7f4e95f43700 1 -- 172.21.15.153:0/3342977267 wait complete. 2023-11-24T08:05:03.149 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:03.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.269+0000 7fc6957c0700 1 Processor -- start 2023-11-24T08:05:03.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.269+0000 7fc6957c0700 1 -- start start 2023-11-24T08:05:03.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.269+0000 7fc6957c0700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc69015bd30 0x7fc6900cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.269+0000 7fc6957c0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc690162920 0x7fc6900cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.269+0000 7fc6957c0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc690161bf0 con 0x7fc69015e6e0 2023-11-24T08:05:03.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.269+0000 7fc6957c0700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6900cff40 con 0x7fc69015bd30 2023-11-24T08:05:03.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.269+0000 7fc6957c0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69015f450 con 0x7fc690162920 2023-11-24T08:05:03.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc69015e6e0 0x7fc69015eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43232/0 (socket says 172.21.15.153:43232) 2023-11-24T08:05:03.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68f7fe700 1 -- 172.21.15.153:0/2528308698 learned_addr learned my addr 172.21.15.153:0/2528308698 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:03.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175191309 0 0) 0x7fc690161bf0 con 0x7fc69015e6e0 2023-11-24T08:05:03.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6780035b0 con 0x7fc69015e6e0 2023-11-24T08:05:03.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68effd700 1 --2- 172.21.15.153:0/2528308698 >> v2:172.21.15.164:3300/0 conn(0x7fc69015bd30 0x7fc6900cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68e7fc700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc690162920 0x7fc6900cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1870284964 0 0) 0x7fc6780035b0 con 0x7fc69015e6e0 2023-11-24T08:05:03.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc690162920 msgr2=0x7fc6900cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc690162920 0x7fc6900cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 >> v2:172.21.15.164:3300/0 conn(0x7fc69015bd30 msgr2=0x7fc6900cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 --2- 172.21.15.153:0/2528308698 >> v2:172.21.15.164:3300/0 conn(0x7fc69015bd30 0x7fc6900cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc690161e40 con 0x7fc69015e6e0 2023-11-24T08:05:03.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fc6880019f0 con 0x7fc69015e6e0 2023-11-24T08:05:03.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68effd700 1 --2- 172.21.15.153:0/2528308698 >> v2:172.21.15.164:3300/0 conn(0x7fc69015bd30 0x7fc6900cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:03.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 >> v1:172.21.15.153:6789/0 conn(0x7fc69015e6e0 legacy=0x7fc69015eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc678003a00 0x7fc678003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc678004850 0x7fc678004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc690162920 0x7fc678005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900cff40 con 0x7fc678004850 2023-11-24T08:05:03.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69015f450 con 0x7fc678003a00 2023-11-24T08:05:03.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67800ba10 con 0x7fc690162920 2023-11-24T08:05:03.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68e7fc700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc678004850 0x7fc678004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68f7fe700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc690162920 0x7fc678005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.270+0000 7fc68effd700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc678003a00 0x7fc678003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc68e7fc700 1 -- 172.21.15.153:0/2528308698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc690162920 msgr2=0x7fc678005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc68e7fc700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc690162920 0x7fc678005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc68e7fc700 1 -- 172.21.15.153:0/2528308698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc678003a00 msgr2=0x7fc678003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc68e7fc700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc678003a00 0x7fc678003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc68e7fc700 1 -- 172.21.15.153:0/2528308698 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6780035b0 con 0x7fc678004850 2023-11-24T08:05:03.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc68e7fc700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc678004850 0x7fc678004cd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc680009b60 tx=0x7fc678005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae6423d9a7850f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68000e6c0 con 0x7fc678004850 2023-11-24T08:05:03.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68000e820 con 0x7fc678004850 2023-11-24T08:05:03.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc68dffb700 1 -- 172.21.15.153:0/2528308698 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68000eb90 con 0x7fc678004850 2023-11-24T08:05:03.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc6957c0700 1 -- 172.21.15.153:0/2528308698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc678004850 msgr2=0x7fc678004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc6957c0700 1 --2- 172.21.15.153:0/2528308698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc678004850 0x7fc678004cd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc680009b60 tx=0x7fc678005880 comp rx=0 tx=0).stop 2023-11-24T08:05:03.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc68f7fe700 1 -- 172.21.15.153:0/2528308698 reap_dead start 2023-11-24T08:05:03.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc6957c0700 1 -- 172.21.15.153:0/2528308698 shutdown_connections 2023-11-24T08:05:03.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc6957c0700 1 -- 172.21.15.153:0/2528308698 >> 172.21.15.153:0/2528308698 conn(0x7fc690072710 msgr2=0x7fc690072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:03.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc6957c0700 1 -- 172.21.15.153:0/2528308698 shutdown_connections 2023-11-24T08:05:03.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.271+0000 7fc6957c0700 1 -- 172.21.15.153:0/2528308698 wait complete. 2023-11-24T08:05:03.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.273+0000 7fc6957c0700 1 Processor -- start 2023-11-24T08:05:03.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.273+0000 7fc6957c0700 1 -- start start 2023-11-24T08:05:03.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc6957c0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc678004850 0x7fc69015c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc6957c0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc690154340 0x7fc690099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc6957c0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6900b5860 0x7fc6900b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc6957c0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900b5dd0 con 0x7fc6900b5860 2023-11-24T08:05:03.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc6957c0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c85d0 con 0x7fc690154340 2023-11-24T08:05:03.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc6957c0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c88b0 con 0x7fc678004850 2023-11-24T08:05:03.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc68f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6900b5860 0x7fc6900b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc68effd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc678004850 0x7fc69015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc68f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6900b5860 0x7fc6900b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37140/0 (socket says 172.21.15.153:37140) 2023-11-24T08:05:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc68f7fe700 1 -- 172.21.15.153:0/1824468429 learned_addr learned my addr 172.21.15.153:0/1824468429 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc68e7fc700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc690154340 0x7fc690099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc68f7fe700 1 -- 172.21.15.153:0/1824468429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc678004850 msgr2=0x7fc69015c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc68f7fe700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc678004850 0x7fc69015c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc68f7fe700 1 -- 172.21.15.153:0/1824468429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc690154340 msgr2=0x7fc690099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc68f7fe700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc690154340 0x7fc690099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc68f7fe700 1 -- 172.21.15.153:0/1824468429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900c8b90 con 0x7fc6900b5860 2023-11-24T08:05:03.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc68f7fe700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6900b5860 0x7fc6900b2f60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc688001330 tx=0x7fc688007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc6777fe700 1 -- 172.21.15.153:0/1824468429 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800ebb0 con 0x7fc6900b5860 2023-11-24T08:05:03.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc6777fe700 1 -- 172.21.15.153:0/1824468429 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68800ed30 con 0x7fc6900b5860 2023-11-24T08:05:03.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc6957c0700 1 -- 172.21.15.153:0/1824468429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6901e7a10 con 0x7fc6900b5860 2023-11-24T08:05:03.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc6777fe700 1 -- 172.21.15.153:0/1824468429 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688013660 con 0x7fc6900b5860 2023-11-24T08:05:03.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.274+0000 7fc6957c0700 1 -- 172.21.15.153:0/1824468429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6900b34a0 con 0x7fc6900b5860 2023-11-24T08:05:03.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.275+0000 7fc6957c0700 1 -- 172.21.15.153:0/1824468429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6900ccb20 con 0x7fc6900b5860 2023-11-24T08:05:03.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.276+0000 7fc6777fe700 1 -- 172.21.15.153:0/1824468429 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6880137c0 con 0x7fc6900b5860 2023-11-24T08:05:03.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.276+0000 7fc6777fe700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc67c06af00 0x7fc67c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.276+0000 7fc6777fe700 1 -- 172.21.15.153:0/1824468429 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc688089730 con 0x7fc6900b5860 2023-11-24T08:05:03.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.276+0000 7fc68effd700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc67c06af00 0x7fc67c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.276+0000 7fc68effd700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc67c06af00 0x7fc67c06d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc684006f10 tx=0x7fc684008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.280+0000 7fc6777fe700 1 -- 172.21.15.153:0/1824468429 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc688054bc0 con 0x7fc6900b5860 2023-11-24T08:05:03.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.473+0000 7fc6957c0700 1 -- 172.21.15.153:0/1824468429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6900c8d20 con 0x7fc6900b5860 2023-11-24T08:05:03.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.473+0000 7fc6777fe700 1 -- 172.21.15.153:0/1824468429 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12893 (secure 0 0 0) 0x7fc68800eea0 con 0x7fc6900b5860 2023-11-24T08:05:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:03.476 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":28,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:00.157596+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:03.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 -- 172.21.15.153:0/1824468429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc67c06af00 msgr2=0x7fc67c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc67c06af00 0x7fc67c06d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc684006f10 tx=0x7fc684008040 comp rx=0 tx=0).stop 2023-11-24T08:05:03.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 -- 172.21.15.153:0/1824468429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6900b5860 msgr2=0x7fc6900b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6900b5860 0x7fc6900b2f60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc688001330 tx=0x7fc688007c90 comp rx=0 tx=0).stop 2023-11-24T08:05:03.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 -- 172.21.15.153:0/1824468429 shutdown_connections 2023-11-24T08:05:03.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc67c06af00 0x7fc67c06d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6900b5860 0x7fc6900b2f60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc678004850 0x7fc69015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 --2- 172.21.15.153:0/1824468429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc690154340 0x7fc690099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 -- 172.21.15.153:0/1824468429 >> 172.21.15.153:0/1824468429 conn(0x7fc690072710 msgr2=0x7fc69015a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:03.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 -- 172.21.15.153:0/1824468429 shutdown_connections 2023-11-24T08:05:03.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.476+0000 7fc6957c0700 1 -- 172.21.15.153:0/1824468429 wait complete. 2023-11-24T08:05:03.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:03.491 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:03.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.613+0000 7f5532e8b700 1 Processor -- start 2023-11-24T08:05:03.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.613+0000 7f5532e8b700 1 -- start start 2023-11-24T08:05:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.614+0000 7f5532e8b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c0cf110 0x7f552c0cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.614+0000 7f5532e8b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c0d0140 con 0x7f552c15bf50 2023-11-24T08:05:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.614+0000 7f5532e8b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c0d03e0 con 0x7f552c0c6c30 2023-11-24T08:05:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.614+0000 7f5532e8b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c15c330 con 0x7f552c0cf110 2023-11-24T08:05:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.614+0000 7f5530c27700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f552c15bf50 0x7f552c0ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43248/0 (socket says 172.21.15.153:43248) 2023-11-24T08:05:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.614+0000 7f5530c27700 1 -- 172.21.15.153:0/2149902750 learned_addr learned my addr 172.21.15.153:0/2149902750 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517558757 0 0) 0x7f552c0d0140 con 0x7f552c15bf50 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f551c0035b0 con 0x7f552c15bf50 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f5531428700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c0cf110 0x7f552c0cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 927128598 0 0) 0x7f551c0035b0 con 0x7f552c15bf50 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c0cf110 msgr2=0x7f552c0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c0cf110 0x7f552c0cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 >> v1:172.21.15.164:6789/0 conn(0x7f552c0c6c30 legacy=0x7f552c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c0d06c0 con 0x7f552c15bf50 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f5520001670 con 0x7f552c15bf50 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 >> v1:172.21.15.153:6789/0 conn(0x7f552c15bf50 legacy=0x7f552c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551c003a30 0x7f551c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f551c004850 0x7f551c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c0cf110 0x7f551c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c15c330 con 0x7f551c004850 2023-11-24T08:05:03.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c00bac0 con 0x7f551c003a30 2023-11-24T08:05:03.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c00bc80 con 0x7f552c0cf110 2023-11-24T08:05:03.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552bfff700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f551c004850 0x7f551c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f5530c27700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551c003a30 0x7f551c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f5531428700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c0cf110 0x7f551c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552bfff700 1 -- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c0cf110 msgr2=0x7f551c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552bfff700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c0cf110 0x7f551c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552bfff700 1 -- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551c003a30 msgr2=0x7f551c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552bfff700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551c003a30 0x7f551c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f552bfff700 1 -- 172.21.15.153:0/2149902750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c0035b0 con 0x7f551c004850 2023-11-24T08:05:03.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.615+0000 7f5531428700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c0cf110 0x7f551c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:03.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.616+0000 7f552bfff700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f551c004850 0x7f551c004cd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5518007fd0 tx=0x7f551c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c97b710e688fce5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.616+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180052d0 con 0x7f551c004850 2023-11-24T08:05:03.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.616+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5518005470 con 0x7f551c004850 2023-11-24T08:05:03.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.616+0000 7f552b7fe700 1 -- 172.21.15.153:0/2149902750 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180038c0 con 0x7f551c004850 2023-11-24T08:05:03.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.616+0000 7f5532e8b700 1 -- 172.21.15.153:0/2149902750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f551c004850 msgr2=0x7f551c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.616+0000 7f5532e8b700 1 --2- 172.21.15.153:0/2149902750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f551c004850 0x7f551c004cd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5518007fd0 tx=0x7f551c005880 comp rx=0 tx=0).stop 2023-11-24T08:05:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.616+0000 7f5531428700 1 -- 172.21.15.153:0/2149902750 reap_dead start 2023-11-24T08:05:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.616+0000 7f5532e8b700 1 -- 172.21.15.153:0/2149902750 shutdown_connections 2023-11-24T08:05:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.616+0000 7f5532e8b700 1 -- 172.21.15.153:0/2149902750 >> 172.21.15.153:0/2149902750 conn(0x7f552c0b3780 msgr2=0x7f552c0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.616+0000 7f5532e8b700 1 -- 172.21.15.153:0/2149902750 shutdown_connections 2023-11-24T08:05:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.616+0000 7f5532e8b700 1 -- 172.21.15.153:0/2149902750 wait complete. 2023-11-24T08:05:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.617+0000 7f5532e8b700 1 Processor -- start 2023-11-24T08:05:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.617+0000 7f5532e8b700 1 -- start start 2023-11-24T08:05:03.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.618+0000 7f5532e8b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551c004850 0x7f552c1f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.618+0000 7f5532e8b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c153f80 0x7f552c153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.618+0000 7f5532e8b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552c1552c0 0x7f552c155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.618+0000 7f5532e8b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c154870 con 0x7f552c1552c0 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.618+0000 7f5532e8b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c155c80 con 0x7f551c004850 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.618+0000 7f5532e8b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c158370 con 0x7f552c153f80 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.618+0000 7f5531428700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552c1552c0 0x7f552c155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.618+0000 7f5531428700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552c1552c0 0x7f552c155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37160/0 (socket says 172.21.15.153:37160) 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.618+0000 7f5531428700 1 -- 172.21.15.153:0/3098617039 learned_addr learned my addr 172.21.15.153:0/3098617039 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f552bfff700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c153f80 0x7f552c153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f5530c27700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551c004850 0x7f552c1f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f5531428700 1 -- 172.21.15.153:0/3098617039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c153f80 msgr2=0x7f552c153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f5531428700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c153f80 0x7f552c153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f5531428700 1 -- 172.21.15.153:0/3098617039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551c004850 msgr2=0x7f552c1f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f5531428700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551c004850 0x7f552c1f2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f5531428700 1 -- 172.21.15.153:0/3098617039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c1f2690 con 0x7f552c1552c0 2023-11-24T08:05:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f5531428700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552c1552c0 0x7f552c155740 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f552c0cf5a0 tx=0x7f55240114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f55297fa700 1 -- 172.21.15.153:0/3098617039 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400e030 con 0x7f552c1552c0 2023-11-24T08:05:03.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f55297fa700 1 -- 172.21.15.153:0/3098617039 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5524011d10 con 0x7f552c1552c0 2023-11-24T08:05:03.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f5532e8b700 1 -- 172.21.15.153:0/3098617039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c157760 con 0x7f552c1552c0 2023-11-24T08:05:03.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f55297fa700 1 -- 172.21.15.153:0/3098617039 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524009bc0 con 0x7f552c1552c0 2023-11-24T08:05:03.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.619+0000 7f5532e8b700 1 -- 172.21.15.153:0/3098617039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c157d20 con 0x7f552c1552c0 2023-11-24T08:05:03.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.620+0000 7f5532e8b700 1 -- 172.21.15.153:0/3098617039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c068fb0 con 0x7f552c1552c0 2023-11-24T08:05:03.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.620+0000 7f55297fa700 1 -- 172.21.15.153:0/3098617039 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5524016690 con 0x7f552c1552c0 2023-11-24T08:05:03.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.621+0000 7f55297fa700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551006aed0 0x7f551006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.621+0000 7f55297fa700 1 -- 172.21.15.153:0/3098617039 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f552400f070 con 0x7f552c1552c0 2023-11-24T08:05:03.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.621+0000 7f5530c27700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551006aed0 0x7f551006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.621+0000 7f5530c27700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551006aed0 0x7f551006d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5520001050 tx=0x7f5520009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.625+0000 7f55297fa700 1 -- 172.21.15.153:0/3098617039 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5524054fc0 con 0x7f552c1552c0 2023-11-24T08:05:03.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.813+0000 7f5532e8b700 1 -- 172.21.15.153:0/3098617039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f552c1584b0 con 0x7f552c1552c0 2023-11-24T08:05:03.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.814+0000 7f55297fa700 1 -- 172.21.15.153:0/3098617039 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f552c1584b0 con 0x7f552c1552c0 2023-11-24T08:05:03.816 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:05:03.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 -- 172.21.15.153:0/3098617039 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551006aed0 msgr2=0x7f551006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551006aed0 0x7f551006d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5520001050 tx=0x7f5520009040 comp rx=0 tx=0).stop 2023-11-24T08:05:03.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 -- 172.21.15.153:0/3098617039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552c1552c0 msgr2=0x7f552c155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552c1552c0 0x7f552c155740 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f552c0cf5a0 tx=0x7f55240114b0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 -- 172.21.15.153:0/3098617039 shutdown_connections 2023-11-24T08:05:03.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f551006aed0 0x7f551006d390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552c1552c0 0x7f552c155740 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551c004850 0x7f552c1f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 --2- 172.21.15.153:0/3098617039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f552c153f80 0x7f552c153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 -- 172.21.15.153:0/3098617039 >> 172.21.15.153:0/3098617039 conn(0x7f552c0b3780 msgr2=0x7f552c0c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:03.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 -- 172.21.15.153:0/3098617039 shutdown_connections 2023-11-24T08:05:03.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.816+0000 7f5532e8b700 1 -- 172.21.15.153:0/3098617039 wait complete. 2023-11-24T08:05:03.830 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:05:03.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.949+0000 7fbe7b79a700 1 Processor -- start 2023-11-24T08:05:03.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.949+0000 7fbe7b79a700 1 -- start start 2023-11-24T08:05:03.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe7b79a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbe7415e080 0x7fbe740b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe7b79a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe7406c710 0x7fbe740afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe7b79a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe740ae430 con 0x7fbe740af4d0 2023-11-24T08:05:03.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe7b79a700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe740af0b0 con 0x7fbe7415e080 2023-11-24T08:05:03.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe7b79a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740b05a0 con 0x7fbe7406c710 2023-11-24T08:05:03.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe78d35700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbe740af4d0 0x7fbe7406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43270/0 (socket says 172.21.15.153:43270) 2023-11-24T08:05:03.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe78d35700 1 -- 172.21.15.153:0/3830569187 learned_addr learned my addr 172.21.15.153:0/3830569187 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:03.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe79d37700 1 --2- 172.21.15.153:0/3830569187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe7406c710 0x7fbe740afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe79536700 1 --2- 172.21.15.153:0/3830569187 >> v2:172.21.15.164:3300/0 conn(0x7fbe7415e080 0x7fbe740b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe6bfff700 1 -- 172.21.15.153:0/3830569187 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373476563 0 0) 0x7fbe740ae430 con 0x7fbe740af4d0 2023-11-24T08:05:03.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe6bfff700 1 -- 172.21.15.153:0/3830569187 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe600035b0 con 0x7fbe740af4d0 2023-11-24T08:05:03.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe6bfff700 1 -- 172.21.15.153:0/3830569187 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 333209155 0 0) 0x7fbe600035b0 con 0x7fbe740af4d0 2023-11-24T08:05:03.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe79d37700 1 -- 172.21.15.153:0/3830569187 >> v2:172.21.15.164:3300/0 conn(0x7fbe7415e080 msgr2=0x7fbe740b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe79d37700 1 --2- 172.21.15.153:0/3830569187 >> v2:172.21.15.164:3300/0 conn(0x7fbe7415e080 0x7fbe740b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe79d37700 1 -- 172.21.15.153:0/3830569187 >> v1:172.21.15.153:6789/0 conn(0x7fbe740af4d0 legacy=0x7fbe7406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe79d37700 1 -- 172.21.15.153:0/3830569187 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe740ae710 con 0x7fbe7406c710 2023-11-24T08:05:03.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.950+0000 7fbe79536700 1 --2- 172.21.15.153:0/3830569187 >> v2:172.21.15.164:3300/0 conn(0x7fbe7415e080 0x7fbe740b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:03.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe79d37700 1 --2- 172.21.15.153:0/3830569187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe7406c710 0x7fbe740afb90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009d90 tx=0x7fbe6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca9f0c13752ad877 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe6bfff700 1 -- 172.21.15.153:0/3830569187 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00e070 con 0x7fbe7406c710 2023-11-24T08:05:03.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe6bfff700 1 -- 172.21.15.153:0/3830569187 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c003a20 con 0x7fbe7406c710 2023-11-24T08:05:03.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe6bfff700 1 -- 172.21.15.153:0/3830569187 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64001670 con 0x7fbe7406c710 2023-11-24T08:05:03.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3830569187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe7406c710 msgr2=0x7fbe740afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe7b79a700 1 --2- 172.21.15.153:0/3830569187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe7406c710 0x7fbe740afb90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009d90 tx=0x7fbe6c00b330 comp rx=0 tx=0).stop 2023-11-24T08:05:03.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3830569187 shutdown_connections 2023-11-24T08:05:03.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe7b79a700 1 --2- 172.21.15.153:0/3830569187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe7406c710 0x7fbe740afb90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe7b79a700 1 --2- 172.21.15.153:0/3830569187 >> v2:172.21.15.164:3300/0 conn(0x7fbe7415e080 0x7fbe740b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3830569187 >> 172.21.15.153:0/3830569187 conn(0x7fbe74071b90 msgr2=0x7fbe74071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:03.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3830569187 shutdown_connections 2023-11-24T08:05:03.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.951+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3830569187 wait complete. 2023-11-24T08:05:03.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.953+0000 7fbe7b79a700 1 Processor -- start 2023-11-24T08:05:03.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.953+0000 7fbe7b79a700 1 -- start start 2023-11-24T08:05:03.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.953+0000 7fbe7b79a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7406c710 0x7fbe7415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.953+0000 7fbe7b79a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe740af4d0 0x7fbe7413e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.953+0000 7fbe7b79a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe7415e080 0x7fbe741560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.953+0000 7fbe7b79a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7413ea30 con 0x7fbe740af4d0 2023-11-24T08:05:03.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.953+0000 7fbe7b79a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7415f750 con 0x7fbe7406c710 2023-11-24T08:05:03.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.953+0000 7fbe7b79a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe741613a0 con 0x7fbe7415e080 2023-11-24T08:05:03.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.953+0000 7fbe78d35700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe740af4d0 0x7fbe7413e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.953+0000 7fbe78d35700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe740af4d0 0x7fbe7413e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37172/0 (socket says 172.21.15.153:37172) 2023-11-24T08:05:03.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.953+0000 7fbe78d35700 1 -- 172.21.15.153:0/3674516750 learned_addr learned my addr 172.21.15.153:0/3674516750 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:03.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe79d37700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe7415e080 0x7fbe741560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe79536700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7406c710 0x7fbe7415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe78d35700 1 -- 172.21.15.153:0/3674516750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe7415e080 msgr2=0x7fbe741560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe78d35700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe7415e080 0x7fbe741560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe78d35700 1 -- 172.21.15.153:0/3674516750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7406c710 msgr2=0x7fbe7415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe78d35700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7406c710 0x7fbe7415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe78d35700 1 -- 172.21.15.153:0/3674516750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe700094a0 con 0x7fbe740af4d0 2023-11-24T08:05:03.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe79536700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7406c710 0x7fbe7415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:03.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe78d35700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe740af4d0 0x7fbe7413e4f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c780 tx=0x7fbe6400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe69ffb700 1 -- 172.21.15.153:0/3674516750 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64004c80 con 0x7fbe740af4d0 2023-11-24T08:05:03.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe69ffb700 1 -- 172.21.15.153:0/3674516750 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe64004de0 con 0x7fbe740af4d0 2023-11-24T08:05:03.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3674516750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c009a70 con 0x7fbe740af4d0 2023-11-24T08:05:03.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe69ffb700 1 -- 172.21.15.153:0/3674516750 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640072d0 con 0x7fbe740af4d0 2023-11-24T08:05:03.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.954+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3674516750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7415ee20 con 0x7fbe740af4d0 2023-11-24T08:05:03.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.955+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3674516750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe740753f0 con 0x7fbe740af4d0 2023-11-24T08:05:03.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.956+0000 7fbe69ffb700 1 -- 172.21.15.153:0/3674516750 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe64007430 con 0x7fbe740af4d0 2023-11-24T08:05:03.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.956+0000 7fbe69ffb700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 0x7fbe5806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.956+0000 7fbe69ffb700 1 -- 172.21.15.153:0/3674516750 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe64088900 con 0x7fbe740af4d0 2023-11-24T08:05:03.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.956+0000 7fbe79536700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 0x7fbe5806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.956+0000 7fbe79536700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 0x7fbe5806d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009c50 tx=0x7fbe70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:03.960+0000 7fbe69ffb700 1 -- 172.21.15.153:0/3674516750 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe64053d00 con 0x7fbe740af4d0 2023-11-24T08:05:04.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.155+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3674516750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbe7415f8c0 con 0x7fbe740af4d0 2023-11-24T08:05:04.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.155+0000 7fbe69ffb700 1 -- 172.21.15.153:0/3674516750 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbe64018090 con 0x7fbe740af4d0 2023-11-24T08:05:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:04.158 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-11-24T08:05:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-11-24T08:05:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": ".mgr" 2023-11-24T08:05:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:04.159 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-11-24T08:05:04.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3674516750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 msgr2=0x7fbe5806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 0x7fbe5806d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009c50 tx=0x7fbe70008040 comp rx=0 tx=0).stop 2023-11-24T08:05:04.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3674516750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe740af4d0 msgr2=0x7fbe7413e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe740af4d0 0x7fbe7413e4f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c780 tx=0x7fbe6400cb40 comp rx=0 tx=0).stop 2023-11-24T08:05:04.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3674516750 shutdown_connections 2023-11-24T08:05:04.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe7415e080 0x7fbe741560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7406c710 0x7fbe7415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe5806aed0 0x7fbe5806d390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 --2- 172.21.15.153:0/3674516750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe740af4d0 0x7fbe7413e4f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3674516750 >> 172.21.15.153:0/3674516750 conn(0x7fbe74071b90 msgr2=0x7fbe7406ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:04.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3674516750 shutdown_connections 2023-11-24T08:05:04.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.157+0000 7fbe7b79a700 1 -- 172.21.15.153:0/3674516750 wait complete. 2023-11-24T08:05:04.171 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:05:04.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:05:04.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.295+0000 7f34b5e4d700 1 Processor -- start 2023-11-24T08:05:04.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.295+0000 7f34b5e4d700 1 -- start start 2023-11-24T08:05:04.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.295+0000 7f34b5e4d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34b00746a0 0x7f34b006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.295+0000 7f34b5e4d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b00b5e00 con 0x7f34b00b59c0 2023-11-24T08:05:04.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.295+0000 7f34b5e4d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b00b05c0 con 0x7f34b00b01e0 2023-11-24T08:05:04.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.295+0000 7f34b5e4d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b01470a0 con 0x7f34b00746a0 2023-11-24T08:05:04.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34affff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f34b00b59c0 0x7f34b006aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43284/0 (socket says 172.21.15.153:43284) 2023-11-24T08:05:04.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34affff700 1 -- 172.21.15.153:0/2190036523 learned_addr learned my addr 172.21.15.153:0/2190036523 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:04.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34aeffd700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34b00746a0 0x7f34b006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164132272 0 0) 0x7f34b00b5e00 con 0x7f34b00b59c0 2023-11-24T08:05:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34980035b0 con 0x7f34b00b59c0 2023-11-24T08:05:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1383853121 0 0) 0x7f34980035b0 con 0x7f34b00b59c0 2023-11-24T08:05:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34b00746a0 msgr2=0x7f34b006e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34b00746a0 0x7f34b006e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 >> v1:172.21.15.164:6789/0 conn(0x7f34b00b01e0 legacy=0x7f34b0073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00b4250 con 0x7f34b00b59c0 2023-11-24T08:05:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f34a8001670 con 0x7f34b00b59c0 2023-11-24T08:05:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 >> v1:172.21.15.153:6789/0 conn(0x7f34b00b59c0 legacy=0x7f34b006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3498003a30 0x7f3498003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34b00746a0 0x7f3498004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3498004d90 0x7f3498005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b01470a0 con 0x7f3498003a30 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349800bc20 con 0x7f3498004d90 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349800bde0 con 0x7f34b00746a0 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34af7fe700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3498003a30 0x7f3498003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34aeffd700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34b00746a0 0x7f3498004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.296+0000 7f34affff700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3498004d90 0x7f3498005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34af7fe700 1 -- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34b00746a0 msgr2=0x7f3498004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34af7fe700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34b00746a0 0x7f3498004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34af7fe700 1 -- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3498004d90 msgr2=0x7f3498005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34af7fe700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3498004d90 0x7f3498005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34af7fe700 1 -- 172.21.15.153:0/2190036523 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34980035b0 con 0x7f3498003a30 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34affff700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3498004d90 0x7f3498005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34af7fe700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3498003a30 0x7f3498003e50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c190 tx=0x7f3498005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30329c5e54a6438e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0001db0 con 0x7f3498003a30 2023-11-24T08:05:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a000ccd0 con 0x7f3498003a30 2023-11-24T08:05:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34ae7fc700 1 -- 172.21.15.153:0/2190036523 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0003c40 con 0x7f3498003a30 2023-11-24T08:05:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2190036523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3498003a30 msgr2=0x7f3498003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34b5e4d700 1 --2- 172.21.15.153:0/2190036523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3498003a30 0x7f3498003e50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c190 tx=0x7f3498005880 comp rx=0 tx=0).stop 2023-11-24T08:05:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34affff700 1 -- 172.21.15.153:0/2190036523 reap_dead start 2023-11-24T08:05:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2190036523 shutdown_connections 2023-11-24T08:05:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.297+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2190036523 >> 172.21.15.153:0/2190036523 conn(0x7f34b00d0b40 msgr2=0x7f34b00d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.298+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2190036523 shutdown_connections 2023-11-24T08:05:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.298+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2190036523 wait complete. 2023-11-24T08:05:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.299+0000 7f34b5e4d700 1 Processor -- start 2023-11-24T08:05:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.299+0000 7f34b5e4d700 1 -- start start 2023-11-24T08:05:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.300+0000 7f34b5e4d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3498003a30 0x7f34b0161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.300+0000 7f34b5e4d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34b01f3ec0 0x7f34b0140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.300+0000 7f34b5e4d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34b0141ce0 0x7f34b0142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.300+0000 7f34b5e4d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b013df60 con 0x7f34b01f3ec0 2023-11-24T08:05:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.300+0000 7f34b5e4d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0140850 con 0x7f34b0141ce0 2023-11-24T08:05:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.300+0000 7f34b5e4d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b013d210 con 0x7f3498003a30 2023-11-24T08:05:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.300+0000 7f34aeffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34b01f3ec0 0x7f34b0140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.300+0000 7f34aeffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34b01f3ec0 0x7f34b0140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37192/0 (socket says 172.21.15.153:37192) 2023-11-24T08:05:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.300+0000 7f34aeffd700 1 -- 172.21.15.153:0/2295863294 learned_addr learned my addr 172.21.15.153:0/2295863294 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.300+0000 7f34af7fe700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3498003a30 0x7f34b0161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.300+0000 7f34affff700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34b0141ce0 0x7f34b0142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f34aeffd700 1 -- 172.21.15.153:0/2295863294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3498003a30 msgr2=0x7f34b0161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f34aeffd700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3498003a30 0x7f34b0161460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f34aeffd700 1 -- 172.21.15.153:0/2295863294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34b0141ce0 msgr2=0x7f34b0142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f34aeffd700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34b0141ce0 0x7f34b0142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f34aeffd700 1 -- 172.21.15.153:0/2295863294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b013d910 con 0x7f34b01f3ec0 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f34af7fe700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3498003a30 0x7f34b0161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f34affff700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34b0141ce0 0x7f34b0142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f34aeffd700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34b01f3ec0 0x7f34b0140310 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f34a40116c0 tx=0x7f34a4011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f3497fff700 1 -- 172.21.15.153:0/2295863294 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400c070 con 0x7f34b01f3ec0 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f3497fff700 1 -- 172.21.15.153:0/2295863294 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a4015870 con 0x7f34b01f3ec0 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f3497fff700 1 -- 172.21.15.153:0/2295863294 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a4015c20 con 0x7f34b01f3ec0 2023-11-24T08:05:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2295863294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b013dbf0 con 0x7f34b01f3ec0 2023-11-24T08:05:04.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.301+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2295863294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b013d4f0 con 0x7f34b01f3ec0 2023-11-24T08:05:04.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.302+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2295863294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b013e110 con 0x7f34b01f3ec0 2023-11-24T08:05:04.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.302+0000 7f3497fff700 1 -- 172.21.15.153:0/2295863294 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34a4013400 con 0x7f34b01f3ec0 2023-11-24T08:05:04.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.302+0000 7f3497fff700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f349c06af00 0x7f349c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.303+0000 7f3497fff700 1 -- 172.21.15.153:0/2295863294 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f34a40893b0 con 0x7f34b01f3ec0 2023-11-24T08:05:04.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.303+0000 7f34af7fe700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f349c06af00 0x7f349c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.303+0000 7f34af7fe700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f349c06af00 0x7f349c06d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f34a0015040 tx=0x7f34a0009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.307+0000 7f3497fff700 1 -- 172.21.15.153:0/2295863294 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34b013e110 con 0x7f34b01f3ec0 2023-11-24T08:05:04.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:04.498+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2295863294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f34b013d710 con 0x7f34b01f3ec0 2023-11-24T08:05:05.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.136+0000 7f3497fff700 1 -- 172.21.15.153:0/2295863294 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f34a40547b0 con 0x7f34b01f3ec0 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.140+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2295863294 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f349c06af00 msgr2=0x7f349c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.140+0000 7f34b5e4d700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f349c06af00 0x7f349c06d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f34a0015040 tx=0x7f34a0009030 comp rx=0 tx=0).stop 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.140+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2295863294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34b01f3ec0 msgr2=0x7f34b0140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.140+0000 7f34b5e4d700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34b01f3ec0 0x7f34b0140310 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f34a40116c0 tx=0x7f34a4011a80 comp rx=0 tx=0).stop 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.140+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2295863294 shutdown_connections 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.140+0000 7f34b5e4d700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34b0141ce0 0x7f34b0142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.140+0000 7f34b5e4d700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3498003a30 0x7f34b0161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.140+0000 7f34b5e4d700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f349c06af00 0x7f349c06d3c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.140+0000 7f34b5e4d700 1 --2- 172.21.15.153:0/2295863294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34b01f3ec0 0x7f34b0140310 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.140+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2295863294 >> 172.21.15.153:0/2295863294 conn(0x7f34b00d0b40 msgr2=0x7f34b0071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:05.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.141+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2295863294 shutdown_connections 2023-11-24T08:05:05.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.141+0000 7f34b5e4d700 1 -- 172.21.15.153:0/2295863294 wait complete. 2023-11-24T08:05:05.145 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-11-24T08:05:05.158 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:05:05.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.287+0000 7f083bd13700 1 Processor -- start 2023-11-24T08:05:05.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.287+0000 7f083bd13700 1 -- start start 2023-11-24T08:05:05.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083bd13700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f083415e160 0x7f08340b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083bd13700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f08340746a0 0x7f083406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083bd13700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08340b3c60 con 0x7f08340afc90 2023-11-24T08:05:05.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083bd13700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08340b4500 con 0x7f08340746a0 2023-11-24T08:05:05.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083bd13700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08340b58c0 con 0x7f083415e160 2023-11-24T08:05:05.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083a2b0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f08340746a0 0x7f083406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f08392ae700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f08340afc90 0x7f0834073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43300/0 (socket says 172.21.15.153:43300) 2023-11-24T08:05:05.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083a2b0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f08340746a0 0x7f083406d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37200/0 (socket says 172.21.15.153:37200) 2023-11-24T08:05:05.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f08392ae700 1 -- 172.21.15.153:0/1902455106 learned_addr learned my addr 172.21.15.153:0/1902455106 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:05.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f0839aaf700 1 --2- 172.21.15.153:0/1902455106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f083415e160 0x7f08340b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083a2b0700 1 -- 172.21.15.153:0/1902455106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f083415e160 msgr2=0x7f08340b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:05.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083a2b0700 1 --2- 172.21.15.153:0/1902455106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f083415e160 0x7f08340b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083a2b0700 1 -- 172.21.15.153:0/1902455106 >> v1:172.21.15.153:6789/0 conn(0x7f08340afc90 legacy=0x7f0834073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083a2b0700 1 -- 172.21.15.153:0/1902455106 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083406bdc0 con 0x7f08340746a0 2023-11-24T08:05:05.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f083a2b0700 1 --2- 172.21.15.153:0/1902455106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08340746a0 0x7f083406d930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f082c009d90 tx=0x7f082c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67f8aeb84f772f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.288+0000 7f0838aad700 1 -- 172.21.15.153:0/1902455106 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c00e070 con 0x7f08340746a0 2023-11-24T08:05:05.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.289+0000 7f0838aad700 1 -- 172.21.15.153:0/1902455106 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c00bbd0 con 0x7f08340746a0 2023-11-24T08:05:05.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.289+0000 7f0838aad700 1 -- 172.21.15.153:0/1902455106 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c012430 con 0x7f08340746a0 2023-11-24T08:05:05.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.289+0000 7f083bd13700 1 -- 172.21.15.153:0/1902455106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08340746a0 msgr2=0x7f083406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.289+0000 7f083bd13700 1 --2- 172.21.15.153:0/1902455106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08340746a0 0x7f083406d930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f082c009d90 tx=0x7f082c00b330 comp rx=0 tx=0).stop 2023-11-24T08:05:05.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.289+0000 7f083bd13700 1 -- 172.21.15.153:0/1902455106 shutdown_connections 2023-11-24T08:05:05.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.289+0000 7f083bd13700 1 --2- 172.21.15.153:0/1902455106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f083415e160 0x7f08340b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.289+0000 7f083bd13700 1 --2- 172.21.15.153:0/1902455106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08340746a0 0x7f083406d930 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.289+0000 7f083bd13700 1 -- 172.21.15.153:0/1902455106 >> 172.21.15.153:0/1902455106 conn(0x7f08340d0bf0 msgr2=0x7f08340d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:05.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.289+0000 7f083bd13700 1 -- 172.21.15.153:0/1902455106 shutdown_connections 2023-11-24T08:05:05.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.289+0000 7f083bd13700 1 -- 172.21.15.153:0/1902455106 wait complete. 2023-11-24T08:05:05.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.291+0000 7f083bd13700 1 Processor -- start 2023-11-24T08:05:05.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.291+0000 7f083bd13700 1 -- start start 2023-11-24T08:05:05.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083bd13700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08340746a0 0x7f083415e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083bd13700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08340afc90 0x7f0834147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083bd13700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f083415e160 0x7f08341498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083bd13700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083415ecb0 con 0x7f083415e160 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083bd13700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0834148840 con 0x7f08340746a0 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083bd13700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0834148b20 con 0x7f08340afc90 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083a2b0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f083415e160 0x7f08341498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083a2b0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f083415e160 0x7f08341498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37206/0 (socket says 172.21.15.153:37206) 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083a2b0700 1 -- 172.21.15.153:0/3334375270 learned_addr learned my addr 172.21.15.153:0/3334375270 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f08392ae700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08340afc90 0x7f0834147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f0839aaf700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08340746a0 0x7f083415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083a2b0700 1 -- 172.21.15.153:0/3334375270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08340afc90 msgr2=0x7f0834147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083a2b0700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08340afc90 0x7f0834147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083a2b0700 1 -- 172.21.15.153:0/3334375270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08340746a0 msgr2=0x7f083415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083a2b0700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08340746a0 0x7f083415e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083a2b0700 1 -- 172.21.15.153:0/3334375270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c009a70 con 0x7f083415e160 2023-11-24T08:05:05.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f08392ae700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08340afc90 0x7f0834147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:05.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083a2b0700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f083415e160 0x7f08341498e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f082c00b370 tx=0x7f082c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f082a7fc700 1 -- 172.21.15.153:0/3334375270 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c012430 con 0x7f083415e160 2023-11-24T08:05:05.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f082a7fc700 1 -- 172.21.15.153:0/3334375270 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c020070 con 0x7f083415e160 2023-11-24T08:05:05.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083bd13700 1 -- 172.21.15.153:0/3334375270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0834148e00 con 0x7f083415e160 2023-11-24T08:05:05.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f082a7fc700 1 -- 172.21.15.153:0/3334375270 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c004280 con 0x7f083415e160 2023-11-24T08:05:05.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.292+0000 7f083bd13700 1 -- 172.21.15.153:0/3334375270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08341493c0 con 0x7f083415e160 2023-11-24T08:05:05.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.293+0000 7f083bd13700 1 -- 172.21.15.153:0/3334375270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0834149550 con 0x7f083415e160 2023-11-24T08:05:05.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.294+0000 7f082a7fc700 1 -- 172.21.15.153:0/3334375270 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f082c0043e0 con 0x7f083415e160 2023-11-24T08:05:05.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.294+0000 7f082a7fc700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f081806aed0 0x7f081806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.294+0000 7f082a7fc700 1 -- 172.21.15.153:0/3334375270 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f082c022070 con 0x7f083415e160 2023-11-24T08:05:05.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.294+0000 7f0839aaf700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f081806aed0 0x7f081806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.295+0000 7f0839aaf700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f081806aed0 0x7f081806d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f083000b9b0 tx=0x7f0830008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.299+0000 7f082a7fc700 1 -- 172.21.15.153:0/3334375270 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f082c0568a0 con 0x7f083415e160 2023-11-24T08:05:05.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:05.488+0000 7f083bd13700 1 -- 172.21.15.153:0/3334375270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f08340afab0 con 0x7f083415e160 2023-11-24T08:05:06.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.143+0000 7f082a7fc700 1 -- 172.21.15.153:0/3334375270 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f082c01ae60 con 0x7f083415e160 2023-11-24T08:05:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 -- 172.21.15.153:0/3334375270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f081806aed0 msgr2=0x7f081806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f081806aed0 0x7f081806d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f083000b9b0 tx=0x7f0830008040 comp rx=0 tx=0).stop 2023-11-24T08:05:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 -- 172.21.15.153:0/3334375270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f083415e160 msgr2=0x7f08341498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f083415e160 0x7f08341498e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f082c00b370 tx=0x7f082c004ad0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 -- 172.21.15.153:0/3334375270 shutdown_connections 2023-11-24T08:05:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f081806aed0 0x7f081806d390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f083415e160 0x7f08341498e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08340746a0 0x7f083415e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 --2- 172.21.15.153:0/3334375270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08340afc90 0x7f0834147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 -- 172.21.15.153:0/3334375270 >> 172.21.15.153:0/3334375270 conn(0x7f08340d0bf0 msgr2=0x7f08340d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 -- 172.21.15.153:0/3334375270 shutdown_connections 2023-11-24T08:05:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.146+0000 7f083bd13700 1 -- 172.21.15.153:0/3334375270 wait complete. 2023-11-24T08:05:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-11-24T08:05:06.167 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:05:06.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.293+0000 7fa076fd7700 1 Processor -- start 2023-11-24T08:05:06.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.293+0000 7fa076fd7700 1 -- start start 2023-11-24T08:05:06.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa076fd7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0700746a0 0x7fa0700b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa076fd7700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0700b3c60 con 0x7fa0700afc90 2023-11-24T08:05:06.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa076fd7700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0700b58c0 con 0x7fa07015e160 2023-11-24T08:05:06.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa076fd7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700b4500 con 0x7fa0700746a0 2023-11-24T08:05:06.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa075574700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa0700afc90 0x7fa07006d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43318/0 (socket says 172.21.15.153:43318) 2023-11-24T08:05:06.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa075574700 1 -- 172.21.15.153:0/16852929 learned_addr learned my addr 172.21.15.153:0/16852929 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:06.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa06ffff700 1 --2- 172.21.15.153:0/16852929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0700746a0 0x7fa0700b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa06f7fe700 1 -- 172.21.15.153:0/16852929 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267075870 0 0) 0x7fa0700b3c60 con 0x7fa0700afc90 2023-11-24T08:05:06.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa06f7fe700 1 -- 172.21.15.153:0/16852929 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0600035b0 con 0x7fa0700afc90 2023-11-24T08:05:06.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa06f7fe700 1 -- 172.21.15.153:0/16852929 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734564189 0 0) 0x7fa0700b58c0 con 0x7fa07015e160 2023-11-24T08:05:06.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa06f7fe700 1 -- 172.21.15.153:0/16852929 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0700b3c60 con 0x7fa07015e160 2023-11-24T08:05:06.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa06ffff700 1 -- 172.21.15.153:0/16852929 >> v1:172.21.15.164:6789/0 conn(0x7fa07015e160 legacy=0x7fa070073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa06f7fe700 1 -- 172.21.15.153:0/16852929 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1298122856 0 0) 0x7fa0600035b0 con 0x7fa0700afc90 2023-11-24T08:05:06.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa06ffff700 1 -- 172.21.15.153:0/16852929 >> v1:172.21.15.153:6789/0 conn(0x7fa0700afc90 legacy=0x7fa07006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.294+0000 7fa06ffff700 1 -- 172.21.15.153:0/16852929 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0700b0140 con 0x7fa0700746a0 2023-11-24T08:05:06.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.295+0000 7fa06ffff700 1 --2- 172.21.15.153:0/16852929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0700746a0 0x7fa0700b5da0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009870 tx=0x7fa05c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e527bc7412ef92b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:06.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.295+0000 7fa06f7fe700 1 -- 172.21.15.153:0/16852929 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680019f0 con 0x7fa0700746a0 2023-11-24T08:05:06.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.295+0000 7fa06f7fe700 1 -- 172.21.15.153:0/16852929 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c004030 con 0x7fa0700746a0 2023-11-24T08:05:06.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.295+0000 7fa06f7fe700 1 -- 172.21.15.153:0/16852929 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0043c0 con 0x7fa0700746a0 2023-11-24T08:05:06.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.295+0000 7fa076fd7700 1 -- 172.21.15.153:0/16852929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0700746a0 msgr2=0x7fa0700b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.295+0000 7fa076fd7700 1 --2- 172.21.15.153:0/16852929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0700746a0 0x7fa0700b5da0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009870 tx=0x7fa05c009b80 comp rx=0 tx=0).stop 2023-11-24T08:05:06.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.295+0000 7fa076fd7700 1 -- 172.21.15.153:0/16852929 shutdown_connections 2023-11-24T08:05:06.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.295+0000 7fa076fd7700 1 --2- 172.21.15.153:0/16852929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0700746a0 0x7fa0700b5da0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.295+0000 7fa076fd7700 1 -- 172.21.15.153:0/16852929 >> 172.21.15.153:0/16852929 conn(0x7fa0700d0bf0 msgr2=0x7fa0700d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:06.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.295+0000 7fa076fd7700 1 -- 172.21.15.153:0/16852929 shutdown_connections 2023-11-24T08:05:06.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.295+0000 7fa076fd7700 1 -- 172.21.15.153:0/16852929 wait complete. 2023-11-24T08:05:06.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.297+0000 7fa076fd7700 1 Processor -- start 2023-11-24T08:05:06.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.297+0000 7fa076fd7700 1 -- start start 2023-11-24T08:05:06.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.297+0000 7fa076fd7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0700746a0 0x7fa070158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.297+0000 7fa076fd7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0700afc90 0x7fa070160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.297+0000 7fa076fd7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa07015e160 0x7fa070071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.297+0000 7fa076fd7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700c65d0 con 0x7fa0700746a0 2023-11-24T08:05:06.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.297+0000 7fa076fd7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700c5c70 con 0x7fa0700afc90 2023-11-24T08:05:06.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.297+0000 7fa076fd7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700c5f10 con 0x7fa07015e160 2023-11-24T08:05:06.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa074d73700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0700746a0 0x7fa070158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa074d73700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0700746a0 0x7fa070158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37216/0 (socket says 172.21.15.153:37216) 2023-11-24T08:05:06.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa074d73700 1 -- 172.21.15.153:0/624749807 learned_addr learned my addr 172.21.15.153:0/624749807 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:06.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa075574700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa07015e160 0x7fa070071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa06ffff700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0700afc90 0x7fa070160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa074d73700 1 -- 172.21.15.153:0/624749807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa07015e160 msgr2=0x7fa070071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa074d73700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa07015e160 0x7fa070071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa074d73700 1 -- 172.21.15.153:0/624749807 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0700afc90 msgr2=0x7fa070160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa074d73700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0700afc90 0x7fa070160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa074d73700 1 -- 172.21.15.153:0/624749807 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c0094a0 con 0x7fa0700746a0 2023-11-24T08:05:06.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa074d73700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0700746a0 0x7fa070158530 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa06400c500 tx=0x7fa06400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:06.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa06d7fa700 1 -- 172.21.15.153:0/624749807 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0640052d0 con 0x7fa0700746a0 2023-11-24T08:05:06.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa06d7fa700 1 -- 172.21.15.153:0/624749807 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa064005450 con 0x7fa0700746a0 2023-11-24T08:05:06.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa076fd7700 1 -- 172.21.15.153:0/624749807 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0700c61f0 con 0x7fa0700746a0 2023-11-24T08:05:06.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa06d7fa700 1 -- 172.21.15.153:0/624749807 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0640038c0 con 0x7fa0700746a0 2023-11-24T08:05:06.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.298+0000 7fa076fd7700 1 -- 172.21.15.153:0/624749807 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa070158a70 con 0x7fa0700746a0 2023-11-24T08:05:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.299+0000 7fa076fd7700 1 -- 172.21.15.153:0/624749807 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0700c6840 con 0x7fa0700746a0 2023-11-24T08:05:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.300+0000 7fa06d7fa700 1 -- 172.21.15.153:0/624749807 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa064003a20 con 0x7fa0700746a0 2023-11-24T08:05:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.300+0000 7fa06d7fa700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa05406aed0 0x7fa05406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.300+0000 7fa06d7fa700 1 -- 172.21.15.153:0/624749807 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa064088990 con 0x7fa0700746a0 2023-11-24T08:05:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.300+0000 7fa06ffff700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa05406aed0 0x7fa05406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.301+0000 7fa06ffff700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa05406aed0 0x7fa05406d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0090b0 tx=0x7fa05c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:06.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.305+0000 7fa06d7fa700 1 -- 172.21.15.153:0/624749807 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa064053b30 con 0x7fa0700746a0 2023-11-24T08:05:06.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:06.540+0000 7fa076fd7700 1 -- 172.21.15.153:0/624749807 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa07006c140 con 0x7fa0700746a0 2023-11-24T08:05:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.145+0000 7fa06d7fa700 1 -- 172.21.15.153:0/624749807 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa0640170c0 con 0x7fa0700746a0 2023-11-24T08:05:07.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 -- 172.21.15.153:0/624749807 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa05406aed0 msgr2=0x7fa05406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa05406aed0 0x7fa05406d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0090b0 tx=0x7fa05c008030 comp rx=0 tx=0).stop 2023-11-24T08:05:07.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 -- 172.21.15.153:0/624749807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0700746a0 msgr2=0x7fa070158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0700746a0 0x7fa070158530 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa06400c500 tx=0x7fa06400c8c0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 -- 172.21.15.153:0/624749807 shutdown_connections 2023-11-24T08:05:07.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa07015e160 0x7fa070071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa05406aed0 0x7fa05406d390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0700746a0 0x7fa070158530 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 --2- 172.21.15.153:0/624749807 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0700afc90 0x7fa070160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 -- 172.21.15.153:0/624749807 >> 172.21.15.153:0/624749807 conn(0x7fa0700d0bf0 msgr2=0x7fa0700aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 -- 172.21.15.153:0/624749807 shutdown_connections 2023-11-24T08:05:07.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.148+0000 7fa076fd7700 1 -- 172.21.15.153:0/624749807 wait complete. 2023-11-24T08:05:07.151 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 4 and data pool 5 2023-11-24T08:05:07.178 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:07.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.304+0000 7fd5206d2700 1 Processor -- start 2023-11-24T08:05:07.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.304+0000 7fd5206d2700 1 -- start start 2023-11-24T08:05:07.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd5206d2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd51815e080 0x7fd5180b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd5206d2700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5180ae430 con 0x7fd5180af4d0 2023-11-24T08:05:07.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd5206d2700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5180ae710 con 0x7fd51806c710 2023-11-24T08:05:07.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd5206d2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180af0b0 con 0x7fd51815e080 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51dc6d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd5180af4d0 0x7fd51806c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43330/0 (socket says 172.21.15.153:43330) 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51dc6d700 1 -- 172.21.15.153:0/3165337104 learned_addr learned my addr 172.21.15.153:0/3165337104 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853908867 0 0) 0x7fd5180ae430 con 0x7fd5180af4d0 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5040035b0 con 0x7fd5180af4d0 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335653688 0 0) 0x7fd5040035b0 con 0x7fd5180af4d0 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd51815e080 msgr2=0x7fd5180b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51d46c700 1 --2- 172.21.15.153:0/3165337104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd51815e080 0x7fd5180b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 >> v1:172.21.15.164:6789/0 conn(0x7fd51806c710 legacy=0x7fd51806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180ae9f0 con 0x7fd5180af4d0 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fd508001670 con 0x7fd5180af4d0 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 >> v1:172.21.15.153:6789/0 conn(0x7fd5180af4d0 legacy=0x7fd51806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51d46c700 1 --2- 172.21.15.153:0/3165337104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd504003a30 0x7fd504003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.305+0000 7fd51d46c700 1 --2- 172.21.15.153:0/3165337104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd51815e080 0x7fd504004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51d46c700 1 --2- 172.21.15.153:0/3165337104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 0x7fd504005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180af0b0 con 0x7fd504004e00 2023-11-24T08:05:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50400bc20 con 0x7fd504003a30 2023-11-24T08:05:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50400bde0 con 0x7fd51815e080 2023-11-24T08:05:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51ec6f700 1 --2- 172.21.15.153:0/3165337104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 0x7fd504005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51e46e700 1 --2- 172.21.15.153:0/3165337104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd504003a30 0x7fd504003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51dc6d700 1 --2- 172.21.15.153:0/3165337104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd51815e080 0x7fd504004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51ec6f700 1 -- 172.21.15.153:0/3165337104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd51815e080 msgr2=0x7fd504004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51ec6f700 1 --2- 172.21.15.153:0/3165337104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd51815e080 0x7fd504004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51ec6f700 1 -- 172.21.15.153:0/3165337104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd504003a30 msgr2=0x7fd504003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51ec6f700 1 --2- 172.21.15.153:0/3165337104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd504003a30 0x7fd504003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51ec6f700 1 -- 172.21.15.153:0/3165337104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5040035b0 con 0x7fd504004e00 2023-11-24T08:05:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51ec6f700 1 --2- 172.21.15.153:0/3165337104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 0x7fd504005280 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd510001db0 tx=0x7fd504005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756d7b18f7a520ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510001850 con 0x7fd504004e00 2023-11-24T08:05:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd510003c20 con 0x7fd504004e00 2023-11-24T08:05:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.306+0000 7fd51d46c700 1 -- 172.21.15.153:0/3165337104 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100050d0 con 0x7fd504004e00 2023-11-24T08:05:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.307+0000 7fd5206d2700 1 -- 172.21.15.153:0/3165337104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 msgr2=0x7fd504005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.307+0000 7fd5206d2700 1 --2- 172.21.15.153:0/3165337104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 0x7fd504005280 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd510001db0 tx=0x7fd504005880 comp rx=0 tx=0).stop 2023-11-24T08:05:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.307+0000 7fd51ec6f700 1 -- 172.21.15.153:0/3165337104 reap_dead start 2023-11-24T08:05:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.307+0000 7fd5206d2700 1 -- 172.21.15.153:0/3165337104 shutdown_connections 2023-11-24T08:05:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.307+0000 7fd5206d2700 1 -- 172.21.15.153:0/3165337104 >> 172.21.15.153:0/3165337104 conn(0x7fd518071b90 msgr2=0x7fd518071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.307+0000 7fd5206d2700 1 -- 172.21.15.153:0/3165337104 shutdown_connections 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.307+0000 7fd5206d2700 1 -- 172.21.15.153:0/3165337104 wait complete. 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.308+0000 7fd5206d2700 1 Processor -- start 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.308+0000 7fd5206d2700 1 -- start start 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd5206d2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 0x7fd518156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd5206d2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd51815e460 0x7fd5181551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd5206d2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd518146450 0x7fd5180cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd5206d2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51815fc30 con 0x7fd504004e00 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd5206d2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd518155710 con 0x7fd51815e460 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd5206d2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181559b0 con 0x7fd518146450 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd51e46e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 0x7fd518156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd51e46e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 0x7fd518156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37236/0 (socket says 172.21.15.153:37236) 2023-11-24T08:05:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd51e46e700 1 -- 172.21.15.153:0/26102352 learned_addr learned my addr 172.21.15.153:0/26102352 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd51ec6f700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd518146450 0x7fd5180cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd51dc6d700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd51815e460 0x7fd5181551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd51e46e700 1 -- 172.21.15.153:0/26102352 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd518146450 msgr2=0x7fd5180cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd51e46e700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd518146450 0x7fd5180cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd51e46e700 1 -- 172.21.15.153:0/26102352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd51815e460 msgr2=0x7fd5181551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd51e46e700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd51815e460 0x7fd5181551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd51e46e700 1 -- 172.21.15.153:0/26102352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518155c90 con 0x7fd504004e00 2023-11-24T08:05:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd51e46e700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 0x7fd518156a50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd51400e870 tx=0x7fd51400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd50effd700 1 -- 172.21.15.153:0/26102352 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514013680 con 0x7fd504004e00 2023-11-24T08:05:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd50effd700 1 -- 172.21.15.153:0/26102352 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5140137e0 con 0x7fd504004e00 2023-11-24T08:05:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.309+0000 7fd5206d2700 1 -- 172.21.15.153:0/26102352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd518155f70 con 0x7fd504004e00 2023-11-24T08:05:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.310+0000 7fd50effd700 1 -- 172.21.15.153:0/26102352 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514013b90 con 0x7fd504004e00 2023-11-24T08:05:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.310+0000 7fd5206d2700 1 -- 172.21.15.153:0/26102352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd518156530 con 0x7fd504004e00 2023-11-24T08:05:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.310+0000 7fd5206d2700 1 -- 172.21.15.153:0/26102352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5181568a0 con 0x7fd504004e00 2023-11-24T08:05:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.311+0000 7fd50effd700 1 -- 172.21.15.153:0/26102352 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd514013cf0 con 0x7fd504004e00 2023-11-24T08:05:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.311+0000 7fd50effd700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd4fc06aed0 0x7fd4fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.311+0000 7fd50effd700 1 -- 172.21.15.153:0/26102352 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd514089400 con 0x7fd504004e00 2023-11-24T08:05:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.311+0000 7fd51dc6d700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd4fc06aed0 0x7fd4fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.312+0000 7fd51dc6d700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd4fc06aed0 0x7fd4fc06d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd518161590 tx=0x7fd508001c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.316+0000 7fd50effd700 1 -- 172.21.15.153:0/26102352 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd514054420 con 0x7fd504004e00 2023-11-24T08:05:07.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.508+0000 7fd5206d2700 1 -- 172.21.15.153:0/26102352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5180753f0 con 0x7fd504004e00 2023-11-24T08:05:07.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.509+0000 7fd50effd700 1 -- 172.21.15.153:0/26102352 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16618 (secure 0 0 0) 0x7fd514057a40 con 0x7fd504004e00 2023-11-24T08:05:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:07.511 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":31,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:06.541382+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:04.517274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:05.507139+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:07.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 -- 172.21.15.153:0/26102352 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd4fc06aed0 msgr2=0x7fd4fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd4fc06aed0 0x7fd4fc06d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd518161590 tx=0x7fd508001c20 comp rx=0 tx=0).stop 2023-11-24T08:05:07.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 -- 172.21.15.153:0/26102352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 msgr2=0x7fd518156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 0x7fd518156a50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd51400e870 tx=0x7fd51400eb80 comp rx=0 tx=0).stop 2023-11-24T08:05:07.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 -- 172.21.15.153:0/26102352 shutdown_connections 2023-11-24T08:05:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd518146450 0x7fd5180cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd4fc06aed0 0x7fd4fc06d390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd504004e00 0x7fd518156a50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 --2- 172.21.15.153:0/26102352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd51815e460 0x7fd5181551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 -- 172.21.15.153:0/26102352 >> 172.21.15.153:0/26102352 conn(0x7fd518071b90 msgr2=0x7fd51806be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 -- 172.21.15.153:0/26102352 shutdown_connections 2023-11-24T08:05:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.511+0000 7fd5206d2700 1 -- 172.21.15.153:0/26102352 wait complete. 2023-11-24T08:05:07.525 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:07.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.643+0000 7fb9fc840700 1 Processor -- start 2023-11-24T08:05:07.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.643+0000 7fb9fc840700 1 -- start start 2023-11-24T08:05:07.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.644+0000 7fb9fc840700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb9f806c710 0x7fb9f80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.644+0000 7fb9fc840700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f80af4d0 0x7fb9f80afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.644+0000 7fb9fc840700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f80ae430 con 0x7fb9f815e080 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.644+0000 7fb9fc840700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f80af0b0 con 0x7fb9f806c710 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.644+0000 7fb9fc840700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80b05a0 con 0x7fb9f80af4d0 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f5d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb9f806c710 0x7fb9f80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f659c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb9f815e080 0x7fb9f806c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43348/0 (socket says 172.21.15.153:43348) 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f659c700 1 -- 172.21.15.153:0/2481362413 learned_addr learned my addr 172.21.15.153:0/2481362413 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f6d9d700 1 --2- 172.21.15.153:0/2481362413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f80af4d0 0x7fb9f80afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f5d9b700 1 -- 172.21.15.153:0/2481362413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f80af4d0 msgr2=0x7fb9f80afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f5d9b700 1 --2- 172.21.15.153:0/2481362413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f80af4d0 0x7fb9f80afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f5d9b700 1 -- 172.21.15.153:0/2481362413 >> v1:172.21.15.153:6789/0 conn(0x7fb9f815e080 legacy=0x7fb9f806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f5d9b700 1 -- 172.21.15.153:0/2481362413 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80ae710 con 0x7fb9f806c710 2023-11-24T08:05:07.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f5d9b700 1 --2- 172.21.15.153:0/2481362413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9f806c710 0x7fb9f80b5050 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009840 tx=0x7fb9e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd31b87dc1cec88 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f559a700 1 -- 172.21.15.153:0/2481362413 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8011830 con 0x7fb9f806c710 2023-11-24T08:05:07.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f559a700 1 -- 172.21.15.153:0/2481362413 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e8011990 con 0x7fb9f806c710 2023-11-24T08:05:07.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.645+0000 7fb9f559a700 1 -- 172.21.15.153:0/2481362413 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8011d20 con 0x7fb9f806c710 2023-11-24T08:05:07.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.646+0000 7fb9fc840700 1 -- 172.21.15.153:0/2481362413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9f806c710 msgr2=0x7fb9f80b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.646+0000 7fb9fc840700 1 --2- 172.21.15.153:0/2481362413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9f806c710 0x7fb9f80b5050 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009840 tx=0x7fb9e8009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:07.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.646+0000 7fb9fc840700 1 -- 172.21.15.153:0/2481362413 shutdown_connections 2023-11-24T08:05:07.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.646+0000 7fb9fc840700 1 --2- 172.21.15.153:0/2481362413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f80af4d0 0x7fb9f80afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.646+0000 7fb9fc840700 1 --2- 172.21.15.153:0/2481362413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9f806c710 0x7fb9f80b5050 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.646+0000 7fb9fc840700 1 -- 172.21.15.153:0/2481362413 >> 172.21.15.153:0/2481362413 conn(0x7fb9f8071b90 msgr2=0x7fb9f8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.646+0000 7fb9fc840700 1 -- 172.21.15.153:0/2481362413 shutdown_connections 2023-11-24T08:05:07.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.646+0000 7fb9fc840700 1 -- 172.21.15.153:0/2481362413 wait complete. 2023-11-24T08:05:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.647+0000 7fb9fc840700 1 Processor -- start 2023-11-24T08:05:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.647+0000 7fb9fc840700 1 -- start start 2023-11-24T08:05:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9fc840700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9f806c710 0x7fb9f8156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9fc840700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f80af4d0 0x7fb9f81f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9fc840700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9f815e080 0x7fb9f8160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9fc840700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f815e840 con 0x7fb9f806c710 2023-11-24T08:05:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9fc840700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f81f3ff0 con 0x7fb9f815e080 2023-11-24T08:05:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9fc840700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f81f42d0 con 0x7fb9f80af4d0 2023-11-24T08:05:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9f659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9f806c710 0x7fb9f8156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9f659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9f806c710 0x7fb9f8156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37248/0 (socket says 172.21.15.153:37248) 2023-11-24T08:05:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9f659c700 1 -- 172.21.15.153:0/51277998 learned_addr learned my addr 172.21.15.153:0/51277998 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9f5d9b700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f80af4d0 0x7fb9f81f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9f6d9d700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9f815e080 0x7fb9f8160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9f659c700 1 -- 172.21.15.153:0/51277998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f80af4d0 msgr2=0x7fb9f81f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9f659c700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f80af4d0 0x7fb9f81f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9f659c700 1 -- 172.21.15.153:0/51277998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9f815e080 msgr2=0x7fb9f8160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9f659c700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9f815e080 0x7fb9f8160db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9f659c700 1 -- 172.21.15.153:0/51277998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80094a0 con 0x7fb9f806c710 2023-11-24T08:05:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.648+0000 7fb9f5d9b700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f80af4d0 0x7fb9f81f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.649+0000 7fb9f659c700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9f806c710 0x7fb9f8156d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000c480 tx=0x7fb9e000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.649+0000 7fb9eeffd700 1 -- 172.21.15.153:0/51277998 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0005d70 con 0x7fb9f806c710 2023-11-24T08:05:07.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.649+0000 7fb9eeffd700 1 -- 172.21.15.153:0/51277998 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e00070d0 con 0x7fb9f806c710 2023-11-24T08:05:07.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.649+0000 7fb9fc840700 1 -- 172.21.15.153:0/51277998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f81f45b0 con 0x7fb9f806c710 2023-11-24T08:05:07.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.649+0000 7fb9eeffd700 1 -- 172.21.15.153:0/51277998 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0007440 con 0x7fb9f806c710 2023-11-24T08:05:07.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.649+0000 7fb9fc840700 1 -- 172.21.15.153:0/51277998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f81f3ca0 con 0x7fb9f806c710 2023-11-24T08:05:07.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.650+0000 7fb9fc840700 1 -- 172.21.15.153:0/51277998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f80753f0 con 0x7fb9f806c710 2023-11-24T08:05:07.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.650+0000 7fb9eeffd700 1 -- 172.21.15.153:0/51277998 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9e00075a0 con 0x7fb9f806c710 2023-11-24T08:05:07.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.650+0000 7fb9eeffd700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb9d806af00 0x7fb9d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.651+0000 7fb9eeffd700 1 -- 172.21.15.153:0/51277998 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9e00889d0 con 0x7fb9f806c710 2023-11-24T08:05:07.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.651+0000 7fb9f5d9b700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb9d806af00 0x7fb9d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.651+0000 7fb9f5d9b700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb9d806af00 0x7fb9d806d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80d0390 tx=0x7fb9e8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.655+0000 7fb9eeffd700 1 -- 172.21.15.153:0/51277998 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb9e0053bc0 con 0x7fb9f806c710 2023-11-24T08:05:07.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.845+0000 7fb9fc840700 1 -- 172.21.15.153:0/51277998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9f8072cf0 con 0x7fb9f806c710 2023-11-24T08:05:07.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.846+0000 7fb9eeffd700 1 -- 172.21.15.153:0/51277998 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16618 (secure 0 0 0) 0x7fb9e0017090 con 0x7fb9f806c710 2023-11-24T08:05:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:07.848 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":31,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:06.541382+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:04.517274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:05.507139+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:07.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 -- 172.21.15.153:0/51277998 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb9d806af00 msgr2=0x7fb9d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb9d806af00 0x7fb9d806d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80d0390 tx=0x7fb9e8008030 comp rx=0 tx=0).stop 2023-11-24T08:05:07.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 -- 172.21.15.153:0/51277998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9f806c710 msgr2=0x7fb9f8156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9f806c710 0x7fb9f8156d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000c480 tx=0x7fb9e000c840 comp rx=0 tx=0).stop 2023-11-24T08:05:07.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 -- 172.21.15.153:0/51277998 shutdown_connections 2023-11-24T08:05:07.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9f815e080 0x7fb9f8160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb9d806af00 0x7fb9d806d3c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9f806c710 0x7fb9f8156d90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 --2- 172.21.15.153:0/51277998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f80af4d0 0x7fb9f81f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 -- 172.21.15.153:0/51277998 >> 172.21.15.153:0/51277998 conn(0x7fb9f8071b90 msgr2=0x7fb9f806be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 -- 172.21.15.153:0/51277998 shutdown_connections 2023-11-24T08:05:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.848+0000 7fb9fc840700 1 -- 172.21.15.153:0/51277998 wait complete. 2023-11-24T08:05:07.863 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:05:07.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.985+0000 7f8b888f7700 1 Processor -- start 2023-11-24T08:05:07.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.985+0000 7f8b888f7700 1 -- start start 2023-11-24T08:05:07.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.986+0000 7f8b888f7700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8b84158510 0x7f8b840b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.986+0000 7f8b888f7700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8415e8f0 con 0x7f8b840746a0 2023-11-24T08:05:07.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.986+0000 7f8b888f7700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8415ebd0 con 0x7f8b840b65c0 2023-11-24T08:05:07.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.986+0000 7f8b888f7700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b8415eeb0 con 0x7f8b84158510 2023-11-24T08:05:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.986+0000 7f8b82d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8b840746a0 0x7f8b8406dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43362/0 (socket says 172.21.15.153:43362) 2023-11-24T08:05:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.986+0000 7f8b82d9d700 1 -- 172.21.15.153:0/2750740424 learned_addr learned my addr 172.21.15.153:0/2750740424 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8259c700 1 --2- 172.21.15.153:0/2750740424 >> v2:172.21.15.164:3300/0 conn(0x7f8b84158510 0x7f8b840b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8159a700 1 -- 172.21.15.153:0/2750740424 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930523161 0 0) 0x7f8b8415e8f0 con 0x7f8b840746a0 2023-11-24T08:05:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8159a700 1 -- 172.21.15.153:0/2750740424 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b700035b0 con 0x7f8b840746a0 2023-11-24T08:05:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8159a700 1 -- 172.21.15.153:0/2750740424 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700139931 0 0) 0x7f8b8415ebd0 con 0x7f8b840b65c0 2023-11-24T08:05:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8159a700 1 -- 172.21.15.153:0/2750740424 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b8415e8f0 con 0x7f8b840b65c0 2023-11-24T08:05:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8159a700 1 -- 172.21.15.153:0/2750740424 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 33552459 0 0) 0x7f8b700035b0 con 0x7f8b840746a0 2023-11-24T08:05:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8259c700 1 -- 172.21.15.153:0/2750740424 >> v1:172.21.15.164:6789/0 conn(0x7f8b840b65c0 legacy=0x7f8b84073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8259c700 1 -- 172.21.15.153:0/2750740424 >> v1:172.21.15.153:6789/0 conn(0x7f8b840746a0 legacy=0x7f8b8406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8259c700 1 -- 172.21.15.153:0/2750740424 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8415f190 con 0x7f8b84158510 2023-11-24T08:05:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8259c700 1 --2- 172.21.15.153:0/2750740424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b84158510 0x7f8b840b49e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009d90 tx=0x7f8b7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da12e34a33c84337 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8159a700 1 -- 172.21.15.153:0/2750740424 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7400e070 con 0x7f8b84158510 2023-11-24T08:05:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8159a700 1 -- 172.21.15.153:0/2750740424 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74003a20 con 0x7f8b84158510 2023-11-24T08:05:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.987+0000 7f8b8159a700 1 -- 172.21.15.153:0/2750740424 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c001670 con 0x7f8b84158510 2023-11-24T08:05:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.988+0000 7f8b888f7700 1 -- 172.21.15.153:0/2750740424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b84158510 msgr2=0x7f8b840b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.988+0000 7f8b888f7700 1 --2- 172.21.15.153:0/2750740424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b84158510 0x7f8b840b49e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009d90 tx=0x7f8b7400b330 comp rx=0 tx=0).stop 2023-11-24T08:05:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.988+0000 7f8b888f7700 1 -- 172.21.15.153:0/2750740424 shutdown_connections 2023-11-24T08:05:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.988+0000 7f8b888f7700 1 --2- 172.21.15.153:0/2750740424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b84158510 0x7f8b840b49e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.988+0000 7f8b888f7700 1 -- 172.21.15.153:0/2750740424 >> 172.21.15.153:0/2750740424 conn(0x7f8b8406aff0 msgr2=0x7f8b8406b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.988+0000 7f8b888f7700 1 -- 172.21.15.153:0/2750740424 shutdown_connections 2023-11-24T08:05:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.988+0000 7f8b888f7700 1 -- 172.21.15.153:0/2750740424 wait complete. 2023-11-24T08:05:07.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.989+0000 7f8b888f7700 1 Processor -- start 2023-11-24T08:05:07.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.989+0000 7f8b888f7700 1 -- start start 2023-11-24T08:05:07.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.990+0000 7f8b888f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b840746a0 0x7f8b840cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.990+0000 7f8b888f7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b840b65c0 0x7f8b84158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.990+0000 7f8b888f7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b84158510 0x7f8b84147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.990+0000 7f8b888f7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b84159240 con 0x7f8b840746a0 2023-11-24T08:05:07.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.990+0000 7f8b888f7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b84147a90 con 0x7f8b840b65c0 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.990+0000 7f8b888f7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840ce3c0 con 0x7f8b84158510 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.990+0000 7f8b8259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b840746a0 0x7f8b840cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.990+0000 7f8b8259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b840746a0 0x7f8b840cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37262/0 (socket says 172.21.15.153:37262) 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.990+0000 7f8b8259c700 1 -- 172.21.15.153:0/1161682277 learned_addr learned my addr 172.21.15.153:0/1161682277 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.990+0000 7f8b81d9b700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b840b65c0 0x7f8b84158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b82d9d700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b84158510 0x7f8b84147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b8259c700 1 -- 172.21.15.153:0/1161682277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b84158510 msgr2=0x7f8b84147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b8259c700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b84158510 0x7f8b84147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b8259c700 1 -- 172.21.15.153:0/1161682277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b840b65c0 msgr2=0x7f8b84158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b8259c700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b840b65c0 0x7f8b84158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b8259c700 1 -- 172.21.15.153:0/1161682277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b74009a70 con 0x7f8b840746a0 2023-11-24T08:05:07.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b81d9b700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b840b65c0 0x7f8b84158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b8259c700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b840746a0 0x7f8b840cdce0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8b74000f80 tx=0x7f8b74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b7affd700 1 -- 172.21.15.153:0/1161682277 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b740046b0 con 0x7f8b840746a0 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b7affd700 1 -- 172.21.15.153:0/1161682277 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74004830 con 0x7f8b840746a0 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b888f7700 1 -- 172.21.15.153:0/1161682277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8415e6c0 con 0x7f8b840746a0 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b7affd700 1 -- 172.21.15.153:0/1161682277 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74012670 con 0x7f8b840746a0 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.991+0000 7f8b888f7700 1 -- 172.21.15.153:0/1161682277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b840ce980 con 0x7f8b840746a0 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.992+0000 7f8b888f7700 1 -- 172.21.15.153:0/1161682277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b84068f10 con 0x7f8b840746a0 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.992+0000 7f8b7affd700 1 -- 172.21.15.153:0/1161682277 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b740127d0 con 0x7f8b840746a0 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.993+0000 7f8b7affd700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8b6406aed0 0x7f8b6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.993+0000 7f8b7affd700 1 -- 172.21.15.153:0/1161682277 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b7408ab00 con 0x7f8b840746a0 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.993+0000 7f8b81d9b700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8b6406aed0 0x7f8b6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.993+0000 7f8b81d9b700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8b6406aed0 0x7f8b6406d390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8b84157240 tx=0x7f8b6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:07.997+0000 7f8b7affd700 1 -- 172.21.15.153:0/1161682277 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b74055c40 con 0x7f8b840746a0 2023-11-24T08:05:08.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:08.236+0000 7f8b888f7700 1 -- 172.21.15.153:0/1161682277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8b8415dd70 con 0x7f8b840746a0 2023-11-24T08:05:09.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.168+0000 7f8b7affd700 1 -- 172.21.15.153:0/1161682277 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8b740160b0 con 0x7f8b840746a0 2023-11-24T08:05:09.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 -- 172.21.15.153:0/1161682277 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8b6406aed0 msgr2=0x7f8b6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8b6406aed0 0x7f8b6406d390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8b84157240 tx=0x7f8b6c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:09.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 -- 172.21.15.153:0/1161682277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b840746a0 msgr2=0x7f8b840cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b840746a0 0x7f8b840cdce0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8b74000f80 tx=0x7f8b74004ad0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 -- 172.21.15.153:0/1161682277 shutdown_connections 2023-11-24T08:05:09.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b84158510 0x7f8b84147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8b6406aed0 0x7f8b6406d390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b840746a0 0x7f8b840cdce0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 --2- 172.21.15.153:0/1161682277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b840b65c0 0x7f8b84158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 -- 172.21.15.153:0/1161682277 >> 172.21.15.153:0/1161682277 conn(0x7f8b8406aff0 msgr2=0x7f8b840ad900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 -- 172.21.15.153:0/1161682277 shutdown_connections 2023-11-24T08:05:09.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.171+0000 7f8b888f7700 1 -- 172.21.15.153:0/1161682277 wait complete. 2023-11-24T08:05:09.188 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:05:09.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:05:09.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.316+0000 7efe18967700 1 Processor -- start 2023-11-24T08:05:09.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.317+0000 7efe18967700 1 -- start start 2023-11-24T08:05:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe18967700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efe140746a0 0x7efe140b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe18967700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe140b3c60 con 0x7efe140afc90 2023-11-24T08:05:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe18967700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe140b58c0 con 0x7efe1415e160 2023-11-24T08:05:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe18967700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe140b4500 con 0x7efe140746a0 2023-11-24T08:05:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe12d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efe140afc90 0x7efe1406d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43378/0 (socket says 172.21.15.153:43378) 2023-11-24T08:05:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe12d9d700 1 -- 172.21.15.153:0/2381092917 learned_addr learned my addr 172.21.15.153:0/2381092917 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279827323 0 0) 0x7efe140b3c60 con 0x7efe140afc90 2023-11-24T08:05:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdfc0035b0 con 0x7efe140afc90 2023-11-24T08:05:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe11d9b700 1 --2- 172.21.15.153:0/2381092917 >> v2:172.21.15.164:3300/0 conn(0x7efe140746a0 0x7efe140b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2091293647 0 0) 0x7efdfc0035b0 con 0x7efe140afc90 2023-11-24T08:05:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 >> v2:172.21.15.164:3300/0 conn(0x7efe140746a0 msgr2=0x7efe140b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 --2- 172.21.15.153:0/2381092917 >> v2:172.21.15.164:3300/0 conn(0x7efe140746a0 0x7efe140b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 >> v1:172.21.15.164:6789/0 conn(0x7efe1415e160 legacy=0x7efe14073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1406bdc0 con 0x7efe140afc90 2023-11-24T08:05:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7efe0c0019f0 con 0x7efe140afc90 2023-11-24T08:05:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 >> v1:172.21.15.153:6789/0 conn(0x7efe140afc90 legacy=0x7efe1406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efdfc003a00 0x7efdfc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 0x7efdfc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efdfc005210 0x7efdfc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe140b4500 con 0x7efdfc004850 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc00c0b0 con 0x7efdfc005210 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc00c270 con 0x7efdfc003a00 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe11d9b700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 0x7efdfc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.318+0000 7efe12d9d700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efdfc005210 0x7efdfc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe1259c700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efdfc003a00 0x7efdfc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe11d9b700 1 -- 172.21.15.153:0/2381092917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efdfc003a00 msgr2=0x7efdfc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe11d9b700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efdfc003a00 0x7efdfc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe11d9b700 1 -- 172.21.15.153:0/2381092917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efdfc005210 msgr2=0x7efdfc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe11d9b700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efdfc005210 0x7efdfc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe11d9b700 1 -- 172.21.15.153:0/2381092917 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0035b0 con 0x7efdfc004850 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe12d9d700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efdfc005210 0x7efdfc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe12d9d700 1 -- 172.21.15.153:0/2381092917 reap_dead start 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe11d9b700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 0x7efdfc004cd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efe04009b60 tx=0x7efdfc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4d7320f050ef10 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400e6c0 con 0x7efdfc004850 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0400e820 con 0x7efdfc004850 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe1159a700 1 -- 172.21.15.153:0/2381092917 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400eb90 con 0x7efdfc004850 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe18967700 1 -- 172.21.15.153:0/2381092917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 msgr2=0x7efdfc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.319+0000 7efe18967700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 0x7efdfc004cd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efe04009b60 tx=0x7efdfc005880 comp rx=0 tx=0).stop 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.320+0000 7efe18967700 1 -- 172.21.15.153:0/2381092917 shutdown_connections 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.320+0000 7efe18967700 1 --2- 172.21.15.153:0/2381092917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 0x7efdfc004cd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.320+0000 7efe18967700 1 -- 172.21.15.153:0/2381092917 >> 172.21.15.153:0/2381092917 conn(0x7efe140d0bf0 msgr2=0x7efe140d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.320+0000 7efe18967700 1 -- 172.21.15.153:0/2381092917 shutdown_connections 2023-11-24T08:05:09.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.320+0000 7efe18967700 1 -- 172.21.15.153:0/2381092917 wait complete. 2023-11-24T08:05:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.321+0000 7efe18967700 1 Processor -- start 2023-11-24T08:05:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.321+0000 7efe18967700 1 -- start start 2023-11-24T08:05:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.322+0000 7efe18967700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 0x7efe1414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.322+0000 7efe18967700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe14149db0 0x7efe141f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.322+0000 7efe18967700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe1414a230 0x7efe14160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.322+0000 7efe18967700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1414c860 con 0x7efdfc004850 2023-11-24T08:05:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.322+0000 7efe18967700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe141f7ac0 con 0x7efe14149db0 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.322+0000 7efe18967700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1414cad0 con 0x7efe1414a230 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.322+0000 7efe1259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 0x7efe1414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.322+0000 7efe1259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 0x7efe1414d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37282/0 (socket says 172.21.15.153:37282) 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.322+0000 7efe1259c700 1 -- 172.21.15.153:0/902512177 learned_addr learned my addr 172.21.15.153:0/902512177 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe1259c700 1 -- 172.21.15.153:0/902512177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe1414a230 msgr2=0x7efe14160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe12d9d700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe1414a230 0x7efe14160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe11d9b700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe14149db0 0x7efe141f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe1259c700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe1414a230 0x7efe14160890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe1259c700 1 -- 172.21.15.153:0/902512177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe14149db0 msgr2=0x7efe141f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe1259c700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe14149db0 0x7efe141f6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe1259c700 1 -- 172.21.15.153:0/902512177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1414cdb0 con 0x7efdfc004850 2023-11-24T08:05:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe1259c700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 0x7efe1414d2d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efe0800e7b0 tx=0x7efe0800eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe02ffd700 1 -- 172.21.15.153:0/902512177 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080052e0 con 0x7efdfc004850 2023-11-24T08:05:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe02ffd700 1 -- 172.21.15.153:0/902512177 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe08005440 con 0x7efdfc004850 2023-11-24T08:05:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe18967700 1 -- 172.21.15.153:0/902512177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1415d190 con 0x7efdfc004850 2023-11-24T08:05:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe02ffd700 1 -- 172.21.15.153:0/902512177 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080038a0 con 0x7efdfc004850 2023-11-24T08:05:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.323+0000 7efe18967700 1 -- 172.21.15.153:0/902512177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe141f74f0 con 0x7efdfc004850 2023-11-24T08:05:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.324+0000 7efe18967700 1 -- 172.21.15.153:0/902512177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1414cf40 con 0x7efdfc004850 2023-11-24T08:05:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.324+0000 7efe02ffd700 1 -- 172.21.15.153:0/902512177 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe08003a00 con 0x7efdfc004850 2023-11-24T08:05:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.325+0000 7efe02ffd700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efdf406aed0 0x7efdf406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.325+0000 7efe02ffd700 1 -- 172.21.15.153:0/902512177 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe08088c90 con 0x7efdfc004850 2023-11-24T08:05:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.325+0000 7efe11d9b700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efdf406aed0 0x7efdf406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.325+0000 7efe11d9b700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efdf406aed0 0x7efdf406d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efe040090b0 tx=0x7efe04008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.329+0000 7efe02ffd700 1 -- 172.21.15.153:0/902512177 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe08053e80 con 0x7efdfc004850 2023-11-24T08:05:09.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:09.565+0000 7efe18967700 1 -- 172.21.15.153:0/902512177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efe14068fb0 con 0x7efdfc004850 2023-11-24T08:05:09.585 INFO:tasks.ceph.mds.b.smithi164.stderr:2023-11-24T08:05:09.583+0000 7fb7573f2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:05:10.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.172+0000 7efe02ffd700 1 -- 172.21.15.153:0/902512177 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7efe08019020 con 0x7efdfc004850 2023-11-24T08:05:10.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 -- 172.21.15.153:0/902512177 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efdf406aed0 msgr2=0x7efdf406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efdf406aed0 0x7efdf406d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efe040090b0 tx=0x7efe04008030 comp rx=0 tx=0).stop 2023-11-24T08:05:10.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 -- 172.21.15.153:0/902512177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 msgr2=0x7efe1414d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 0x7efe1414d2d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efe0800e7b0 tx=0x7efe0800eb70 comp rx=0 tx=0).stop 2023-11-24T08:05:10.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 -- 172.21.15.153:0/902512177 shutdown_connections 2023-11-24T08:05:10.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe1414a230 0x7efe14160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efdf406aed0 0x7efdf406d390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc004850 0x7efe1414d2d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 --2- 172.21.15.153:0/902512177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe14149db0 0x7efe141f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 -- 172.21.15.153:0/902512177 >> 172.21.15.153:0/902512177 conn(0x7efe140d0bf0 msgr2=0x7efe141619f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 -- 172.21.15.153:0/902512177 shutdown_connections 2023-11-24T08:05:10.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.175+0000 7efe18967700 1 -- 172.21.15.153:0/902512177 wait complete. 2023-11-24T08:05:10.191 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:05:10.191 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:10.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.313+0000 7f51ccfcd700 1 Processor -- start 2023-11-24T08:05:10.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.313+0000 7f51ccfcd700 1 -- start start 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.314+0000 7f51ccfcd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f51c81446a0 0x7f51c80b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.314+0000 7f51ccfcd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f51c80adf00 0x7f51c806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.314+0000 7f51ccfcd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51c806c540 0x7f51c806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.314+0000 7f51ccfcd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c8144a80 con 0x7f51c81446a0 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.314+0000 7f51ccfcd700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c806c9c0 con 0x7f51c80adf00 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.314+0000 7f51ccfcd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80af950 con 0x7f51c806c540 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f51c81446a0 0x7f51c80b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f51c81446a0 0x7f51c80b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37290/0 (socket says 172.21.15.153:37290) 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c659c700 1 -- 172.21.15.153:0/2218699703 learned_addr learned my addr 172.21.15.153:0/2218699703 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c6d9d700 1 --2- 172.21.15.153:0/2218699703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51c806c540 0x7f51c806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c5d9b700 1 --2- 172.21.15.153:0/2218699703 >> v2:172.21.15.164:3300/0 conn(0x7f51c80adf00 0x7f51c806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c659c700 1 -- 172.21.15.153:0/2218699703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51c806c540 msgr2=0x7f51c806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c659c700 1 --2- 172.21.15.153:0/2218699703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51c806c540 0x7f51c806da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c659c700 1 -- 172.21.15.153:0/2218699703 >> v2:172.21.15.164:3300/0 conn(0x7f51c80adf00 msgr2=0x7f51c806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c659c700 1 --2- 172.21.15.153:0/2218699703 >> v2:172.21.15.164:3300/0 conn(0x7f51c80adf00 0x7f51c806c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c659c700 1 -- 172.21.15.153:0/2218699703 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c80afc30 con 0x7f51c81446a0 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c659c700 1 --2- 172.21.15.153:0/2218699703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c81446a0 0x7f51c80b5ae0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f51c809f030 tx=0x7f51b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e958ecb074d67e03 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c559a700 1 -- 172.21.15.153:0/2218699703 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000b870 con 0x7f51c81446a0 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c559a700 1 -- 172.21.15.153:0/2218699703 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b000b9d0 con 0x7f51c81446a0 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.315+0000 7f51c559a700 1 -- 172.21.15.153:0/2218699703 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000bd60 con 0x7f51c81446a0 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.316+0000 7f51ccfcd700 1 -- 172.21.15.153:0/2218699703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c81446a0 msgr2=0x7f51c80b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.316+0000 7f51ccfcd700 1 --2- 172.21.15.153:0/2218699703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c81446a0 0x7f51c80b5ae0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f51c809f030 tx=0x7f51b0009bd0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.316+0000 7f51ccfcd700 1 -- 172.21.15.153:0/2218699703 shutdown_connections 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.316+0000 7f51ccfcd700 1 --2- 172.21.15.153:0/2218699703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51c806c540 0x7f51c806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.316+0000 7f51ccfcd700 1 --2- 172.21.15.153:0/2218699703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c81446a0 0x7f51c80b5ae0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.316+0000 7f51ccfcd700 1 --2- 172.21.15.153:0/2218699703 >> v2:172.21.15.164:3300/0 conn(0x7f51c80adf00 0x7f51c806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.316+0000 7f51ccfcd700 1 -- 172.21.15.153:0/2218699703 >> 172.21.15.153:0/2218699703 conn(0x7f51c8071b90 msgr2=0x7f51c8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.316+0000 7f51ccfcd700 1 -- 172.21.15.153:0/2218699703 shutdown_connections 2023-11-24T08:05:10.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.316+0000 7f51ccfcd700 1 -- 172.21.15.153:0/2218699703 wait complete. 2023-11-24T08:05:10.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.317+0000 7f51ccfcd700 1 Processor -- start 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.317+0000 7f51ccfcd700 1 -- start start 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51ccfcd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51c806c540 0x7f51c81fbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51ccfcd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80adf00 0x7f51c809c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51ccfcd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51c81446a0 0x7f51c809e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51ccfcd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c809de10 con 0x7f51c80adf00 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51ccfcd700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8157f10 con 0x7f51c806c540 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51ccfcd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c81fc940 con 0x7f51c81446a0 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51c5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80adf00 0x7f51c809c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51c5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80adf00 0x7f51c809c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37298/0 (socket says 172.21.15.153:37298) 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51c5d9b700 1 -- 172.21.15.153:0/3618809909 learned_addr learned my addr 172.21.15.153:0/3618809909 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51c6d9d700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51c81446a0 0x7f51c809e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51c659c700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51c806c540 0x7f51c81fbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51c5d9b700 1 -- 172.21.15.153:0/3618809909 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51c81446a0 msgr2=0x7f51c809e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51c5d9b700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51c81446a0 0x7f51c809e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51c5d9b700 1 -- 172.21.15.153:0/3618809909 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51c806c540 msgr2=0x7f51c81fbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51c5d9b700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51c806c540 0x7f51c81fbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.318+0000 7f51c5d9b700 1 -- 172.21.15.153:0/3618809909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b0009550 con 0x7f51c80adf00 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.319+0000 7f51c5d9b700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80adf00 0x7f51c809c8c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f51b800e7e0 tx=0x7f51b800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.319+0000 7f51beffd700 1 -- 172.21.15.153:0/3618809909 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b800c070 con 0x7f51c80adf00 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.319+0000 7f51beffd700 1 -- 172.21.15.153:0/3618809909 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8013610 con 0x7f51c80adf00 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.319+0000 7f51ccfcd700 1 -- 172.21.15.153:0/3618809909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c81fc0a0 con 0x7f51c80adf00 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.319+0000 7f51beffd700 1 -- 172.21.15.153:0/3618809909 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b80139a0 con 0x7f51c80adf00 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.319+0000 7f51ccfcd700 1 -- 172.21.15.153:0/3618809909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c81fc430 con 0x7f51c80adf00 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.320+0000 7f51ccfcd700 1 -- 172.21.15.153:0/3618809909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c80cf170 con 0x7f51c80adf00 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.320+0000 7f51beffd700 1 -- 172.21.15.153:0/3618809909 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51b8013b00 con 0x7f51c80adf00 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.321+0000 7f51beffd700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f51a806aed0 0x7f51a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.321+0000 7f51beffd700 1 -- 172.21.15.153:0/3618809909 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51b80892f0 con 0x7f51c80adf00 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.321+0000 7f51c659c700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f51a806aed0 0x7f51a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.321+0000 7f51c659c700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f51a806aed0 0x7f51a806d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f51b0014040 tx=0x7f51b0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.325+0000 7f51beffd700 1 -- 172.21.15.153:0/3618809909 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51b8054310 con 0x7f51c80adf00 2023-11-24T08:05:10.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.560+0000 7f51ccfcd700 1 -- 172.21.15.153:0/3618809909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51c80753f0 con 0x7f51c80adf00 2023-11-24T08:05:10.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.561+0000 7f51beffd700 1 -- 172.21.15.153:0/3618809909 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f51b805ce60 con 0x7f51c80adf00 2023-11-24T08:05:10.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:10.563 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2772655217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2772655217},{"type":"v1","addr":"172.21.15.164:6834","nonce":2772655217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2600357639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2600357639},{"type":"v1","addr":"172.21.15.153:6836","nonce":2600357639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5037,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3970007773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3970007773},{"type":"v1","addr":"172.21.15.153:6837","nonce":3970007773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:06.541701+0000","modified":"2023-11-24T08:05:09.566528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2977715145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2977715145},{"type":"v1","addr":"172.21.15.164:6835","nonce":2977715145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:05:10.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 -- 172.21.15.153:0/3618809909 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f51a806aed0 msgr2=0x7f51a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f51a806aed0 0x7f51a806d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f51b0014040 tx=0x7f51b0008030 comp rx=0 tx=0).stop 2023-11-24T08:05:10.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 -- 172.21.15.153:0/3618809909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80adf00 msgr2=0x7f51c809c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80adf00 0x7f51c809c8c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f51b800e7e0 tx=0x7f51b800eaf0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 -- 172.21.15.153:0/3618809909 shutdown_connections 2023-11-24T08:05:10.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51c81446a0 0x7f51c809e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51c806c540 0x7f51c81fbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f51a806aed0 0x7f51a806d390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 --2- 172.21.15.153:0/3618809909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80adf00 0x7f51c809c8c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 -- 172.21.15.153:0/3618809909 >> 172.21.15.153:0/3618809909 conn(0x7f51c8071b90 msgr2=0x7f51c80b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 -- 172.21.15.153:0/3618809909 shutdown_connections 2023-11-24T08:05:10.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.563+0000 7f51ccfcd700 1 -- 172.21.15.153:0/3618809909 wait complete. 2023-11-24T08:05:10.567 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 16 2023-11-24T08:05:10.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:10.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.698+0000 7fa1384ca700 1 Processor -- start 2023-11-24T08:05:10.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.698+0000 7fa1384ca700 1 -- start start 2023-11-24T08:05:10.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa1384ca700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa13015bd60 0x7fa1300d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa1384ca700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1300cf2b0 0x7fa1300c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa1384ca700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300cc780 con 0x7fa13015c140 2023-11-24T08:05:10.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa1384ca700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1300cc9b0 con 0x7fa13015bd60 2023-11-24T08:05:10.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa1384ca700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300ccc90 con 0x7fa1300cf2b0 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa136266700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa13015bd60 0x7fa1300d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa136266700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa13015bd60 0x7fa1300d1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37304/0 (socket says 172.21.15.153:37304) 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa136266700 1 -- 172.21.15.153:0/2294661433 learned_addr learned my addr 172.21.15.153:0/2294661433 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa136a67700 1 --2- 172.21.15.153:0/2294661433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1300cf2b0 0x7fa1300c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa136266700 1 -- 172.21.15.153:0/2294661433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1300cf2b0 msgr2=0x7fa1300c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa136266700 1 --2- 172.21.15.153:0/2294661433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1300cf2b0 0x7fa1300c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa136266700 1 -- 172.21.15.153:0/2294661433 >> v1:172.21.15.164:6789/0 conn(0x7fa13015c140 legacy=0x7fa1300cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.699+0000 7fa136266700 1 -- 172.21.15.153:0/2294661433 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300ccf70 con 0x7fa13015bd60 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa136266700 1 --2- 172.21.15.153:0/2294661433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa13015bd60 0x7fa1300d1ff0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa1200098f0 tx=0x7fa120009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5d0f1d4fa43181 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa135264700 1 -- 172.21.15.153:0/2294661433 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12000b8a0 con 0x7fa13015bd60 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa135264700 1 -- 172.21.15.153:0/2294661433 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12000ba00 con 0x7fa13015bd60 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa135264700 1 -- 172.21.15.153:0/2294661433 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12000bd90 con 0x7fa13015bd60 2023-11-24T08:05:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa1384ca700 1 -- 172.21.15.153:0/2294661433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa13015bd60 msgr2=0x7fa1300d1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa1384ca700 1 --2- 172.21.15.153:0/2294661433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa13015bd60 0x7fa1300d1ff0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa1200098f0 tx=0x7fa120009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:10.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa1384ca700 1 -- 172.21.15.153:0/2294661433 shutdown_connections 2023-11-24T08:05:10.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa1384ca700 1 --2- 172.21.15.153:0/2294661433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1300cf2b0 0x7fa1300c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa1384ca700 1 --2- 172.21.15.153:0/2294661433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa13015bd60 0x7fa1300d1ff0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa1384ca700 1 -- 172.21.15.153:0/2294661433 >> 172.21.15.153:0/2294661433 conn(0x7fa130073130 msgr2=0x7fa13009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa1384ca700 1 -- 172.21.15.153:0/2294661433 shutdown_connections 2023-11-24T08:05:10.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.700+0000 7fa1384ca700 1 -- 172.21.15.153:0/2294661433 wait complete. 2023-11-24T08:05:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.702+0000 7fa1384ca700 1 Processor -- start 2023-11-24T08:05:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.702+0000 7fa1384ca700 1 -- start start 2023-11-24T08:05:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.702+0000 7fa1384ca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1300cf2b0 0x7fa130155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.702+0000 7fa1384ca700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa13015bd60 0x7fa1300cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.702+0000 7fa1384ca700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa13015c140 0x7fa130157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.702+0000 7fa1384ca700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301562d0 con 0x7fa1300cf2b0 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.702+0000 7fa1384ca700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300c9f30 con 0x7fa13015c140 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.702+0000 7fa1384ca700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300ca210 con 0x7fa13015bd60 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa136266700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1300cf2b0 0x7fa130155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa136266700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1300cf2b0 0x7fa130155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37310/0 (socket says 172.21.15.153:37310) 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa136266700 1 -- 172.21.15.153:0/1883020432 learned_addr learned my addr 172.21.15.153:0/1883020432 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa135a65700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa13015bd60 0x7fa1300cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa136a67700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa13015c140 0x7fa130157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa136266700 1 -- 172.21.15.153:0/1883020432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa13015bd60 msgr2=0x7fa1300cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa136266700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa13015bd60 0x7fa1300cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa136266700 1 -- 172.21.15.153:0/1883020432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa13015c140 msgr2=0x7fa130157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa136266700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa13015c140 0x7fa130157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa136266700 1 -- 172.21.15.153:0/1883020432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa120009550 con 0x7fa1300cf2b0 2023-11-24T08:05:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa136266700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1300cf2b0 0x7fa130155d90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa120000c00 tx=0x7fa120004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa126ffd700 1 -- 172.21.15.153:0/1883020432 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120004300 con 0x7fa1300cf2b0 2023-11-24T08:05:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa126ffd700 1 -- 172.21.15.153:0/1883020432 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12001f070 con 0x7fa1300cf2b0 2023-11-24T08:05:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa1384ca700 1 -- 172.21.15.153:0/1883020432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1300ca4f0 con 0x7fa1300cf2b0 2023-11-24T08:05:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa126ffd700 1 -- 172.21.15.153:0/1883020432 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200036a0 con 0x7fa1300cf2b0 2023-11-24T08:05:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.703+0000 7fa1384ca700 1 -- 172.21.15.153:0/1883020432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1300caab0 con 0x7fa1300cf2b0 2023-11-24T08:05:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.704+0000 7fa1384ca700 1 -- 172.21.15.153:0/1883020432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1300cac40 con 0x7fa1300cf2b0 2023-11-24T08:05:10.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.705+0000 7fa126ffd700 1 -- 172.21.15.153:0/1883020432 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa120021030 con 0x7fa1300cf2b0 2023-11-24T08:05:10.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.705+0000 7fa126ffd700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa11406aed0 0x7fa11406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.705+0000 7fa126ffd700 1 -- 172.21.15.153:0/1883020432 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa12008a900 con 0x7fa1300cf2b0 2023-11-24T08:05:10.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.705+0000 7fa135a65700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa11406aed0 0x7fa11406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.705+0000 7fa135a65700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa11406aed0 0x7fa11406d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa13006b720 tx=0x7fa12c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.709+0000 7fa126ffd700 1 -- 172.21.15.153:0/1883020432 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa1200559c0 con 0x7fa1300cf2b0 2023-11-24T08:05:10.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.901+0000 7fa1384ca700 1 -- 172.21.15.153:0/1883020432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa130067f60 con 0x7fa1300cf2b0 2023-11-24T08:05:10.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.902+0000 7fa126ffd700 1 -- 172.21.15.153:0/1883020432 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fa120058fe0 con 0x7fa1300cf2b0 2023-11-24T08:05:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:10.904 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":32,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:08.158007+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:04.517274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:05.507139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:10.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 -- 172.21.15.153:0/1883020432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa11406aed0 msgr2=0x7fa11406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa11406aed0 0x7fa11406d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa13006b720 tx=0x7fa12c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:10.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 -- 172.21.15.153:0/1883020432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1300cf2b0 msgr2=0x7fa130155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1300cf2b0 0x7fa130155d90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa120000c00 tx=0x7fa120004750 comp rx=0 tx=0).stop 2023-11-24T08:05:10.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 -- 172.21.15.153:0/1883020432 shutdown_connections 2023-11-24T08:05:10.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa13015c140 0x7fa130157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa11406aed0 0x7fa11406d390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1300cf2b0 0x7fa130155d90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 --2- 172.21.15.153:0/1883020432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa13015bd60 0x7fa1300cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 -- 172.21.15.153:0/1883020432 >> 172.21.15.153:0/1883020432 conn(0x7fa130073130 msgr2=0x7fa1300c7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 -- 172.21.15.153:0/1883020432 shutdown_connections 2023-11-24T08:05:10.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:10.904+0000 7fa1384ca700 1 -- 172.21.15.153:0/1883020432 wait complete. 2023-11-24T08:05:10.919 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:05:10.921 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:11.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.040+0000 7f8373c83700 1 Processor -- start 2023-11-24T08:05:11.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.040+0000 7f8373c83700 1 -- start start 2023-11-24T08:05:11.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.041+0000 7f8373c83700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f836c1446a0 0x7f836c0b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.041+0000 7f8373c83700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f836c0adf00 0x7f836c06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.041+0000 7f8373c83700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f836c06c540 0x7f836c06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.041+0000 7f8373c83700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c144a80 con 0x7f836c1446a0 2023-11-24T08:05:11.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.041+0000 7f8373c83700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c06c9c0 con 0x7f836c0adf00 2023-11-24T08:05:11.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.041+0000 7f8373c83700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0af950 con 0x7f836c06c540 2023-11-24T08:05:11.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.041+0000 7f8371a1f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f836c1446a0 0x7f836c0b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.041+0000 7f8371a1f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f836c1446a0 0x7f836c0b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37318/0 (socket says 172.21.15.153:37318) 2023-11-24T08:05:11.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.041+0000 7f8371a1f700 1 -- 172.21.15.153:0/2170373704 learned_addr learned my addr 172.21.15.153:0/2170373704 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:11.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f837121e700 1 --2- 172.21.15.153:0/2170373704 >> v2:172.21.15.164:3300/0 conn(0x7f836c0adf00 0x7f836c06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f8372220700 1 --2- 172.21.15.153:0/2170373704 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f836c06c540 0x7f836c06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f8371a1f700 1 -- 172.21.15.153:0/2170373704 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f836c06c540 msgr2=0x7f836c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f8371a1f700 1 --2- 172.21.15.153:0/2170373704 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f836c06c540 0x7f836c06da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f8371a1f700 1 -- 172.21.15.153:0/2170373704 >> v2:172.21.15.164:3300/0 conn(0x7f836c0adf00 msgr2=0x7f836c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f8371a1f700 1 --2- 172.21.15.153:0/2170373704 >> v2:172.21.15.164:3300/0 conn(0x7f836c0adf00 0x7f836c06c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f8371a1f700 1 -- 172.21.15.153:0/2170373704 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0afc30 con 0x7f836c1446a0 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f837121e700 1 --2- 172.21.15.153:0/2170373704 >> v2:172.21.15.164:3300/0 conn(0x7f836c0adf00 0x7f836c06c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f8371a1f700 1 --2- 172.21.15.153:0/2170373704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c1446a0 0x7f836c0b5ae0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f836c09f030 tx=0x7f835c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8de50fc13b81dd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f8370a1d700 1 -- 172.21.15.153:0/2170373704 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00dd30 con 0x7f836c1446a0 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f8370a1d700 1 -- 172.21.15.153:0/2170373704 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c00de90 con 0x7f836c1446a0 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.042+0000 7f8370a1d700 1 -- 172.21.15.153:0/2170373704 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c010690 con 0x7f836c1446a0 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.043+0000 7f8373c83700 1 -- 172.21.15.153:0/2170373704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c1446a0 msgr2=0x7f836c0b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.043+0000 7f8373c83700 1 --2- 172.21.15.153:0/2170373704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c1446a0 0x7f836c0b5ae0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f836c09f030 tx=0x7f835c00be70 comp rx=0 tx=0).stop 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.043+0000 7f8373c83700 1 -- 172.21.15.153:0/2170373704 shutdown_connections 2023-11-24T08:05:11.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.043+0000 7f8373c83700 1 --2- 172.21.15.153:0/2170373704 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f836c06c540 0x7f836c06da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.043+0000 7f8373c83700 1 --2- 172.21.15.153:0/2170373704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c1446a0 0x7f836c0b5ae0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.043+0000 7f8373c83700 1 --2- 172.21.15.153:0/2170373704 >> v2:172.21.15.164:3300/0 conn(0x7f836c0adf00 0x7f836c06c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.043+0000 7f8373c83700 1 -- 172.21.15.153:0/2170373704 >> 172.21.15.153:0/2170373704 conn(0x7f836c071b90 msgr2=0x7f836c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.043+0000 7f8373c83700 1 -- 172.21.15.153:0/2170373704 shutdown_connections 2023-11-24T08:05:11.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.043+0000 7f8373c83700 1 -- 172.21.15.153:0/2170373704 wait complete. 2023-11-24T08:05:11.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.044+0000 7f8373c83700 1 Processor -- start 2023-11-24T08:05:11.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.044+0000 7f8373c83700 1 -- start start 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f8373c83700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f836c06c540 0x7f836c1efa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f8373c83700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0adf00 0x7f836c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f8373c83700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f836c1446a0 0x7f836c1437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f8373c83700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c09aa00 con 0x7f836c0adf00 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f8373c83700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c09ace0 con 0x7f836c06c540 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f8373c83700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c09afc0 con 0x7f836c1446a0 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f837121e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0adf00 0x7f836c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f837121e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0adf00 0x7f836c0b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37324/0 (socket says 172.21.15.153:37324) 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f837121e700 1 -- 172.21.15.153:0/3447377880 learned_addr learned my addr 172.21.15.153:0/3447377880 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f8371a1f700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f836c06c540 0x7f836c1efa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f8372220700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f836c1446a0 0x7f836c1437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f837121e700 1 -- 172.21.15.153:0/3447377880 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f836c1446a0 msgr2=0x7f836c1437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f837121e700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f836c1446a0 0x7f836c1437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f837121e700 1 -- 172.21.15.153:0/3447377880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f836c06c540 msgr2=0x7f836c1efa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f837121e700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f836c06c540 0x7f836c1efa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f837121e700 1 -- 172.21.15.153:0/3447377880 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c00b7f0 con 0x7f836c0adf00 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f837121e700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0adf00 0x7f836c0b1c70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f836800e810 tx=0x7f836800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f83627fc700 1 -- 172.21.15.153:0/3447377880 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836800c070 con 0x7f836c0adf00 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f83627fc700 1 -- 172.21.15.153:0/3447377880 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8368013610 con 0x7f836c0adf00 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f8373c83700 1 -- 172.21.15.153:0/3447377880 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c09b2a0 con 0x7f836c0adf00 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.045+0000 7f83627fc700 1 -- 172.21.15.153:0/3447377880 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83680139c0 con 0x7f836c0adf00 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.046+0000 7f8373c83700 1 -- 172.21.15.153:0/3447377880 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c09b860 con 0x7f836c0adf00 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.046+0000 7f8373c83700 1 -- 172.21.15.153:0/3447377880 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c0753f0 con 0x7f836c0adf00 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.047+0000 7f83627fc700 1 -- 172.21.15.153:0/3447377880 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8368013b20 con 0x7f836c0adf00 2023-11-24T08:05:11.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.047+0000 7f83627fc700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f835006aed0 0x7f835006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.047+0000 7f83627fc700 1 -- 172.21.15.153:0/3447377880 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8368089270 con 0x7f836c0adf00 2023-11-24T08:05:11.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.047+0000 7f8371a1f700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f835006aed0 0x7f835006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.048+0000 7f8371a1f700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f835006aed0 0x7f835006d390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f835c00beb0 tx=0x7f835c012000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.051+0000 7f83627fc700 1 -- 172.21.15.153:0/3447377880 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f83680543b0 con 0x7f836c0adf00 2023-11-24T08:05:11.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.241+0000 7f8373c83700 1 -- 172.21.15.153:0/3447377880 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f836c09b130 con 0x7f835006aed0 2023-11-24T08:05:11.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.248+0000 7f83627fc700 1 -- 172.21.15.153:0/3447377880 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249850 (secure 0 0 0) 0x7f836c09b130 con 0x7f835006aed0 2023-11-24T08:05:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:11.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 -- 172.21.15.153:0/3447377880 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f835006aed0 msgr2=0x7f835006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f835006aed0 0x7f835006d390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f835c00beb0 tx=0x7f835c012000 comp rx=0 tx=0).stop 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 -- 172.21.15.153:0/3447377880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0adf00 msgr2=0x7f836c0b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0adf00 0x7f836c0b1c70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f836800e810 tx=0x7f836800eb20 comp rx=0 tx=0).stop 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 -- 172.21.15.153:0/3447377880 shutdown_connections 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f836c1446a0 0x7f836c1437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f836c06c540 0x7f836c1efa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f835006aed0 0x7f835006d390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 --2- 172.21.15.153:0/3447377880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0adf00 0x7f836c0b1c70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 -- 172.21.15.153:0/3447377880 >> 172.21.15.153:0/3447377880 conn(0x7f836c071b90 msgr2=0x7f836c0b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 -- 172.21.15.153:0/3447377880 shutdown_connections 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.251+0000 7f8373c83700 1 -- 172.21.15.153:0/3447377880 wait complete. 2023-11-24T08:05:11.255 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:05:11.265 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-11-24T08:05:10.052801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219804,"kb_used_data":3588,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754916,"statfs":{"total":773094113280,"available":772869033984,"internally_reserved":0,"allocated":3674112,"data_stored":2093781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914707"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-24T08:04:59.187780+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:04:59.187780+0000","last_peered":"2023-11-24T08:04:59.187780+0000","last_clean":"2023-11-24T08:04:59.187780+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:04:59.187780+0000","last_undegraded":"2023-11-24T08:04:59.187780+0000","last_fullsized":"2023-11-24T08:04:59.187780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":704626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":901120,"data_stored":703607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27344,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:11.269 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.425+0000 7f09b7478700 1 Processor -- start 2023-11-24T08:05:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.425+0000 7f09b7478700 1 -- start start 2023-11-24T08:05:11.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b7478700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09b01446a0 0x7f09b00b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b7478700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f09b00adf00 0x7f09b006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b7478700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b00af950 con 0x7f09b006c540 2023-11-24T08:05:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b7478700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b0144a80 con 0x7f09b00adf00 2023-11-24T08:05:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b7478700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b006c9b0 con 0x7f09b01446a0 2023-11-24T08:05:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b4a13700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f09b00adf00 0x7f09b006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b5a15700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f09b006c540 0x7f09b006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43436/0 (socket says 172.21.15.153:43436) 2023-11-24T08:05:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b5a15700 1 -- 172.21.15.153:0/1749164691 learned_addr learned my addr 172.21.15.153:0/1749164691 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b4a13700 1 -- 172.21.15.153:0/1749164691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09b01446a0 msgr2=0x7f09b00b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b5214700 1 --2- 172.21.15.153:0/1749164691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09b01446a0 0x7f09b00b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09a7fff700 1 -- 172.21.15.153:0/1749164691 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781212079 0 0) 0x7f09b00af950 con 0x7f09b006c540 2023-11-24T08:05:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b4a13700 1 --2- 172.21.15.153:0/1749164691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09b01446a0 0x7f09b00b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b4a13700 1 -- 172.21.15.153:0/1749164691 >> v1:172.21.15.153:6789/0 conn(0x7f09b006c540 legacy=0x7f09b006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b4a13700 1 -- 172.21.15.153:0/1749164691 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b00afc30 con 0x7f09b00adf00 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.426+0000 7f09b4a13700 1 --2- 172.21.15.153:0/1749164691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09b00adf00 0x7f09b006c000 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009870 tx=0x7f09a0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c4a3fb9ec2cbe2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.427+0000 7f09a7fff700 1 -- 172.21.15.153:0/1749164691 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0011830 con 0x7f09b00adf00 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.427+0000 7f09a7fff700 1 -- 172.21.15.153:0/1749164691 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a0011990 con 0x7f09b00adf00 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.427+0000 7f09a7fff700 1 -- 172.21.15.153:0/1749164691 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0011d20 con 0x7f09b00adf00 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.427+0000 7f09b7478700 1 -- 172.21.15.153:0/1749164691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09b00adf00 msgr2=0x7f09b006c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.427+0000 7f09b7478700 1 --2- 172.21.15.153:0/1749164691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09b00adf00 0x7f09b006c000 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009870 tx=0x7f09a0009b80 comp rx=0 tx=0).stop 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.427+0000 7f09b7478700 1 -- 172.21.15.153:0/1749164691 shutdown_connections 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.427+0000 7f09b7478700 1 --2- 172.21.15.153:0/1749164691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09b01446a0 0x7f09b00b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.427+0000 7f09b7478700 1 --2- 172.21.15.153:0/1749164691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09b00adf00 0x7f09b006c000 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.427+0000 7f09b7478700 1 -- 172.21.15.153:0/1749164691 >> 172.21.15.153:0/1749164691 conn(0x7f09b0071b90 msgr2=0x7f09b0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.427+0000 7f09b7478700 1 -- 172.21.15.153:0/1749164691 shutdown_connections 2023-11-24T08:05:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.427+0000 7f09b7478700 1 -- 172.21.15.153:0/1749164691 wait complete. 2023-11-24T08:05:11.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.429+0000 7f09b7478700 1 Processor -- start 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.429+0000 7f09b7478700 1 -- start start 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b7478700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09b006c540 0x7f09b0158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b7478700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09b00adf00 0x7f09b01f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b7478700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09b01446a0 0x7f09b013ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b7478700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00cd860 con 0x7f09b00adf00 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b7478700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00cf9c0 con 0x7f09b006c540 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b7478700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b01589a0 con 0x7f09b01446a0 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b4a13700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09b00adf00 0x7f09b01f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b4a13700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09b00adf00 0x7f09b01f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37336/0 (socket says 172.21.15.153:37336) 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b4a13700 1 -- 172.21.15.153:0/1392460117 learned_addr learned my addr 172.21.15.153:0/1392460117 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b5214700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09b006c540 0x7f09b0158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b5a15700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09b01446a0 0x7f09b013ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b4a13700 1 -- 172.21.15.153:0/1392460117 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09b01446a0 msgr2=0x7f09b013ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b4a13700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09b01446a0 0x7f09b013ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b4a13700 1 -- 172.21.15.153:0/1392460117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09b006c540 msgr2=0x7f09b0158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b4a13700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09b006c540 0x7f09b0158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b4a13700 1 -- 172.21.15.153:0/1392460117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a00094a0 con 0x7f09b00adf00 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b5214700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09b006c540 0x7f09b0158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09b4a13700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09b00adf00 0x7f09b01f4e00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f09a0000c00 tx=0x7f09a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09a5ffb700 1 -- 172.21.15.153:0/1392460117 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a00036a0 con 0x7f09b00adf00 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09a5ffb700 1 -- 172.21.15.153:0/1392460117 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a001f070 con 0x7f09b00adf00 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.430+0000 7f09a5ffb700 1 -- 172.21.15.153:0/1392460117 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0003a40 con 0x7f09b00adf00 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.431+0000 7f09b7478700 1 -- 172.21.15.153:0/1392460117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b01f5340 con 0x7f09b00adf00 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.431+0000 7f09b7478700 1 -- 172.21.15.153:0/1392460117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b01f5850 con 0x7f09b00adf00 2023-11-24T08:05:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.432+0000 7f09b7478700 1 -- 172.21.15.153:0/1392460117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b00753f0 con 0x7f09b00adf00 2023-11-24T08:05:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.432+0000 7f09a5ffb700 1 -- 172.21.15.153:0/1392460117 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09a0003ba0 con 0x7f09b00adf00 2023-11-24T08:05:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.433+0000 7f09a5ffb700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f099406af00 0x7f099406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.433+0000 7f09a5ffb700 1 -- 172.21.15.153:0/1392460117 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09a0021070 con 0x7f09b00adf00 2023-11-24T08:05:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.433+0000 7f09b5214700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f099406af00 0x7f099406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.433+0000 7f09b5214700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f099406af00 0x7f099406d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f09ac006fd0 tx=0x7f09ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.437+0000 7f09a5ffb700 1 -- 172.21.15.153:0/1392460117 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f09a00564f0 con 0x7f09b00adf00 2023-11-24T08:05:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.624+0000 7f09b7478700 1 -- 172.21.15.153:0/1392460117 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09b00b04d0 con 0x7f099406af00 2023-11-24T08:05:11.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.631+0000 7f09a5ffb700 1 -- 172.21.15.153:0/1392460117 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249850 (secure 0 0 0) 0x7f09ac00c040 con 0x7f099406af00 2023-11-24T08:05:11.635 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:11.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 -- 172.21.15.153:0/1392460117 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f099406af00 msgr2=0x7f099406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f099406af00 0x7f099406d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f09ac006fd0 tx=0x7f09ac008040 comp rx=0 tx=0).stop 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 -- 172.21.15.153:0/1392460117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09b00adf00 msgr2=0x7f09b01f4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09b00adf00 0x7f09b01f4e00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f09a0000c00 tx=0x7f09a0004750 comp rx=0 tx=0).stop 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 -- 172.21.15.153:0/1392460117 shutdown_connections 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09b01446a0 0x7f09b013ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09b006c540 0x7f09b0158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f099406af00 0x7f099406d3c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 --2- 172.21.15.153:0/1392460117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09b00adf00 0x7f09b01f4e00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 -- 172.21.15.153:0/1392460117 >> 172.21.15.153:0/1392460117 conn(0x7f09b0071b90 msgr2=0x7f09b00b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 -- 172.21.15.153:0/1392460117 shutdown_connections 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.634+0000 7f09b7478700 1 -- 172.21.15.153:0/1392460117 wait complete. 2023-11-24T08:05:11.638 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:05:11.648 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-11-24T08:05:10.052801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219804,"kb_used_data":3588,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754916,"statfs":{"total":773094113280,"available":772869033984,"internally_reserved":0,"allocated":3674112,"data_stored":2093781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914707"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-24T08:04:59.187780+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:04:59.187780+0000","last_peered":"2023-11-24T08:04:59.187780+0000","last_clean":"2023-11-24T08:04:59.187780+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:04:59.187780+0000","last_undegraded":"2023-11-24T08:04:59.187780+0000","last_fullsized":"2023-11-24T08:04:59.187780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":704626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":901120,"data_stored":703607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27344,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:11.652 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:11.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.808+0000 7fa551474700 1 Processor -- start 2023-11-24T08:05:11.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.808+0000 7fa551474700 1 -- start start 2023-11-24T08:05:11.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.808+0000 7fa551474700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa54c15bdd0 0x7fa54c1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa551474700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa54c0b3370 0x7fa54c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa551474700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa54c0d1c70 0x7fa54c0d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa551474700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54c0b2f50 con 0x7fa54c15bdd0 2023-11-24T08:05:11.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa551474700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54c0d2660 con 0x7fa54c0b3370 2023-11-24T08:05:11.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa551474700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0b2030 con 0x7fa54c0d1c70 2023-11-24T08:05:11.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa54affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa54c15bdd0 0x7fa54c1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa54affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa54c15bdd0 0x7fa54c1604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37342/0 (socket says 172.21.15.153:37342) 2023-11-24T08:05:11.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa54affd700 1 -- 172.21.15.153:0/3875467649 learned_addr learned my addr 172.21.15.153:0/3875467649 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:11.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa54a7fc700 1 --2- 172.21.15.153:0/3875467649 >> v2:172.21.15.164:3300/0 conn(0x7fa54c0b3370 0x7fa54c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa54b7fe700 1 --2- 172.21.15.153:0/3875467649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa54c0d1c70 0x7fa54c0d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa54affd700 1 -- 172.21.15.153:0/3875467649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa54c0d1c70 msgr2=0x7fa54c0d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa54affd700 1 --2- 172.21.15.153:0/3875467649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa54c0d1c70 0x7fa54c0d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa54affd700 1 -- 172.21.15.153:0/3875467649 >> v2:172.21.15.164:3300/0 conn(0x7fa54c0b3370 msgr2=0x7fa54c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa54affd700 1 --2- 172.21.15.153:0/3875467649 >> v2:172.21.15.164:3300/0 conn(0x7fa54c0b3370 0x7fa54c0b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa54affd700 1 -- 172.21.15.153:0/3875467649 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c0b22d0 con 0x7fa54c15bdd0 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa54affd700 1 --2- 172.21.15.153:0/3875467649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c15bdd0 0x7fa54c1604e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0714c0 tx=0x7fa53c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8916763a21f263 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa549ffb700 1 -- 172.21.15.153:0/3875467649 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00b870 con 0x7fa54c15bdd0 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa549ffb700 1 -- 172.21.15.153:0/3875467649 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c00b9d0 con 0x7fa54c15bdd0 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.809+0000 7fa549ffb700 1 -- 172.21.15.153:0/3875467649 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00bd60 con 0x7fa54c15bdd0 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.810+0000 7fa551474700 1 -- 172.21.15.153:0/3875467649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c15bdd0 msgr2=0x7fa54c1604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.810+0000 7fa551474700 1 --2- 172.21.15.153:0/3875467649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c15bdd0 0x7fa54c1604e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0714c0 tx=0x7fa53c009bd0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.810+0000 7fa551474700 1 -- 172.21.15.153:0/3875467649 shutdown_connections 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.810+0000 7fa551474700 1 --2- 172.21.15.153:0/3875467649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa54c0d1c70 0x7fa54c0d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.810+0000 7fa551474700 1 --2- 172.21.15.153:0/3875467649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c15bdd0 0x7fa54c1604e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.810+0000 7fa551474700 1 --2- 172.21.15.153:0/3875467649 >> v2:172.21.15.164:3300/0 conn(0x7fa54c0b3370 0x7fa54c0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.810+0000 7fa551474700 1 -- 172.21.15.153:0/3875467649 >> 172.21.15.153:0/3875467649 conn(0x7fa54c0731a0 msgr2=0x7fa54c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.810+0000 7fa551474700 1 -- 172.21.15.153:0/3875467649 shutdown_connections 2023-11-24T08:05:11.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.810+0000 7fa551474700 1 -- 172.21.15.153:0/3875467649 wait complete. 2023-11-24T08:05:11.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.811+0000 7fa551474700 1 Processor -- start 2023-11-24T08:05:11.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.811+0000 7fa551474700 1 -- start start 2023-11-24T08:05:11.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa551474700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa54c0b3370 0x7fa54c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa551474700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0d1c70 0x7fa54c15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa551474700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa54c15bdd0 0x7fa54c148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa551474700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0b51c0 con 0x7fa54c0d1c70 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa551474700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0c6680 con 0x7fa54c0b3370 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa551474700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0c6f10 con 0x7fa54c15bdd0 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa54a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0d1c70 0x7fa54c15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa54a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0d1c70 0x7fa54c15eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37348/0 (socket says 172.21.15.153:37348) 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa54a7fc700 1 -- 172.21.15.153:0/3246585266 learned_addr learned my addr 172.21.15.153:0/3246585266 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa54affd700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa54c0b3370 0x7fa54c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa54b7fe700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa54c15bdd0 0x7fa54c148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa54a7fc700 1 -- 172.21.15.153:0/3246585266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa54c15bdd0 msgr2=0x7fa54c148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa54a7fc700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa54c15bdd0 0x7fa54c148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa54a7fc700 1 -- 172.21.15.153:0/3246585266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa54c0b3370 msgr2=0x7fa54c0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa54a7fc700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa54c0b3370 0x7fa54c0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa54a7fc700 1 -- 172.21.15.153:0/3246585266 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c009550 con 0x7fa54c0d1c70 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.812+0000 7fa54b7fe700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa54c15bdd0 0x7fa54c148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.813+0000 7fa54a7fc700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0d1c70 0x7fa54c15eea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa54000e7e0 tx=0x7fa54000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.813+0000 7fa5337fe700 1 -- 172.21.15.153:0/3246585266 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54000c070 con 0x7fa54c0d1c70 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.813+0000 7fa5337fe700 1 -- 172.21.15.153:0/3246585266 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa540013610 con 0x7fa54c0d1c70 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.813+0000 7fa5337fe700 1 -- 172.21.15.153:0/3246585266 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400139a0 con 0x7fa54c0d1c70 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.813+0000 7fa551474700 1 -- 172.21.15.153:0/3246585266 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c0b4ee0 con 0x7fa54c0d1c70 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.813+0000 7fa551474700 1 -- 172.21.15.153:0/3246585266 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c0c6ba0 con 0x7fa54c0d1c70 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.814+0000 7fa551474700 1 -- 172.21.15.153:0/3246585266 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c067f60 con 0x7fa54c0d1c70 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.814+0000 7fa5337fe700 1 -- 172.21.15.153:0/3246585266 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa540013b00 con 0x7fa54c0d1c70 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.814+0000 7fa5337fe700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa53806aed0 0x7fa53806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.814+0000 7fa5337fe700 1 -- 172.21.15.153:0/3246585266 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5400892d0 con 0x7fa54c0d1c70 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.815+0000 7fa54affd700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa53806aed0 0x7fa53806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.815+0000 7fa54affd700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa53806aed0 0x7fa53806d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa53c014040 tx=0x7fa53c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:11.819+0000 7fa5337fe700 1 -- 172.21.15.153:0/3246585266 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa540054380 con 0x7fa54c0d1c70 2023-11-24T08:05:12.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.005+0000 7fa551474700 1 -- 172.21.15.153:0/3246585266 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa54c0b2b70 con 0x7fa53806aed0 2023-11-24T08:05:12.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.011+0000 7fa5337fe700 1 -- 172.21.15.153:0/3246585266 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249850 (secure 0 0 0) 0x7fa53c00bb40 con 0x7fa53806aed0 2023-11-24T08:05:12.016 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:12.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 -- 172.21.15.153:0/3246585266 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa53806aed0 msgr2=0x7fa53806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa53806aed0 0x7fa53806d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa53c014040 tx=0x7fa53c008030 comp rx=0 tx=0).stop 2023-11-24T08:05:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 -- 172.21.15.153:0/3246585266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0d1c70 msgr2=0x7fa54c15eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0d1c70 0x7fa54c15eea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa54000e7e0 tx=0x7fa54000eaf0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 -- 172.21.15.153:0/3246585266 shutdown_connections 2023-11-24T08:05:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa54c15bdd0 0x7fa54c148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa54c0b3370 0x7fa54c0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa53806aed0 0x7fa53806d390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 --2- 172.21.15.153:0/3246585266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0d1c70 0x7fa54c15eea0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 -- 172.21.15.153:0/3246585266 >> 172.21.15.153:0/3246585266 conn(0x7fa54c0731a0 msgr2=0x7fa54c0aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 -- 172.21.15.153:0/3246585266 shutdown_connections 2023-11-24T08:05:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.014+0000 7fa551474700 1 -- 172.21.15.153:0/3246585266 wait complete. 2023-11-24T08:05:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:05:12.028 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-11-24T08:05:10.052801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219804,"kb_used_data":3588,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754916,"statfs":{"total":773094113280,"available":772869033984,"internally_reserved":0,"allocated":3674112,"data_stored":2093781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914707"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:06.138163+0000","last_change":"2023-11-24T08:05:06.138163+0000","last_active":"2023-11-24T08:05:06.138163+0000","last_peered":"2023-11-24T08:05:06.138163+0000","last_clean":"2023-11-24T08:05:06.138163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:06.138163+0000","last_undegraded":"2023-11-24T08:05:06.138163+0000","last_fullsized":"2023-11-24T08:05:06.138163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:05:05.136171+0000","last_change":"2023-11-24T08:05:05.136171+0000","last_active":"2023-11-24T08:05:05.136171+0000","last_peered":"2023-11-24T08:05:05.136171+0000","last_clean":"2023-11-24T08:05:05.136171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:05.136171+0000","last_undegraded":"2023-11-24T08:05:05.136171+0000","last_fullsized":"2023-11-24T08:05:05.136171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-24T08:04:59.187780+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:04:59.187780+0000","last_peered":"2023-11-24T08:04:59.187780+0000","last_clean":"2023-11-24T08:04:59.187780+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:04:59.187780+0000","last_undegraded":"2023-11-24T08:04:59.187780+0000","last_fullsized":"2023-11-24T08:04:59.187780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":704626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":901120,"data_stored":703607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27344,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:12.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-24T08:05:12.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-24T08:05:12.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-24T08:05:12.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-24T08:05:12.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-24T08:05:12.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-24T08:05:12.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-24T08:05:12.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-24T08:05:12.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-24T08:05:12.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-24T08:05:12.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-24T08:05:12.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-24T08:05:12.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-24T08:05:12.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-24T08:05:12.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-24T08:05:12.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-24T08:05:12.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-24T08:05:12.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-24T08:05:12.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-24T08:05:12.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-24T08:05:12.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-24T08:05:12.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-24T08:05:12.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-24T08:05:12.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-24T08:05:12.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-24T08:05:12.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-24T08:05:12.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-24T08:05:12.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-24T08:05:12.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-24T08:05:12.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-24T08:05:12.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-24T08:05:12.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-24T08:05:12.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-24T08:05:12.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-11-24T08:05:12.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-24T08:05:12.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-24T08:05:12.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-24T08:05:12.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-24T08:05:12.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-24T08:05:12.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-24T08:05:12.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-24T08:05:12.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-11-24T08:05:12.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-24T08:05:12.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-11-24T08:05:12.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-24T08:05:12.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-24T08:05:12.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-24T08:05:12.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-11-24T08:05:12.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-24T08:05:12.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-24T08:05:12.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-24T08:05:12.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-24T08:05:12.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-24T08:05:12.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-11-24T08:05:12.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-24T08:05:12.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-24T08:05:12.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-24T08:05:12.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-11-24T08:05:12.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-24T08:05:12.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-24T08:05:12.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-24T08:05:12.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-24T08:05:12.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-24T08:05:12.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-24T08:05:12.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-24T08:05:12.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-24T08:05:12.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-24T08:05:12.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-11-24T08:05:12.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-24T08:05:12.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-11-24T08:05:12.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-24T08:05:12.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-11-24T08:05:12.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-24T08:05:12.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-24T08:05:12.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-24T08:05:12.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-11-24T08:05:12.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-24T08:05:12.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-11-24T08:05:12.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-24T08:05:12.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-11-24T08:05:12.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-24T08:05:12.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-24T08:05:12.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-24T08:05:12.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-24T08:05:12.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-24T08:05:12.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-24T08:05:12.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-24T08:05:12.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-24T08:05:12.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-24T08:05:12.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-24T08:05:12.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-24T08:05:12.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-11-24T08:05:12.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-24T08:05:12.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-24T08:05:12.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-24T08:05:12.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:06.138163+0000', 'last_change': '2023-11-24T08:05:06.138163+0000', 'last_active': '2023-11-24T08:05:06.138163+0000', 'last_peered': '2023-11-24T08:05:06.138163+0000', 'last_clean': '2023-11-24T08:05:06.138163+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:06.138163+0000', 'last_undegraded': '2023-11-24T08:05:06.138163+0000', 'last_fullsized': '2023-11-24T08:05:06.138163+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:06.138163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-11-24T08:05:12.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:05:05.136171+0000', 'last_change': '2023-11-24T08:05:05.136171+0000', 'last_active': '2023-11-24T08:05:05.136171+0000', 'last_peered': '2023-11-24T08:05:05.136171+0000', 'last_clean': '2023-11-24T08:05:05.136171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:05.136171+0000', 'last_undegraded': '2023-11-24T08:05:05.136171+0000', 'last_fullsized': '2023-11-24T08:05:05.136171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:05.136171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:05:12.064 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-24T08:05:12.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.187+0000 7efe5e8d6700 1 Processor -- start 2023-11-24T08:05:12.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.187+0000 7efe5e8d6700 1 -- start start 2023-11-24T08:05:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe5e8d6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe5815bdd0 0x7efe581604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe5e8d6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe580b3370 0x7efe580b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe5e8d6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe580b2030 con 0x7efe580d1c70 2023-11-24T08:05:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe5e8d6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe580b2f50 con 0x7efe5815bdd0 2023-11-24T08:05:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe5e8d6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe580b22d0 con 0x7efe580b3370 2023-11-24T08:05:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe57fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe5815bdd0 0x7efe581604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe5ce73700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efe580d1c70 0x7efe580ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43462/0 (socket says 172.21.15.153:43462) 2023-11-24T08:05:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe5ce73700 1 -- 172.21.15.153:0/2713081540 learned_addr learned my addr 172.21.15.153:0/2713081540 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe577fe700 1 --2- 172.21.15.153:0/2713081540 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe580b3370 0x7efe580b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe57fff700 1 -- 172.21.15.153:0/2713081540 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe580b3370 msgr2=0x7efe580b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe57fff700 1 --2- 172.21.15.153:0/2713081540 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe580b3370 0x7efe580b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe57fff700 1 -- 172.21.15.153:0/2713081540 >> v1:172.21.15.153:6789/0 conn(0x7efe580d1c70 legacy=0x7efe580ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe57fff700 1 -- 172.21.15.153:0/2713081540 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe580b25b0 con 0x7efe5815bdd0 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.188+0000 7efe577fe700 1 --2- 172.21.15.153:0/2713081540 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe580b3370 0x7efe580b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe57fff700 1 --2- 172.21.15.153:0/2713081540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe5815bdd0 0x7efe581604e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efe48009840 tx=0x7efe48009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36820ea44f172443 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe56ffd700 1 -- 172.21.15.153:0/2713081540 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48011830 con 0x7efe5815bdd0 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe56ffd700 1 -- 172.21.15.153:0/2713081540 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe48011990 con 0x7efe5815bdd0 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe56ffd700 1 -- 172.21.15.153:0/2713081540 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48011d20 con 0x7efe5815bdd0 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe5e8d6700 1 -- 172.21.15.153:0/2713081540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe5815bdd0 msgr2=0x7efe581604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe5e8d6700 1 --2- 172.21.15.153:0/2713081540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe5815bdd0 0x7efe581604e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efe48009840 tx=0x7efe48009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe5e8d6700 1 -- 172.21.15.153:0/2713081540 shutdown_connections 2023-11-24T08:05:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe5e8d6700 1 --2- 172.21.15.153:0/2713081540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe5815bdd0 0x7efe581604e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe5e8d6700 1 --2- 172.21.15.153:0/2713081540 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe580b3370 0x7efe580b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe5e8d6700 1 -- 172.21.15.153:0/2713081540 >> 172.21.15.153:0/2713081540 conn(0x7efe580731a0 msgr2=0x7efe5809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe5e8d6700 1 -- 172.21.15.153:0/2713081540 shutdown_connections 2023-11-24T08:05:12.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.189+0000 7efe5e8d6700 1 -- 172.21.15.153:0/2713081540 wait complete. 2023-11-24T08:05:12.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.190+0000 7efe5e8d6700 1 Processor -- start 2023-11-24T08:05:12.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.191+0000 7efe5e8d6700 1 -- start start 2023-11-24T08:05:12.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.191+0000 7efe5e8d6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe580b3370 0x7efe581e7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.191+0000 7efe5e8d6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe580d1c70 0x7efe581e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.191+0000 7efe5e8d6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5815bdd0 0x7efe580ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.191+0000 7efe5e8d6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe580cdf10 con 0x7efe580d1c70 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.191+0000 7efe5e8d6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe580cd570 con 0x7efe580b3370 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.191+0000 7efe5e8d6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe580cd850 con 0x7efe5815bdd0 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe577fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe580d1c70 0x7efe581e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe577fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe580d1c70 0x7efe581e6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37362/0 (socket says 172.21.15.153:37362) 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe577fe700 1 -- 172.21.15.153:0/3997408501 learned_addr learned my addr 172.21.15.153:0/3997408501 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe57fff700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe580b3370 0x7efe581e7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe5ce73700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5815bdd0 0x7efe580ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe577fe700 1 -- 172.21.15.153:0/3997408501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5815bdd0 msgr2=0x7efe580ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe577fe700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5815bdd0 0x7efe580ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe577fe700 1 -- 172.21.15.153:0/3997408501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe580b3370 msgr2=0x7efe581e7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe577fe700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe580b3370 0x7efe581e7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe577fe700 1 -- 172.21.15.153:0/3997408501 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe480094a0 con 0x7efe580d1c70 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe577fe700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe580d1c70 0x7efe581e6ee0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efe4000c750 tx=0x7efe4000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe54ff9700 1 -- 172.21.15.153:0/3997408501 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40011800 con 0x7efe580d1c70 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe54ff9700 1 -- 172.21.15.153:0/3997408501 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe40011960 con 0x7efe580d1c70 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe5e8d6700 1 -- 172.21.15.153:0/3997408501 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe580cdb30 con 0x7efe580d1c70 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe54ff9700 1 -- 172.21.15.153:0/3997408501 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40011cd0 con 0x7efe580d1c70 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.192+0000 7efe5e8d6700 1 -- 172.21.15.153:0/3997408501 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe581e7420 con 0x7efe580d1c70 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.193+0000 7efe5e8d6700 1 -- 172.21.15.153:0/3997408501 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe580ce050 con 0x7efe580d1c70 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.194+0000 7efe54ff9700 1 -- 172.21.15.153:0/3997408501 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe40021350 con 0x7efe580d1c70 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.194+0000 7efe54ff9700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe3806af00 0x7efe3806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.194+0000 7efe54ff9700 1 -- 172.21.15.153:0/3997408501 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe40089570 con 0x7efe580d1c70 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.194+0000 7efe57fff700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe3806af00 0x7efe3806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.194+0000 7efe57fff700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe3806af00 0x7efe3806d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe480090b0 tx=0x7efe4801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.198+0000 7efe54ff9700 1 -- 172.21.15.153:0/3997408501 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe580ce050 con 0x7efe580d1c70 2023-11-24T08:05:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.471+0000 7efe5e8d6700 1 -- 172.21.15.153:0/3997408501 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7efe580ce050 con 0x7efe580d1c70 2023-11-24T08:05:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.472+0000 7efe54ff9700 1 -- 172.21.15.153:0/3997408501 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1559 (secure 0 0 0) 0x7efe4001e630 con 0x7efe580d1c70 2023-11-24T08:05:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:12.474 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":78,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1700813045,"num_in_osds":8,"osd_in_since":1700813036,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":225480704,"bytes_avail":772868632576,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5046}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-11-24T08:05:06.052158+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-24T08:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 -- 172.21.15.153:0/3997408501 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe3806af00 msgr2=0x7efe3806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe3806af00 0x7efe3806d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe480090b0 tx=0x7efe4801c040 comp rx=0 tx=0).stop 2023-11-24T08:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 -- 172.21.15.153:0/3997408501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe580d1c70 msgr2=0x7efe581e6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe580d1c70 0x7efe581e6ee0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efe4000c750 tx=0x7efe4000cb10 comp rx=0 tx=0).stop 2023-11-24T08:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 -- 172.21.15.153:0/3997408501 shutdown_connections 2023-11-24T08:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5815bdd0 0x7efe580ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe580b3370 0x7efe581e7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe3806af00 0x7efe3806d3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 --2- 172.21.15.153:0/3997408501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe580d1c70 0x7efe581e6ee0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 -- 172.21.15.153:0/3997408501 >> 172.21.15.153:0/3997408501 conn(0x7efe580731a0 msgr2=0x7efe58159d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 -- 172.21.15.153:0/3997408501 shutdown_connections 2023-11-24T08:05:12.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.474+0000 7efe5e8d6700 1 -- 172.21.15.153:0/3997408501 wait complete. 2023-11-24T08:05:12.488 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-24T08:05:12.488 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:12.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.608+0000 7f224b153700 1 Processor -- start 2023-11-24T08:05:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.608+0000 7f224b153700 1 -- start start 2023-11-24T08:05:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.608+0000 7f224b153700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f224415e080 0x7f22440b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.608+0000 7f224b153700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f224406c710 0x7f22440afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.608+0000 7f224b153700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22440ae430 con 0x7f22440af4d0 2023-11-24T08:05:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.608+0000 7f224b153700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22440af0b0 con 0x7f224415e080 2023-11-24T08:05:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.608+0000 7f224b153700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22440b05a0 con 0x7f224406c710 2023-11-24T08:05:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.609+0000 7f2248eef700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f224415e080 0x7f22440b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.609+0000 7f2243fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f22440af4d0 0x7f224406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43472/0 (socket says 172.21.15.153:43472) 2023-11-24T08:05:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.609+0000 7f2243fff700 1 -- 172.21.15.153:0/1420593257 learned_addr learned my addr 172.21.15.153:0/1420593257 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.609+0000 7f2248eef700 1 -- 172.21.15.153:0/1420593257 >> v2:172.21.15.164:3300/0 conn(0x7f224406c710 msgr2=0x7f22440afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.609+0000 7f2248eef700 1 --2- 172.21.15.153:0/1420593257 >> v2:172.21.15.164:3300/0 conn(0x7f224406c710 0x7f22440afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.609+0000 7f2248eef700 1 -- 172.21.15.153:0/1420593257 >> v1:172.21.15.153:6789/0 conn(0x7f22440af4d0 legacy=0x7f224406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.609+0000 7f2248eef700 1 -- 172.21.15.153:0/1420593257 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440ae710 con 0x7f224415e080 2023-11-24T08:05:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.609+0000 7f2248eef700 1 --2- 172.21.15.153:0/1420593257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f224415e080 0x7f22440b5050 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f224406e060 tx=0x7f2238009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5749f8ac15a44c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.609+0000 7f22437fe700 1 -- 172.21.15.153:0/1420593257 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238011830 con 0x7f224415e080 2023-11-24T08:05:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.609+0000 7f22437fe700 1 -- 172.21.15.153:0/1420593257 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2238011990 con 0x7f224415e080 2023-11-24T08:05:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.609+0000 7f22437fe700 1 -- 172.21.15.153:0/1420593257 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238011d20 con 0x7f224415e080 2023-11-24T08:05:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.610+0000 7f224b153700 1 -- 172.21.15.153:0/1420593257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f224415e080 msgr2=0x7f22440b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.610+0000 7f224b153700 1 --2- 172.21.15.153:0/1420593257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f224415e080 0x7f22440b5050 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f224406e060 tx=0x7f2238009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.610+0000 7f224b153700 1 -- 172.21.15.153:0/1420593257 shutdown_connections 2023-11-24T08:05:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.610+0000 7f224b153700 1 --2- 172.21.15.153:0/1420593257 >> v2:172.21.15.164:3300/0 conn(0x7f224406c710 0x7f22440afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.610+0000 7f224b153700 1 --2- 172.21.15.153:0/1420593257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f224415e080 0x7f22440b5050 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.610+0000 7f224b153700 1 -- 172.21.15.153:0/1420593257 >> 172.21.15.153:0/1420593257 conn(0x7f2244071b90 msgr2=0x7f2244071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.610+0000 7f224b153700 1 -- 172.21.15.153:0/1420593257 shutdown_connections 2023-11-24T08:05:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.610+0000 7f224b153700 1 -- 172.21.15.153:0/1420593257 wait complete. 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.611+0000 7f224b153700 1 Processor -- start 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.611+0000 7f224b153700 1 -- start start 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.612+0000 7f224b153700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f224406c710 0x7f2244153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.612+0000 7f224b153700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22440af4d0 0x7f2244153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.612+0000 7f224b153700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f224415e080 0x7f224414a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.612+0000 7f224b153700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22441543c0 con 0x7f224406c710 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.612+0000 7f224b153700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2244154660 con 0x7f224415e080 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.612+0000 7f224b153700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2244154940 con 0x7f22440af4d0 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.612+0000 7f2248eef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f224406c710 0x7f2244153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.612+0000 7f2248eef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f224406c710 0x7f2244153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37374/0 (socket says 172.21.15.153:37374) 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.612+0000 7f2248eef700 1 -- 172.21.15.153:0/755738366 learned_addr learned my addr 172.21.15.153:0/755738366 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f2243fff700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22440af4d0 0x7f2244153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f22496f0700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f224415e080 0x7f224414a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f2248eef700 1 -- 172.21.15.153:0/755738366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22440af4d0 msgr2=0x7f2244153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f2248eef700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22440af4d0 0x7f2244153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f2248eef700 1 -- 172.21.15.153:0/755738366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f224415e080 msgr2=0x7f224414a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f2248eef700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f224415e080 0x7f224414a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f2248eef700 1 -- 172.21.15.153:0/755738366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22380094a0 con 0x7f224406c710 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f2243fff700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22440af4d0 0x7f2244153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f22496f0700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f224415e080 0x7f224414a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f2248eef700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f224406c710 0x7f2244153870 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2238014040 tx=0x7f2238004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f22417fa700 1 -- 172.21.15.153:0/755738366 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380045f0 con 0x7f224406c710 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f22417fa700 1 -- 172.21.15.153:0/755738366 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223801e070 con 0x7f224406c710 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f22417fa700 1 -- 172.21.15.153:0/755738366 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238003b00 con 0x7f224406c710 2023-11-24T08:05:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f224b153700 1 -- 172.21.15.153:0/755738366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2244154c20 con 0x7f224406c710 2023-11-24T08:05:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.613+0000 7f224b153700 1 -- 172.21.15.153:0/755738366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22441551e0 con 0x7f224406c710 2023-11-24T08:05:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.614+0000 7f224b153700 1 -- 172.21.15.153:0/755738366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22440753f0 con 0x7f224406c710 2023-11-24T08:05:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.615+0000 7f22417fa700 1 -- 172.21.15.153:0/755738366 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2238003c60 con 0x7f224406c710 2023-11-24T08:05:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.615+0000 7f22417fa700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f222806aed0 0x7f222806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.615+0000 7f22417fa700 1 -- 172.21.15.153:0/755738366 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f223808a720 con 0x7f224406c710 2023-11-24T08:05:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.615+0000 7f2243fff700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f222806aed0 0x7f222806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.616+0000 7f2243fff700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f222806aed0 0x7f222806d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f224406b9d0 tx=0x7f2230009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.620+0000 7f22417fa700 1 -- 172.21.15.153:0/755738366 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2238055860 con 0x7f224406c710 2023-11-24T08:05:12.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.806+0000 7f224b153700 1 -- 172.21.15.153:0/755738366 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22440aecd0 con 0x7f222806aed0 2023-11-24T08:05:12.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.814+0000 7f22417fa700 1 -- 172.21.15.153:0/755738366 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288864 (secure 0 0 0) 0x7f2230005960 con 0x7f222806aed0 2023-11-24T08:05:12.819 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:12.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 -- 172.21.15.153:0/755738366 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f222806aed0 msgr2=0x7f222806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f222806aed0 0x7f222806d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f224406b9d0 tx=0x7f2230009040 comp rx=0 tx=0).stop 2023-11-24T08:05:12.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 -- 172.21.15.153:0/755738366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f224406c710 msgr2=0x7f2244153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f224406c710 0x7f2244153870 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2238014040 tx=0x7f2238004750 comp rx=0 tx=0).stop 2023-11-24T08:05:12.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 -- 172.21.15.153:0/755738366 shutdown_connections 2023-11-24T08:05:12.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f224415e080 0x7f224414a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f222806aed0 0x7f222806d390 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f224406c710 0x7f2244153870 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 --2- 172.21.15.153:0/755738366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22440af4d0 0x7f2244153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 -- 172.21.15.153:0/755738366 >> 172.21.15.153:0/755738366 conn(0x7f2244071b90 msgr2=0x7f22440b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 -- 172.21.15.153:0/755738366 shutdown_connections 2023-11-24T08:05:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:12.817+0000 7f224b153700 1 -- 172.21.15.153:0/755738366 wait complete. 2023-11-24T08:05:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:05:12.831 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-11-24T08:05:12.053197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220196,"kb_used_data":4012,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754524,"statfs":{"total":773094113280,"available":772868632576,"internally_reserved":0,"allocated":4108288,"data_stored":2287273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001099"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866109+0000","last_change":"2023-11-24T08:05:07.170588+0000","last_active":"2023-11-24T08:05:09.866109+0000","last_peered":"2023-11-24T08:05:09.866109+0000","last_clean":"2023-11-24T08:05:09.866109+0000","last_became_active":"2023-11-24T08:05:07.170314+0000","last_became_peered":"2023-11-24T08:05:07.170314+0000","last_unstale":"2023-11-24T08:05:09.866109+0000","last_undegraded":"2023-11-24T08:05:09.866109+0000","last_fullsized":"2023-11-24T08:05:09.866109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:49:51.782544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165331+0000","last_change":"2023-11-24T08:05:07.179168+0000","last_active":"2023-11-24T08:05:08.165331+0000","last_peered":"2023-11-24T08:05:08.165331+0000","last_clean":"2023-11-24T08:05:08.165331+0000","last_became_active":"2023-11-24T08:05:07.178869+0000","last_became_peered":"2023-11-24T08:05:07.178869+0000","last_unstale":"2023-11-24T08:05:08.165331+0000","last_undegraded":"2023-11-24T08:05:08.165331+0000","last_fullsized":"2023-11-24T08:05:08.165331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:58:37.801404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165850+0000","last_change":"2023-11-24T08:05:07.170997+0000","last_active":"2023-11-24T08:05:08.165850+0000","last_peered":"2023-11-24T08:05:08.165850+0000","last_clean":"2023-11-24T08:05:08.165850+0000","last_became_active":"2023-11-24T08:05:07.170390+0000","last_became_peered":"2023-11-24T08:05:07.170390+0000","last_unstale":"2023-11-24T08:05:08.165850+0000","last_undegraded":"2023-11-24T08:05:08.165850+0000","last_fullsized":"2023-11-24T08:05:08.165850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:02.029814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744751+0000","last_change":"2023-11-24T08:05:07.175543+0000","last_active":"2023-11-24T08:05:08.744751+0000","last_peered":"2023-11-24T08:05:08.744751+0000","last_clean":"2023-11-24T08:05:08.744751+0000","last_became_active":"2023-11-24T08:05:07.174950+0000","last_became_peered":"2023-11-24T08:05:07.174950+0000","last_unstale":"2023-11-24T08:05:08.744751+0000","last_undegraded":"2023-11-24T08:05:08.744751+0000","last_fullsized":"2023-11-24T08:05:08.744751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:29.914282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365032+0000","last_change":"2023-11-24T08:05:07.173644+0000","last_active":"2023-11-24T08:05:09.365032+0000","last_peered":"2023-11-24T08:05:09.365032+0000","last_clean":"2023-11-24T08:05:09.365032+0000","last_became_active":"2023-11-24T08:05:07.173357+0000","last_became_peered":"2023-11-24T08:05:07.173357+0000","last_unstale":"2023-11-24T08:05:09.365032+0000","last_undegraded":"2023-11-24T08:05:09.365032+0000","last_fullsized":"2023-11-24T08:05:09.365032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:26.847661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164590+0000","last_change":"2023-11-24T08:05:07.180220+0000","last_active":"2023-11-24T08:05:08.164590+0000","last_peered":"2023-11-24T08:05:08.164590+0000","last_clean":"2023-11-24T08:05:08.164590+0000","last_became_active":"2023-11-24T08:05:07.179908+0000","last_became_peered":"2023-11-24T08:05:07.179908+0000","last_unstale":"2023-11-24T08:05:08.164590+0000","last_undegraded":"2023-11-24T08:05:08.164590+0000","last_fullsized":"2023-11-24T08:05:08.164590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:19.944842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866283+0000","last_change":"2023-11-24T08:05:07.174887+0000","last_active":"2023-11-24T08:05:09.866283+0000","last_peered":"2023-11-24T08:05:09.866283+0000","last_clean":"2023-11-24T08:05:09.866283+0000","last_became_active":"2023-11-24T08:05:07.174540+0000","last_became_peered":"2023-11-24T08:05:07.174540+0000","last_unstale":"2023-11-24T08:05:09.866283+0000","last_undegraded":"2023-11-24T08:05:09.866283+0000","last_fullsized":"2023-11-24T08:05:09.866283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:10:29.803093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.865747+0000","last_change":"2023-11-24T08:05:07.171307+0000","last_active":"2023-11-24T08:05:09.865747+0000","last_peered":"2023-11-24T08:05:09.865747+0000","last_clean":"2023-11-24T08:05:09.865747+0000","last_became_active":"2023-11-24T08:05:07.169588+0000","last_became_peered":"2023-11-24T08:05:07.169588+0000","last_unstale":"2023-11-24T08:05:09.865747+0000","last_undegraded":"2023-11-24T08:05:09.865747+0000","last_fullsized":"2023-11-24T08:05:09.865747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:03:43.888603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.491065+0000","last_change":"2023-11-24T08:05:07.165131+0000","last_active":"2023-11-24T08:05:08.491065+0000","last_peered":"2023-11-24T08:05:08.491065+0000","last_clean":"2023-11-24T08:05:08.491065+0000","last_became_active":"2023-11-24T08:05:07.164828+0000","last_became_peered":"2023-11-24T08:05:07.164828+0000","last_unstale":"2023-11-24T08:05:08.491065+0000","last_undegraded":"2023-11-24T08:05:08.491065+0000","last_fullsized":"2023-11-24T08:05:08.491065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:44.742619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745001+0000","last_change":"2023-11-24T08:05:07.172919+0000","last_active":"2023-11-24T08:05:08.745001+0000","last_peered":"2023-11-24T08:05:08.745001+0000","last_clean":"2023-11-24T08:05:08.745001+0000","last_became_active":"2023-11-24T08:05:07.172665+0000","last_became_peered":"2023-11-24T08:05:07.172665+0000","last_unstale":"2023-11-24T08:05:08.745001+0000","last_undegraded":"2023-11-24T08:05:08.745001+0000","last_fullsized":"2023-11-24T08:05:08.745001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:52.831778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866557+0000","last_change":"2023-11-24T08:05:07.170757+0000","last_active":"2023-11-24T08:05:09.866557+0000","last_peered":"2023-11-24T08:05:09.866557+0000","last_clean":"2023-11-24T08:05:09.866557+0000","last_became_active":"2023-11-24T08:05:07.170374+0000","last_became_peered":"2023-11-24T08:05:07.170374+0000","last_unstale":"2023-11-24T08:05:09.866557+0000","last_undegraded":"2023-11-24T08:05:09.866557+0000","last_fullsized":"2023-11-24T08:05:09.866557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:15.963017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165938+0000","last_change":"2023-11-24T08:05:07.171929+0000","last_active":"2023-11-24T08:05:08.165938+0000","last_peered":"2023-11-24T08:05:08.165938+0000","last_clean":"2023-11-24T08:05:08.165938+0000","last_became_active":"2023-11-24T08:05:07.171623+0000","last_became_peered":"2023-11-24T08:05:07.171623+0000","last_unstale":"2023-11-24T08:05:08.165938+0000","last_undegraded":"2023-11-24T08:05:08.165938+0000","last_fullsized":"2023-11-24T08:05:08.165938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:15.963017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365159+0000","last_change":"2023-11-24T08:05:07.164579+0000","last_active":"2023-11-24T08:05:09.365159+0000","last_peered":"2023-11-24T08:05:09.365159+0000","last_clean":"2023-11-24T08:05:09.365159+0000","last_became_active":"2023-11-24T08:05:07.164257+0000","last_became_peered":"2023-11-24T08:05:07.164257+0000","last_unstale":"2023-11-24T08:05:09.365159+0000","last_undegraded":"2023-11-24T08:05:09.365159+0000","last_fullsized":"2023-11-24T08:05:09.365159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:35.189913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164650+0000","last_change":"2023-11-24T08:05:07.170150+0000","last_active":"2023-11-24T08:05:08.164650+0000","last_peered":"2023-11-24T08:05:08.164650+0000","last_clean":"2023-11-24T08:05:08.164650+0000","last_became_active":"2023-11-24T08:05:07.169825+0000","last_became_peered":"2023-11-24T08:05:07.169825+0000","last_unstale":"2023-11-24T08:05:08.164650+0000","last_undegraded":"2023-11-24T08:05:08.164650+0000","last_fullsized":"2023-11-24T08:05:08.164650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:15.963017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165511+0000","last_change":"2023-11-24T08:05:07.173529+0000","last_active":"2023-11-24T08:05:08.165511+0000","last_peered":"2023-11-24T08:05:08.165511+0000","last_clean":"2023-11-24T08:05:08.165511+0000","last_became_active":"2023-11-24T08:05:07.173265+0000","last_became_peered":"2023-11-24T08:05:07.173265+0000","last_unstale":"2023-11-24T08:05:08.165511+0000","last_undegraded":"2023-11-24T08:05:08.165511+0000","last_fullsized":"2023-11-24T08:05:08.165511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:10:29.803093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.865900+0000","last_change":"2023-11-24T08:05:07.171202+0000","last_active":"2023-11-24T08:05:09.865900+0000","last_peered":"2023-11-24T08:05:09.865900+0000","last_clean":"2023-11-24T08:05:09.865900+0000","last_became_active":"2023-11-24T08:05:07.170929+0000","last_became_peered":"2023-11-24T08:05:07.170929+0000","last_unstale":"2023-11-24T08:05:09.865900+0000","last_undegraded":"2023-11-24T08:05:09.865900+0000","last_fullsized":"2023-11-24T08:05:09.865900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:46.925963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866708+0000","last_change":"2023-11-24T08:05:07.174400+0000","last_active":"2023-11-24T08:05:09.866708+0000","last_peered":"2023-11-24T08:05:09.866708+0000","last_clean":"2023-11-24T08:05:09.866708+0000","last_became_active":"2023-11-24T08:05:07.174119+0000","last_became_peered":"2023-11-24T08:05:07.174119+0000","last_unstale":"2023-11-24T08:05:09.866708+0000","last_undegraded":"2023-11-24T08:05:09.866708+0000","last_fullsized":"2023-11-24T08:05:09.866708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:44:29.767456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165451+0000","last_change":"2023-11-24T08:05:07.179706+0000","last_active":"2023-11-24T08:05:08.165451+0000","last_peered":"2023-11-24T08:05:08.165451+0000","last_clean":"2023-11-24T08:05:08.165451+0000","last_became_active":"2023-11-24T08:05:07.178584+0000","last_became_peered":"2023-11-24T08:05:07.178584+0000","last_unstale":"2023-11-24T08:05:08.165451+0000","last_undegraded":"2023-11-24T08:05:08.165451+0000","last_fullsized":"2023-11-24T08:05:08.165451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:34.482131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165024+0000","last_change":"2023-11-24T08:05:07.179428+0000","last_active":"2023-11-24T08:05:08.165024+0000","last_peered":"2023-11-24T08:05:08.165024+0000","last_clean":"2023-11-24T08:05:08.165024+0000","last_became_active":"2023-11-24T08:05:07.178444+0000","last_became_peered":"2023-11-24T08:05:07.178444+0000","last_unstale":"2023-11-24T08:05:08.165024+0000","last_undegraded":"2023-11-24T08:05:08.165024+0000","last_fullsized":"2023-11-24T08:05:08.165024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:32:16.566917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365196+0000","last_change":"2023-11-24T08:05:07.164250+0000","last_active":"2023-11-24T08:05:09.365196+0000","last_peered":"2023-11-24T08:05:09.365196+0000","last_clean":"2023-11-24T08:05:09.365196+0000","last_became_active":"2023-11-24T08:05:07.163270+0000","last_became_peered":"2023-11-24T08:05:07.163270+0000","last_unstale":"2023-11-24T08:05:09.365196+0000","last_undegraded":"2023-11-24T08:05:09.365196+0000","last_fullsized":"2023-11-24T08:05:09.365196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:58.407712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490710+0000","last_change":"2023-11-24T08:05:07.164929+0000","last_active":"2023-11-24T08:05:08.490710+0000","last_peered":"2023-11-24T08:05:08.490710+0000","last_clean":"2023-11-24T08:05:08.490710+0000","last_became_active":"2023-11-24T08:05:07.164629+0000","last_became_peered":"2023-11-24T08:05:07.164629+0000","last_unstale":"2023-11-24T08:05:08.490710+0000","last_undegraded":"2023-11-24T08:05:08.490710+0000","last_fullsized":"2023-11-24T08:05:08.490710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:00.992778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490844+0000","last_change":"2023-11-24T08:05:07.171031+0000","last_active":"2023-11-24T08:05:08.490844+0000","last_peered":"2023-11-24T08:05:08.490844+0000","last_clean":"2023-11-24T08:05:08.490844+0000","last_became_active":"2023-11-24T08:05:07.170715+0000","last_became_peered":"2023-11-24T08:05:07.170715+0000","last_unstale":"2023-11-24T08:05:08.490844+0000","last_undegraded":"2023-11-24T08:05:08.490844+0000","last_fullsized":"2023-11-24T08:05:08.490844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:38.062624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742589+0000","last_change":"2023-11-24T08:05:07.162297+0000","last_active":"2023-11-24T08:05:08.742589+0000","last_peered":"2023-11-24T08:05:08.742589+0000","last_clean":"2023-11-24T08:05:08.742589+0000","last_became_active":"2023-11-24T08:05:07.162001+0000","last_became_peered":"2023-11-24T08:05:07.162001+0000","last_unstale":"2023-11-24T08:05:08.742589+0000","last_undegraded":"2023-11-24T08:05:08.742589+0000","last_fullsized":"2023-11-24T08:05:08.742589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:01:29.259922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165398+0000","last_change":"2023-11-24T08:05:07.174013+0000","last_active":"2023-11-24T08:05:08.165398+0000","last_peered":"2023-11-24T08:05:08.165398+0000","last_clean":"2023-11-24T08:05:08.165398+0000","last_became_active":"2023-11-24T08:05:07.171792+0000","last_became_peered":"2023-11-24T08:05:07.171792+0000","last_unstale":"2023-11-24T08:05:08.165398+0000","last_undegraded":"2023-11-24T08:05:08.165398+0000","last_fullsized":"2023-11-24T08:05:08.165398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:09.842863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745099+0000","last_change":"2023-11-24T08:05:07.165158+0000","last_active":"2023-11-24T08:05:08.745099+0000","last_peered":"2023-11-24T08:05:08.745099+0000","last_clean":"2023-11-24T08:05:08.745099+0000","last_became_active":"2023-11-24T08:05:07.164887+0000","last_became_peered":"2023-11-24T08:05:07.164887+0000","last_unstale":"2023-11-24T08:05:08.745099+0000","last_undegraded":"2023-11-24T08:05:08.745099+0000","last_fullsized":"2023-11-24T08:05:08.745099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:03:43.888603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165573+0000","last_change":"2023-11-24T08:05:07.171835+0000","last_active":"2023-11-24T08:05:08.165573+0000","last_peered":"2023-11-24T08:05:08.165573+0000","last_clean":"2023-11-24T08:05:08.165573+0000","last_became_active":"2023-11-24T08:05:07.169844+0000","last_became_peered":"2023-11-24T08:05:07.169844+0000","last_unstale":"2023-11-24T08:05:08.165573+0000","last_undegraded":"2023-11-24T08:05:08.165573+0000","last_fullsized":"2023-11-24T08:05:08.165573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:48:05.724245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745091+0000","last_change":"2023-11-24T08:05:07.174469+0000","last_active":"2023-11-24T08:05:08.745091+0000","last_peered":"2023-11-24T08:05:08.745091+0000","last_clean":"2023-11-24T08:05:08.745091+0000","last_became_active":"2023-11-24T08:05:07.174179+0000","last_became_peered":"2023-11-24T08:05:07.174179+0000","last_unstale":"2023-11-24T08:05:08.745091+0000","last_undegraded":"2023-11-24T08:05:08.745091+0000","last_fullsized":"2023-11-24T08:05:08.745091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:37.811909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165782+0000","last_change":"2023-11-24T08:05:07.170828+0000","last_active":"2023-11-24T08:05:08.165782+0000","last_peered":"2023-11-24T08:05:08.165782+0000","last_clean":"2023-11-24T08:05:08.165782+0000","last_became_active":"2023-11-24T08:05:07.170546+0000","last_became_peered":"2023-11-24T08:05:07.170546+0000","last_unstale":"2023-11-24T08:05:08.165782+0000","last_undegraded":"2023-11-24T08:05:08.165782+0000","last_fullsized":"2023-11-24T08:05:08.165782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:19.944842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.491074+0000","last_change":"2023-11-24T08:05:07.168952+0000","last_active":"2023-11-24T08:05:08.491074+0000","last_peered":"2023-11-24T08:05:08.491074+0000","last_clean":"2023-11-24T08:05:08.491074+0000","last_became_active":"2023-11-24T08:05:07.168668+0000","last_became_peered":"2023-11-24T08:05:07.168668+0000","last_unstale":"2023-11-24T08:05:08.491074+0000","last_undegraded":"2023-11-24T08:05:08.491074+0000","last_fullsized":"2023-11-24T08:05:08.491074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:37.811909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866282+0000","last_change":"2023-11-24T08:05:07.171639+0000","last_active":"2023-11-24T08:05:09.866282+0000","last_peered":"2023-11-24T08:05:09.866282+0000","last_clean":"2023-11-24T08:05:09.866282+0000","last_became_active":"2023-11-24T08:05:07.171198+0000","last_became_peered":"2023-11-24T08:05:07.171198+0000","last_unstale":"2023-11-24T08:05:09.866282+0000","last_undegraded":"2023-11-24T08:05:09.866282+0000","last_fullsized":"2023-11-24T08:05:09.866282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:09.842863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866102+0000","last_change":"2023-11-24T08:05:07.165764+0000","last_active":"2023-11-24T08:05:09.866102+0000","last_peered":"2023-11-24T08:05:09.866102+0000","last_clean":"2023-11-24T08:05:09.866102+0000","last_became_active":"2023-11-24T08:05:07.165485+0000","last_became_peered":"2023-11-24T08:05:07.165485+0000","last_unstale":"2023-11-24T08:05:09.866102+0000","last_undegraded":"2023-11-24T08:05:09.866102+0000","last_fullsized":"2023-11-24T08:05:09.866102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:54.075211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866216+0000","last_change":"2023-11-24T08:05:07.174096+0000","last_active":"2023-11-24T08:05:09.866216+0000","last_peered":"2023-11-24T08:05:09.866216+0000","last_clean":"2023-11-24T08:05:09.866216+0000","last_became_active":"2023-11-24T08:05:07.173646+0000","last_became_peered":"2023-11-24T08:05:07.173646+0000","last_unstale":"2023-11-24T08:05:09.866216+0000","last_undegraded":"2023-11-24T08:05:09.866216+0000","last_fullsized":"2023-11-24T08:05:09.866216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:10.497691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742710+0000","last_change":"2023-11-24T08:05:07.173298+0000","last_active":"2023-11-24T08:05:08.742710+0000","last_peered":"2023-11-24T08:05:08.742710+0000","last_clean":"2023-11-24T08:05:08.742710+0000","last_became_active":"2023-11-24T08:05:07.173030+0000","last_became_peered":"2023-11-24T08:05:07.173030+0000","last_unstale":"2023-11-24T08:05:08.742710+0000","last_undegraded":"2023-11-24T08:05:08.742710+0000","last_fullsized":"2023-11-24T08:05:08.742710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:12:42.888692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866212+0000","last_change":"2023-11-24T08:05:06.167366+0000","last_active":"2023-11-24T08:05:09.866212+0000","last_peered":"2023-11-24T08:05:09.866212+0000","last_clean":"2023-11-24T08:05:09.866212+0000","last_became_active":"2023-11-24T08:05:06.167081+0000","last_became_peered":"2023-11-24T08:05:06.167081+0000","last_unstale":"2023-11-24T08:05:09.866212+0000","last_undegraded":"2023-11-24T08:05:09.866212+0000","last_fullsized":"2023-11-24T08:05:09.866212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:34.187921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866338+0000","last_change":"2023-11-24T08:05:07.172862+0000","last_active":"2023-11-24T08:05:09.866338+0000","last_peered":"2023-11-24T08:05:09.866338+0000","last_clean":"2023-11-24T08:05:09.866338+0000","last_became_active":"2023-11-24T08:05:07.172488+0000","last_became_peered":"2023-11-24T08:05:07.172488+0000","last_unstale":"2023-11-24T08:05:09.866338+0000","last_undegraded":"2023-11-24T08:05:09.866338+0000","last_fullsized":"2023-11-24T08:05:09.866338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:12.752555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742705+0000","last_change":"2023-11-24T08:05:06.170698+0000","last_active":"2023-11-24T08:05:08.742705+0000","last_peered":"2023-11-24T08:05:08.742705+0000","last_clean":"2023-11-24T08:05:08.742705+0000","last_became_active":"2023-11-24T08:05:06.170478+0000","last_became_peered":"2023-11-24T08:05:06.170478+0000","last_unstale":"2023-11-24T08:05:08.742705+0000","last_undegraded":"2023-11-24T08:05:08.742705+0000","last_fullsized":"2023-11-24T08:05:08.742705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:40.881550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490848+0000","last_change":"2023-11-24T08:05:07.168994+0000","last_active":"2023-11-24T08:05:08.490848+0000","last_peered":"2023-11-24T08:05:08.490848+0000","last_clean":"2023-11-24T08:05:08.490848+0000","last_became_active":"2023-11-24T08:05:07.168704+0000","last_became_peered":"2023-11-24T08:05:07.168704+0000","last_unstale":"2023-11-24T08:05:08.490848+0000","last_undegraded":"2023-11-24T08:05:08.490848+0000","last_fullsized":"2023-11-24T08:05:08.490848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:52.831778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165004+0000","last_change":"2023-11-24T08:05:06.170071+0000","last_active":"2023-11-24T08:05:08.165004+0000","last_peered":"2023-11-24T08:05:08.165004+0000","last_clean":"2023-11-24T08:05:08.165004+0000","last_became_active":"2023-11-24T08:05:06.169708+0000","last_became_peered":"2023-11-24T08:05:06.169708+0000","last_unstale":"2023-11-24T08:05:08.165004+0000","last_undegraded":"2023-11-24T08:05:08.165004+0000","last_fullsized":"2023-11-24T08:05:08.165004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:36.809916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745043+0000","last_change":"2023-11-24T08:05:07.174490+0000","last_active":"2023-11-24T08:05:08.745043+0000","last_peered":"2023-11-24T08:05:08.745043+0000","last_clean":"2023-11-24T08:05:08.745043+0000","last_became_active":"2023-11-24T08:05:07.174305+0000","last_became_peered":"2023-11-24T08:05:07.174305+0000","last_unstale":"2023-11-24T08:05:08.745043+0000","last_undegraded":"2023-11-24T08:05:08.745043+0000","last_fullsized":"2023-11-24T08:05:08.745043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:44.742619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365121+0000","last_change":"2023-11-24T08:05:06.167696+0000","last_active":"2023-11-24T08:05:09.365121+0000","last_peered":"2023-11-24T08:05:09.365121+0000","last_clean":"2023-11-24T08:05:09.365121+0000","last_became_active":"2023-11-24T08:05:06.167431+0000","last_became_peered":"2023-11-24T08:05:06.167431+0000","last_unstale":"2023-11-24T08:05:09.365121+0000","last_undegraded":"2023-11-24T08:05:09.365121+0000","last_fullsized":"2023-11-24T08:05:09.365121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:37.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866431+0000","last_change":"2023-11-24T08:05:07.173898+0000","last_active":"2023-11-24T08:05:09.866431+0000","last_peered":"2023-11-24T08:05:09.866431+0000","last_clean":"2023-11-24T08:05:09.866431+0000","last_became_active":"2023-11-24T08:05:07.173605+0000","last_became_peered":"2023-11-24T08:05:07.173605+0000","last_unstale":"2023-11-24T08:05:09.866431+0000","last_undegraded":"2023-11-24T08:05:09.866431+0000","last_fullsized":"2023-11-24T08:05:09.866431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:49.608429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.491061+0000","last_change":"2023-11-24T08:05:06.166255+0000","last_active":"2023-11-24T08:05:08.491061+0000","last_peered":"2023-11-24T08:05:08.491061+0000","last_clean":"2023-11-24T08:05:08.491061+0000","last_became_active":"2023-11-24T08:05:06.165979+0000","last_became_peered":"2023-11-24T08:05:06.165979+0000","last_unstale":"2023-11-24T08:05:08.491061+0000","last_undegraded":"2023-11-24T08:05:08.491061+0000","last_fullsized":"2023-11-24T08:05:08.491061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:40.881550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165566+0000","last_change":"2023-11-24T08:05:07.178460+0000","last_active":"2023-11-24T08:05:08.165566+0000","last_peered":"2023-11-24T08:05:08.165566+0000","last_clean":"2023-11-24T08:05:08.165566+0000","last_became_active":"2023-11-24T08:05:07.178190+0000","last_became_peered":"2023-11-24T08:05:07.178190+0000","last_unstale":"2023-11-24T08:05:08.165566+0000","last_undegraded":"2023-11-24T08:05:08.165566+0000","last_fullsized":"2023-11-24T08:05:08.165566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:49.608429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490720+0000","last_change":"2023-11-24T08:05:06.165062+0000","last_active":"2023-11-24T08:05:08.490720+0000","last_peered":"2023-11-24T08:05:08.490720+0000","last_clean":"2023-11-24T08:05:08.490720+0000","last_became_active":"2023-11-24T08:05:06.164791+0000","last_became_peered":"2023-11-24T08:05:06.164791+0000","last_unstale":"2023-11-24T08:05:08.490720+0000","last_undegraded":"2023-11-24T08:05:08.490720+0000","last_fullsized":"2023-11-24T08:05:08.490720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:01:28.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490616+0000","last_change":"2023-11-24T08:05:07.165720+0000","last_active":"2023-11-24T08:05:08.490616+0000","last_peered":"2023-11-24T08:05:08.490616+0000","last_clean":"2023-11-24T08:05:08.490616+0000","last_became_active":"2023-11-24T08:05:07.165448+0000","last_became_peered":"2023-11-24T08:05:07.165448+0000","last_unstale":"2023-11-24T08:05:08.490616+0000","last_undegraded":"2023-11-24T08:05:08.490616+0000","last_fullsized":"2023-11-24T08:05:08.490616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:02.279227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164435+0000","last_change":"2023-11-24T08:05:06.165355+0000","last_active":"2023-11-24T08:05:08.164435+0000","last_peered":"2023-11-24T08:05:08.164435+0000","last_clean":"2023-11-24T08:05:08.164435+0000","last_became_active":"2023-11-24T08:05:06.165104+0000","last_became_peered":"2023-11-24T08:05:06.165104+0000","last_unstale":"2023-11-24T08:05:08.164435+0000","last_undegraded":"2023-11-24T08:05:08.164435+0000","last_fullsized":"2023-11-24T08:05:08.164435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:43.740627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744625+0000","last_change":"2023-11-24T08:05:07.171234+0000","last_active":"2023-11-24T08:05:08.744625+0000","last_peered":"2023-11-24T08:05:08.744625+0000","last_clean":"2023-11-24T08:05:08.744625+0000","last_became_active":"2023-11-24T08:05:07.170960+0000","last_became_peered":"2023-11-24T08:05:07.170960+0000","last_unstale":"2023-11-24T08:05:08.744625+0000","last_undegraded":"2023-11-24T08:05:08.744625+0000","last_fullsized":"2023-11-24T08:05:08.744625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:02.279227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490548+0000","last_change":"2023-11-24T08:05:06.161319+0000","last_active":"2023-11-24T08:05:08.490548+0000","last_peered":"2023-11-24T08:05:08.490548+0000","last_clean":"2023-11-24T08:05:08.490548+0000","last_became_active":"2023-11-24T08:05:06.161038+0000","last_became_peered":"2023-11-24T08:05:06.161038+0000","last_unstale":"2023-11-24T08:05:08.490548+0000","last_undegraded":"2023-11-24T08:05:08.490548+0000","last_fullsized":"2023-11-24T08:05:08.490548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:31.490738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.166109+0000","last_change":"2023-11-24T08:05:07.180747+0000","last_active":"2023-11-24T08:05:08.166109+0000","last_peered":"2023-11-24T08:05:08.166109+0000","last_clean":"2023-11-24T08:05:08.166109+0000","last_became_active":"2023-11-24T08:05:07.180497+0000","last_became_peered":"2023-11-24T08:05:07.180497+0000","last_unstale":"2023-11-24T08:05:08.166109+0000","last_undegraded":"2023-11-24T08:05:08.166109+0000","last_fullsized":"2023-11-24T08:05:08.166109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:44:29.767456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165073+0000","last_change":"2023-11-24T08:05:06.170829+0000","last_active":"2023-11-24T08:05:08.165073+0000","last_peered":"2023-11-24T08:05:08.165073+0000","last_clean":"2023-11-24T08:05:08.165073+0000","last_became_active":"2023-11-24T08:05:06.170437+0000","last_became_peered":"2023-11-24T08:05:06.170437+0000","last_unstale":"2023-11-24T08:05:08.165073+0000","last_undegraded":"2023-11-24T08:05:08.165073+0000","last_fullsized":"2023-11-24T08:05:08.165073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:09.495698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165115+0000","last_change":"2023-11-24T08:05:07.168921+0000","last_active":"2023-11-24T08:05:08.165115+0000","last_peered":"2023-11-24T08:05:08.165115+0000","last_clean":"2023-11-24T08:05:08.165115+0000","last_became_active":"2023-11-24T08:05:07.168509+0000","last_became_peered":"2023-11-24T08:05:07.168509+0000","last_unstale":"2023-11-24T08:05:08.165115+0000","last_undegraded":"2023-11-24T08:05:08.165115+0000","last_fullsized":"2023-11-24T08:05:08.165115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:36.672494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742779+0000","last_change":"2023-11-24T08:05:06.166360+0000","last_active":"2023-11-24T08:05:08.742779+0000","last_peered":"2023-11-24T08:05:08.742779+0000","last_clean":"2023-11-24T08:05:08.742779+0000","last_became_active":"2023-11-24T08:05:06.166084+0000","last_became_peered":"2023-11-24T08:05:06.166084+0000","last_unstale":"2023-11-24T08:05:08.742779+0000","last_undegraded":"2023-11-24T08:05:08.742779+0000","last_fullsized":"2023-11-24T08:05:08.742779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:53.073218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164629+0000","last_change":"2023-11-24T08:05:07.168323+0000","last_active":"2023-11-24T08:05:08.164629+0000","last_peered":"2023-11-24T08:05:08.164629+0000","last_clean":"2023-11-24T08:05:08.164629+0000","last_became_active":"2023-11-24T08:05:07.168008+0000","last_became_peered":"2023-11-24T08:05:07.168008+0000","last_unstale":"2023-11-24T08:05:08.164629+0000","last_undegraded":"2023-11-24T08:05:08.164629+0000","last_fullsized":"2023-11-24T08:05:08.164629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:02.029814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165974+0000","last_change":"2023-11-24T08:05:06.170349+0000","last_active":"2023-11-24T08:05:08.165974+0000","last_peered":"2023-11-24T08:05:08.165974+0000","last_clean":"2023-11-24T08:05:08.165974+0000","last_became_active":"2023-11-24T08:05:06.170052+0000","last_became_peered":"2023-11-24T08:05:06.170052+0000","last_unstale":"2023-11-24T08:05:08.165974+0000","last_undegraded":"2023-11-24T08:05:08.165974+0000","last_fullsized":"2023-11-24T08:05:08.165974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:09.495698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.166214+0000","last_change":"2023-11-24T08:05:07.171236+0000","last_active":"2023-11-24T08:05:08.166214+0000","last_peered":"2023-11-24T08:05:08.166214+0000","last_clean":"2023-11-24T08:05:08.166214+0000","last_became_active":"2023-11-24T08:05:07.170732+0000","last_became_peered":"2023-11-24T08:05:07.170732+0000","last_unstale":"2023-11-24T08:05:08.166214+0000","last_undegraded":"2023-11-24T08:05:08.166214+0000","last_fullsized":"2023-11-24T08:05:08.166214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:36.672494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164993+0000","last_change":"2023-11-24T08:05:06.169837+0000","last_active":"2023-11-24T08:05:08.164993+0000","last_peered":"2023-11-24T08:05:08.164993+0000","last_clean":"2023-11-24T08:05:08.164993+0000","last_became_active":"2023-11-24T08:05:06.169587+0000","last_became_peered":"2023-11-24T08:05:06.169587+0000","last_unstale":"2023-11-24T08:05:08.164993+0000","last_undegraded":"2023-11-24T08:05:08.164993+0000","last_fullsized":"2023-11-24T08:05:08.164993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:45.923970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744648+0000","last_change":"2023-11-24T08:05:07.171311+0000","last_active":"2023-11-24T08:05:08.744648+0000","last_peered":"2023-11-24T08:05:08.744648+0000","last_clean":"2023-11-24T08:05:08.744648+0000","last_became_active":"2023-11-24T08:05:07.171034+0000","last_became_peered":"2023-11-24T08:05:07.171034+0000","last_unstale":"2023-11-24T08:05:08.744648+0000","last_undegraded":"2023-11-24T08:05:08.744648+0000","last_fullsized":"2023-11-24T08:05:08.744648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:00.992778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490925+0000","last_change":"2023-11-24T08:05:06.159882+0000","last_active":"2023-11-24T08:05:08.490925+0000","last_peered":"2023-11-24T08:05:08.490925+0000","last_clean":"2023-11-24T08:05:08.490925+0000","last_became_active":"2023-11-24T08:05:06.159558+0000","last_became_peered":"2023-11-24T08:05:06.159558+0000","last_unstale":"2023-11-24T08:05:08.490925+0000","last_undegraded":"2023-11-24T08:05:08.490925+0000","last_fullsized":"2023-11-24T08:05:08.490925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:19:13.170118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164801+0000","last_change":"2023-11-24T08:05:07.168610+0000","last_active":"2023-11-24T08:05:08.164801+0000","last_peered":"2023-11-24T08:05:08.164801+0000","last_clean":"2023-11-24T08:05:08.164801+0000","last_became_active":"2023-11-24T08:05:07.168350+0000","last_became_peered":"2023-11-24T08:05:07.168350+0000","last_unstale":"2023-11-24T08:05:08.164801+0000","last_undegraded":"2023-11-24T08:05:08.164801+0000","last_fullsized":"2023-11-24T08:05:08.164801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:44:29.767456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744664+0000","last_change":"2023-11-24T08:05:06.166107+0000","last_active":"2023-11-24T08:05:08.744664+0000","last_peered":"2023-11-24T08:05:08.744664+0000","last_clean":"2023-11-24T08:05:08.744664+0000","last_became_active":"2023-11-24T08:05:06.165823+0000","last_became_peered":"2023-11-24T08:05:06.165823+0000","last_unstale":"2023-11-24T08:05:08.744664+0000","last_undegraded":"2023-11-24T08:05:08.744664+0000","last_fullsized":"2023-11-24T08:05:08.744664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:19:13.170118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866185+0000","last_change":"2023-11-24T08:05:07.173919+0000","last_active":"2023-11-24T08:05:09.866185+0000","last_peered":"2023-11-24T08:05:09.866185+0000","last_clean":"2023-11-24T08:05:09.866185+0000","last_became_active":"2023-11-24T08:05:07.173333+0000","last_became_peered":"2023-11-24T08:05:07.173333+0000","last_unstale":"2023-11-24T08:05:09.866185+0000","last_undegraded":"2023-11-24T08:05:09.866185+0000","last_fullsized":"2023-11-24T08:05:09.866185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:58.130042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164508+0000","last_change":"2023-11-24T08:05:06.170576+0000","last_active":"2023-11-24T08:05:08.164508+0000","last_peered":"2023-11-24T08:05:08.164508+0000","last_clean":"2023-11-24T08:05:08.164508+0000","last_became_active":"2023-11-24T08:05:06.169894+0000","last_became_peered":"2023-11-24T08:05:06.169894+0000","last_unstale":"2023-11-24T08:05:08.164508+0000","last_undegraded":"2023-11-24T08:05:08.164508+0000","last_fullsized":"2023-11-24T08:05:08.164508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:03:42.886610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866076+0000","last_change":"2023-11-24T08:05:07.177714+0000","last_active":"2023-11-24T08:05:09.866076+0000","last_peered":"2023-11-24T08:05:09.866076+0000","last_clean":"2023-11-24T08:05:09.866076+0000","last_became_active":"2023-11-24T08:05:07.177379+0000","last_became_peered":"2023-11-24T08:05:07.177379+0000","last_unstale":"2023-11-24T08:05:09.866076+0000","last_undegraded":"2023-11-24T08:05:09.866076+0000","last_fullsized":"2023-11-24T08:05:09.866076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:57.421717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164405+0000","last_change":"2023-11-24T08:05:06.169625+0000","last_active":"2023-11-24T08:05:08.164405+0000","last_peered":"2023-11-24T08:05:08.164405+0000","last_clean":"2023-11-24T08:05:08.164405+0000","last_became_active":"2023-11-24T08:05:06.169384+0000","last_became_peered":"2023-11-24T08:05:06.169384+0000","last_unstale":"2023-11-24T08:05:08.164405+0000","last_undegraded":"2023-11-24T08:05:08.164405+0000","last_fullsized":"2023-11-24T08:05:08.164405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:57.128050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490806+0000","last_change":"2023-11-24T08:05:07.172833+0000","last_active":"2023-11-24T08:05:08.490806+0000","last_peered":"2023-11-24T08:05:08.490806+0000","last_clean":"2023-11-24T08:05:08.490806+0000","last_became_active":"2023-11-24T08:05:07.172547+0000","last_became_peered":"2023-11-24T08:05:07.172547+0000","last_unstale":"2023-11-24T08:05:08.490806+0000","last_undegraded":"2023-11-24T08:05:08.490806+0000","last_fullsized":"2023-11-24T08:05:08.490806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:29.914282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745240+0000","last_change":"2023-11-24T08:05:06.165927+0000","last_active":"2023-11-24T08:05:08.745240+0000","last_peered":"2023-11-24T08:05:08.745240+0000","last_clean":"2023-11-24T08:05:08.745240+0000","last_became_active":"2023-11-24T08:05:06.165698+0000","last_became_peered":"2023-11-24T08:05:06.165698+0000","last_unstale":"2023-11-24T08:05:08.745240+0000","last_undegraded":"2023-11-24T08:05:08.745240+0000","last_fullsized":"2023-11-24T08:05:08.745240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:53.073218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.166283+0000","last_change":"2023-11-24T08:05:07.173049+0000","last_active":"2023-11-24T08:05:08.166283+0000","last_peered":"2023-11-24T08:05:08.166283+0000","last_clean":"2023-11-24T08:05:08.166283+0000","last_became_active":"2023-11-24T08:05:07.172777+0000","last_became_peered":"2023-11-24T08:05:07.172777+0000","last_unstale":"2023-11-24T08:05:08.166283+0000","last_undegraded":"2023-11-24T08:05:08.166283+0000","last_fullsized":"2023-11-24T08:05:08.166283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:58:37.801404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490861+0000","last_change":"2023-11-24T08:05:06.161253+0000","last_active":"2023-11-24T08:05:08.490861+0000","last_peered":"2023-11-24T08:05:08.490861+0000","last_clean":"2023-11-24T08:05:08.490861+0000","last_became_active":"2023-11-24T08:05:06.160958+0000","last_became_peered":"2023-11-24T08:05:06.160958+0000","last_unstale":"2023-11-24T08:05:08.490861+0000","last_undegraded":"2023-11-24T08:05:08.490861+0000","last_fullsized":"2023-11-24T08:05:08.490861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:57.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744855+0000","last_change":"2023-11-24T08:05:07.175714+0000","last_active":"2023-11-24T08:05:08.744855+0000","last_peered":"2023-11-24T08:05:08.744855+0000","last_clean":"2023-11-24T08:05:08.744855+0000","last_became_active":"2023-11-24T08:05:07.175296+0000","last_became_peered":"2023-11-24T08:05:07.175296+0000","last_unstale":"2023-11-24T08:05:08.744855+0000","last_undegraded":"2023-11-24T08:05:08.744855+0000","last_fullsized":"2023-11-24T08:05:08.744855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:38.062624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490924+0000","last_change":"2023-11-24T08:05:06.165335+0000","last_active":"2023-11-24T08:05:08.490924+0000","last_peered":"2023-11-24T08:05:08.490924+0000","last_clean":"2023-11-24T08:05:08.490924+0000","last_became_active":"2023-11-24T08:05:06.165057+0000","last_became_peered":"2023-11-24T08:05:06.165057+0000","last_unstale":"2023-11-24T08:05:08.490924+0000","last_undegraded":"2023-11-24T08:05:08.490924+0000","last_fullsized":"2023-11-24T08:05:08.490924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:19.673273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365123+0000","last_change":"2023-11-24T08:05:07.165138+0000","last_active":"2023-11-24T08:05:09.365123+0000","last_peered":"2023-11-24T08:05:09.365123+0000","last_clean":"2023-11-24T08:05:09.365123+0000","last_became_active":"2023-11-24T08:05:07.164852+0000","last_became_peered":"2023-11-24T08:05:07.164852+0000","last_unstale":"2023-11-24T08:05:09.365123+0000","last_undegraded":"2023-11-24T08:05:09.365123+0000","last_fullsized":"2023-11-24T08:05:09.365123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:24.053377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.491032+0000","last_change":"2023-11-24T08:05:06.167096+0000","last_active":"2023-11-24T08:05:08.491032+0000","last_peered":"2023-11-24T08:05:08.491032+0000","last_clean":"2023-11-24T08:05:08.491032+0000","last_became_active":"2023-11-24T08:05:06.166715+0000","last_became_peered":"2023-11-24T08:05:06.166715+0000","last_unstale":"2023-11-24T08:05:08.491032+0000","last_undegraded":"2023-11-24T08:05:08.491032+0000","last_fullsized":"2023-11-24T08:05:08.491032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:25.845668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365000+0000","last_change":"2023-11-24T08:05:07.172174+0000","last_active":"2023-11-24T08:05:09.365000+0000","last_peered":"2023-11-24T08:05:09.365000+0000","last_clean":"2023-11-24T08:05:09.365000+0000","last_became_active":"2023-11-24T08:05:07.171856+0000","last_became_peered":"2023-11-24T08:05:07.171856+0000","last_unstale":"2023-11-24T08:05:09.365000+0000","last_undegraded":"2023-11-24T08:05:09.365000+0000","last_fullsized":"2023-11-24T08:05:09.365000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:20.675266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742717+0000","last_change":"2023-11-24T08:05:06.171728+0000","last_active":"2023-11-24T08:05:08.742717+0000","last_peered":"2023-11-24T08:05:08.742717+0000","last_clean":"2023-11-24T08:05:08.742717+0000","last_became_active":"2023-11-24T08:05:06.171463+0000","last_became_peered":"2023-11-24T08:05:06.171463+0000","last_unstale":"2023-11-24T08:05:08.742717+0000","last_undegraded":"2023-11-24T08:05:08.742717+0000","last_fullsized":"2023-11-24T08:05:08.742717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:23.051385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365065+0000","last_change":"2023-11-24T08:05:07.163462+0000","last_active":"2023-11-24T08:05:09.365065+0000","last_peered":"2023-11-24T08:05:09.365065+0000","last_clean":"2023-11-24T08:05:09.365065+0000","last_became_active":"2023-11-24T08:05:07.163005+0000","last_became_peered":"2023-11-24T08:05:07.163005+0000","last_unstale":"2023-11-24T08:05:09.365065+0000","last_undegraded":"2023-11-24T08:05:09.365065+0000","last_fullsized":"2023-11-24T08:05:09.365065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:19:14.172111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.865925+0000","last_change":"2023-11-24T08:05:06.166904+0000","last_active":"2023-11-24T08:05:09.865925+0000","last_peered":"2023-11-24T08:05:09.865925+0000","last_clean":"2023-11-24T08:05:09.865925+0000","last_became_active":"2023-11-24T08:05:06.166560+0000","last_became_peered":"2023-11-24T08:05:06.166560+0000","last_unstale":"2023-11-24T08:05:09.865925+0000","last_undegraded":"2023-11-24T08:05:09.865925+0000","last_fullsized":"2023-11-24T08:05:09.865925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:57.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.364981+0000","last_change":"2023-11-24T08:05:07.162646+0000","last_active":"2023-11-24T08:05:09.364981+0000","last_peered":"2023-11-24T08:05:09.364981+0000","last_clean":"2023-11-24T08:05:09.364981+0000","last_became_active":"2023-11-24T08:05:07.162389+0000","last_became_peered":"2023-11-24T08:05:07.162389+0000","last_unstale":"2023-11-24T08:05:09.364981+0000","last_undegraded":"2023-11-24T08:05:09.364981+0000","last_fullsized":"2023-11-24T08:05:09.364981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:58:15.960798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490783+0000","last_change":"2023-11-24T08:05:06.166275+0000","last_active":"2023-11-24T08:05:08.490783+0000","last_peered":"2023-11-24T08:05:08.490783+0000","last_clean":"2023-11-24T08:05:08.490783+0000","last_became_active":"2023-11-24T08:05:06.165991+0000","last_became_peered":"2023-11-24T08:05:06.165991+0000","last_unstale":"2023-11-24T08:05:08.490783+0000","last_undegraded":"2023-11-24T08:05:08.490783+0000","last_fullsized":"2023-11-24T08:05:08.490783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:49:50.780552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866489+0000","last_change":"2023-11-24T08:05:07.176023+0000","last_active":"2023-11-24T08:05:09.866489+0000","last_peered":"2023-11-24T08:05:09.866489+0000","last_clean":"2023-11-24T08:05:09.866489+0000","last_became_active":"2023-11-24T08:05:07.174707+0000","last_became_peered":"2023-11-24T08:05:07.174707+0000","last_unstale":"2023-11-24T08:05:09.866489+0000","last_undegraded":"2023-11-24T08:05:09.866489+0000","last_fullsized":"2023-11-24T08:05:09.866489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:19.944842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165325+0000","last_change":"2023-11-24T08:05:06.170415+0000","last_active":"2023-11-24T08:05:08.165325+0000","last_peered":"2023-11-24T08:05:08.165325+0000","last_clean":"2023-11-24T08:05:08.165325+0000","last_became_active":"2023-11-24T08:05:06.170153+0000","last_became_peered":"2023-11-24T08:05:06.170153+0000","last_unstale":"2023-11-24T08:05:08.165325+0000","last_undegraded":"2023-11-24T08:05:08.165325+0000","last_fullsized":"2023-11-24T08:05:08.165325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:45.923970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365206+0000","last_change":"2023-11-24T08:05:07.171305+0000","last_active":"2023-11-24T08:05:09.365206+0000","last_peered":"2023-11-24T08:05:09.365206+0000","last_clean":"2023-11-24T08:05:09.365206+0000","last_became_active":"2023-11-24T08:05:07.171035+0000","last_became_peered":"2023-11-24T08:05:07.171035+0000","last_unstale":"2023-11-24T08:05:09.365206+0000","last_undegraded":"2023-11-24T08:05:09.365206+0000","last_fullsized":"2023-11-24T08:05:09.365206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:41.883543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745179+0000","last_change":"2023-11-24T08:05:06.166139+0000","last_active":"2023-11-24T08:05:08.745179+0000","last_peered":"2023-11-24T08:05:08.745179+0000","last_clean":"2023-11-24T08:05:08.745179+0000","last_became_active":"2023-11-24T08:05:06.165389+0000","last_became_peered":"2023-11-24T08:05:06.165389+0000","last_unstale":"2023-11-24T08:05:08.745179+0000","last_undegraded":"2023-11-24T08:05:08.745179+0000","last_fullsized":"2023-11-24T08:05:08.745179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:56.419725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.166126+0000","last_change":"2023-11-24T08:05:07.178828+0000","last_active":"2023-11-24T08:05:08.166126+0000","last_peered":"2023-11-24T08:05:08.166126+0000","last_clean":"2023-11-24T08:05:08.166126+0000","last_became_active":"2023-11-24T08:05:07.178589+0000","last_became_peered":"2023-11-24T08:05:07.178589+0000","last_unstale":"2023-11-24T08:05:08.166126+0000","last_undegraded":"2023-11-24T08:05:08.166126+0000","last_fullsized":"2023-11-24T08:05:08.166126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:32:16.566917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744102+0000","last_change":"2023-11-24T08:05:06.170207+0000","last_active":"2023-11-24T08:05:08.744102+0000","last_peered":"2023-11-24T08:05:08.744102+0000","last_clean":"2023-11-24T08:05:08.744102+0000","last_became_active":"2023-11-24T08:05:06.169894+0000","last_became_peered":"2023-11-24T08:05:06.169894+0000","last_unstale":"2023-11-24T08:05:08.744102+0000","last_undegraded":"2023-11-24T08:05:08.744102+0000","last_fullsized":"2023-11-24T08:05:08.744102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:49:50.780552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742652+0000","last_change":"2023-11-24T08:05:07.170828+0000","last_active":"2023-11-24T08:05:08.742652+0000","last_peered":"2023-11-24T08:05:08.742652+0000","last_clean":"2023-11-24T08:05:08.742652+0000","last_became_active":"2023-11-24T08:05:07.170529+0000","last_became_peered":"2023-11-24T08:05:07.170529+0000","last_unstale":"2023-11-24T08:05:08.742652+0000","last_undegraded":"2023-11-24T08:05:08.742652+0000","last_fullsized":"2023-11-24T08:05:08.742652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:12.752555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744922+0000","last_change":"2023-11-24T08:05:06.165259+0000","last_active":"2023-11-24T08:05:08.744922+0000","last_peered":"2023-11-24T08:05:08.744922+0000","last_clean":"2023-11-24T08:05:08.744922+0000","last_became_active":"2023-11-24T08:05:06.165000+0000","last_became_peered":"2023-11-24T08:05:06.165000+0000","last_unstale":"2023-11-24T08:05:08.744922+0000","last_undegraded":"2023-11-24T08:05:08.744922+0000","last_fullsized":"2023-11-24T08:05:08.744922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:01:28.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866254+0000","last_change":"2023-11-24T08:05:07.164674+0000","last_active":"2023-11-24T08:05:09.866254+0000","last_peered":"2023-11-24T08:05:09.866254+0000","last_clean":"2023-11-24T08:05:09.866254+0000","last_became_active":"2023-11-24T08:05:07.164385+0000","last_became_peered":"2023-11-24T08:05:07.164385+0000","last_unstale":"2023-11-24T08:05:09.866254+0000","last_undegraded":"2023-11-24T08:05:09.866254+0000","last_fullsized":"2023-11-24T08:05:09.866254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:01:29.259922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742685+0000","last_change":"2023-11-24T08:05:06.167778+0000","last_active":"2023-11-24T08:05:08.742685+0000","last_peered":"2023-11-24T08:05:08.742685+0000","last_clean":"2023-11-24T08:05:08.742685+0000","last_became_active":"2023-11-24T08:05:06.167507+0000","last_became_peered":"2023-11-24T08:05:06.167507+0000","last_unstale":"2023-11-24T08:05:08.742685+0000","last_undegraded":"2023-11-24T08:05:08.742685+0000","last_fullsized":"2023-11-24T08:05:08.742685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:25.845668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742783+0000","last_change":"2023-11-24T08:05:07.171951+0000","last_active":"2023-11-24T08:05:08.742783+0000","last_peered":"2023-11-24T08:05:08.742783+0000","last_clean":"2023-11-24T08:05:08.742783+0000","last_became_active":"2023-11-24T08:05:07.171619+0000","last_became_peered":"2023-11-24T08:05:07.171619+0000","last_unstale":"2023-11-24T08:05:08.742783+0000","last_undegraded":"2023-11-24T08:05:08.742783+0000","last_fullsized":"2023-11-24T08:05:08.742783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:02.279227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744765+0000","last_change":"2023-11-24T08:05:06.168541+0000","last_active":"2023-11-24T08:05:08.744765+0000","last_peered":"2023-11-24T08:05:08.744765+0000","last_clean":"2023-11-24T08:05:08.744765+0000","last_became_active":"2023-11-24T08:05:06.168172+0000","last_became_peered":"2023-11-24T08:05:06.168172+0000","last_unstale":"2023-11-24T08:05:08.744765+0000","last_undegraded":"2023-11-24T08:05:08.744765+0000","last_fullsized":"2023-11-24T08:05:08.744765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:23.051385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164456+0000","last_change":"2023-11-24T08:05:07.178496+0000","last_active":"2023-11-24T08:05:08.164456+0000","last_peered":"2023-11-24T08:05:08.164456+0000","last_clean":"2023-11-24T08:05:08.164456+0000","last_became_active":"2023-11-24T08:05:07.175421+0000","last_became_peered":"2023-11-24T08:05:07.175421+0000","last_unstale":"2023-11-24T08:05:08.164456+0000","last_undegraded":"2023-11-24T08:05:08.164456+0000","last_fullsized":"2023-11-24T08:05:08.164456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:49.608429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490793+0000","last_change":"2023-11-24T08:05:06.164192+0000","last_active":"2023-11-24T08:05:08.490793+0000","last_peered":"2023-11-24T08:05:08.490793+0000","last_clean":"2023-11-24T08:05:08.490793+0000","last_became_active":"2023-11-24T08:05:06.163910+0000","last_became_peered":"2023-11-24T08:05:06.163910+0000","last_unstale":"2023-11-24T08:05:08.490793+0000","last_undegraded":"2023-11-24T08:05:08.490793+0000","last_fullsized":"2023-11-24T08:05:08.490793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:53.073218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490566+0000","last_change":"2023-11-24T08:05:07.168616+0000","last_active":"2023-11-24T08:05:08.490566+0000","last_peered":"2023-11-24T08:05:08.490566+0000","last_clean":"2023-11-24T08:05:08.490566+0000","last_became_active":"2023-11-24T08:05:07.168232+0000","last_became_peered":"2023-11-24T08:05:07.168232+0000","last_unstale":"2023-11-24T08:05:08.490566+0000","last_undegraded":"2023-11-24T08:05:08.490566+0000","last_fullsized":"2023-11-24T08:05:08.490566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:12:42.888692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164542+0000","last_change":"2023-11-24T08:05:06.170514+0000","last_active":"2023-11-24T08:05:08.164542+0000","last_peered":"2023-11-24T08:05:08.164542+0000","last_clean":"2023-11-24T08:05:08.164542+0000","last_became_active":"2023-11-24T08:05:06.170149+0000","last_became_peered":"2023-11-24T08:05:06.170149+0000","last_unstale":"2023-11-24T08:05:08.164542+0000","last_undegraded":"2023-11-24T08:05:08.164542+0000","last_fullsized":"2023-11-24T08:05:08.164542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:08.840870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866525+0000","last_change":"2023-11-24T08:05:07.169964+0000","last_active":"2023-11-24T08:05:09.866525+0000","last_peered":"2023-11-24T08:05:09.866525+0000","last_clean":"2023-11-24T08:05:09.866525+0000","last_became_active":"2023-11-24T08:05:07.169585+0000","last_became_peered":"2023-11-24T08:05:07.169585+0000","last_unstale":"2023-11-24T08:05:09.866525+0000","last_undegraded":"2023-11-24T08:05:09.866525+0000","last_fullsized":"2023-11-24T08:05:09.866525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:02.029814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.865804+0000","last_change":"2023-11-24T08:05:06.158426+0000","last_active":"2023-11-24T08:05:09.865804+0000","last_peered":"2023-11-24T08:05:09.865804+0000","last_clean":"2023-11-24T08:05:09.865804+0000","last_became_active":"2023-11-24T08:05:06.158105+0000","last_became_peered":"2023-11-24T08:05:06.158105+0000","last_unstale":"2023-11-24T08:05:09.865804+0000","last_undegraded":"2023-11-24T08:05:09.865804+0000","last_fullsized":"2023-11-24T08:05:09.865804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:23.051385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T08:05:07.160092+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:05:07.160092+0000","last_peered":"2023-11-24T08:05:07.160092+0000","last_clean":"2023-11-24T08:05:07.160092+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:05:07.160092+0000","last_undegraded":"2023-11-24T08:05:07.160092+0000","last_fullsized":"2023-11-24T08:05:07.160092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":729875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.438}]},{"osd":2,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":133733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":10.285,"5min":10.285,"15min":10.285},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.63},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.83599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.249},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.32400000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.747},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.71599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":728766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.314},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.30399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.33900000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.8109999999999999,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":9.9100000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4,"5min":4,"15min":4},"last":0.66100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":133187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":5.673,"5min":5.673,"15min":5.673},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.372}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":4.4400000000000004,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.751},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":5.726,"5min":5.726,"15min":5.726},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.7880000000000003,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.307},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.36799999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.40500000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.443},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.621},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.51400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":139521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.48899999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.443},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.4199999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.476},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":1.556}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":140089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.501}]},{"osd":2,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.37},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.44800000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.629},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:15.837 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:15.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.970+0000 7fd3c4367700 1 Processor -- start 2023-11-24T08:05:15.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.970+0000 7fd3c4367700 1 -- start start 2023-11-24T08:05:15.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c4367700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc1473a0 0x7fd3bc15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c4367700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd3bc147780 0x7fd3bc06c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c4367700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd3bc06dc20 0x7fd3bc073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c4367700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc06c9a0 con 0x7fd3bc147780 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c4367700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc15eb00 con 0x7fd3bc06dc20 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c4367700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc15ede0 con 0x7fd3bc1473a0 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c1902700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd3bc147780 0x7fd3bc06c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c1902700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd3bc147780 0x7fd3bc06c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37382/0 (socket says 172.21.15.153:37382) 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c1902700 1 -- 172.21.15.153:0/3967706592 learned_addr learned my addr 172.21.15.153:0/3967706592 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c2904700 1 --2- 172.21.15.153:0/3967706592 >> v2:172.21.15.164:3300/0 conn(0x7fd3bc06dc20 0x7fd3bc073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c2103700 1 --2- 172.21.15.153:0/3967706592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc1473a0 0x7fd3bc15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c1902700 1 -- 172.21.15.153:0/3967706592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc1473a0 msgr2=0x7fd3bc15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c1902700 1 --2- 172.21.15.153:0/3967706592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc1473a0 0x7fd3bc15e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c1902700 1 -- 172.21.15.153:0/3967706592 >> v2:172.21.15.164:3300/0 conn(0x7fd3bc06dc20 msgr2=0x7fd3bc073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c1902700 1 --2- 172.21.15.153:0/3967706592 >> v2:172.21.15.164:3300/0 conn(0x7fd3bc06dc20 0x7fd3bc073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c1902700 1 -- 172.21.15.153:0/3967706592 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc15f0c0 con 0x7fd3bc147780 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c2904700 1 --2- 172.21.15.153:0/3967706592 >> v2:172.21.15.164:3300/0 conn(0x7fd3bc06dc20 0x7fd3bc073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.971+0000 7fd3c1902700 1 --2- 172.21.15.153:0/3967706592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc147780 0x7fd3bc06c460 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc15e9f0 tx=0x7fd3ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16225c627b357454 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c1101700 1 -- 172.21.15.153:0/3967706592 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00b870 con 0x7fd3bc147780 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c1101700 1 -- 172.21.15.153:0/3967706592 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00b9d0 con 0x7fd3bc147780 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c1101700 1 -- 172.21.15.153:0/3967706592 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00bd60 con 0x7fd3bc147780 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c4367700 1 -- 172.21.15.153:0/3967706592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc147780 msgr2=0x7fd3bc06c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c4367700 1 --2- 172.21.15.153:0/3967706592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc147780 0x7fd3bc06c460 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc15e9f0 tx=0x7fd3ac009bd0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c4367700 1 -- 172.21.15.153:0/3967706592 shutdown_connections 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c4367700 1 --2- 172.21.15.153:0/3967706592 >> v2:172.21.15.164:3300/0 conn(0x7fd3bc06dc20 0x7fd3bc073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c4367700 1 --2- 172.21.15.153:0/3967706592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc1473a0 0x7fd3bc15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c4367700 1 --2- 172.21.15.153:0/3967706592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc147780 0x7fd3bc06c460 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c4367700 1 -- 172.21.15.153:0/3967706592 >> 172.21.15.153:0/3967706592 conn(0x7fd3bc0b3130 msgr2=0x7fd3bc0d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:15.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c4367700 1 -- 172.21.15.153:0/3967706592 shutdown_connections 2023-11-24T08:05:15.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.972+0000 7fd3c4367700 1 -- 172.21.15.153:0/3967706592 wait complete. 2023-11-24T08:05:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.973+0000 7fd3c4367700 1 Processor -- start 2023-11-24T08:05:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.974+0000 7fd3c4367700 1 -- start start 2023-11-24T08:05:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.974+0000 7fd3c4367700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc06dc20 0x7fd3bc142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.974+0000 7fd3c4367700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc1473a0 0x7fd3bc143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.974+0000 7fd3c4367700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3bc147780 0x7fd3bc15d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.974+0000 7fd3c4367700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc1442e0 con 0x7fd3bc06dc20 2023-11-24T08:05:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.974+0000 7fd3c4367700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc143060 con 0x7fd3bc147780 2023-11-24T08:05:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.974+0000 7fd3c4367700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc143340 con 0x7fd3bc1473a0 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.974+0000 7fd3c2103700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc06dc20 0x7fd3bc142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.974+0000 7fd3c2103700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc06dc20 0x7fd3bc142500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37388/0 (socket says 172.21.15.153:37388) 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.974+0000 7fd3c2103700 1 -- 172.21.15.153:0/1575892420 learned_addr learned my addr 172.21.15.153:0/1575892420 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c2103700 1 -- 172.21.15.153:0/1575892420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc1473a0 msgr2=0x7fd3bc143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c1902700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc1473a0 0x7fd3bc143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c2904700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3bc147780 0x7fd3bc15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c2103700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc1473a0 0x7fd3bc143da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c2103700 1 -- 172.21.15.153:0/1575892420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3bc147780 msgr2=0x7fd3bc15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c2103700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3bc147780 0x7fd3bc15d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c2103700 1 -- 172.21.15.153:0/1575892420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac009550 con 0x7fd3bc06dc20 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c1902700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc1473a0 0x7fd3bc143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c2904700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3bc147780 0x7fd3bc15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c2103700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc06dc20 0x7fd3bc142500 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800c7f0 tx=0x7fd3b800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3b2ffd700 1 -- 172.21.15.153:0/1575892420 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8011800 con 0x7fd3bc06dc20 2023-11-24T08:05:15.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3b2ffd700 1 -- 172.21.15.153:0/1575892420 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b8011960 con 0x7fd3bc06dc20 2023-11-24T08:05:15.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c4367700 1 -- 172.21.15.153:0/1575892420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc143620 con 0x7fd3bc06dc20 2023-11-24T08:05:15.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3b2ffd700 1 -- 172.21.15.153:0/1575892420 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8011cf0 con 0x7fd3bc06dc20 2023-11-24T08:05:15.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.975+0000 7fd3c4367700 1 -- 172.21.15.153:0/1575892420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc0b0900 con 0x7fd3bc06dc20 2023-11-24T08:05:15.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.976+0000 7fd3c4367700 1 -- 172.21.15.153:0/1575892420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc067f60 con 0x7fd3bc06dc20 2023-11-24T08:05:15.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.976+0000 7fd3b2ffd700 1 -- 172.21.15.153:0/1575892420 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3b8018360 con 0x7fd3bc06dc20 2023-11-24T08:05:15.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.977+0000 7fd3b2ffd700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd3a006aed0 0x7fd3a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.977+0000 7fd3c1902700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd3a006aed0 0x7fd3a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.977+0000 7fd3b2ffd700 1 -- 172.21.15.153:0/1575892420 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3b80894c0 con 0x7fd3bc06dc20 2023-11-24T08:05:15.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.977+0000 7fd3c1902700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd3a006aed0 0x7fd3a006d390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc15e9f0 tx=0x7fd3ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:15.982+0000 7fd3b2ffd700 1 -- 172.21.15.153:0/1575892420 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3b8054580 con 0x7fd3bc06dc20 2023-11-24T08:05:16.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.168+0000 7fd3c4367700 1 -- 172.21.15.153:0/1575892420 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3bc06b090 con 0x7fd3a006aed0 2023-11-24T08:05:16.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.176+0000 7fd3b2ffd700 1 -- 172.21.15.153:0/1575892420 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288826 (secure 0 0 0) 0x7fd3ac00bbc0 con 0x7fd3a006aed0 2023-11-24T08:05:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 -- 172.21.15.153:0/1575892420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd3a006aed0 msgr2=0x7fd3a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd3a006aed0 0x7fd3a006d390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc15e9f0 tx=0x7fd3ac008030 comp rx=0 tx=0).stop 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 -- 172.21.15.153:0/1575892420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc06dc20 msgr2=0x7fd3bc142500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc06dc20 0x7fd3bc142500 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800c7f0 tx=0x7fd3b800cbb0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 -- 172.21.15.153:0/1575892420 shutdown_connections 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3bc147780 0x7fd3bc15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd3a006aed0 0x7fd3a006d390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc06dc20 0x7fd3bc142500 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 --2- 172.21.15.153:0/1575892420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc1473a0 0x7fd3bc143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 -- 172.21.15.153:0/1575892420 >> 172.21.15.153:0/1575892420 conn(0x7fd3bc0b3130 msgr2=0x7fd3bc1618a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 -- 172.21.15.153:0/1575892420 shutdown_connections 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.179+0000 7fd3c4367700 1 -- 172.21.15.153:0/1575892420 wait complete. 2023-11-24T08:05:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:05:16.193 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-11-24T08:05:16.054175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220220,"kb_used_data":4036,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754500,"statfs":{"total":773094113280,"available":772868608000,"internally_reserved":0,"allocated":4132864,"data_stored":2299873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.905217"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866109+0000","last_change":"2023-11-24T08:05:07.170588+0000","last_active":"2023-11-24T08:05:09.866109+0000","last_peered":"2023-11-24T08:05:09.866109+0000","last_clean":"2023-11-24T08:05:09.866109+0000","last_became_active":"2023-11-24T08:05:07.170314+0000","last_became_peered":"2023-11-24T08:05:07.170314+0000","last_unstale":"2023-11-24T08:05:09.866109+0000","last_undegraded":"2023-11-24T08:05:09.866109+0000","last_fullsized":"2023-11-24T08:05:09.866109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:49:51.782544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165331+0000","last_change":"2023-11-24T08:05:07.179168+0000","last_active":"2023-11-24T08:05:08.165331+0000","last_peered":"2023-11-24T08:05:08.165331+0000","last_clean":"2023-11-24T08:05:08.165331+0000","last_became_active":"2023-11-24T08:05:07.178869+0000","last_became_peered":"2023-11-24T08:05:07.178869+0000","last_unstale":"2023-11-24T08:05:08.165331+0000","last_undegraded":"2023-11-24T08:05:08.165331+0000","last_fullsized":"2023-11-24T08:05:08.165331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:58:37.801404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165850+0000","last_change":"2023-11-24T08:05:07.170997+0000","last_active":"2023-11-24T08:05:08.165850+0000","last_peered":"2023-11-24T08:05:08.165850+0000","last_clean":"2023-11-24T08:05:08.165850+0000","last_became_active":"2023-11-24T08:05:07.170390+0000","last_became_peered":"2023-11-24T08:05:07.170390+0000","last_unstale":"2023-11-24T08:05:08.165850+0000","last_undegraded":"2023-11-24T08:05:08.165850+0000","last_fullsized":"2023-11-24T08:05:08.165850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:02.029814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744751+0000","last_change":"2023-11-24T08:05:07.175543+0000","last_active":"2023-11-24T08:05:08.744751+0000","last_peered":"2023-11-24T08:05:08.744751+0000","last_clean":"2023-11-24T08:05:08.744751+0000","last_became_active":"2023-11-24T08:05:07.174950+0000","last_became_peered":"2023-11-24T08:05:07.174950+0000","last_unstale":"2023-11-24T08:05:08.744751+0000","last_undegraded":"2023-11-24T08:05:08.744751+0000","last_fullsized":"2023-11-24T08:05:08.744751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:29.914282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365032+0000","last_change":"2023-11-24T08:05:07.173644+0000","last_active":"2023-11-24T08:05:09.365032+0000","last_peered":"2023-11-24T08:05:09.365032+0000","last_clean":"2023-11-24T08:05:09.365032+0000","last_became_active":"2023-11-24T08:05:07.173357+0000","last_became_peered":"2023-11-24T08:05:07.173357+0000","last_unstale":"2023-11-24T08:05:09.365032+0000","last_undegraded":"2023-11-24T08:05:09.365032+0000","last_fullsized":"2023-11-24T08:05:09.365032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:26.847661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164590+0000","last_change":"2023-11-24T08:05:07.180220+0000","last_active":"2023-11-24T08:05:08.164590+0000","last_peered":"2023-11-24T08:05:08.164590+0000","last_clean":"2023-11-24T08:05:08.164590+0000","last_became_active":"2023-11-24T08:05:07.179908+0000","last_became_peered":"2023-11-24T08:05:07.179908+0000","last_unstale":"2023-11-24T08:05:08.164590+0000","last_undegraded":"2023-11-24T08:05:08.164590+0000","last_fullsized":"2023-11-24T08:05:08.164590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:19.944842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866283+0000","last_change":"2023-11-24T08:05:07.174887+0000","last_active":"2023-11-24T08:05:09.866283+0000","last_peered":"2023-11-24T08:05:09.866283+0000","last_clean":"2023-11-24T08:05:09.866283+0000","last_became_active":"2023-11-24T08:05:07.174540+0000","last_became_peered":"2023-11-24T08:05:07.174540+0000","last_unstale":"2023-11-24T08:05:09.866283+0000","last_undegraded":"2023-11-24T08:05:09.866283+0000","last_fullsized":"2023-11-24T08:05:09.866283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:10:29.803093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.865747+0000","last_change":"2023-11-24T08:05:07.171307+0000","last_active":"2023-11-24T08:05:09.865747+0000","last_peered":"2023-11-24T08:05:09.865747+0000","last_clean":"2023-11-24T08:05:09.865747+0000","last_became_active":"2023-11-24T08:05:07.169588+0000","last_became_peered":"2023-11-24T08:05:07.169588+0000","last_unstale":"2023-11-24T08:05:09.865747+0000","last_undegraded":"2023-11-24T08:05:09.865747+0000","last_fullsized":"2023-11-24T08:05:09.865747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:03:43.888603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.491065+0000","last_change":"2023-11-24T08:05:07.165131+0000","last_active":"2023-11-24T08:05:08.491065+0000","last_peered":"2023-11-24T08:05:08.491065+0000","last_clean":"2023-11-24T08:05:08.491065+0000","last_became_active":"2023-11-24T08:05:07.164828+0000","last_became_peered":"2023-11-24T08:05:07.164828+0000","last_unstale":"2023-11-24T08:05:08.491065+0000","last_undegraded":"2023-11-24T08:05:08.491065+0000","last_fullsized":"2023-11-24T08:05:08.491065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:44.742619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745001+0000","last_change":"2023-11-24T08:05:07.172919+0000","last_active":"2023-11-24T08:05:08.745001+0000","last_peered":"2023-11-24T08:05:08.745001+0000","last_clean":"2023-11-24T08:05:08.745001+0000","last_became_active":"2023-11-24T08:05:07.172665+0000","last_became_peered":"2023-11-24T08:05:07.172665+0000","last_unstale":"2023-11-24T08:05:08.745001+0000","last_undegraded":"2023-11-24T08:05:08.745001+0000","last_fullsized":"2023-11-24T08:05:08.745001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:52.831778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866557+0000","last_change":"2023-11-24T08:05:07.170757+0000","last_active":"2023-11-24T08:05:09.866557+0000","last_peered":"2023-11-24T08:05:09.866557+0000","last_clean":"2023-11-24T08:05:09.866557+0000","last_became_active":"2023-11-24T08:05:07.170374+0000","last_became_peered":"2023-11-24T08:05:07.170374+0000","last_unstale":"2023-11-24T08:05:09.866557+0000","last_undegraded":"2023-11-24T08:05:09.866557+0000","last_fullsized":"2023-11-24T08:05:09.866557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:15.963017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165938+0000","last_change":"2023-11-24T08:05:07.171929+0000","last_active":"2023-11-24T08:05:08.165938+0000","last_peered":"2023-11-24T08:05:08.165938+0000","last_clean":"2023-11-24T08:05:08.165938+0000","last_became_active":"2023-11-24T08:05:07.171623+0000","last_became_peered":"2023-11-24T08:05:07.171623+0000","last_unstale":"2023-11-24T08:05:08.165938+0000","last_undegraded":"2023-11-24T08:05:08.165938+0000","last_fullsized":"2023-11-24T08:05:08.165938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:15.963017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365159+0000","last_change":"2023-11-24T08:05:07.164579+0000","last_active":"2023-11-24T08:05:09.365159+0000","last_peered":"2023-11-24T08:05:09.365159+0000","last_clean":"2023-11-24T08:05:09.365159+0000","last_became_active":"2023-11-24T08:05:07.164257+0000","last_became_peered":"2023-11-24T08:05:07.164257+0000","last_unstale":"2023-11-24T08:05:09.365159+0000","last_undegraded":"2023-11-24T08:05:09.365159+0000","last_fullsized":"2023-11-24T08:05:09.365159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:35.189913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164650+0000","last_change":"2023-11-24T08:05:07.170150+0000","last_active":"2023-11-24T08:05:08.164650+0000","last_peered":"2023-11-24T08:05:08.164650+0000","last_clean":"2023-11-24T08:05:08.164650+0000","last_became_active":"2023-11-24T08:05:07.169825+0000","last_became_peered":"2023-11-24T08:05:07.169825+0000","last_unstale":"2023-11-24T08:05:08.164650+0000","last_undegraded":"2023-11-24T08:05:08.164650+0000","last_fullsized":"2023-11-24T08:05:08.164650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:15.963017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165511+0000","last_change":"2023-11-24T08:05:07.173529+0000","last_active":"2023-11-24T08:05:08.165511+0000","last_peered":"2023-11-24T08:05:08.165511+0000","last_clean":"2023-11-24T08:05:08.165511+0000","last_became_active":"2023-11-24T08:05:07.173265+0000","last_became_peered":"2023-11-24T08:05:07.173265+0000","last_unstale":"2023-11-24T08:05:08.165511+0000","last_undegraded":"2023-11-24T08:05:08.165511+0000","last_fullsized":"2023-11-24T08:05:08.165511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:10:29.803093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.865900+0000","last_change":"2023-11-24T08:05:07.171202+0000","last_active":"2023-11-24T08:05:09.865900+0000","last_peered":"2023-11-24T08:05:09.865900+0000","last_clean":"2023-11-24T08:05:09.865900+0000","last_became_active":"2023-11-24T08:05:07.170929+0000","last_became_peered":"2023-11-24T08:05:07.170929+0000","last_unstale":"2023-11-24T08:05:09.865900+0000","last_undegraded":"2023-11-24T08:05:09.865900+0000","last_fullsized":"2023-11-24T08:05:09.865900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:46.925963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866708+0000","last_change":"2023-11-24T08:05:07.174400+0000","last_active":"2023-11-24T08:05:09.866708+0000","last_peered":"2023-11-24T08:05:09.866708+0000","last_clean":"2023-11-24T08:05:09.866708+0000","last_became_active":"2023-11-24T08:05:07.174119+0000","last_became_peered":"2023-11-24T08:05:07.174119+0000","last_unstale":"2023-11-24T08:05:09.866708+0000","last_undegraded":"2023-11-24T08:05:09.866708+0000","last_fullsized":"2023-11-24T08:05:09.866708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:44:29.767456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165451+0000","last_change":"2023-11-24T08:05:07.179706+0000","last_active":"2023-11-24T08:05:08.165451+0000","last_peered":"2023-11-24T08:05:08.165451+0000","last_clean":"2023-11-24T08:05:08.165451+0000","last_became_active":"2023-11-24T08:05:07.178584+0000","last_became_peered":"2023-11-24T08:05:07.178584+0000","last_unstale":"2023-11-24T08:05:08.165451+0000","last_undegraded":"2023-11-24T08:05:08.165451+0000","last_fullsized":"2023-11-24T08:05:08.165451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:34.482131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165024+0000","last_change":"2023-11-24T08:05:07.179428+0000","last_active":"2023-11-24T08:05:08.165024+0000","last_peered":"2023-11-24T08:05:08.165024+0000","last_clean":"2023-11-24T08:05:08.165024+0000","last_became_active":"2023-11-24T08:05:07.178444+0000","last_became_peered":"2023-11-24T08:05:07.178444+0000","last_unstale":"2023-11-24T08:05:08.165024+0000","last_undegraded":"2023-11-24T08:05:08.165024+0000","last_fullsized":"2023-11-24T08:05:08.165024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:32:16.566917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365196+0000","last_change":"2023-11-24T08:05:07.164250+0000","last_active":"2023-11-24T08:05:09.365196+0000","last_peered":"2023-11-24T08:05:09.365196+0000","last_clean":"2023-11-24T08:05:09.365196+0000","last_became_active":"2023-11-24T08:05:07.163270+0000","last_became_peered":"2023-11-24T08:05:07.163270+0000","last_unstale":"2023-11-24T08:05:09.365196+0000","last_undegraded":"2023-11-24T08:05:09.365196+0000","last_fullsized":"2023-11-24T08:05:09.365196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:58.407712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490710+0000","last_change":"2023-11-24T08:05:07.164929+0000","last_active":"2023-11-24T08:05:08.490710+0000","last_peered":"2023-11-24T08:05:08.490710+0000","last_clean":"2023-11-24T08:05:08.490710+0000","last_became_active":"2023-11-24T08:05:07.164629+0000","last_became_peered":"2023-11-24T08:05:07.164629+0000","last_unstale":"2023-11-24T08:05:08.490710+0000","last_undegraded":"2023-11-24T08:05:08.490710+0000","last_fullsized":"2023-11-24T08:05:08.490710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:00.992778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490844+0000","last_change":"2023-11-24T08:05:07.171031+0000","last_active":"2023-11-24T08:05:08.490844+0000","last_peered":"2023-11-24T08:05:08.490844+0000","last_clean":"2023-11-24T08:05:08.490844+0000","last_became_active":"2023-11-24T08:05:07.170715+0000","last_became_peered":"2023-11-24T08:05:07.170715+0000","last_unstale":"2023-11-24T08:05:08.490844+0000","last_undegraded":"2023-11-24T08:05:08.490844+0000","last_fullsized":"2023-11-24T08:05:08.490844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:38.062624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742589+0000","last_change":"2023-11-24T08:05:07.162297+0000","last_active":"2023-11-24T08:05:08.742589+0000","last_peered":"2023-11-24T08:05:08.742589+0000","last_clean":"2023-11-24T08:05:08.742589+0000","last_became_active":"2023-11-24T08:05:07.162001+0000","last_became_peered":"2023-11-24T08:05:07.162001+0000","last_unstale":"2023-11-24T08:05:08.742589+0000","last_undegraded":"2023-11-24T08:05:08.742589+0000","last_fullsized":"2023-11-24T08:05:08.742589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:01:29.259922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165398+0000","last_change":"2023-11-24T08:05:07.174013+0000","last_active":"2023-11-24T08:05:08.165398+0000","last_peered":"2023-11-24T08:05:08.165398+0000","last_clean":"2023-11-24T08:05:08.165398+0000","last_became_active":"2023-11-24T08:05:07.171792+0000","last_became_peered":"2023-11-24T08:05:07.171792+0000","last_unstale":"2023-11-24T08:05:08.165398+0000","last_undegraded":"2023-11-24T08:05:08.165398+0000","last_fullsized":"2023-11-24T08:05:08.165398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:09.842863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745099+0000","last_change":"2023-11-24T08:05:07.165158+0000","last_active":"2023-11-24T08:05:08.745099+0000","last_peered":"2023-11-24T08:05:08.745099+0000","last_clean":"2023-11-24T08:05:08.745099+0000","last_became_active":"2023-11-24T08:05:07.164887+0000","last_became_peered":"2023-11-24T08:05:07.164887+0000","last_unstale":"2023-11-24T08:05:08.745099+0000","last_undegraded":"2023-11-24T08:05:08.745099+0000","last_fullsized":"2023-11-24T08:05:08.745099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:03:43.888603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165573+0000","last_change":"2023-11-24T08:05:07.171835+0000","last_active":"2023-11-24T08:05:08.165573+0000","last_peered":"2023-11-24T08:05:08.165573+0000","last_clean":"2023-11-24T08:05:08.165573+0000","last_became_active":"2023-11-24T08:05:07.169844+0000","last_became_peered":"2023-11-24T08:05:07.169844+0000","last_unstale":"2023-11-24T08:05:08.165573+0000","last_undegraded":"2023-11-24T08:05:08.165573+0000","last_fullsized":"2023-11-24T08:05:08.165573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:48:05.724245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745091+0000","last_change":"2023-11-24T08:05:07.174469+0000","last_active":"2023-11-24T08:05:08.745091+0000","last_peered":"2023-11-24T08:05:08.745091+0000","last_clean":"2023-11-24T08:05:08.745091+0000","last_became_active":"2023-11-24T08:05:07.174179+0000","last_became_peered":"2023-11-24T08:05:07.174179+0000","last_unstale":"2023-11-24T08:05:08.745091+0000","last_undegraded":"2023-11-24T08:05:08.745091+0000","last_fullsized":"2023-11-24T08:05:08.745091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:37.811909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165782+0000","last_change":"2023-11-24T08:05:07.170828+0000","last_active":"2023-11-24T08:05:08.165782+0000","last_peered":"2023-11-24T08:05:08.165782+0000","last_clean":"2023-11-24T08:05:08.165782+0000","last_became_active":"2023-11-24T08:05:07.170546+0000","last_became_peered":"2023-11-24T08:05:07.170546+0000","last_unstale":"2023-11-24T08:05:08.165782+0000","last_undegraded":"2023-11-24T08:05:08.165782+0000","last_fullsized":"2023-11-24T08:05:08.165782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:19.944842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.491074+0000","last_change":"2023-11-24T08:05:07.168952+0000","last_active":"2023-11-24T08:05:08.491074+0000","last_peered":"2023-11-24T08:05:08.491074+0000","last_clean":"2023-11-24T08:05:08.491074+0000","last_became_active":"2023-11-24T08:05:07.168668+0000","last_became_peered":"2023-11-24T08:05:07.168668+0000","last_unstale":"2023-11-24T08:05:08.491074+0000","last_undegraded":"2023-11-24T08:05:08.491074+0000","last_fullsized":"2023-11-24T08:05:08.491074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:37.811909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866282+0000","last_change":"2023-11-24T08:05:07.171639+0000","last_active":"2023-11-24T08:05:09.866282+0000","last_peered":"2023-11-24T08:05:09.866282+0000","last_clean":"2023-11-24T08:05:09.866282+0000","last_became_active":"2023-11-24T08:05:07.171198+0000","last_became_peered":"2023-11-24T08:05:07.171198+0000","last_unstale":"2023-11-24T08:05:09.866282+0000","last_undegraded":"2023-11-24T08:05:09.866282+0000","last_fullsized":"2023-11-24T08:05:09.866282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:09.842863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866102+0000","last_change":"2023-11-24T08:05:07.165764+0000","last_active":"2023-11-24T08:05:09.866102+0000","last_peered":"2023-11-24T08:05:09.866102+0000","last_clean":"2023-11-24T08:05:09.866102+0000","last_became_active":"2023-11-24T08:05:07.165485+0000","last_became_peered":"2023-11-24T08:05:07.165485+0000","last_unstale":"2023-11-24T08:05:09.866102+0000","last_undegraded":"2023-11-24T08:05:09.866102+0000","last_fullsized":"2023-11-24T08:05:09.866102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:54.075211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866216+0000","last_change":"2023-11-24T08:05:07.174096+0000","last_active":"2023-11-24T08:05:09.866216+0000","last_peered":"2023-11-24T08:05:09.866216+0000","last_clean":"2023-11-24T08:05:09.866216+0000","last_became_active":"2023-11-24T08:05:07.173646+0000","last_became_peered":"2023-11-24T08:05:07.173646+0000","last_unstale":"2023-11-24T08:05:09.866216+0000","last_undegraded":"2023-11-24T08:05:09.866216+0000","last_fullsized":"2023-11-24T08:05:09.866216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:10.497691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742710+0000","last_change":"2023-11-24T08:05:07.173298+0000","last_active":"2023-11-24T08:05:08.742710+0000","last_peered":"2023-11-24T08:05:08.742710+0000","last_clean":"2023-11-24T08:05:08.742710+0000","last_became_active":"2023-11-24T08:05:07.173030+0000","last_became_peered":"2023-11-24T08:05:07.173030+0000","last_unstale":"2023-11-24T08:05:08.742710+0000","last_undegraded":"2023-11-24T08:05:08.742710+0000","last_fullsized":"2023-11-24T08:05:08.742710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:12:42.888692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866212+0000","last_change":"2023-11-24T08:05:06.167366+0000","last_active":"2023-11-24T08:05:09.866212+0000","last_peered":"2023-11-24T08:05:09.866212+0000","last_clean":"2023-11-24T08:05:09.866212+0000","last_became_active":"2023-11-24T08:05:06.167081+0000","last_became_peered":"2023-11-24T08:05:06.167081+0000","last_unstale":"2023-11-24T08:05:09.866212+0000","last_undegraded":"2023-11-24T08:05:09.866212+0000","last_fullsized":"2023-11-24T08:05:09.866212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:34.187921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866338+0000","last_change":"2023-11-24T08:05:07.172862+0000","last_active":"2023-11-24T08:05:09.866338+0000","last_peered":"2023-11-24T08:05:09.866338+0000","last_clean":"2023-11-24T08:05:09.866338+0000","last_became_active":"2023-11-24T08:05:07.172488+0000","last_became_peered":"2023-11-24T08:05:07.172488+0000","last_unstale":"2023-11-24T08:05:09.866338+0000","last_undegraded":"2023-11-24T08:05:09.866338+0000","last_fullsized":"2023-11-24T08:05:09.866338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:12.752555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742705+0000","last_change":"2023-11-24T08:05:06.170698+0000","last_active":"2023-11-24T08:05:08.742705+0000","last_peered":"2023-11-24T08:05:08.742705+0000","last_clean":"2023-11-24T08:05:08.742705+0000","last_became_active":"2023-11-24T08:05:06.170478+0000","last_became_peered":"2023-11-24T08:05:06.170478+0000","last_unstale":"2023-11-24T08:05:08.742705+0000","last_undegraded":"2023-11-24T08:05:08.742705+0000","last_fullsized":"2023-11-24T08:05:08.742705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:40.881550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490848+0000","last_change":"2023-11-24T08:05:07.168994+0000","last_active":"2023-11-24T08:05:08.490848+0000","last_peered":"2023-11-24T08:05:08.490848+0000","last_clean":"2023-11-24T08:05:08.490848+0000","last_became_active":"2023-11-24T08:05:07.168704+0000","last_became_peered":"2023-11-24T08:05:07.168704+0000","last_unstale":"2023-11-24T08:05:08.490848+0000","last_undegraded":"2023-11-24T08:05:08.490848+0000","last_fullsized":"2023-11-24T08:05:08.490848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:52.831778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165004+0000","last_change":"2023-11-24T08:05:06.170071+0000","last_active":"2023-11-24T08:05:08.165004+0000","last_peered":"2023-11-24T08:05:08.165004+0000","last_clean":"2023-11-24T08:05:08.165004+0000","last_became_active":"2023-11-24T08:05:06.169708+0000","last_became_peered":"2023-11-24T08:05:06.169708+0000","last_unstale":"2023-11-24T08:05:08.165004+0000","last_undegraded":"2023-11-24T08:05:08.165004+0000","last_fullsized":"2023-11-24T08:05:08.165004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:36.809916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745043+0000","last_change":"2023-11-24T08:05:07.174490+0000","last_active":"2023-11-24T08:05:08.745043+0000","last_peered":"2023-11-24T08:05:08.745043+0000","last_clean":"2023-11-24T08:05:08.745043+0000","last_became_active":"2023-11-24T08:05:07.174305+0000","last_became_peered":"2023-11-24T08:05:07.174305+0000","last_unstale":"2023-11-24T08:05:08.745043+0000","last_undegraded":"2023-11-24T08:05:08.745043+0000","last_fullsized":"2023-11-24T08:05:08.745043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:44.742619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365121+0000","last_change":"2023-11-24T08:05:06.167696+0000","last_active":"2023-11-24T08:05:09.365121+0000","last_peered":"2023-11-24T08:05:09.365121+0000","last_clean":"2023-11-24T08:05:09.365121+0000","last_became_active":"2023-11-24T08:05:06.167431+0000","last_became_peered":"2023-11-24T08:05:06.167431+0000","last_unstale":"2023-11-24T08:05:09.365121+0000","last_undegraded":"2023-11-24T08:05:09.365121+0000","last_fullsized":"2023-11-24T08:05:09.365121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:37.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866431+0000","last_change":"2023-11-24T08:05:07.173898+0000","last_active":"2023-11-24T08:05:09.866431+0000","last_peered":"2023-11-24T08:05:09.866431+0000","last_clean":"2023-11-24T08:05:09.866431+0000","last_became_active":"2023-11-24T08:05:07.173605+0000","last_became_peered":"2023-11-24T08:05:07.173605+0000","last_unstale":"2023-11-24T08:05:09.866431+0000","last_undegraded":"2023-11-24T08:05:09.866431+0000","last_fullsized":"2023-11-24T08:05:09.866431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:49.608429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.491061+0000","last_change":"2023-11-24T08:05:06.166255+0000","last_active":"2023-11-24T08:05:08.491061+0000","last_peered":"2023-11-24T08:05:08.491061+0000","last_clean":"2023-11-24T08:05:08.491061+0000","last_became_active":"2023-11-24T08:05:06.165979+0000","last_became_peered":"2023-11-24T08:05:06.165979+0000","last_unstale":"2023-11-24T08:05:08.491061+0000","last_undegraded":"2023-11-24T08:05:08.491061+0000","last_fullsized":"2023-11-24T08:05:08.491061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:40.881550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165566+0000","last_change":"2023-11-24T08:05:07.178460+0000","last_active":"2023-11-24T08:05:08.165566+0000","last_peered":"2023-11-24T08:05:08.165566+0000","last_clean":"2023-11-24T08:05:08.165566+0000","last_became_active":"2023-11-24T08:05:07.178190+0000","last_became_peered":"2023-11-24T08:05:07.178190+0000","last_unstale":"2023-11-24T08:05:08.165566+0000","last_undegraded":"2023-11-24T08:05:08.165566+0000","last_fullsized":"2023-11-24T08:05:08.165566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:49.608429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490720+0000","last_change":"2023-11-24T08:05:06.165062+0000","last_active":"2023-11-24T08:05:08.490720+0000","last_peered":"2023-11-24T08:05:08.490720+0000","last_clean":"2023-11-24T08:05:08.490720+0000","last_became_active":"2023-11-24T08:05:06.164791+0000","last_became_peered":"2023-11-24T08:05:06.164791+0000","last_unstale":"2023-11-24T08:05:08.490720+0000","last_undegraded":"2023-11-24T08:05:08.490720+0000","last_fullsized":"2023-11-24T08:05:08.490720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:01:28.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490616+0000","last_change":"2023-11-24T08:05:07.165720+0000","last_active":"2023-11-24T08:05:08.490616+0000","last_peered":"2023-11-24T08:05:08.490616+0000","last_clean":"2023-11-24T08:05:08.490616+0000","last_became_active":"2023-11-24T08:05:07.165448+0000","last_became_peered":"2023-11-24T08:05:07.165448+0000","last_unstale":"2023-11-24T08:05:08.490616+0000","last_undegraded":"2023-11-24T08:05:08.490616+0000","last_fullsized":"2023-11-24T08:05:08.490616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:02.279227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164435+0000","last_change":"2023-11-24T08:05:06.165355+0000","last_active":"2023-11-24T08:05:08.164435+0000","last_peered":"2023-11-24T08:05:08.164435+0000","last_clean":"2023-11-24T08:05:08.164435+0000","last_became_active":"2023-11-24T08:05:06.165104+0000","last_became_peered":"2023-11-24T08:05:06.165104+0000","last_unstale":"2023-11-24T08:05:08.164435+0000","last_undegraded":"2023-11-24T08:05:08.164435+0000","last_fullsized":"2023-11-24T08:05:08.164435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:43.740627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744625+0000","last_change":"2023-11-24T08:05:07.171234+0000","last_active":"2023-11-24T08:05:08.744625+0000","last_peered":"2023-11-24T08:05:08.744625+0000","last_clean":"2023-11-24T08:05:08.744625+0000","last_became_active":"2023-11-24T08:05:07.170960+0000","last_became_peered":"2023-11-24T08:05:07.170960+0000","last_unstale":"2023-11-24T08:05:08.744625+0000","last_undegraded":"2023-11-24T08:05:08.744625+0000","last_fullsized":"2023-11-24T08:05:08.744625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:02.279227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490548+0000","last_change":"2023-11-24T08:05:06.161319+0000","last_active":"2023-11-24T08:05:08.490548+0000","last_peered":"2023-11-24T08:05:08.490548+0000","last_clean":"2023-11-24T08:05:08.490548+0000","last_became_active":"2023-11-24T08:05:06.161038+0000","last_became_peered":"2023-11-24T08:05:06.161038+0000","last_unstale":"2023-11-24T08:05:08.490548+0000","last_undegraded":"2023-11-24T08:05:08.490548+0000","last_fullsized":"2023-11-24T08:05:08.490548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:31.490738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.166109+0000","last_change":"2023-11-24T08:05:07.180747+0000","last_active":"2023-11-24T08:05:08.166109+0000","last_peered":"2023-11-24T08:05:08.166109+0000","last_clean":"2023-11-24T08:05:08.166109+0000","last_became_active":"2023-11-24T08:05:07.180497+0000","last_became_peered":"2023-11-24T08:05:07.180497+0000","last_unstale":"2023-11-24T08:05:08.166109+0000","last_undegraded":"2023-11-24T08:05:08.166109+0000","last_fullsized":"2023-11-24T08:05:08.166109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:44:29.767456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165073+0000","last_change":"2023-11-24T08:05:06.170829+0000","last_active":"2023-11-24T08:05:08.165073+0000","last_peered":"2023-11-24T08:05:08.165073+0000","last_clean":"2023-11-24T08:05:08.165073+0000","last_became_active":"2023-11-24T08:05:06.170437+0000","last_became_peered":"2023-11-24T08:05:06.170437+0000","last_unstale":"2023-11-24T08:05:08.165073+0000","last_undegraded":"2023-11-24T08:05:08.165073+0000","last_fullsized":"2023-11-24T08:05:08.165073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:09.495698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165115+0000","last_change":"2023-11-24T08:05:07.168921+0000","last_active":"2023-11-24T08:05:08.165115+0000","last_peered":"2023-11-24T08:05:08.165115+0000","last_clean":"2023-11-24T08:05:08.165115+0000","last_became_active":"2023-11-24T08:05:07.168509+0000","last_became_peered":"2023-11-24T08:05:07.168509+0000","last_unstale":"2023-11-24T08:05:08.165115+0000","last_undegraded":"2023-11-24T08:05:08.165115+0000","last_fullsized":"2023-11-24T08:05:08.165115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:36.672494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742779+0000","last_change":"2023-11-24T08:05:06.166360+0000","last_active":"2023-11-24T08:05:08.742779+0000","last_peered":"2023-11-24T08:05:08.742779+0000","last_clean":"2023-11-24T08:05:08.742779+0000","last_became_active":"2023-11-24T08:05:06.166084+0000","last_became_peered":"2023-11-24T08:05:06.166084+0000","last_unstale":"2023-11-24T08:05:08.742779+0000","last_undegraded":"2023-11-24T08:05:08.742779+0000","last_fullsized":"2023-11-24T08:05:08.742779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:53.073218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164629+0000","last_change":"2023-11-24T08:05:07.168323+0000","last_active":"2023-11-24T08:05:08.164629+0000","last_peered":"2023-11-24T08:05:08.164629+0000","last_clean":"2023-11-24T08:05:08.164629+0000","last_became_active":"2023-11-24T08:05:07.168008+0000","last_became_peered":"2023-11-24T08:05:07.168008+0000","last_unstale":"2023-11-24T08:05:08.164629+0000","last_undegraded":"2023-11-24T08:05:08.164629+0000","last_fullsized":"2023-11-24T08:05:08.164629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:02.029814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165974+0000","last_change":"2023-11-24T08:05:06.170349+0000","last_active":"2023-11-24T08:05:08.165974+0000","last_peered":"2023-11-24T08:05:08.165974+0000","last_clean":"2023-11-24T08:05:08.165974+0000","last_became_active":"2023-11-24T08:05:06.170052+0000","last_became_peered":"2023-11-24T08:05:06.170052+0000","last_unstale":"2023-11-24T08:05:08.165974+0000","last_undegraded":"2023-11-24T08:05:08.165974+0000","last_fullsized":"2023-11-24T08:05:08.165974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:09.495698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.166214+0000","last_change":"2023-11-24T08:05:07.171236+0000","last_active":"2023-11-24T08:05:08.166214+0000","last_peered":"2023-11-24T08:05:08.166214+0000","last_clean":"2023-11-24T08:05:08.166214+0000","last_became_active":"2023-11-24T08:05:07.170732+0000","last_became_peered":"2023-11-24T08:05:07.170732+0000","last_unstale":"2023-11-24T08:05:08.166214+0000","last_undegraded":"2023-11-24T08:05:08.166214+0000","last_fullsized":"2023-11-24T08:05:08.166214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:36.672494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164993+0000","last_change":"2023-11-24T08:05:06.169837+0000","last_active":"2023-11-24T08:05:08.164993+0000","last_peered":"2023-11-24T08:05:08.164993+0000","last_clean":"2023-11-24T08:05:08.164993+0000","last_became_active":"2023-11-24T08:05:06.169587+0000","last_became_peered":"2023-11-24T08:05:06.169587+0000","last_unstale":"2023-11-24T08:05:08.164993+0000","last_undegraded":"2023-11-24T08:05:08.164993+0000","last_fullsized":"2023-11-24T08:05:08.164993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:45.923970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744648+0000","last_change":"2023-11-24T08:05:07.171311+0000","last_active":"2023-11-24T08:05:08.744648+0000","last_peered":"2023-11-24T08:05:08.744648+0000","last_clean":"2023-11-24T08:05:08.744648+0000","last_became_active":"2023-11-24T08:05:07.171034+0000","last_became_peered":"2023-11-24T08:05:07.171034+0000","last_unstale":"2023-11-24T08:05:08.744648+0000","last_undegraded":"2023-11-24T08:05:08.744648+0000","last_fullsized":"2023-11-24T08:05:08.744648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:00.992778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490925+0000","last_change":"2023-11-24T08:05:06.159882+0000","last_active":"2023-11-24T08:05:08.490925+0000","last_peered":"2023-11-24T08:05:08.490925+0000","last_clean":"2023-11-24T08:05:08.490925+0000","last_became_active":"2023-11-24T08:05:06.159558+0000","last_became_peered":"2023-11-24T08:05:06.159558+0000","last_unstale":"2023-11-24T08:05:08.490925+0000","last_undegraded":"2023-11-24T08:05:08.490925+0000","last_fullsized":"2023-11-24T08:05:08.490925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:19:13.170118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164801+0000","last_change":"2023-11-24T08:05:07.168610+0000","last_active":"2023-11-24T08:05:08.164801+0000","last_peered":"2023-11-24T08:05:08.164801+0000","last_clean":"2023-11-24T08:05:08.164801+0000","last_became_active":"2023-11-24T08:05:07.168350+0000","last_became_peered":"2023-11-24T08:05:07.168350+0000","last_unstale":"2023-11-24T08:05:08.164801+0000","last_undegraded":"2023-11-24T08:05:08.164801+0000","last_fullsized":"2023-11-24T08:05:08.164801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:44:29.767456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744664+0000","last_change":"2023-11-24T08:05:06.166107+0000","last_active":"2023-11-24T08:05:08.744664+0000","last_peered":"2023-11-24T08:05:08.744664+0000","last_clean":"2023-11-24T08:05:08.744664+0000","last_became_active":"2023-11-24T08:05:06.165823+0000","last_became_peered":"2023-11-24T08:05:06.165823+0000","last_unstale":"2023-11-24T08:05:08.744664+0000","last_undegraded":"2023-11-24T08:05:08.744664+0000","last_fullsized":"2023-11-24T08:05:08.744664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:19:13.170118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866185+0000","last_change":"2023-11-24T08:05:07.173919+0000","last_active":"2023-11-24T08:05:09.866185+0000","last_peered":"2023-11-24T08:05:09.866185+0000","last_clean":"2023-11-24T08:05:09.866185+0000","last_became_active":"2023-11-24T08:05:07.173333+0000","last_became_peered":"2023-11-24T08:05:07.173333+0000","last_unstale":"2023-11-24T08:05:09.866185+0000","last_undegraded":"2023-11-24T08:05:09.866185+0000","last_fullsized":"2023-11-24T08:05:09.866185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:58.130042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164508+0000","last_change":"2023-11-24T08:05:06.170576+0000","last_active":"2023-11-24T08:05:08.164508+0000","last_peered":"2023-11-24T08:05:08.164508+0000","last_clean":"2023-11-24T08:05:08.164508+0000","last_became_active":"2023-11-24T08:05:06.169894+0000","last_became_peered":"2023-11-24T08:05:06.169894+0000","last_unstale":"2023-11-24T08:05:08.164508+0000","last_undegraded":"2023-11-24T08:05:08.164508+0000","last_fullsized":"2023-11-24T08:05:08.164508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:03:42.886610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866076+0000","last_change":"2023-11-24T08:05:07.177714+0000","last_active":"2023-11-24T08:05:09.866076+0000","last_peered":"2023-11-24T08:05:09.866076+0000","last_clean":"2023-11-24T08:05:09.866076+0000","last_became_active":"2023-11-24T08:05:07.177379+0000","last_became_peered":"2023-11-24T08:05:07.177379+0000","last_unstale":"2023-11-24T08:05:09.866076+0000","last_undegraded":"2023-11-24T08:05:09.866076+0000","last_fullsized":"2023-11-24T08:05:09.866076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:57.421717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164405+0000","last_change":"2023-11-24T08:05:06.169625+0000","last_active":"2023-11-24T08:05:08.164405+0000","last_peered":"2023-11-24T08:05:08.164405+0000","last_clean":"2023-11-24T08:05:08.164405+0000","last_became_active":"2023-11-24T08:05:06.169384+0000","last_became_peered":"2023-11-24T08:05:06.169384+0000","last_unstale":"2023-11-24T08:05:08.164405+0000","last_undegraded":"2023-11-24T08:05:08.164405+0000","last_fullsized":"2023-11-24T08:05:08.164405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:57.128050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490806+0000","last_change":"2023-11-24T08:05:07.172833+0000","last_active":"2023-11-24T08:05:08.490806+0000","last_peered":"2023-11-24T08:05:08.490806+0000","last_clean":"2023-11-24T08:05:08.490806+0000","last_became_active":"2023-11-24T08:05:07.172547+0000","last_became_peered":"2023-11-24T08:05:07.172547+0000","last_unstale":"2023-11-24T08:05:08.490806+0000","last_undegraded":"2023-11-24T08:05:08.490806+0000","last_fullsized":"2023-11-24T08:05:08.490806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:29.914282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745240+0000","last_change":"2023-11-24T08:05:06.165927+0000","last_active":"2023-11-24T08:05:08.745240+0000","last_peered":"2023-11-24T08:05:08.745240+0000","last_clean":"2023-11-24T08:05:08.745240+0000","last_became_active":"2023-11-24T08:05:06.165698+0000","last_became_peered":"2023-11-24T08:05:06.165698+0000","last_unstale":"2023-11-24T08:05:08.745240+0000","last_undegraded":"2023-11-24T08:05:08.745240+0000","last_fullsized":"2023-11-24T08:05:08.745240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:53.073218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.166283+0000","last_change":"2023-11-24T08:05:07.173049+0000","last_active":"2023-11-24T08:05:08.166283+0000","last_peered":"2023-11-24T08:05:08.166283+0000","last_clean":"2023-11-24T08:05:08.166283+0000","last_became_active":"2023-11-24T08:05:07.172777+0000","last_became_peered":"2023-11-24T08:05:07.172777+0000","last_unstale":"2023-11-24T08:05:08.166283+0000","last_undegraded":"2023-11-24T08:05:08.166283+0000","last_fullsized":"2023-11-24T08:05:08.166283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:58:37.801404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490861+0000","last_change":"2023-11-24T08:05:06.161253+0000","last_active":"2023-11-24T08:05:08.490861+0000","last_peered":"2023-11-24T08:05:08.490861+0000","last_clean":"2023-11-24T08:05:08.490861+0000","last_became_active":"2023-11-24T08:05:06.160958+0000","last_became_peered":"2023-11-24T08:05:06.160958+0000","last_unstale":"2023-11-24T08:05:08.490861+0000","last_undegraded":"2023-11-24T08:05:08.490861+0000","last_fullsized":"2023-11-24T08:05:08.490861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:57.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744855+0000","last_change":"2023-11-24T08:05:07.175714+0000","last_active":"2023-11-24T08:05:08.744855+0000","last_peered":"2023-11-24T08:05:08.744855+0000","last_clean":"2023-11-24T08:05:08.744855+0000","last_became_active":"2023-11-24T08:05:07.175296+0000","last_became_peered":"2023-11-24T08:05:07.175296+0000","last_unstale":"2023-11-24T08:05:08.744855+0000","last_undegraded":"2023-11-24T08:05:08.744855+0000","last_fullsized":"2023-11-24T08:05:08.744855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:38.062624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490924+0000","last_change":"2023-11-24T08:05:06.165335+0000","last_active":"2023-11-24T08:05:08.490924+0000","last_peered":"2023-11-24T08:05:08.490924+0000","last_clean":"2023-11-24T08:05:08.490924+0000","last_became_active":"2023-11-24T08:05:06.165057+0000","last_became_peered":"2023-11-24T08:05:06.165057+0000","last_unstale":"2023-11-24T08:05:08.490924+0000","last_undegraded":"2023-11-24T08:05:08.490924+0000","last_fullsized":"2023-11-24T08:05:08.490924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:19.673273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365123+0000","last_change":"2023-11-24T08:05:07.165138+0000","last_active":"2023-11-24T08:05:09.365123+0000","last_peered":"2023-11-24T08:05:09.365123+0000","last_clean":"2023-11-24T08:05:09.365123+0000","last_became_active":"2023-11-24T08:05:07.164852+0000","last_became_peered":"2023-11-24T08:05:07.164852+0000","last_unstale":"2023-11-24T08:05:09.365123+0000","last_undegraded":"2023-11-24T08:05:09.365123+0000","last_fullsized":"2023-11-24T08:05:09.365123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:24.053377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.491032+0000","last_change":"2023-11-24T08:05:06.167096+0000","last_active":"2023-11-24T08:05:08.491032+0000","last_peered":"2023-11-24T08:05:08.491032+0000","last_clean":"2023-11-24T08:05:08.491032+0000","last_became_active":"2023-11-24T08:05:06.166715+0000","last_became_peered":"2023-11-24T08:05:06.166715+0000","last_unstale":"2023-11-24T08:05:08.491032+0000","last_undegraded":"2023-11-24T08:05:08.491032+0000","last_fullsized":"2023-11-24T08:05:08.491032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:25.845668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365000+0000","last_change":"2023-11-24T08:05:07.172174+0000","last_active":"2023-11-24T08:05:09.365000+0000","last_peered":"2023-11-24T08:05:09.365000+0000","last_clean":"2023-11-24T08:05:09.365000+0000","last_became_active":"2023-11-24T08:05:07.171856+0000","last_became_peered":"2023-11-24T08:05:07.171856+0000","last_unstale":"2023-11-24T08:05:09.365000+0000","last_undegraded":"2023-11-24T08:05:09.365000+0000","last_fullsized":"2023-11-24T08:05:09.365000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:20.675266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742717+0000","last_change":"2023-11-24T08:05:06.171728+0000","last_active":"2023-11-24T08:05:08.742717+0000","last_peered":"2023-11-24T08:05:08.742717+0000","last_clean":"2023-11-24T08:05:08.742717+0000","last_became_active":"2023-11-24T08:05:06.171463+0000","last_became_peered":"2023-11-24T08:05:06.171463+0000","last_unstale":"2023-11-24T08:05:08.742717+0000","last_undegraded":"2023-11-24T08:05:08.742717+0000","last_fullsized":"2023-11-24T08:05:08.742717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:23.051385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365065+0000","last_change":"2023-11-24T08:05:07.163462+0000","last_active":"2023-11-24T08:05:09.365065+0000","last_peered":"2023-11-24T08:05:09.365065+0000","last_clean":"2023-11-24T08:05:09.365065+0000","last_became_active":"2023-11-24T08:05:07.163005+0000","last_became_peered":"2023-11-24T08:05:07.163005+0000","last_unstale":"2023-11-24T08:05:09.365065+0000","last_undegraded":"2023-11-24T08:05:09.365065+0000","last_fullsized":"2023-11-24T08:05:09.365065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:19:14.172111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.865925+0000","last_change":"2023-11-24T08:05:06.166904+0000","last_active":"2023-11-24T08:05:09.865925+0000","last_peered":"2023-11-24T08:05:09.865925+0000","last_clean":"2023-11-24T08:05:09.865925+0000","last_became_active":"2023-11-24T08:05:06.166560+0000","last_became_peered":"2023-11-24T08:05:06.166560+0000","last_unstale":"2023-11-24T08:05:09.865925+0000","last_undegraded":"2023-11-24T08:05:09.865925+0000","last_fullsized":"2023-11-24T08:05:09.865925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:57.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.364981+0000","last_change":"2023-11-24T08:05:07.162646+0000","last_active":"2023-11-24T08:05:09.364981+0000","last_peered":"2023-11-24T08:05:09.364981+0000","last_clean":"2023-11-24T08:05:09.364981+0000","last_became_active":"2023-11-24T08:05:07.162389+0000","last_became_peered":"2023-11-24T08:05:07.162389+0000","last_unstale":"2023-11-24T08:05:09.364981+0000","last_undegraded":"2023-11-24T08:05:09.364981+0000","last_fullsized":"2023-11-24T08:05:09.364981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:58:15.960798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490783+0000","last_change":"2023-11-24T08:05:06.166275+0000","last_active":"2023-11-24T08:05:08.490783+0000","last_peered":"2023-11-24T08:05:08.490783+0000","last_clean":"2023-11-24T08:05:08.490783+0000","last_became_active":"2023-11-24T08:05:06.165991+0000","last_became_peered":"2023-11-24T08:05:06.165991+0000","last_unstale":"2023-11-24T08:05:08.490783+0000","last_undegraded":"2023-11-24T08:05:08.490783+0000","last_fullsized":"2023-11-24T08:05:08.490783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:49:50.780552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866489+0000","last_change":"2023-11-24T08:05:07.176023+0000","last_active":"2023-11-24T08:05:09.866489+0000","last_peered":"2023-11-24T08:05:09.866489+0000","last_clean":"2023-11-24T08:05:09.866489+0000","last_became_active":"2023-11-24T08:05:07.174707+0000","last_became_peered":"2023-11-24T08:05:07.174707+0000","last_unstale":"2023-11-24T08:05:09.866489+0000","last_undegraded":"2023-11-24T08:05:09.866489+0000","last_fullsized":"2023-11-24T08:05:09.866489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:19.944842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.165325+0000","last_change":"2023-11-24T08:05:06.170415+0000","last_active":"2023-11-24T08:05:08.165325+0000","last_peered":"2023-11-24T08:05:08.165325+0000","last_clean":"2023-11-24T08:05:08.165325+0000","last_became_active":"2023-11-24T08:05:06.170153+0000","last_became_peered":"2023-11-24T08:05:06.170153+0000","last_unstale":"2023-11-24T08:05:08.165325+0000","last_undegraded":"2023-11-24T08:05:08.165325+0000","last_fullsized":"2023-11-24T08:05:08.165325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:45.923970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.365206+0000","last_change":"2023-11-24T08:05:07.171305+0000","last_active":"2023-11-24T08:05:09.365206+0000","last_peered":"2023-11-24T08:05:09.365206+0000","last_clean":"2023-11-24T08:05:09.365206+0000","last_became_active":"2023-11-24T08:05:07.171035+0000","last_became_peered":"2023-11-24T08:05:07.171035+0000","last_unstale":"2023-11-24T08:05:09.365206+0000","last_undegraded":"2023-11-24T08:05:09.365206+0000","last_fullsized":"2023-11-24T08:05:09.365206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:41.883543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.745179+0000","last_change":"2023-11-24T08:05:06.166139+0000","last_active":"2023-11-24T08:05:08.745179+0000","last_peered":"2023-11-24T08:05:08.745179+0000","last_clean":"2023-11-24T08:05:08.745179+0000","last_became_active":"2023-11-24T08:05:06.165389+0000","last_became_peered":"2023-11-24T08:05:06.165389+0000","last_unstale":"2023-11-24T08:05:08.745179+0000","last_undegraded":"2023-11-24T08:05:08.745179+0000","last_fullsized":"2023-11-24T08:05:08.745179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:56.419725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.166126+0000","last_change":"2023-11-24T08:05:07.178828+0000","last_active":"2023-11-24T08:05:08.166126+0000","last_peered":"2023-11-24T08:05:08.166126+0000","last_clean":"2023-11-24T08:05:08.166126+0000","last_became_active":"2023-11-24T08:05:07.178589+0000","last_became_peered":"2023-11-24T08:05:07.178589+0000","last_unstale":"2023-11-24T08:05:08.166126+0000","last_undegraded":"2023-11-24T08:05:08.166126+0000","last_fullsized":"2023-11-24T08:05:08.166126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:32:16.566917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744102+0000","last_change":"2023-11-24T08:05:06.170207+0000","last_active":"2023-11-24T08:05:08.744102+0000","last_peered":"2023-11-24T08:05:08.744102+0000","last_clean":"2023-11-24T08:05:08.744102+0000","last_became_active":"2023-11-24T08:05:06.169894+0000","last_became_peered":"2023-11-24T08:05:06.169894+0000","last_unstale":"2023-11-24T08:05:08.744102+0000","last_undegraded":"2023-11-24T08:05:08.744102+0000","last_fullsized":"2023-11-24T08:05:08.744102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:49:50.780552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742652+0000","last_change":"2023-11-24T08:05:07.170828+0000","last_active":"2023-11-24T08:05:08.742652+0000","last_peered":"2023-11-24T08:05:08.742652+0000","last_clean":"2023-11-24T08:05:08.742652+0000","last_became_active":"2023-11-24T08:05:07.170529+0000","last_became_peered":"2023-11-24T08:05:07.170529+0000","last_unstale":"2023-11-24T08:05:08.742652+0000","last_undegraded":"2023-11-24T08:05:08.742652+0000","last_fullsized":"2023-11-24T08:05:08.742652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:12.752555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744922+0000","last_change":"2023-11-24T08:05:06.165259+0000","last_active":"2023-11-24T08:05:08.744922+0000","last_peered":"2023-11-24T08:05:08.744922+0000","last_clean":"2023-11-24T08:05:08.744922+0000","last_became_active":"2023-11-24T08:05:06.165000+0000","last_became_peered":"2023-11-24T08:05:06.165000+0000","last_unstale":"2023-11-24T08:05:08.744922+0000","last_undegraded":"2023-11-24T08:05:08.744922+0000","last_fullsized":"2023-11-24T08:05:08.744922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:01:28.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866254+0000","last_change":"2023-11-24T08:05:07.164674+0000","last_active":"2023-11-24T08:05:09.866254+0000","last_peered":"2023-11-24T08:05:09.866254+0000","last_clean":"2023-11-24T08:05:09.866254+0000","last_became_active":"2023-11-24T08:05:07.164385+0000","last_became_peered":"2023-11-24T08:05:07.164385+0000","last_unstale":"2023-11-24T08:05:09.866254+0000","last_undegraded":"2023-11-24T08:05:09.866254+0000","last_fullsized":"2023-11-24T08:05:09.866254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:01:29.259922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742685+0000","last_change":"2023-11-24T08:05:06.167778+0000","last_active":"2023-11-24T08:05:08.742685+0000","last_peered":"2023-11-24T08:05:08.742685+0000","last_clean":"2023-11-24T08:05:08.742685+0000","last_became_active":"2023-11-24T08:05:06.167507+0000","last_became_peered":"2023-11-24T08:05:06.167507+0000","last_unstale":"2023-11-24T08:05:08.742685+0000","last_undegraded":"2023-11-24T08:05:08.742685+0000","last_fullsized":"2023-11-24T08:05:08.742685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:25.845668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.742783+0000","last_change":"2023-11-24T08:05:07.171951+0000","last_active":"2023-11-24T08:05:08.742783+0000","last_peered":"2023-11-24T08:05:08.742783+0000","last_clean":"2023-11-24T08:05:08.742783+0000","last_became_active":"2023-11-24T08:05:07.171619+0000","last_became_peered":"2023-11-24T08:05:07.171619+0000","last_unstale":"2023-11-24T08:05:08.742783+0000","last_undegraded":"2023-11-24T08:05:08.742783+0000","last_fullsized":"2023-11-24T08:05:08.742783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:02.279227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.744765+0000","last_change":"2023-11-24T08:05:06.168541+0000","last_active":"2023-11-24T08:05:08.744765+0000","last_peered":"2023-11-24T08:05:08.744765+0000","last_clean":"2023-11-24T08:05:08.744765+0000","last_became_active":"2023-11-24T08:05:06.168172+0000","last_became_peered":"2023-11-24T08:05:06.168172+0000","last_unstale":"2023-11-24T08:05:08.744765+0000","last_undegraded":"2023-11-24T08:05:08.744765+0000","last_fullsized":"2023-11-24T08:05:08.744765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:23.051385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164456+0000","last_change":"2023-11-24T08:05:07.178496+0000","last_active":"2023-11-24T08:05:08.164456+0000","last_peered":"2023-11-24T08:05:08.164456+0000","last_clean":"2023-11-24T08:05:08.164456+0000","last_became_active":"2023-11-24T08:05:07.175421+0000","last_became_peered":"2023-11-24T08:05:07.175421+0000","last_unstale":"2023-11-24T08:05:08.164456+0000","last_undegraded":"2023-11-24T08:05:08.164456+0000","last_fullsized":"2023-11-24T08:05:08.164456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:49.608429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490793+0000","last_change":"2023-11-24T08:05:06.164192+0000","last_active":"2023-11-24T08:05:08.490793+0000","last_peered":"2023-11-24T08:05:08.490793+0000","last_clean":"2023-11-24T08:05:08.490793+0000","last_became_active":"2023-11-24T08:05:06.163910+0000","last_became_peered":"2023-11-24T08:05:06.163910+0000","last_unstale":"2023-11-24T08:05:08.490793+0000","last_undegraded":"2023-11-24T08:05:08.490793+0000","last_fullsized":"2023-11-24T08:05:08.490793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:53.073218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.490566+0000","last_change":"2023-11-24T08:05:07.168616+0000","last_active":"2023-11-24T08:05:08.490566+0000","last_peered":"2023-11-24T08:05:08.490566+0000","last_clean":"2023-11-24T08:05:08.490566+0000","last_became_active":"2023-11-24T08:05:07.168232+0000","last_became_peered":"2023-11-24T08:05:07.168232+0000","last_unstale":"2023-11-24T08:05:08.490566+0000","last_undegraded":"2023-11-24T08:05:08.490566+0000","last_fullsized":"2023-11-24T08:05:08.490566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:12:42.888692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:08.164542+0000","last_change":"2023-11-24T08:05:06.170514+0000","last_active":"2023-11-24T08:05:08.164542+0000","last_peered":"2023-11-24T08:05:08.164542+0000","last_clean":"2023-11-24T08:05:08.164542+0000","last_became_active":"2023-11-24T08:05:06.170149+0000","last_became_peered":"2023-11-24T08:05:06.170149+0000","last_unstale":"2023-11-24T08:05:08.164542+0000","last_undegraded":"2023-11-24T08:05:08.164542+0000","last_fullsized":"2023-11-24T08:05:08.164542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:08.840870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.866525+0000","last_change":"2023-11-24T08:05:07.169964+0000","last_active":"2023-11-24T08:05:09.866525+0000","last_peered":"2023-11-24T08:05:09.866525+0000","last_clean":"2023-11-24T08:05:09.866525+0000","last_became_active":"2023-11-24T08:05:07.169585+0000","last_became_peered":"2023-11-24T08:05:07.169585+0000","last_unstale":"2023-11-24T08:05:09.866525+0000","last_undegraded":"2023-11-24T08:05:09.866525+0000","last_fullsized":"2023-11-24T08:05:09.866525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:06.138163+0000","last_clean_scrub_stamp":"2023-11-24T08:05:06.138163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:02.029814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T08:05:09.865804+0000","last_change":"2023-11-24T08:05:06.158426+0000","last_active":"2023-11-24T08:05:09.865804+0000","last_peered":"2023-11-24T08:05:09.865804+0000","last_clean":"2023-11-24T08:05:09.865804+0000","last_became_active":"2023-11-24T08:05:06.158105+0000","last_became_peered":"2023-11-24T08:05:06.158105+0000","last_unstale":"2023-11-24T08:05:09.865804+0000","last_undegraded":"2023-11-24T08:05:09.865804+0000","last_fullsized":"2023-11-24T08:05:09.865804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:05.136171+0000","last_clean_scrub_stamp":"2023-11-24T08:05:05.136171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:23.051385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T08:05:07.160092+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:05:07.160092+0000","last_peered":"2023-11-24T08:05:07.160092+0000","last_clean":"2023-11-24T08:05:07.160092+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:05:07.160092+0000","last_undegraded":"2023-11-24T08:05:07.160092+0000","last_fullsized":"2023-11-24T08:05:07.160092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":729875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.67500000000000004}]},{"osd":2,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.436},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.61899999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":10.285,"5min":10.285,"15min":10.285},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.753},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.436}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46800000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.496}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.379},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":728766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.308}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.34000000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.8109999999999999,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.55400000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":9.9100000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4,"5min":4,"15min":4},"last":0.56200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":139487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":5.673,"5min":5.673,"15min":5.673},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.372}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":4.4400000000000004,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.751},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":5.726,"5min":5.726,"15min":5.726},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.7880000000000003,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.32000000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.245},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.44700000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.47899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":139521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.495},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.63100000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.45500000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":140089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.42399999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60599999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:16.198 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:05:16.199 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T08:05:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.359+0000 7f7389126700 1 Processor -- start 2023-11-24T08:05:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.359+0000 7f7389126700 1 -- start start 2023-11-24T08:05:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f7389126700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738415ada0 0x7f738406f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f7389126700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f73840afb40 0x7f73840cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f7389126700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f73840cfa80 0x7f738406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f7389126700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73840cd2e0 con 0x7f73840cfa80 2023-11-24T08:05:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f7389126700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73840cd5c0 con 0x7f73840afb40 2023-11-24T08:05:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f7389126700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73840cccd0 con 0x7f738415ada0 2023-11-24T08:05:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f738359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f73840cfa80 0x7f738406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f738359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f73840cfa80 0x7f738406d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37400/0 (socket says 172.21.15.153:37400) 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f738359e700 1 -- 172.21.15.153:0/3297998555 learned_addr learned my addr 172.21.15.153:0/3297998555 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f7382d9d700 1 --2- 172.21.15.153:0/3297998555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738415ada0 0x7f738406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f738259c700 1 --2- 172.21.15.153:0/3297998555 >> v2:172.21.15.164:3300/0 conn(0x7f73840afb40 0x7f73840cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f738359e700 1 -- 172.21.15.153:0/3297998555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738415ada0 msgr2=0x7f738406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f738359e700 1 --2- 172.21.15.153:0/3297998555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738415ada0 0x7f738406f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f738359e700 1 -- 172.21.15.153:0/3297998555 >> v2:172.21.15.164:3300/0 conn(0x7f73840afb40 msgr2=0x7f73840cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f738359e700 1 --2- 172.21.15.153:0/3297998555 >> v2:172.21.15.164:3300/0 conn(0x7f73840afb40 0x7f73840cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f738359e700 1 -- 172.21.15.153:0/3297998555 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738406fd50 con 0x7f73840cfa80 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.360+0000 7f738359e700 1 --2- 172.21.15.153:0/3297998555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73840cfa80 0x7f738406d3c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7384071050 tx=0x7f737c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee55aabebb269d2c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7381d9b700 1 -- 172.21.15.153:0/3297998555 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c00e070 con 0x7f73840cfa80 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7381d9b700 1 -- 172.21.15.153:0/3297998555 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c00b9c0 con 0x7f73840cfa80 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7381d9b700 1 -- 172.21.15.153:0/3297998555 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c00bd70 con 0x7f73840cfa80 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7389126700 1 -- 172.21.15.153:0/3297998555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73840cfa80 msgr2=0x7f738406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7389126700 1 --2- 172.21.15.153:0/3297998555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73840cfa80 0x7f738406d3c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7384071050 tx=0x7f737c00b330 comp rx=0 tx=0).stop 2023-11-24T08:05:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7389126700 1 -- 172.21.15.153:0/3297998555 shutdown_connections 2023-11-24T08:05:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7389126700 1 --2- 172.21.15.153:0/3297998555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73840cfa80 0x7f738406d3c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7389126700 1 --2- 172.21.15.153:0/3297998555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738415ada0 0x7f738406f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7389126700 1 --2- 172.21.15.153:0/3297998555 >> v2:172.21.15.164:3300/0 conn(0x7f73840afb40 0x7f73840cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7389126700 1 -- 172.21.15.153:0/3297998555 >> 172.21.15.153:0/3297998555 conn(0x7f73840b2050 msgr2=0x7f73840b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7389126700 1 -- 172.21.15.153:0/3297998555 shutdown_connections 2023-11-24T08:05:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.361+0000 7f7389126700 1 -- 172.21.15.153:0/3297998555 wait complete. 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.363+0000 7f7389126700 1 Processor -- start 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.363+0000 7f7389126700 1 -- start start 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.363+0000 7f7389126700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73840afb40 0x7f73840ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.363+0000 7f7389126700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73840cfa80 0x7f7384148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.363+0000 7f7389126700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f738415ada0 0x7f73840ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.363+0000 7f7389126700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73840acdb0 con 0x7f73840afb40 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.363+0000 7f7389126700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73840ac130 con 0x7f738415ada0 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.363+0000 7f7389126700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73840ac410 con 0x7f73840cfa80 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f7382d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73840afb40 0x7f73840ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f7382d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73840afb40 0x7f73840ad1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37402/0 (socket says 172.21.15.153:37402) 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f7382d9d700 1 -- 172.21.15.153:0/4166274208 learned_addr learned my addr 172.21.15.153:0/4166274208 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f738359e700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f738415ada0 0x7f73840ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f738259c700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73840cfa80 0x7f7384148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f7382d9d700 1 -- 172.21.15.153:0/4166274208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73840cfa80 msgr2=0x7f7384148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f7382d9d700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73840cfa80 0x7f7384148ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f7382d9d700 1 -- 172.21.15.153:0/4166274208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f738415ada0 msgr2=0x7f73840ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f7382d9d700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f738415ada0 0x7f73840ab670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f7382d9d700 1 -- 172.21.15.153:0/4166274208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c009b30 con 0x7f73840afb40 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f7382d9d700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73840afb40 0x7f73840ad1d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f737800d800 tx=0x7f737800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f736b7fe700 1 -- 172.21.15.153:0/4166274208 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73780125f0 con 0x7f73840afb40 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f736b7fe700 1 -- 172.21.15.153:0/4166274208 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7378012750 con 0x7f73840afb40 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f736b7fe700 1 -- 172.21.15.153:0/4166274208 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7378012b00 con 0x7f73840afb40 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f7389126700 1 -- 172.21.15.153:0/4166274208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73840ac6f0 con 0x7f73840afb40 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.364+0000 7f7389126700 1 -- 172.21.15.153:0/4166274208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73840ad710 con 0x7f73840afb40 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.365+0000 7f7389126700 1 -- 172.21.15.153:0/4166274208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7384068d90 con 0x7f73840afb40 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.366+0000 7f736b7fe700 1 -- 172.21.15.153:0/4166274208 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7378012c60 con 0x7f73840afb40 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.366+0000 7f736b7fe700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f737006aed0 0x7f737006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.366+0000 7f738259c700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f737006aed0 0x7f737006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.366+0000 7f736b7fe700 1 -- 172.21.15.153:0/4166274208 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7378089980 con 0x7f73840afb40 2023-11-24T08:05:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.367+0000 7f738259c700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f737006aed0 0x7f737006d390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f738415a7b0 tx=0x7f7374008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.371+0000 7f736b7fe700 1 -- 172.21.15.153:0/4166274208 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7378054a30 con 0x7f73840afb40 2023-11-24T08:05:16.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.642+0000 7f7389126700 1 -- 172.21.15.153:0/4166274208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7384068fb0 con 0x7f73840afb40 2023-11-24T08:05:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.644+0000 7f736b7fe700 1 -- 172.21.15.153:0/4166274208 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f7378058050 con 0x7f73840afb40 2023-11-24T08:05:16.646 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2023-11-24T08:05:16.646 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDIWGBlu28wOBAATnuO3XTplxrcn9JD3ta5XQ== 2023-11-24T08:05:16.646 INFO:teuthology.orchestra.run.smithi153.stdout: caps mds = "allow" 2023-11-24T08:05:16.646 INFO:teuthology.orchestra.run.smithi153.stdout: caps mon = "allow r" 2023-11-24T08:05:16.647 INFO:teuthology.orchestra.run.smithi153.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T08:05:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 -- 172.21.15.153:0/4166274208 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f737006aed0 msgr2=0x7f737006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f737006aed0 0x7f737006d390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f738415a7b0 tx=0x7f7374008040 comp rx=0 tx=0).stop 2023-11-24T08:05:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 -- 172.21.15.153:0/4166274208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73840afb40 msgr2=0x7f73840ad1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73840afb40 0x7f73840ad1d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f737800d800 tx=0x7f737800dbc0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 -- 172.21.15.153:0/4166274208 shutdown_connections 2023-11-24T08:05:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f738415ada0 0x7f73840ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f737006aed0 0x7f737006d390 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73840afb40 0x7f73840ad1d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 --2- 172.21.15.153:0/4166274208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73840cfa80 0x7f7384148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 -- 172.21.15.153:0/4166274208 >> 172.21.15.153:0/4166274208 conn(0x7f73840b2050 msgr2=0x7f738406e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 -- 172.21.15.153:0/4166274208 shutdown_connections 2023-11-24T08:05:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.646+0000 7f7389126700 1 -- 172.21.15.153:0/4166274208 wait complete. 2023-11-24T08:05:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-11-24T08:05:16.661 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:16.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.780+0000 7f30452d5700 1 Processor -- start 2023-11-24T08:05:16.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.780+0000 7f30452d5700 1 -- start start 2023-11-24T08:05:16.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.780+0000 7f30452d5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304015e090 0x7f304006bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.780+0000 7f30452d5700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f30400d2250 0x7f30400b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.780+0000 7f30452d5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30400d0ee0 con 0x7f304006c090 2023-11-24T08:05:16.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f30452d5700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30400d02d0 con 0x7f30400d2250 2023-11-24T08:05:16.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f30452d5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30400d05b0 con 0x7f304015e090 2023-11-24T08:05:16.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303e7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f304006c090 0x7f30400d1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43516/0 (socket says 172.21.15.153:43516) 2023-11-24T08:05:16.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303e7fc700 1 -- 172.21.15.153:0/193889915 learned_addr learned my addr 172.21.15.153:0/193889915 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:16.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303effd700 1 --2- 172.21.15.153:0/193889915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304015e090 0x7f304006bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303f7fe700 1 --2- 172.21.15.153:0/193889915 >> v2:172.21.15.164:3300/0 conn(0x7f30400d2250 0x7f30400b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303dffb700 1 -- 172.21.15.153:0/193889915 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006763200 0 0) 0x7f30400d0ee0 con 0x7f304006c090 2023-11-24T08:05:16.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303dffb700 1 -- 172.21.15.153:0/193889915 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30280035b0 con 0x7f304006c090 2023-11-24T08:05:16.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303f7fe700 1 -- 172.21.15.153:0/193889915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304015e090 msgr2=0x7f304006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303dffb700 1 -- 172.21.15.153:0/193889915 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3916255911 0 0) 0x7f30280035b0 con 0x7f304006c090 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303f7fe700 1 --2- 172.21.15.153:0/193889915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304015e090 0x7f304006bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303f7fe700 1 -- 172.21.15.153:0/193889915 >> v1:172.21.15.153:6789/0 conn(0x7f304006c090 legacy=0x7f30400d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303f7fe700 1 -- 172.21.15.153:0/193889915 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400d0890 con 0x7f30400d2250 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303effd700 1 --2- 172.21.15.153:0/193889915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304015e090 0x7f304006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.781+0000 7f303f7fe700 1 --2- 172.21.15.153:0/193889915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30400d2250 0x7f30400b15c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3038009d90 tx=0x7f303800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e6b0e42333f9e95 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.782+0000 7f303dffb700 1 -- 172.21.15.153:0/193889915 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800e070 con 0x7f30400d2250 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.782+0000 7f303dffb700 1 -- 172.21.15.153:0/193889915 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3038003a20 con 0x7f30400d2250 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.782+0000 7f303dffb700 1 -- 172.21.15.153:0/193889915 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034001670 con 0x7f30400d2250 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.782+0000 7f30452d5700 1 -- 172.21.15.153:0/193889915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30400d2250 msgr2=0x7f30400b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.782+0000 7f30452d5700 1 --2- 172.21.15.153:0/193889915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30400d2250 0x7f30400b15c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3038009d90 tx=0x7f303800b330 comp rx=0 tx=0).stop 2023-11-24T08:05:16.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.782+0000 7f30452d5700 1 -- 172.21.15.153:0/193889915 shutdown_connections 2023-11-24T08:05:16.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.782+0000 7f30452d5700 1 --2- 172.21.15.153:0/193889915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30400d2250 0x7f30400b15c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.782+0000 7f30452d5700 1 --2- 172.21.15.153:0/193889915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304015e090 0x7f304006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.782+0000 7f30452d5700 1 -- 172.21.15.153:0/193889915 >> 172.21.15.153:0/193889915 conn(0x7f30400731a0 msgr2=0x7f304009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.782+0000 7f30452d5700 1 -- 172.21.15.153:0/193889915 shutdown_connections 2023-11-24T08:05:16.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.782+0000 7f30452d5700 1 -- 172.21.15.153:0/193889915 wait complete. 2023-11-24T08:05:16.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.783+0000 7f30452d5700 1 Processor -- start 2023-11-24T08:05:16.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.784+0000 7f30452d5700 1 -- start start 2023-11-24T08:05:16.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.784+0000 7f30452d5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304006c090 0x7f3040160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.784+0000 7f30452d5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30400d2250 0x7f30401524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.784+0000 7f30452d5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f304015e090 0x7f30400cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.784+0000 7f30452d5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30401529e0 con 0x7f304015e090 2023-11-24T08:05:16.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.784+0000 7f30452d5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30400cbb40 con 0x7f30400d2250 2023-11-24T08:05:16.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.784+0000 7f30452d5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3040160dc0 con 0x7f304006c090 2023-11-24T08:05:16.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.784+0000 7f303f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f304015e090 0x7f30400cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.784+0000 7f303f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f304015e090 0x7f30400cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37420/0 (socket says 172.21.15.153:37420) 2023-11-24T08:05:16.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.784+0000 7f303f7fe700 1 -- 172.21.15.153:0/392413906 learned_addr learned my addr 172.21.15.153:0/392413906 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:16.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f303effd700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304006c090 0x7f3040160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f303e7fc700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30400d2250 0x7f30401524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f303f7fe700 1 -- 172.21.15.153:0/392413906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304006c090 msgr2=0x7f3040160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f303f7fe700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304006c090 0x7f3040160770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f303f7fe700 1 -- 172.21.15.153:0/392413906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30400d2250 msgr2=0x7f30401524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f303f7fe700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30400d2250 0x7f30401524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f303f7fe700 1 -- 172.21.15.153:0/392413906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30300094a0 con 0x7f304015e090 2023-11-24T08:05:16.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f303effd700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304006c090 0x7f3040160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:16.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f303f7fe700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f304015e090 0x7f30400cb600 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f303800b370 tx=0x7f3038004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f30277fe700 1 -- 172.21.15.153:0/392413906 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038004540 con 0x7f304015e090 2023-11-24T08:05:16.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f30277fe700 1 -- 172.21.15.153:0/392413906 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30380046a0 con 0x7f304015e090 2023-11-24T08:05:16.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f30452d5700 1 -- 172.21.15.153:0/392413906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3038009a70 con 0x7f304015e090 2023-11-24T08:05:16.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f30277fe700 1 -- 172.21.15.153:0/392413906 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038012430 con 0x7f304015e090 2023-11-24T08:05:16.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.785+0000 7f30452d5700 1 -- 172.21.15.153:0/392413906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3040161380 con 0x7f304015e090 2023-11-24T08:05:16.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.786+0000 7f30452d5700 1 -- 172.21.15.153:0/392413906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30400751e0 con 0x7f304015e090 2023-11-24T08:05:16.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.786+0000 7f30277fe700 1 -- 172.21.15.153:0/392413906 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3038012590 con 0x7f304015e090 2023-11-24T08:05:16.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.787+0000 7f30277fe700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f302c06aed0 0x7f302c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.787+0000 7f30277fe700 1 -- 172.21.15.153:0/392413906 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f303808b540 con 0x7f304015e090 2023-11-24T08:05:16.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.787+0000 7f303effd700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f302c06aed0 0x7f302c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.787+0000 7f303effd700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f302c06aed0 0x7f302c06d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3030009d20 tx=0x7f3030008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:16.791+0000 7f30277fe700 1 -- 172.21.15.153:0/392413906 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f303805a080 con 0x7f304015e090 2023-11-24T08:05:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.027+0000 7f30452d5700 1 -- 172.21.15.153:0/392413906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30400c5540 con 0x7f304015e090 2023-11-24T08:05:17.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.027+0000 7f30277fe700 1 -- 172.21.15.153:0/392413906 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f3038059c10 con 0x7f304015e090 2023-11-24T08:05:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:17.029 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2772655217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2772655217},{"type":"v1","addr":"172.21.15.164:6834","nonce":2772655217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2600357639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2600357639},{"type":"v1","addr":"172.21.15.153:6836","nonce":2600357639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5037,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3970007773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3970007773},{"type":"v1","addr":"172.21.15.153:6837","nonce":3970007773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:06.541701+0000","modified":"2023-11-24T08:05:09.566528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2977715145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2977715145},{"type":"v1","addr":"172.21.15.164:6835","nonce":2977715145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:05:17.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 -- 172.21.15.153:0/392413906 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f302c06aed0 msgr2=0x7f302c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f302c06aed0 0x7f302c06d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3030009d20 tx=0x7f3030008040 comp rx=0 tx=0).stop 2023-11-24T08:05:17.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 -- 172.21.15.153:0/392413906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f304015e090 msgr2=0x7f30400cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f304015e090 0x7f30400cb600 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f303800b370 tx=0x7f3038004ad0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 -- 172.21.15.153:0/392413906 shutdown_connections 2023-11-24T08:05:17.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f302c06aed0 0x7f302c06d390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f304015e090 0x7f30400cb600 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f304006c090 0x7f3040160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 --2- 172.21.15.153:0/392413906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30400d2250 0x7f30401524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 -- 172.21.15.153:0/392413906 >> 172.21.15.153:0/392413906 conn(0x7f30400731a0 msgr2=0x7f304015d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 -- 172.21.15.153:0/392413906 shutdown_connections 2023-11-24T08:05:17.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.030+0000 7f30452d5700 1 -- 172.21.15.153:0/392413906 wait complete. 2023-11-24T08:05:17.033 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 16 2023-11-24T08:05:17.446 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:05:06.541701+0000', 'modified': '2023-11-24T08:05:09.566528+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5046}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5046': {'gid': 5046, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.164:6835/2977715145', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6833', 'nonce': 2977715145}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 2977715145}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:05:17.446 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:05:17.447 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-24T08:05:17.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.567+0000 7f3a9445d700 1 Processor -- start 2023-11-24T08:05:17.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.567+0000 7f3a9445d700 1 -- start start 2023-11-24T08:05:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a9445d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3a8c0d1570 0x7f3a8c0d34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a9445d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a8c0b2fc0 0x7f3a8c0d3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a9445d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8c0d2d10 con 0x7f3a8c15dfc0 2023-11-24T08:05:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a9445d700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c0cefd0 con 0x7f3a8c0d1570 2023-11-24T08:05:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a9445d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0cf2b0 con 0x7f3a8c0b2fc0 2023-11-24T08:05:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a921f9700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3a8c15dfc0 0x7f3a8c0d0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43528/0 (socket says 172.21.15.153:43528) 2023-11-24T08:05:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a921f9700 1 -- 172.21.15.153:0/2775070089 learned_addr learned my addr 172.21.15.153:0/2775070089 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:17.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a929fa700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a8c0b2fc0 0x7f3a8c0d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210939935 0 0) 0x7f3a8c0d2d10 con 0x7f3a8c15dfc0 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a919f8700 1 --2- 172.21.15.153:0/2775070089 >> v2:172.21.15.164:3300/0 conn(0x7f3a8c0d1570 0x7f3a8c0d34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a780035b0 con 0x7f3a8c15dfc0 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1170197490 0 0) 0x7f3a780035b0 con 0x7f3a8c15dfc0 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a8c0b2fc0 msgr2=0x7f3a8c0d3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a911f7700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a8c0b2fc0 0x7f3a8c0d3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 >> v2:172.21.15.164:3300/0 conn(0x7f3a8c0d1570 msgr2=0x7f3a8c0d34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a911f7700 1 --2- 172.21.15.153:0/2775070089 >> v2:172.21.15.164:3300/0 conn(0x7f3a8c0d1570 0x7f3a8c0d34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c0d2fb0 con 0x7f3a8c15dfc0 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f3a88001670 con 0x7f3a8c15dfc0 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 >> v1:172.21.15.153:6789/0 conn(0x7f3a8c15dfc0 legacy=0x7f3a8c0d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.568+0000 7f3a911f7700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a78003a00 0x7f3a78003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a911f7700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a8c0b2fc0 0x7f3a78004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a911f7700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a78004d90 0x7f3a78005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0cefd0 con 0x7f3a78004d90 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0cf2b0 con 0x7f3a78003a00 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7800ba40 con 0x7f3a8c0b2fc0 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a929fa700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a78004d90 0x7f3a78005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a921f9700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a78003a00 0x7f3a78003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a919f8700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a8c0b2fc0 0x7f3a78004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a929fa700 1 -- 172.21.15.153:0/2775070089 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a8c0b2fc0 msgr2=0x7f3a78004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a929fa700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a8c0b2fc0 0x7f3a78004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a929fa700 1 -- 172.21.15.153:0/2775070089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a78003a00 msgr2=0x7f3a78003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a929fa700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a78003a00 0x7f3a78003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a929fa700 1 -- 172.21.15.153:0/2775070089 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a780035b0 con 0x7f3a78004d90 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a929fa700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a78004d90 0x7f3a78005210 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009f90 tx=0x7f3a78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fda815bc594667 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8400ebd0 con 0x7f3a78004d90 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8400f040 con 0x7f3a78004d90 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.569+0000 7f3a911f7700 1 -- 172.21.15.153:0/2775070089 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84014480 con 0x7f3a78004d90 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.570+0000 7f3a9445d700 1 -- 172.21.15.153:0/2775070089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a78004d90 msgr2=0x7f3a78005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.570+0000 7f3a9445d700 1 --2- 172.21.15.153:0/2775070089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a78004d90 0x7f3a78005210 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009f90 tx=0x7f3a78005880 comp rx=0 tx=0).stop 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.570+0000 7f3a929fa700 1 -- 172.21.15.153:0/2775070089 reap_dead start 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.570+0000 7f3a9445d700 1 -- 172.21.15.153:0/2775070089 shutdown_connections 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.570+0000 7f3a9445d700 1 -- 172.21.15.153:0/2775070089 >> 172.21.15.153:0/2775070089 conn(0x7f3a8c06b410 msgr2=0x7f3a8c06b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.570+0000 7f3a9445d700 1 -- 172.21.15.153:0/2775070089 shutdown_connections 2023-11-24T08:05:17.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.570+0000 7f3a9445d700 1 -- 172.21.15.153:0/2775070089 wait complete. 2023-11-24T08:05:17.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.571+0000 7f3a9445d700 1 Processor -- start 2023-11-24T08:05:17.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.571+0000 7f3a9445d700 1 -- start start 2023-11-24T08:05:17.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a9445d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a78004d90 0x7f3a8c15c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a9445d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a8c0cdd70 0x7f3a8c0cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a9445d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a8c0cc4e0 0x7f3a8c0aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a9445d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0cccd0 con 0x7f3a8c0cdd70 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a9445d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0ccfb0 con 0x7f3a8c0cc4e0 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a9445d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0cd290 con 0x7f3a78004d90 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a919f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a8c0cdd70 0x7f3a8c0cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a919f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a8c0cdd70 0x7f3a8c0cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37438/0 (socket says 172.21.15.153:37438) 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a919f8700 1 -- 172.21.15.153:0/288127934 learned_addr learned my addr 172.21.15.153:0/288127934 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a929fa700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a8c0cc4e0 0x7f3a8c0aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a921f9700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a78004d90 0x7f3a8c15c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a919f8700 1 -- 172.21.15.153:0/288127934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a78004d90 msgr2=0x7f3a8c15c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a919f8700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a78004d90 0x7f3a8c15c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a919f8700 1 -- 172.21.15.153:0/288127934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a8c0cc4e0 msgr2=0x7f3a8c0aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a919f8700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a8c0cc4e0 0x7f3a8c0aa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a919f8700 1 -- 172.21.15.153:0/288127934 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c0cd570 con 0x7f3a8c0cdd70 2023-11-24T08:05:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a921f9700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a78004d90 0x7f3a8c15c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a919f8700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a8c0cdd70 0x7f3a8c0cbfa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c011aa0 tx=0x7f3a7c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a82ffd700 1 -- 172.21.15.153:0/288127934 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00f9e0 con 0x7f3a8c0cdd70 2023-11-24T08:05:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a82ffd700 1 -- 172.21.15.153:0/288127934 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c00fb40 con 0x7f3a8c0cdd70 2023-11-24T08:05:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a82ffd700 1 -- 172.21.15.153:0/288127934 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c014440 con 0x7f3a8c0cdd70 2023-11-24T08:05:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.572+0000 7f3a9445d700 1 -- 172.21.15.153:0/288127934 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8c0cd850 con 0x7f3a8c0cdd70 2023-11-24T08:05:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.573+0000 7f3a9445d700 1 -- 172.21.15.153:0/288127934 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8c0cc960 con 0x7f3a8c0cdd70 2023-11-24T08:05:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.574+0000 7f3a82ffd700 1 -- 172.21.15.153:0/288127934 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a7c0145a0 con 0x7f3a8c0cdd70 2023-11-24T08:05:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.574+0000 7f3a82ffd700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a7006af00 0x7f3a7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.574+0000 7f3a82ffd700 1 -- 172.21.15.153:0/288127934 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a7c089da0 con 0x7f3a8c0cdd70 2023-11-24T08:05:17.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.574+0000 7f3a921f9700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a7006af00 0x7f3a7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.575+0000 7f3a921f9700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a7006af00 0x7f3a7006d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a88000fb0 tx=0x7f3a88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.576+0000 7f3aa0656b80 1 Processor -- start 2023-11-24T08:05:17.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.577+0000 7f3aa0656b80 1 -- start start 2023-11-24T08:05:17.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.577+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d77080 0x55a290dbd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.577+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d8ced0 0x55a290dbdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.577+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290da0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.577+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a290cea770 con 0x55a290d74490 2023-11-24T08:05:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a290cd1750 con 0x55a290d77080 2023-11-24T08:05:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a290ccf070 con 0x55a290d8ced0 2023-11-24T08:05:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a929fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290da0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a929fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290da0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37448/0 (socket says 172.21.15.153:37448) 2023-11-24T08:05:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a929fa700 1 -- 172.21.15.153:0/2572956023 learned_addr learned my addr 172.21.15.153:0/2572956023 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a919f8700 1 --2- 172.21.15.153:0/2572956023 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d8ced0 0x55a290dbdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a921f9700 1 --2- 172.21.15.153:0/2572956023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d77080 0x55a290dbd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a929fa700 1 -- 172.21.15.153:0/2572956023 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d8ced0 msgr2=0x55a290dbdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a929fa700 1 --2- 172.21.15.153:0/2572956023 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d8ced0 0x55a290dbdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a929fa700 1 -- 172.21.15.153:0/2572956023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d77080 msgr2=0x55a290dbd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a929fa700 1 --2- 172.21.15.153:0/2572956023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d77080 0x55a290dbd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a929fa700 1 -- 172.21.15.153:0/2572956023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a290b475e0 con 0x55a290d74490 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a929fa700 1 --2- 172.21.15.153:0/2572956023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290da0e70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3a84016000 tx=0x7f3a84011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533f60ecfeeca77f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a6ffff700 1 -- 172.21.15.153:0/2572956023 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84007000 con 0x55a290d74490 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a6ffff700 1 -- 172.21.15.153:0/2572956023 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a84003c20 con 0x55a290d74490 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.578+0000 7f3a6ffff700 1 -- 172.21.15.153:0/2572956023 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8400e9d0 con 0x55a290d74490 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.579+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2572956023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 msgr2=0x55a290da0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.579+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/2572956023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290da0e70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3a84016000 tx=0x7f3a84011000 comp rx=0 tx=0).stop 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.579+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2572956023 shutdown_connections 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.579+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/2572956023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290da0e70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.579+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/2572956023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d77080 0x55a290dbd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.579+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/2572956023 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d8ced0 0x55a290dbdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.579+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2572956023 >> 172.21.15.153:0/2572956023 conn(0x55a290ca5310 msgr2=0x55a290dbbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.579+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2572956023 shutdown_connections 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.579+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2572956023 wait complete. 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.580+0000 7f3aa0656b80 1 -- start start 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.580+0000 7f3aa0656b80 1 Processor -- start 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d74490 0x55a290d80d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d77080 0x55a290d7d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290d6b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a290cca960 con 0x55a290d8ced0 2023-11-24T08:05:17.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a290c84510 con 0x55a290d77080 2023-11-24T08:05:17.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a290c841b0 con 0x55a290d74490 2023-11-24T08:05:17.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3aa0656b80 10 client.0 _ll_register_callbacks cb 0x55a290bafa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:05:17.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3a929fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290d6b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3a929fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290d6b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37454/0 (socket says 172.21.15.153:37454) 2023-11-24T08:05:17.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3a929fa700 1 -- 172.21.15.153:0/994991602 learned_addr learned my addr 172.21.15.153:0/994991602 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:17.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3a919f8700 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d77080 0x55a290d7d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.581+0000 7f3a921f9700 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d74490 0x55a290d80d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a929fa700 1 -- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d74490 msgr2=0x55a290d80d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a929fa700 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d74490 0x55a290d80d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a929fa700 1 -- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d77080 msgr2=0x55a290d7d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a929fa700 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d77080 0x55a290d7d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a929fa700 1 -- 172.21.15.153:0/994991602 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a780035b0 con 0x55a290d8ced0 2023-11-24T08:05:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a929fa700 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290d6b330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400ef50 tx=0x7f3a84004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc4adf7ebe0f24b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-11-24T08:05:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/994991602 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84003fa0 con 0x55a290d8ced0 2023-11-24T08:05:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/994991602 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a84004100 con 0x55a290d8ced0 2023-11-24T08:05:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3aa0656b80 1 -- 172.21.15.153:0/994991602 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a290d69a40 con 0x55a290d8ced0 2023-11-24T08:05:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/994991602 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a840042c0 con 0x55a290d8ced0 2023-11-24T08:05:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3aa0656b80 10 client.5244 fetch_fsmap learned FSMap version 16 2023-11-24T08:05:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3aa0656b80 1 -- 172.21.15.153:0/994991602 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a290af3d90 con 0x55a290d8ced0 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/994991602 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a290d69a40 con 0x55a290d8ced0 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/994991602 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3a84004420 con 0x55a290d8ced0 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3aa0656b80 10 client.5244 fetch_fsmap finished waiting for FSMap version 16 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3aa0656b80 10 client.5244 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3aa0656b80 20 client.5244 populate_metadata read hostname 'smithi153' 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:6833/2977715145,v1:172.21.15.164:6835/2977715145] conn(0x55a290d7e3f0 0x55a290d7e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3aa0656b80 4 client.5244 mds_command: new command op to 5046 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.582+0000 7f3aa0656b80 1 -- 172.21.15.153:0/994991602 --> [v2:172.21.15.164:6833/2977715145,v1:172.21.15.164:6835/2977715145] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a290d45840 con 0x55a290d7e3f0 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.583+0000 7f3a921f9700 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:6833/2977715145,v1:172.21.15.164:6835/2977715145] conn(0x55a290d7e3f0 0x55a290d7e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.583+0000 7f3a6d7fa700 10 client.5244 ms_handle_connect on v2:172.21.15.164:6833/2977715145 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.583+0000 7f3a921f9700 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:6833/2977715145,v1:172.21.15.164:6835/2977715145] conn(0x55a290d7e3f0 0x55a290d7e7d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c56cd6c3c375c97 server_cookie=9d85d4b6048b0bbb in_seq=0 out_seq=0 2023-11-24T08:05:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/994991602 <== mds.0 v2:172.21.15.164:6833/2977715145 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a290d45840 con 0x55a290d7e3f0 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3a6d7fa700 10 client.5244 handle_command_reply: tid=0 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 1 client.5244 shutdown 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 1 -- 172.21.15.153:0/994991602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 msgr2=0x55a290d6b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290d6b330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400ef50 tx=0x7f3a84004b40 comp rx=0 tx=0).stop 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 1 -- 172.21.15.153:0/994991602 shutdown_connections 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:6833/2977715145,v1:172.21.15.164:6835/2977715145] conn(0x55a290d7e3f0 0x55a290d7e7d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290d6b330 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d74490 0x55a290d80d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/994991602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d77080 0x55a290d7d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3a6d7fa700 0 client.5244 ms_handle_reset on v2:172.21.15.164:6833/2977715145 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 1 -- 172.21.15.153:0/994991602 >> 172.21.15.153:0/994991602 conn(0x55a290ca5310 msgr2=0x55a290dbfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 1 -- 172.21.15.153:0/994991602 shutdown_connections 2023-11-24T08:05:17.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 1 -- 172.21.15.153:0/994991602 wait complete. 2023-11-24T08:05:17.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.584+0000 7f3aa0656b80 20 client.5244 trim_cache size 0 max 16384 2023-11-24T08:05:17.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.602+0000 7f3aa0656b80 1 Processor -- start 2023-11-24T08:05:17.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.603+0000 7f3aa0656b80 1 -- start start 2023-11-24T08:05:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.603+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290d7d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.603+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d77080 0x55a290d71690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.603+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d8ced0 0x55a290d6acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.603+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a290b498d0 con 0x55a290d74490 2023-11-24T08:05:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.603+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a290dde3a0 con 0x55a290d8ced0 2023-11-24T08:05:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.603+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a290d7f080 con 0x55a290d77080 2023-11-24T08:05:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.603+0000 7f3a921f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290d7d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a921f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290d7d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37458/0 (socket says 172.21.15.153:37458) 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a921f9700 1 -- 172.21.15.153:0/3696517328 learned_addr learned my addr 172.21.15.153:0/3696517328 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a919f8700 1 --2- 172.21.15.153:0/3696517328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d77080 0x55a290d71690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a929fa700 1 --2- 172.21.15.153:0/3696517328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d8ced0 0x55a290d6acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a921f9700 1 -- 172.21.15.153:0/3696517328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d77080 msgr2=0x55a290d71690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a921f9700 1 --2- 172.21.15.153:0/3696517328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d77080 0x55a290d71690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a921f9700 1 -- 172.21.15.153:0/3696517328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d8ced0 msgr2=0x55a290d6acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a921f9700 1 --2- 172.21.15.153:0/3696517328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d8ced0 0x55a290d6acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a921f9700 1 -- 172.21.15.153:0/3696517328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a290adcc10 con 0x55a290d74490 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a921f9700 1 --2- 172.21.15.153:0/3696517328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290d7d750 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3a880017a0 tx=0x7f3a88013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7bd63e306dfd8df server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a80d82700 1 -- 172.21.15.153:0/3696517328 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88029b00 con 0x55a290d74490 2023-11-24T08:05:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a80d82700 1 -- 172.21.15.153:0/3696517328 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a88029040 con 0x55a290d74490 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.604+0000 7f3a80d82700 1 -- 172.21.15.153:0/3696517328 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88029e60 con 0x55a290d74490 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.605+0000 7f3aa0656b80 1 -- 172.21.15.153:0/3696517328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 msgr2=0x55a290d7d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.605+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/3696517328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290d7d750 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3a880017a0 tx=0x7f3a88013000 comp rx=0 tx=0).stop 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.605+0000 7f3aa0656b80 1 -- 172.21.15.153:0/3696517328 shutdown_connections 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.605+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/3696517328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d8ced0 0x55a290d6acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.605+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/3696517328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d74490 0x55a290d7d750 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.605+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/3696517328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d77080 0x55a290d71690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.605+0000 7f3aa0656b80 1 -- 172.21.15.153:0/3696517328 >> 172.21.15.153:0/3696517328 conn(0x55a290ca5310 msgr2=0x55a290d7e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.605+0000 7f3aa0656b80 1 -- 172.21.15.153:0/3696517328 shutdown_connections 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.605+0000 7f3aa0656b80 1 -- 172.21.15.153:0/3696517328 wait complete. 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.605+0000 7f3aa0656b80 1 -- start start 2023-11-24T08:05:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.605+0000 7f3aa0656b80 1 Processor -- start 2023-11-24T08:05:17.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d74490 0x55a290e24310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d77080 0x55a290db1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3aa0656b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290db2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a290dba6f0 con 0x55a290d8ced0 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a290dcde70 con 0x55a290d74490 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3aa0656b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a290da4f60 con 0x55a290d77080 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3aa0656b80 10 client.0 _ll_register_callbacks cb 0x55a290bafa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a929fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290db2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a921f9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d74490 0x55a290e24310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a929fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290db2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37468/0 (socket says 172.21.15.153:37468) 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a919f8700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d77080 0x55a290db1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a929fa700 1 -- 172.21.15.153:0/2243022644 learned_addr learned my addr 172.21.15.153:0/2243022644 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a929fa700 1 -- 172.21.15.153:0/2243022644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d77080 msgr2=0x55a290db1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a929fa700 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d77080 0x55a290db1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a929fa700 1 -- 172.21.15.153:0/2243022644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d74490 msgr2=0x55a290e24310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a929fa700 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d74490 0x55a290e24310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a929fa700 1 -- 172.21.15.153:0/2243022644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8800f040 con 0x55a290d8ced0 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a921f9700 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d74490 0x55a290e24310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a929fa700 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290db2050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009550 tx=0x7f3a84013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba2df65f56b969 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/2243022644 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84003fa0 con 0x55a290d8ced0 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/2243022644 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a8403faa0 con 0x55a290d8ced0 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.607+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2243022644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a84003c20 con 0x55a290d8ced0 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/2243022644 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a8403fc60 con 0x55a290d8ced0 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3aa0656b80 10 client.5250 fetch_fsmap learned FSMap version 16 2023-11-24T08:05:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2243022644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a290b1a200 con 0x55a290d8ced0 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/2243022644 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a84003c20 con 0x55a290d8ced0 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/2243022644 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3a84004100 con 0x55a290d8ced0 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3aa0656b80 10 client.5250 fetch_fsmap finished waiting for FSMap version 16 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3aa0656b80 10 client.5250 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3aa0656b80 20 client.5250 populate_metadata read hostname 'smithi153' 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.164:6833/2977715145,v1:172.21.15.164:6835/2977715145] conn(0x55a290da3ec0 0x55a290da42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3aa0656b80 4 client.5250 mds_command: new command op to 5046 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2243022644 --> [v2:172.21.15.164:6833/2977715145,v1:172.21.15.164:6835/2977715145] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a290c90f80 con 0x55a290da3ec0 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3a921f9700 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.164:6833/2977715145,v1:172.21.15.164:6835/2977715145] conn(0x55a290da3ec0 0x55a290da42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3a6d7fa700 10 client.5250 ms_handle_connect on v2:172.21.15.164:6833/2977715145 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.608+0000 7f3a921f9700 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.164:6833/2977715145,v1:172.21.15.164:6835/2977715145] conn(0x55a290da3ec0 0x55a290da42a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ebbbcced3e3d832 server_cookie=88fedcd204ada2c5 in_seq=0 out_seq=0 2023-11-24T08:05:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3a6d7fa700 1 -- 172.21.15.153:0/2243022644 <== mds.0 v2:172.21.15.164:6833/2977715145 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55a290c90f80 con 0x55a290da3ec0 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3a6d7fa700 10 client.5250 handle_command_reply: tid=0 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 1 client.5250 shutdown 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2243022644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 msgr2=0x55a290db2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290db2050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009550 tx=0x7f3a84013000 comp rx=0 tx=0).stop 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2243022644 shutdown_connections 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.164:6833/2977715145,v1:172.21.15.164:6835/2977715145] conn(0x55a290da3ec0 0x55a290da42a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a290d8ced0 0x55a290db2050 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a290d74490 0x55a290e24310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3a6d7fa700 0 client.5250 ms_handle_reset on v2:172.21.15.164:6833/2977715145 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 1 --2- 172.21.15.153:0/2243022644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a290d77080 0x55a290db1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2243022644 >> 172.21.15.153:0/2243022644 conn(0x55a290ca5310 msgr2=0x55a290d6acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2243022644 shutdown_connections 2023-11-24T08:05:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 1 -- 172.21.15.153:0/2243022644 wait complete. 2023-11-24T08:05:17.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3aa0656b80 20 client.5250 trim_cache size 0 max 16384 2023-11-24T08:05:17.618 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:05:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "a594d4d2-de60-4a04-bb93-76779d526986", 2023-11-24T08:05:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-11-24T08:05:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5046, 2023-11-24T08:05:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-11-24T08:05:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-11-24T08:05:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-11-24T08:05:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 10.463137617999999, 2023-11-24T08:05:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 16, 2023-11-24T08:05:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 32, 2023-11-24T08:05:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 32, 2023-11-24T08:05:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 18.871530476 2023-11-24T08:05:17.619 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:05:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3a9445d700 1 -- 172.21.15.153:0/288127934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a7006af00 msgr2=0x7f3a7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3a9445d700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a7006af00 0x7f3a7006d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a88000fb0 tx=0x7f3a88009040 comp rx=0 tx=0).stop 2023-11-24T08:05:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3a9445d700 1 -- 172.21.15.153:0/288127934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a8c0cdd70 msgr2=0x7f3a8c0cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.609+0000 7f3a9445d700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a8c0cdd70 0x7f3a8c0cbfa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c011aa0 tx=0x7f3a7c011e60 comp rx=0 tx=0).stop 2023-11-24T08:05:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.610+0000 7f3a9445d700 1 -- 172.21.15.153:0/288127934 shutdown_connections 2023-11-24T08:05:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.610+0000 7f3a9445d700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a8c0cc4e0 0x7f3a8c0aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.610+0000 7f3a9445d700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a78004d90 0x7f3a8c15c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.610+0000 7f3a9445d700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a7006af00 0x7f3a7006d3c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.610+0000 7f3a9445d700 1 --2- 172.21.15.153:0/288127934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a8c0cdd70 0x7f3a8c0cbfa0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.610+0000 7f3a9445d700 1 -- 172.21.15.153:0/288127934 >> 172.21.15.153:0/288127934 conn(0x7f3a8c06b410 msgr2=0x7f3a8c071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.610+0000 7f3a9445d700 1 -- 172.21.15.153:0/288127934 shutdown_connections 2023-11-24T08:05:17.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.610+0000 7f3a9445d700 1 -- 172.21.15.153:0/288127934 wait complete. 2023-11-24T08:05:17.623 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:05:17.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.741+0000 7f36776d8700 1 Processor -- start 2023-11-24T08:05:17.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.742+0000 7f36776d8700 1 -- start start 2023-11-24T08:05:17.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.742+0000 7f36776d8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f367015e080 0x7f36700b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.742+0000 7f36776d8700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36700af4d0 0x7f36700afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.742+0000 7f36776d8700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f367006c000 0x7f367006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.742+0000 7f36776d8700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700af0b0 con 0x7f367015e080 2023-11-24T08:05:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.742+0000 7f36776d8700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367006c9f0 con 0x7f367006c000 2023-11-24T08:05:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.742+0000 7f36776d8700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36700b05a0 con 0x7f36700af4d0 2023-11-24T08:05:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3675474700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f367015e080 0x7f36700b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3675474700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f367015e080 0x7f36700b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37472/0 (socket says 172.21.15.153:37472) 2023-11-24T08:05:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3675474700 1 -- 172.21.15.153:0/156855382 learned_addr learned my addr 172.21.15.153:0/156855382 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3674c73700 1 --2- 172.21.15.153:0/156855382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36700af4d0 0x7f36700afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3675c75700 1 --2- 172.21.15.153:0/156855382 >> v2:172.21.15.164:3300/0 conn(0x7f367006c000 0x7f367006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3675474700 1 -- 172.21.15.153:0/156855382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36700af4d0 msgr2=0x7f36700afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3675474700 1 --2- 172.21.15.153:0/156855382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36700af4d0 0x7f36700afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3675474700 1 -- 172.21.15.153:0/156855382 >> v2:172.21.15.164:3300/0 conn(0x7f367006c000 msgr2=0x7f367006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3675474700 1 --2- 172.21.15.153:0/156855382 >> v2:172.21.15.164:3300/0 conn(0x7f367006c000 0x7f367006c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3675474700 1 -- 172.21.15.153:0/156855382 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36700ae430 con 0x7f367015e080 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3675474700 1 --2- 172.21.15.153:0/156855382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f367015e080 0x7f36700b5050 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f367009eea0 tx=0x7f3664009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb190e8327dac7a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3663fff700 1 -- 172.21.15.153:0/156855382 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366400b860 con 0x7f367015e080 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3663fff700 1 -- 172.21.15.153:0/156855382 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366400b9c0 con 0x7f367015e080 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.743+0000 7f3663fff700 1 -- 172.21.15.153:0/156855382 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366400bd50 con 0x7f367015e080 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.744+0000 7f36776d8700 1 -- 172.21.15.153:0/156855382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f367015e080 msgr2=0x7f36700b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.744+0000 7f36776d8700 1 --2- 172.21.15.153:0/156855382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f367015e080 0x7f36700b5050 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f367009eea0 tx=0x7f3664009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.744+0000 7f36776d8700 1 -- 172.21.15.153:0/156855382 shutdown_connections 2023-11-24T08:05:17.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.744+0000 7f36776d8700 1 --2- 172.21.15.153:0/156855382 >> v2:172.21.15.164:3300/0 conn(0x7f367006c000 0x7f367006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.744+0000 7f36776d8700 1 --2- 172.21.15.153:0/156855382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f367015e080 0x7f36700b5050 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.744+0000 7f36776d8700 1 --2- 172.21.15.153:0/156855382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36700af4d0 0x7f36700afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.744+0000 7f36776d8700 1 -- 172.21.15.153:0/156855382 >> 172.21.15.153:0/156855382 conn(0x7f3670071b90 msgr2=0x7f3670071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.744+0000 7f36776d8700 1 -- 172.21.15.153:0/156855382 shutdown_connections 2023-11-24T08:05:17.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.744+0000 7f36776d8700 1 -- 172.21.15.153:0/156855382 wait complete. 2023-11-24T08:05:17.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.745+0000 7f36776d8700 1 Processor -- start 2023-11-24T08:05:17.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.745+0000 7f36776d8700 1 -- start start 2023-11-24T08:05:17.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f36776d8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f367006c000 0x7f3670141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f36776d8700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36700af4d0 0x7f3670160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f36776d8700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f367015e080 0x7f3670160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f36776d8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36701f4790 con 0x7f367006c000 2023-11-24T08:05:17.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f36776d8700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670158c30 con 0x7f36700af4d0 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f36776d8700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3670158f10 con 0x7f367015e080 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3675474700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f367006c000 0x7f3670141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3675474700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f367006c000 0x7f3670141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37478/0 (socket says 172.21.15.153:37478) 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3675474700 1 -- 172.21.15.153:0/4027950276 learned_addr learned my addr 172.21.15.153:0/4027950276 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3674c73700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36700af4d0 0x7f3670160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3675474700 1 -- 172.21.15.153:0/4027950276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f367015e080 msgr2=0x7f3670160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3675c75700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f367015e080 0x7f3670160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3675474700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f367015e080 0x7f3670160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3675474700 1 -- 172.21.15.153:0/4027950276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36700af4d0 msgr2=0x7f3670160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3675474700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36700af4d0 0x7f3670160a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3675474700 1 -- 172.21.15.153:0/4027950276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3664009550 con 0x7f367006c000 2023-11-24T08:05:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3674c73700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36700af4d0 0x7f3670160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3675474700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f367006c000 0x7f3670141930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3664009130 tx=0x7f3664004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3661ffb700 1 -- 172.21.15.153:0/4027950276 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640044d0 con 0x7f367006c000 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3661ffb700 1 -- 172.21.15.153:0/4027950276 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366401e070 con 0x7f367006c000 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f3661ffb700 1 -- 172.21.15.153:0/4027950276 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640038e0 con 0x7f367006c000 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.746+0000 7f36776d8700 1 -- 172.21.15.153:0/4027950276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36701591f0 con 0x7f367006c000 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.747+0000 7f36776d8700 1 -- 172.21.15.153:0/4027950276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3670141e70 con 0x7f367006c000 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.748+0000 7f36776d8700 1 -- 172.21.15.153:0/4027950276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36700753f0 con 0x7f367006c000 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.748+0000 7f3661ffb700 1 -- 172.21.15.153:0/4027950276 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3664003a40 con 0x7f367006c000 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.749+0000 7f3661ffb700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f365406aed0 0x7f365406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.749+0000 7f3674c73700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f365406aed0 0x7f365406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.749+0000 7f3661ffb700 1 -- 172.21.15.153:0/4027950276 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3664020070 con 0x7f367006c000 2023-11-24T08:05:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.749+0000 7f3674c73700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f365406aed0 0x7f365406d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3670072c00 tx=0x7f366c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.753+0000 7f3661ffb700 1 -- 172.21.15.153:0/4027950276 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3664055b20 con 0x7f367006c000 2023-11-24T08:05:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.990+0000 7f36776d8700 1 -- 172.21.15.153:0/4027950276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3670159380 con 0x7f367006c000 2023-11-24T08:05:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.990+0000 7f3661ffb700 1 -- 172.21.15.153:0/4027950276 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f366402a020 con 0x7f367006c000 2023-11-24T08:05:17.992 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:05:17.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 -- 172.21.15.153:0/4027950276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f365406aed0 msgr2=0x7f365406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f365406aed0 0x7f365406d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3670072c00 tx=0x7f366c008040 comp rx=0 tx=0).stop 2023-11-24T08:05:17.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 -- 172.21.15.153:0/4027950276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f367006c000 msgr2=0x7f3670141930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f367006c000 0x7f3670141930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3664009130 tx=0x7f3664004750 comp rx=0 tx=0).stop 2023-11-24T08:05:17.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 -- 172.21.15.153:0/4027950276 shutdown_connections 2023-11-24T08:05:17.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f367015e080 0x7f3670160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f365406aed0 0x7f365406d390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f367006c000 0x7f3670141930 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 --2- 172.21.15.153:0/4027950276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36700af4d0 0x7f3670160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 -- 172.21.15.153:0/4027950276 >> 172.21.15.153:0/4027950276 conn(0x7f3670071b90 msgr2=0x7f3670073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 -- 172.21.15.153:0/4027950276 shutdown_connections 2023-11-24T08:05:17.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:17.992+0000 7f36776d8700 1 -- 172.21.15.153:0/4027950276 wait complete. 2023-11-24T08:05:18.006 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:05:18.006 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:05:18.006 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-11-24T08:05:18.006 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:05:18.006 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:18.006 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:05:18.006 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:05:18.006 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:05:18.006 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:18.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:18.007 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-11-24T08:05:18.024 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:05:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:05:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:05:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:05:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42354sec preferred_lft 42354sec 2023-11-24T08:05:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e4cb:ff36:bdaf:3e03/64 scope link noprefixroute 2023-11-24T08:05:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:18.026 INFO:teuthology.orchestra.run.smithi153.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:05:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 9e:57:11:a0:a0:4b brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:05:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e4cd:e0ff:fe37:cdab/64 scope link 2023-11-24T08:05:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:18.027 INFO:teuthology.orchestra.run.smithi153.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 9e:57:11:a0:a0:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:05:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::9c57:11ff:fea0:a04b/64 scope link 2023-11-24T08:05:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:18.028 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether f6:b2:5a:65:17:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:05:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::f4b2:5aff:fe65:174f/64 scope link 2023-11-24T08:05:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:18.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:18.028 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:05:18.089 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-11-24T08:05:18.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:18.091 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-11-24T08:05:18.095 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:18.134 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:18.149 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-11-24T08:05:18.149 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:05:18.150 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:05:18.150 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:05:18.150 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:05:18.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:18.150 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:05:18.150 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:05:18.150 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:05:18.150 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:05:18.150 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:05:18.150 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:05:18.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:18.281 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-11-24T08:05:18.298 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:05:18.298 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:05:18.298 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:18.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:18.298 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-11-24T08:05:18.366 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:18.366 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:18.422 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:18.423 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:18.423 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:18.479 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T08:05:18.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:18.479 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:05:18.565 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:05:18.565 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:05:18.565 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:05:18.574 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:05:18.574 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:05:18.574 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:05:18.574 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:05:18.574 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:05:18.648 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:05:18.648 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:05:18.648 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:05:18.649 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:05:18.649 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:05:18.649 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-11-24T08:05:18.649 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-11-24T08:05:18.649 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a594d4d2-de60-4a04-bb93-76779d526986" will pass to kernel 2023-11-24T08:05:18.651 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:05:18.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:18.651 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:18.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:18.680 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:05:18.758 INFO:teuthology.orchestra.run.smithi153.stdout:client5095 2023-11-24T08:05:18.759 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:05:18.759 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:18.817 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:05:18.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.976+0000 7ff6b9d4a700 1 Processor -- start 2023-11-24T08:05:18.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.976+0000 7ff6b9d4a700 1 -- start start 2023-11-24T08:05:18.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.977+0000 7ff6b9d4a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b4158770 0x7ff6b406e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.977+0000 7ff6b9d4a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40b3000 con 0x7ff6b415b140 2023-11-24T08:05:18.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.977+0000 7ff6b9d4a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40b32e0 con 0x7ff6b4071bd0 2023-11-24T08:05:18.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.977+0000 7ff6b9d4a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40b35c0 con 0x7ff6b4158770 2023-11-24T08:05:18.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.977+0000 7ff6b2ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff6b415b140 0x7ff6b415e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43594/0 (socket says 172.21.15.153:43594) 2023-11-24T08:05:18.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.977+0000 7ff6b2ffd700 1 -- 172.21.15.153:0/2845723824 learned_addr learned my addr 172.21.15.153:0/2845723824 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:18.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.977+0000 7ff6b37fe700 1 --2- 172.21.15.153:0/2845723824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b4158770 0x7ff6b406e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.977+0000 7ff6b27fc700 1 -- 172.21.15.153:0/2845723824 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995820643 0 0) 0x7ff6b40b3000 con 0x7ff6b415b140 2023-11-24T08:05:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.977+0000 7ff6b27fc700 1 -- 172.21.15.153:0/2845723824 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff69c0035b0 con 0x7ff6b415b140 2023-11-24T08:05:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.978+0000 7ff6b27fc700 1 -- 172.21.15.153:0/2845723824 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872700116 0 0) 0x7ff6b40b32e0 con 0x7ff6b4071bd0 2023-11-24T08:05:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.978+0000 7ff6b27fc700 1 -- 172.21.15.153:0/2845723824 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b40b3000 con 0x7ff6b4071bd0 2023-11-24T08:05:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.978+0000 7ff6b27fc700 1 -- 172.21.15.153:0/2845723824 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2725656367 0 0) 0x7ff69c0035b0 con 0x7ff6b415b140 2023-11-24T08:05:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.978+0000 7ff6b37fe700 1 -- 172.21.15.153:0/2845723824 >> v1:172.21.15.164:6789/0 conn(0x7ff6b4071bd0 legacy=0x7ff6b415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.978+0000 7ff6b37fe700 1 -- 172.21.15.153:0/2845723824 >> v1:172.21.15.153:6789/0 conn(0x7ff6b415b140 legacy=0x7ff6b415e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.978+0000 7ff6b37fe700 1 -- 172.21.15.153:0/2845723824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40b38a0 con 0x7ff6b4158770 2023-11-24T08:05:18.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.978+0000 7ff6b37fe700 1 --2- 172.21.15.153:0/2845723824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b4158770 0x7ff6b406e460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009870 tx=0x7ff6a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3283da9612f8a879 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.978+0000 7ff6b27fc700 1 -- 172.21.15.153:0/2845723824 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4001670 con 0x7ff6b4158770 2023-11-24T08:05:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.978+0000 7ff6b27fc700 1 -- 172.21.15.153:0/2845723824 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a8004030 con 0x7ff6b4158770 2023-11-24T08:05:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.978+0000 7ff6b27fc700 1 -- 172.21.15.153:0/2845723824 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80043c0 con 0x7ff6b4158770 2023-11-24T08:05:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.979+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/2845723824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b4158770 msgr2=0x7ff6b406e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.979+0000 7ff6b9d4a700 1 --2- 172.21.15.153:0/2845723824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b4158770 0x7ff6b406e460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009870 tx=0x7ff6a8009b80 comp rx=0 tx=0).stop 2023-11-24T08:05:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.979+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/2845723824 shutdown_connections 2023-11-24T08:05:18.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.979+0000 7ff6b9d4a700 1 --2- 172.21.15.153:0/2845723824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b4158770 0x7ff6b406e460 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.979+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/2845723824 >> 172.21.15.153:0/2845723824 conn(0x7ff6b40b1740 msgr2=0x7ff6b40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.979+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/2845723824 shutdown_connections 2023-11-24T08:05:18.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.979+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/2845723824 wait complete. 2023-11-24T08:05:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.980+0000 7ff6b9d4a700 1 Processor -- start 2023-11-24T08:05:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.980+0000 7ff6b9d4a700 1 -- start start 2023-11-24T08:05:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b9d4a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b4071bd0 0x7ff6b415aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b9d4a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b4158770 0x7ff6b40cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b9d4a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b415b140 0x7ff6b41f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b9d4a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b41e4cb0 con 0x7ff6b4158770 2023-11-24T08:05:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b9d4a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40cb520 con 0x7ff6b4071bd0 2023-11-24T08:05:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b9d4a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b41e43c0 con 0x7ff6b415b140 2023-11-24T08:05:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b4158770 0x7ff6b40cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b4158770 0x7ff6b40cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37498/0 (socket says 172.21.15.153:37498) 2023-11-24T08:05:18.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b2ffd700 1 -- 172.21.15.153:0/622844237 learned_addr learned my addr 172.21.15.153:0/622844237 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:18.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b37fe700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b4071bd0 0x7ff6b415aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b3fff700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b415b140 0x7ff6b41f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b2ffd700 1 -- 172.21.15.153:0/622844237 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b415b140 msgr2=0x7ff6b41f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b2ffd700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b415b140 0x7ff6b41f39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b2ffd700 1 -- 172.21.15.153:0/622844237 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b4071bd0 msgr2=0x7ff6b415aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b2ffd700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b4071bd0 0x7ff6b415aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b2ffd700 1 -- 172.21.15.153:0/622844237 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a80094a0 con 0x7ff6b4158770 2023-11-24T08:05:18.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.981+0000 7ff6b2ffd700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b4158770 0x7ff6b40cafe0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400c6e0 tx=0x7ff6a400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.982+0000 7ff69bfff700 1 -- 172.21.15.153:0/622844237 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4004c80 con 0x7ff6b4158770 2023-11-24T08:05:18.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.982+0000 7ff69bfff700 1 -- 172.21.15.153:0/622844237 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a4004de0 con 0x7ff6b4158770 2023-11-24T08:05:18.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.982+0000 7ff69bfff700 1 -- 172.21.15.153:0/622844237 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4007310 con 0x7ff6b4158770 2023-11-24T08:05:18.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.982+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/622844237 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b41e4660 con 0x7ff6b4158770 2023-11-24T08:05:18.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.982+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/622844237 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b41f3f00 con 0x7ff6b4158770 2023-11-24T08:05:18.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.983+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/622844237 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b41e4e60 con 0x7ff6b4158770 2023-11-24T08:05:18.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.983+0000 7ff69bfff700 1 -- 172.21.15.153:0/622844237 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6a4007470 con 0x7ff6b4158770 2023-11-24T08:05:18.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.984+0000 7ff69bfff700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff6a006aed0 0x7ff6a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.984+0000 7ff69bfff700 1 -- 172.21.15.153:0/622844237 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6a4089380 con 0x7ff6b4158770 2023-11-24T08:05:18.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.984+0000 7ff6b37fe700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff6a006aed0 0x7ff6a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.984+0000 7ff6b37fe700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff6a006aed0 0x7ff6a006d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80097c0 tx=0x7ff6a8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:18.988+0000 7ff69bfff700 1 -- 172.21.15.153:0/622844237 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff6b41e4e60 con 0x7ff6b4158770 2023-11-24T08:05:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.225+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/622844237 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff6b41e4e60 con 0x7ff6b4158770 2023-11-24T08:05:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.225+0000 7ff69bfff700 1 -- 172.21.15.153:0/622844237 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff6b41e4e60 con 0x7ff6b4158770 2023-11-24T08:05:19.227 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:05:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/622844237 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff6a006aed0 msgr2=0x7ff6a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff6a006aed0 0x7ff6a006d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80097c0 tx=0x7ff6a8008030 comp rx=0 tx=0).stop 2023-11-24T08:05:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/622844237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b4158770 msgr2=0x7ff6b40cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b4158770 0x7ff6b40cafe0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400c6e0 tx=0x7ff6a400caa0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/622844237 shutdown_connections 2023-11-24T08:05:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b415b140 0x7ff6b41f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b4071bd0 0x7ff6b415aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff6a006aed0 0x7ff6a006d390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 --2- 172.21.15.153:0/622844237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b4158770 0x7ff6b40cafe0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/622844237 >> 172.21.15.153:0/622844237 conn(0x7ff6b40b1740 msgr2=0x7ff6b415d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/622844237 shutdown_connections 2023-11-24T08:05:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:19.227+0000 7ff6b9d4a700 1 -- 172.21.15.153:0/622844237 wait complete. 2023-11-24T08:05:19.241 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:05:19.241 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:05:19.241 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-11-24T08:05:19.241 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:05:19.241 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:19.241 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:05:19.241 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:05:19.242 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:05:19.242 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:19.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:19.242 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-11-24T08:05:19.263 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:05:19.263 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:05:19.264 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:05:19.264 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:19.264 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-11-24T08:05:19.264 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:19.264 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:19.264 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:19.264 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:19.264 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:19.264 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42359sec preferred_lft 42359sec 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c3a:c9d4:b907:ae22/64 scope link noprefixroute 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 2a:59:a8:c3:97:84 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::743c:f9ff:fe03:c5d2/64 scope link 2023-11-24T08:05:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:19.266 INFO:teuthology.orchestra.run.smithi164.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:19.266 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 2a:59:a8:c3:97:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:05:19.266 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::2859:a8ff:fec3:9784/64 scope link 2023-11-24T08:05:19.266 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:19.266 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:19.266 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether b6:1c:9d:ac:a8:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:05:19.266 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::b41c:9dff:feac:a8c8/64 scope link 2023-11-24T08:05:19.266 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:19.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:19.267 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:05:19.334 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-11-24T08:05:19.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:19.336 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-11-24T08:05:19.397 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-11-24T08:05:19.397 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:05:19.397 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:05:19.397 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:05:19.398 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:05:19.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:19.398 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:05:19.398 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:05:19.398 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:05:19.398 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:05:19.398 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:05:19.398 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:05:19.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:19.509 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-11-24T08:05:19.526 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:05:19.526 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:05:19.526 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:19.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:19.526 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-11-24T08:05:19.594 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:19.594 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:19.652 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:19.652 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:19.653 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:19.709 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T08:05:19.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:19.709 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:05:19.794 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:05:19.795 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:05:19.795 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:05:19.803 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:05:19.803 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:05:19.804 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:05:19.804 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:05:19.804 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:05:19.877 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:05:19.878 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:05:19.878 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:05:19.878 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:05:19.878 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:05:19.878 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-11-24T08:05:19.878 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-11-24T08:05:19.878 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a594d4d2-de60-4a04-bb93-76779d526986" will pass to kernel 2023-11-24T08:05:19.880 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:05:19.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:19.880 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:19.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:19.907 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:05:19.978 INFO:teuthology.orchestra.run.smithi164.stdout:client5265 2023-11-24T08:05:19.979 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:05:19.979 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:20.036 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T08:05:20.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.172+0000 7efc4af1a700 1 Processor -- start 2023-11-24T08:05:20.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.172+0000 7efc4af1a700 1 -- start start 2023-11-24T08:05:20.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc4af1a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efc440d22b0 0x7efc44166c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc4af1a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc440aec00 con 0x7efc4415bd70 2023-11-24T08:05:20.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc4af1a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc440705d0 con 0x7efc440d07c0 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc4af1a700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc440703c0 con 0x7efc440d22b0 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc48cb6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efc4415bd70 0x7efc4406fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43608/0 (socket says 172.21.15.153:43608) 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc48cb6700 1 -- 172.21.15.153:0/4095107419 learned_addr learned my addr 172.21.15.153:0/4095107419 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc494b7700 1 --2- 172.21.15.153:0/4095107419 >> v2:172.21.15.164:3300/0 conn(0x7efc440d22b0 0x7efc44166c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc437fe700 1 -- 172.21.15.153:0/4095107419 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293399472 0 0) 0x7efc440aec00 con 0x7efc4415bd70 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc437fe700 1 -- 172.21.15.153:0/4095107419 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc340035b0 con 0x7efc4415bd70 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc494b7700 1 -- 172.21.15.153:0/4095107419 >> v1:172.21.15.164:6789/0 conn(0x7efc440d07c0 legacy=0x7efc440d1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc437fe700 1 -- 172.21.15.153:0/4095107419 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531186327 0 0) 0x7efc440705d0 con 0x7efc440d07c0 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc494b7700 1 -- 172.21.15.153:0/4095107419 >> v1:172.21.15.153:6789/0 conn(0x7efc4415bd70 legacy=0x7efc4406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.173+0000 7efc494b7700 1 -- 172.21.15.153:0/4095107419 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440708b0 con 0x7efc440d22b0 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.174+0000 7efc494b7700 1 --2- 172.21.15.153:0/4095107419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc440d22b0 0x7efc44166c30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc44070500 tx=0x7efc3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d10b98035c27226e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.174+0000 7efc437fe700 1 -- 172.21.15.153:0/4095107419 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c016070 con 0x7efc440d22b0 2023-11-24T08:05:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.174+0000 7efc437fe700 1 -- 172.21.15.153:0/4095107419 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c00bb20 con 0x7efc440d22b0 2023-11-24T08:05:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.174+0000 7efc437fe700 1 -- 172.21.15.153:0/4095107419 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c00e070 con 0x7efc440d22b0 2023-11-24T08:05:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.174+0000 7efc4af1a700 1 -- 172.21.15.153:0/4095107419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc440d22b0 msgr2=0x7efc44166c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.174+0000 7efc4af1a700 1 --2- 172.21.15.153:0/4095107419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc440d22b0 0x7efc44166c30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc44070500 tx=0x7efc3c00b330 comp rx=0 tx=0).stop 2023-11-24T08:05:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.174+0000 7efc4af1a700 1 -- 172.21.15.153:0/4095107419 shutdown_connections 2023-11-24T08:05:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.174+0000 7efc4af1a700 1 --2- 172.21.15.153:0/4095107419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc440d22b0 0x7efc44166c30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.174+0000 7efc4af1a700 1 -- 172.21.15.153:0/4095107419 >> 172.21.15.153:0/4095107419 conn(0x7efc4406dc80 msgr2=0x7efc4409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.174+0000 7efc4af1a700 1 -- 172.21.15.153:0/4095107419 shutdown_connections 2023-11-24T08:05:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.174+0000 7efc4af1a700 1 -- 172.21.15.153:0/4095107419 wait complete. 2023-11-24T08:05:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.175+0000 7efc4af1a700 1 Processor -- start 2023-11-24T08:05:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.175+0000 7efc4af1a700 1 -- start start 2023-11-24T08:05:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.176+0000 7efc4af1a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc440d07c0 0x7efc441535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.176+0000 7efc4af1a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc440d22b0 0x7efc4406c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.176+0000 7efc4af1a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc4415bd70 0x7efc4415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.176+0000 7efc4af1a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440c7550 con 0x7efc440d22b0 2023-11-24T08:05:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.176+0000 7efc4af1a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440c7830 con 0x7efc440d07c0 2023-11-24T08:05:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.176+0000 7efc4af1a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc440c7b10 con 0x7efc4415bd70 2023-11-24T08:05:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.176+0000 7efc43fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc440d22b0 0x7efc4406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc43fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc440d22b0 0x7efc4406c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37512/0 (socket says 172.21.15.153:37512) 2023-11-24T08:05:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc43fff700 1 -- 172.21.15.153:0/3151493845 learned_addr learned my addr 172.21.15.153:0/3151493845 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc48cb6700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc440d07c0 0x7efc441535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc494b7700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc4415bd70 0x7efc4415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc43fff700 1 -- 172.21.15.153:0/3151493845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc4415bd70 msgr2=0x7efc4415a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc43fff700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc4415bd70 0x7efc4415a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc43fff700 1 -- 172.21.15.153:0/3151493845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc440d07c0 msgr2=0x7efc441535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc43fff700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc440d07c0 0x7efc441535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc43fff700 1 -- 172.21.15.153:0/3151493845 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c009a70 con 0x7efc440d22b0 2023-11-24T08:05:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc43fff700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc440d22b0 0x7efc4406c640 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7efc300011e0 tx=0x7efc3000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc417fa700 1 -- 172.21.15.153:0/3151493845 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc300054e0 con 0x7efc440d22b0 2023-11-24T08:05:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc4af1a700 1 -- 172.21.15.153:0/3151493845 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc440c7df0 con 0x7efc440d22b0 2023-11-24T08:05:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc4af1a700 1 -- 172.21.15.153:0/3151493845 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc44153b20 con 0x7efc440d22b0 2023-11-24T08:05:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc417fa700 1 -- 172.21.15.153:0/3151493845 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc30003680 con 0x7efc440d22b0 2023-11-24T08:05:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.177+0000 7efc417fa700 1 -- 172.21.15.153:0/3151493845 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc300039f0 con 0x7efc440d22b0 2023-11-24T08:05:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.178+0000 7efc4af1a700 1 -- 172.21.15.153:0/3151493845 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc240052e0 con 0x7efc440d22b0 2023-11-24T08:05:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.179+0000 7efc417fa700 1 -- 172.21.15.153:0/3151493845 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc30003b50 con 0x7efc440d22b0 2023-11-24T08:05:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.179+0000 7efc417fa700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efc2806aed0 0x7efc2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.179+0000 7efc417fa700 1 -- 172.21.15.153:0/3151493845 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc30088900 con 0x7efc440d22b0 2023-11-24T08:05:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.179+0000 7efc48cb6700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efc2806aed0 0x7efc2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.180+0000 7efc48cb6700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efc2806aed0 0x7efc2806d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efc38007fd0 tx=0x7efc38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.184+0000 7efc417fa700 1 -- 172.21.15.153:0/3151493845 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc300539e0 con 0x7efc440d22b0 2023-11-24T08:05:20.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:20.415+0000 7efc4af1a700 1 -- 172.21.15.153:0/3151493845 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efc24005860 con 0x7efc440d22b0 2023-11-24T08:05:21.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.207+0000 7efc417fa700 1 -- 172.21.15.153:0/3151493845 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 136+0+0 (secure 0 0 0) 0x7efc30057000 con 0x7efc440d22b0 2023-11-24T08:05:21.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.210+0000 7efc4af1a700 1 -- 172.21.15.153:0/3151493845 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efc2806aed0 msgr2=0x7efc2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.210+0000 7efc4af1a700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efc2806aed0 0x7efc2806d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efc38007fd0 tx=0x7efc38009040 comp rx=0 tx=0).stop 2023-11-24T08:05:21.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.210+0000 7efc4af1a700 1 -- 172.21.15.153:0/3151493845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc440d22b0 msgr2=0x7efc4406c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.210+0000 7efc4af1a700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc440d22b0 0x7efc4406c640 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7efc300011e0 tx=0x7efc3000ca30 comp rx=0 tx=0).stop 2023-11-24T08:05:21.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.210+0000 7efc4af1a700 1 -- 172.21.15.153:0/3151493845 shutdown_connections 2023-11-24T08:05:21.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.210+0000 7efc4af1a700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc4415bd70 0x7efc4415a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.211+0000 7efc4af1a700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc440d07c0 0x7efc441535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.211+0000 7efc4af1a700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efc2806aed0 0x7efc2806d390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.211+0000 7efc4af1a700 1 --2- 172.21.15.153:0/3151493845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc440d22b0 0x7efc4406c640 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.211+0000 7efc4af1a700 1 -- 172.21.15.153:0/3151493845 >> 172.21.15.153:0/3151493845 conn(0x7efc4406dc80 msgr2=0x7efc44158190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.211+0000 7efc4af1a700 1 -- 172.21.15.153:0/3151493845 shutdown_connections 2023-11-24T08:05:21.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.211+0000 7efc4af1a700 1 -- 172.21.15.153:0/3151493845 wait complete. 2023-11-24T08:05:21.228 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T08:05:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.354+0000 7fa84907f700 1 Processor -- start 2023-11-24T08:05:21.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.354+0000 7fa84907f700 1 -- start start 2023-11-24T08:05:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.354+0000 7fa84907f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa84415ae20 0x7fa8440b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa84907f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8440cfd40 con 0x7fa84415b200 2023-11-24T08:05:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa84907f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8440affa0 con 0x7fa8440b1a70 2023-11-24T08:05:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa84907f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440d0020 con 0x7fa84415ae20 2023-11-24T08:05:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa84259c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa84415b200 0x7fa8440b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43624/0 (socket says 172.21.15.153:43624) 2023-11-24T08:05:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa84259c700 1 -- 172.21.15.153:0/1208175444 learned_addr learned my addr 172.21.15.153:0/1208175444 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa842d9d700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa84415ae20 0x7fa8440b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171159477 0 0) 0x7fa8440cfd40 con 0x7fa84415b200 2023-11-24T08:05:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa82c0035b0 con 0x7fa84415b200 2023-11-24T08:05:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1795283673 0 0) 0x7fa82c0035b0 con 0x7fa84415b200 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa84415ae20 msgr2=0x7fa8440b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa84415ae20 0x7fa8440b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 >> v1:172.21.15.164:6789/0 conn(0x7fa8440b1a70 legacy=0x7fa844164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8440b0280 con 0x7fa84415b200 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fa838001670 con 0x7fa84415b200 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 >> v1:172.21.15.153:6789/0 conn(0x7fa84415b200 legacy=0x7fa8440b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa82c003a30 0x7fa82c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa82c0043e0 0x7fa82c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa84415ae20 0x7fa82c005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440d0020 con 0x7fa82c0043e0 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c00ba10 con 0x7fa82c003a30 2023-11-24T08:05:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c00bbd0 con 0x7fa84415ae20 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.355+0000 7fa84259c700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa82c0043e0 0x7fa82c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa842d9d700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa82c003a30 0x7fa82c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84359e700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa84415ae20 0x7fa82c005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84259c700 1 -- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa84415ae20 msgr2=0x7fa82c005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84259c700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa84415ae20 0x7fa82c005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84259c700 1 -- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa82c003a30 msgr2=0x7fa82c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84259c700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa82c003a30 0x7fa82c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84259c700 1 -- 172.21.15.153:0/1208175444 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c0035b0 con 0x7fa82c0043e0 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84359e700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa84415ae20 0x7fa82c005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84259c700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa82c0043e0 0x7fa82c0048b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa83800c2f0 tx=0x7fa82c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2e9593dc04541e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800ce30 con 0x7fa82c0043e0 2023-11-24T08:05:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838005960 con 0x7fa82c0043e0 2023-11-24T08:05:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa841d9b700 1 -- 172.21.15.153:0/1208175444 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838005d10 con 0x7fa82c0043e0 2023-11-24T08:05:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84907f700 1 -- 172.21.15.153:0/1208175444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa82c0043e0 msgr2=0x7fa82c0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84907f700 1 --2- 172.21.15.153:0/1208175444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa82c0043e0 0x7fa82c0048b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa83800c2f0 tx=0x7fa82c005880 comp rx=0 tx=0).stop 2023-11-24T08:05:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84359e700 1 -- 172.21.15.153:0/1208175444 reap_dead start 2023-11-24T08:05:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.356+0000 7fa84907f700 1 -- 172.21.15.153:0/1208175444 shutdown_connections 2023-11-24T08:05:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.357+0000 7fa84907f700 1 -- 172.21.15.153:0/1208175444 >> 172.21.15.153:0/1208175444 conn(0x7fa8440b57b0 msgr2=0x7fa8440b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.357+0000 7fa84907f700 1 -- 172.21.15.153:0/1208175444 shutdown_connections 2023-11-24T08:05:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.357+0000 7fa84907f700 1 -- 172.21.15.153:0/1208175444 wait complete. 2023-11-24T08:05:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.358+0000 7fa84907f700 1 Processor -- start 2023-11-24T08:05:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.358+0000 7fa84907f700 1 -- start start 2023-11-24T08:05:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84907f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa82c0043e0 0x7fa84415b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84907f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa844155890 0x7fa84414c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84907f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8440c9610 0x7fa8440c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84907f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440ca000 con 0x7fa8440c9610 2023-11-24T08:05:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84907f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415cd20 con 0x7fa844155890 2023-11-24T08:05:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84907f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8441547f0 con 0x7fa82c0043e0 2023-11-24T08:05:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8440c9610 0x7fa8440c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8440c9610 0x7fa8440c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37534/0 (socket says 172.21.15.153:37534) 2023-11-24T08:05:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84359e700 1 -- 172.21.15.153:0/2786719727 learned_addr learned my addr 172.21.15.153:0/2786719727 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84259c700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa844155890 0x7fa84414c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa842d9d700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa82c0043e0 0x7fa84415b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84359e700 1 -- 172.21.15.153:0/2786719727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa82c0043e0 msgr2=0x7fa84415b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84359e700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa82c0043e0 0x7fa84415b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84359e700 1 -- 172.21.15.153:0/2786719727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa844155890 msgr2=0x7fa84414c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84359e700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa844155890 0x7fa84414c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84359e700 1 -- 172.21.15.153:0/2786719727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844154ad0 con 0x7fa8440c9610 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa842d9d700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa82c0043e0 0x7fa84415b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84259c700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa844155890 0x7fa84414c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa84359e700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8440c9610 0x7fa8440c9ac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa84406d1b0 tx=0x7fa83c00c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa82b7fe700 1 -- 172.21.15.153:0/2786719727 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c003c10 con 0x7fa8440c9610 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa82b7fe700 1 -- 172.21.15.153:0/2786719727 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c003d90 con 0x7fa8440c9610 2023-11-24T08:05:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.359+0000 7fa82b7fe700 1 -- 172.21.15.153:0/2786719727 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00c9a0 con 0x7fa8440c9610 2023-11-24T08:05:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.360+0000 7fa84907f700 1 -- 172.21.15.153:0/2786719727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa844154db0 con 0x7fa8440c9610 2023-11-24T08:05:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.360+0000 7fa84907f700 1 -- 172.21.15.153:0/2786719727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa844155370 con 0x7fa8440c9610 2023-11-24T08:05:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.360+0000 7fa84907f700 1 -- 172.21.15.153:0/2786719727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa844155500 con 0x7fa8440c9610 2023-11-24T08:05:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.361+0000 7fa82b7fe700 1 -- 172.21.15.153:0/2786719727 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa83c00cb00 con 0x7fa8440c9610 2023-11-24T08:05:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.361+0000 7fa82b7fe700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa83006af00 0x7fa83006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.361+0000 7fa82b7fe700 1 -- 172.21.15.153:0/2786719727 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa83c0897e0 con 0x7fa8440c9610 2023-11-24T08:05:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.361+0000 7fa842d9d700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa83006af00 0x7fa83006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.362+0000 7fa842d9d700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa83006af00 0x7fa83006d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa834009c60 tx=0x7fa834008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.366+0000 7fa82b7fe700 1 -- 172.21.15.153:0/2786719727 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa83c054800 con 0x7fa8440c9610 2023-11-24T08:05:21.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.582+0000 7fa84907f700 1 -- 172.21.15.153:0/2786719727 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8440b39a0 con 0x7fa83006af00 2023-11-24T08:05:21.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.584+0000 7fa82b7fe700 1 -- 172.21.15.153:0/2786719727 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa834009da0 con 0x7fa83006af00 2023-11-24T08:05:21.585 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-11-24T08:05:21.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:21.586 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "cephfs" 2023-11-24T08:05:21.586 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:21.586 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-11-24T08:05:21.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 -- 172.21.15.153:0/2786719727 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa83006af00 msgr2=0x7fa83006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa83006af00 0x7fa83006d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa834009c60 tx=0x7fa834008040 comp rx=0 tx=0).stop 2023-11-24T08:05:21.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 -- 172.21.15.153:0/2786719727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8440c9610 msgr2=0x7fa8440c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8440c9610 0x7fa8440c9ac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa84406d1b0 tx=0x7fa83c00c0e0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 -- 172.21.15.153:0/2786719727 shutdown_connections 2023-11-24T08:05:21.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa83006af00 0x7fa83006d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8440c9610 0x7fa8440c9ac0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa82c0043e0 0x7fa84415b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 --2- 172.21.15.153:0/2786719727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa844155890 0x7fa84414c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 -- 172.21.15.153:0/2786719727 >> 172.21.15.153:0/2786719727 conn(0x7fa8440b57b0 msgr2=0x7fa84406e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 -- 172.21.15.153:0/2786719727 shutdown_connections 2023-11-24T08:05:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.586+0000 7fa84907f700 1 -- 172.21.15.153:0/2786719727 wait complete. 2023-11-24T08:05:21.600 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:05:21.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.722+0000 7fdaf7297700 1 Processor -- start 2023-11-24T08:05:21.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.722+0000 7fdaf7297700 1 -- start start 2023-11-24T08:05:21.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.723+0000 7fdaf7297700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf0140540 0x7fdaf0140920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.723+0000 7fdaf7297700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdaf00cf4e0 0x7fdaf00cf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.723+0000 7fdaf7297700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf006de00 con 0x7fdaf015e930 2023-11-24T08:05:21.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.723+0000 7fdaf7297700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf00d0bb0 con 0x7fdaf00cf4e0 2023-11-24T08:05:21.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.723+0000 7fdaf7297700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0140e60 con 0x7fdaf0140540 2023-11-24T08:05:21.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.723+0000 7fdaf5834700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdaf015e930 0x7fdaf015edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43646/0 (socket says 172.21.15.153:43646) 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.723+0000 7fdaf5834700 1 -- 172.21.15.153:0/1608223551 learned_addr learned my addr 172.21.15.153:0/1608223551 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdaf5033700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf0140540 0x7fdaf0140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737517274 0 0) 0x7fdaf006de00 con 0x7fdaf015e930 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdaf4832700 1 --2- 172.21.15.153:0/1608223551 >> v2:172.21.15.164:3300/0 conn(0x7fdaf00cf4e0 0x7fdaf00cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdadc0035b0 con 0x7fdaf015e930 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 849254241 0 0) 0x7fdadc0035b0 con 0x7fdaf015e930 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf0140540 msgr2=0x7fdaf0140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf0140540 0x7fdaf0140920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 >> v2:172.21.15.164:3300/0 conn(0x7fdaf00cf4e0 msgr2=0x7fdaf00cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 --2- 172.21.15.153:0/1608223551 >> v2:172.21.15.164:3300/0 conn(0x7fdaf00cf4e0 0x7fdaf00cf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf00d0310 con 0x7fdaf015e930 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fdae80019f0 con 0x7fdaf015e930 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 >> v1:172.21.15.153:6789/0 conn(0x7fdaf015e930 legacy=0x7fdaf015edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf0140540 0x7fdadc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdadc003f80 0x7fdadc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdadc004d90 0x7fdadc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0140e60 con 0x7fdadc004d90 2023-11-24T08:05:21.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc00ba10 con 0x7fdadc003f80 2023-11-24T08:05:21.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc00bb50 con 0x7fdaf0140540 2023-11-24T08:05:21.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdaf5834700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdadc004d90 0x7fdadc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdaf5033700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf0140540 0x7fdadc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdaf4832700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdadc003f80 0x7fdadc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdaf5834700 1 -- 172.21.15.153:0/1608223551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf0140540 msgr2=0x7fdadc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdaf5834700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf0140540 0x7fdadc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdaf5834700 1 -- 172.21.15.153:0/1608223551 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdadc003f80 msgr2=0x7fdadc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdaf5834700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdadc003f80 0x7fdadc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.724+0000 7fdaf5834700 1 -- 172.21.15.153:0/1608223551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc0035b0 con 0x7fdadc004d90 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.725+0000 7fdaf5834700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdadc004d90 0x7fdadc005210 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdae800a8d0 tx=0x7fdadc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484c662afe5eda30 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.725+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae800a340 con 0x7fdadc004d90 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.725+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae8012600 con 0x7fdadc004d90 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.725+0000 7fdae7fff700 1 -- 172.21.15.153:0/1608223551 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae80129b0 con 0x7fdadc004d90 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.725+0000 7fdaf7297700 1 -- 172.21.15.153:0/1608223551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdadc004d90 msgr2=0x7fdadc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.725+0000 7fdaf7297700 1 --2- 172.21.15.153:0/1608223551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdadc004d90 0x7fdadc005210 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdae800a8d0 tx=0x7fdadc005880 comp rx=0 tx=0).stop 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.725+0000 7fdaf5834700 1 -- 172.21.15.153:0/1608223551 reap_dead start 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.725+0000 7fdaf7297700 1 -- 172.21.15.153:0/1608223551 shutdown_connections 2023-11-24T08:05:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.725+0000 7fdaf7297700 1 -- 172.21.15.153:0/1608223551 >> 172.21.15.153:0/1608223551 conn(0x7fdaf0072960 msgr2=0x7fdaf006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.725+0000 7fdaf7297700 1 -- 172.21.15.153:0/1608223551 shutdown_connections 2023-11-24T08:05:21.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.726+0000 7fdaf7297700 1 -- 172.21.15.153:0/1608223551 wait complete. 2023-11-24T08:05:21.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.727+0000 7fdaf7297700 1 Processor -- start 2023-11-24T08:05:21.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.727+0000 7fdaf7297700 1 -- start start 2023-11-24T08:05:21.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.727+0000 7fdaf7297700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdaf013e4b0 0x7fdaf0152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.727+0000 7fdaf7297700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf00b60e0 0x7fdaf0152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.727+0000 7fdaf7297700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf013e890 0x7fdaf00b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.727+0000 7fdaf7297700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf00b4dd0 con 0x7fdaf00b60e0 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.727+0000 7fdaf7297700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf01555f0 con 0x7fdaf013e4b0 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.727+0000 7fdaf7297700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf00b5040 con 0x7fdaf013e890 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.727+0000 7fdaf4832700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf00b60e0 0x7fdaf0152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf4832700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf00b60e0 0x7fdaf0152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37552/0 (socket says 172.21.15.153:37552) 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf4832700 1 -- 172.21.15.153:0/3040730067 learned_addr learned my addr 172.21.15.153:0/3040730067 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf5033700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdaf013e4b0 0x7fdaf0152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf5834700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf013e890 0x7fdaf00b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf4832700 1 -- 172.21.15.153:0/3040730067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf013e890 msgr2=0x7fdaf00b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf4832700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf013e890 0x7fdaf00b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf4832700 1 -- 172.21.15.153:0/3040730067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdaf013e4b0 msgr2=0x7fdaf0152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf4832700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdaf013e4b0 0x7fdaf0152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf4832700 1 -- 172.21.15.153:0/3040730067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf00b5320 con 0x7fdaf00b60e0 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf5834700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf013e890 0x7fdaf00b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf4832700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf00b60e0 0x7fdaf0152680 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdaec011ad0 tx=0x7fdaec011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdae5ffb700 1 -- 172.21.15.153:0/3040730067 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00f9a0 con 0x7fdaf00b60e0 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdae5ffb700 1 -- 172.21.15.153:0/3040730067 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec00fb00 con 0x7fdaf00b60e0 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdae5ffb700 1 -- 172.21.15.153:0/3040730067 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00feb0 con 0x7fdaf00b60e0 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf7297700 1 -- 172.21.15.153:0/3040730067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf00b5600 con 0x7fdaf00b60e0 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.728+0000 7fdaf7297700 1 -- 172.21.15.153:0/3040730067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf00b5bc0 con 0x7fdaf00b60e0 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.729+0000 7fdaf7297700 1 -- 172.21.15.153:0/3040730067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf0068fb0 con 0x7fdaf00b60e0 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.730+0000 7fdae5ffb700 1 -- 172.21.15.153:0/3040730067 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdaec014440 con 0x7fdaf00b60e0 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.730+0000 7fdae5ffb700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdad406aec0 0x7fdad406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.730+0000 7fdae5ffb700 1 -- 172.21.15.153:0/3040730067 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaec089d10 con 0x7fdaf00b60e0 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.730+0000 7fdaf5033700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdad406aec0 0x7fdad406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.731+0000 7fdaf5033700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdad406aec0 0x7fdad406d380 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0153730 tx=0x7fdae0009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.735+0000 7fdae5ffb700 1 -- 172.21.15.153:0/3040730067 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdaec054e70 con 0x7fdaf00b60e0 2023-11-24T08:05:21.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.924+0000 7fdaf7297700 1 -- 172.21.15.153:0/3040730067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdaf006f710 con 0x7fdaf00b60e0 2023-11-24T08:05:21.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.925+0000 7fdae5ffb700 1 -- 172.21.15.153:0/3040730067 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdaec058490 con 0x7fdaf00b60e0 2023-11-24T08:05:21.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 -- 172.21.15.153:0/3040730067 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdad406aec0 msgr2=0x7fdad406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdad406aec0 0x7fdad406d380 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0153730 tx=0x7fdae0009210 comp rx=0 tx=0).stop 2023-11-24T08:05:21.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 -- 172.21.15.153:0/3040730067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf00b60e0 msgr2=0x7fdaf0152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf00b60e0 0x7fdaf0152680 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdaec011ad0 tx=0x7fdaec011e90 comp rx=0 tx=0).stop 2023-11-24T08:05:21.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 -- 172.21.15.153:0/3040730067 shutdown_connections 2023-11-24T08:05:21.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf013e890 0x7fdaf00b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdaf013e4b0 0x7fdaf0152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdad406aec0 0x7fdad406d380 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 --2- 172.21.15.153:0/3040730067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf00b60e0 0x7fdaf0152680 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 -- 172.21.15.153:0/3040730067 >> 172.21.15.153:0/3040730067 conn(0x7fdaf0072960 msgr2=0x7fdaf015ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 -- 172.21.15.153:0/3040730067 shutdown_connections 2023-11-24T08:05:21.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:21.927+0000 7fdaf7297700 1 -- 172.21.15.153:0/3040730067 wait complete. 2023-11-24T08:05:21.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:21.941 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp8068/subvol34) 2023-11-24T08:05:21.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:21.975 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2023-11-24T08:05:22.033 INFO:teuthology.orchestra.run.smithi153.stdout:cephfs_data 2023-11-24T08:05:22.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:22.033 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp8068/subvol34) 2023-11-24T08:05:22.113 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:05:22.114 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp8068/subvol34/.meta 2023-11-24T08:05:22.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol34 subvol_grp8068 2023-11-24T08:05:22.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.348+0000 7f86514ef700 1 Processor -- start 2023-11-24T08:05:22.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.348+0000 7f86514ef700 1 -- start start 2023-11-24T08:05:22.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f86514ef700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c15e120 0x7f864c06eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f86514ef700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f864c0b4260 0x7f864c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f86514ef700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864c0af5e0 con 0x7f864c0af9b0 2023-11-24T08:05:22.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f86514ef700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c0b5ee0 con 0x7f864c0b4260 2023-11-24T08:05:22.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f86514ef700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c06dd80 con 0x7f864c15e120 2023-11-24T08:05:22.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f864a7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f864c0af9b0 0x7f864c0b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43664/0 (socket says 172.21.15.153:43664) 2023-11-24T08:05:22.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f864a7fc700 1 -- 172.21.15.153:0/216553815 learned_addr learned my addr 172.21.15.153:0/216553815 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:22.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f864b7fe700 1 --2- 172.21.15.153:0/216553815 >> v2:172.21.15.164:3300/0 conn(0x7f864c0b4260 0x7f864c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f864affd700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c15e120 0x7f864c06eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823995859 0 0) 0x7f864c0af5e0 con 0x7f864c0af9b0 2023-11-24T08:05:22.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86340035b0 con 0x7f864c0af9b0 2023-11-24T08:05:22.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2756963569 0 0) 0x7f86340035b0 con 0x7f864c0af9b0 2023-11-24T08:05:22.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c15e120 msgr2=0x7f864c06eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f8649ffb700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c15e120 0x7f864c06eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 >> v2:172.21.15.164:3300/0 conn(0x7f864c0b4260 msgr2=0x7f864c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f8649ffb700 1 --2- 172.21.15.153:0/216553815 >> v2:172.21.15.164:3300/0 conn(0x7f864c0b4260 0x7f864c0b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0b0350 con 0x7f864c0af9b0 2023-11-24T08:05:22.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.349+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f863c001670 con 0x7f864c0af9b0 2023-11-24T08:05:22.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 >> v1:172.21.15.153:6789/0 conn(0x7f864c0af9b0 legacy=0x7f864c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f8649ffb700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8634003a00 0x7f8634003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f8649ffb700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c15e120 0x7f8634004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f8649ffb700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8634004d90 0x7f8634005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0b5ee0 con 0x7f8634004d90 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c06dd80 con 0x7f8634003a00 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863400ba10 con 0x7f864c15e120 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f864b7fe700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8634004d90 0x7f8634005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f864affd700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8634003a00 0x7f8634003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f864a7fc700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c15e120 0x7f8634004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f864b7fe700 1 -- 172.21.15.153:0/216553815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c15e120 msgr2=0x7f8634004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f864b7fe700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c15e120 0x7f8634004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f864b7fe700 1 -- 172.21.15.153:0/216553815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8634003a00 msgr2=0x7f8634003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f864b7fe700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8634003a00 0x7f8634003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f864b7fe700 1 -- 172.21.15.153:0/216553815 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86340035b0 con 0x7f8634004d90 2023-11-24T08:05:22.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f864b7fe700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8634004d90 0x7f8634005210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8644009f90 tx=0x7f8634005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fa7f7807a701cd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864400ec30 con 0x7f8634004d90 2023-11-24T08:05:22.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864400f040 con 0x7f8634004d90 2023-11-24T08:05:22.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.350+0000 7f8649ffb700 1 -- 172.21.15.153:0/216553815 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644014480 con 0x7f8634004d90 2023-11-24T08:05:22.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.351+0000 7f86514ef700 1 -- 172.21.15.153:0/216553815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8634004d90 msgr2=0x7f8634005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.351+0000 7f86514ef700 1 --2- 172.21.15.153:0/216553815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8634004d90 0x7f8634005210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8644009f90 tx=0x7f8634005880 comp rx=0 tx=0).stop 2023-11-24T08:05:22.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.351+0000 7f864b7fe700 1 -- 172.21.15.153:0/216553815 reap_dead start 2023-11-24T08:05:22.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.351+0000 7f86514ef700 1 -- 172.21.15.153:0/216553815 shutdown_connections 2023-11-24T08:05:22.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.351+0000 7f86514ef700 1 -- 172.21.15.153:0/216553815 >> 172.21.15.153:0/216553815 conn(0x7f864c0d0ba0 msgr2=0x7f864c0d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:22.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.351+0000 7f86514ef700 1 -- 172.21.15.153:0/216553815 shutdown_connections 2023-11-24T08:05:22.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.351+0000 7f86514ef700 1 -- 172.21.15.153:0/216553815 wait complete. 2023-11-24T08:05:22.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.352+0000 7f86514ef700 1 Processor -- start 2023-11-24T08:05:22.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.352+0000 7f86514ef700 1 -- start start 2023-11-24T08:05:22.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f86514ef700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f864c0cf570 0x7f864c160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f86514ef700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c160a50 0x7f864c0c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f86514ef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864c0c92c0 0x7f864c1f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f86514ef700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c160ed0 con 0x7f864c0c92c0 2023-11-24T08:05:22.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f86514ef700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0c5b60 con 0x7f864c0cf570 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f86514ef700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0c5e00 con 0x7f864c160a50 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f864b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864c0c92c0 0x7f864c1f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f864b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864c0c92c0 0x7f864c1f6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37574/0 (socket says 172.21.15.153:37574) 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f864b7fe700 1 -- 172.21.15.153:0/2372496528 learned_addr learned my addr 172.21.15.153:0/2372496528 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f864affd700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f864c0cf570 0x7f864c160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f864a7fc700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c160a50 0x7f864c0c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f864b7fe700 1 -- 172.21.15.153:0/2372496528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c160a50 msgr2=0x7f864c0c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f864b7fe700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c160a50 0x7f864c0c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f864b7fe700 1 -- 172.21.15.153:0/2372496528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f864c0cf570 msgr2=0x7f864c160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f864b7fe700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f864c0cf570 0x7f864c160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f864b7fe700 1 -- 172.21.15.153:0/2372496528 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0c60e0 con 0x7f864c0c92c0 2023-11-24T08:05:22.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.353+0000 7f864affd700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f864c0cf570 0x7f864c160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:22.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.354+0000 7f864b7fe700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864c0c92c0 0x7f864c1f6d40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8644016000 tx=0x7f8644009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.354+0000 7f86337fe700 1 -- 172.21.15.153:0/2372496528 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644007000 con 0x7f864c0c92c0 2023-11-24T08:05:22.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.354+0000 7f86337fe700 1 -- 172.21.15.153:0/2372496528 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8644003e30 con 0x7f864c0c92c0 2023-11-24T08:05:22.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.354+0000 7f86337fe700 1 -- 172.21.15.153:0/2372496528 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644015b60 con 0x7f864c0c92c0 2023-11-24T08:05:22.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.354+0000 7f86514ef700 1 -- 172.21.15.153:0/2372496528 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c0c63c0 con 0x7f864c0c92c0 2023-11-24T08:05:22.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.354+0000 7f86514ef700 1 -- 172.21.15.153:0/2372496528 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c0cf950 con 0x7f864c0c92c0 2023-11-24T08:05:22.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.355+0000 7f86514ef700 1 -- 172.21.15.153:0/2372496528 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c0c6a10 con 0x7f864c0c92c0 2023-11-24T08:05:22.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.355+0000 7f86337fe700 1 -- 172.21.15.153:0/2372496528 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8644015cc0 con 0x7f864c0c92c0 2023-11-24T08:05:22.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.355+0000 7f86337fe700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f863806aed0 0x7f863806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.356+0000 7f86337fe700 1 -- 172.21.15.153:0/2372496528 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f864408a890 con 0x7f864c0c92c0 2023-11-24T08:05:22.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.356+0000 7f864affd700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f863806aed0 0x7f863806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.356+0000 7f864affd700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f863806aed0 0x7f863806d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8640009be0 tx=0x7f8640008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.360+0000 7f86337fe700 1 -- 172.21.15.153:0/2372496528 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f86440559d0 con 0x7f864c0c92c0 2023-11-24T08:05:22.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.585+0000 7f86514ef700 1 -- 172.21.15.153:0/2372496528 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol34", "group_name": "subvol_grp8068", "target": ["mon-mgr", ""]}) v1 -- 0x7f864c06e600 con 0x7f863806aed0 2023-11-24T08:05:22.591 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:22.589+0000 7f67d8edc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:22.591 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:22.589+0000 7f67d8edc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:22.591 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:22.589+0000 7f67d8edc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:22.591 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:22.589+0000 7f67d8edc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:22.591 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:22.589+0000 7f67d8edc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.622+0000 7f86337fe700 1 -- 172.21.15.153:0/2372496528 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f8640009830 con 0x7f863806aed0 2023-11-24T08:05:22.624 INFO:teuthology.orchestra.run.smithi153.stdout:/volumes/subvol_grp8068/subvol34 2023-11-24T08:05:22.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.624+0000 7f86514ef700 1 -- 172.21.15.153:0/2372496528 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f863806aed0 msgr2=0x7f863806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.624+0000 7f86514ef700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f863806aed0 0x7f863806d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8640009be0 tx=0x7f8640008040 comp rx=0 tx=0).stop 2023-11-24T08:05:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.624+0000 7f86514ef700 1 -- 172.21.15.153:0/2372496528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864c0c92c0 msgr2=0x7f864c1f6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.625+0000 7f86514ef700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864c0c92c0 0x7f864c1f6d40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8644016000 tx=0x7f8644009750 comp rx=0 tx=0).stop 2023-11-24T08:05:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.625+0000 7f86514ef700 1 -- 172.21.15.153:0/2372496528 shutdown_connections 2023-11-24T08:05:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.625+0000 7f86514ef700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f863806aed0 0x7f863806d390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.625+0000 7f86514ef700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864c0c92c0 0x7f864c1f6d40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.625+0000 7f86514ef700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f864c0cf570 0x7f864c160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.625+0000 7f86514ef700 1 --2- 172.21.15.153:0/2372496528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f864c160a50 0x7f864c0c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.625+0000 7f86514ef700 1 -- 172.21.15.153:0/2372496528 >> 172.21.15.153:0/2372496528 conn(0x7f864c0d0ba0 msgr2=0x7f864c0d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.625+0000 7f86514ef700 1 -- 172.21.15.153:0/2372496528 shutdown_connections 2023-11-24T08:05:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.625+0000 7f86514ef700 1 -- 172.21.15.153:0/2372496528 wait complete. 2023-11-24T08:05:22.639 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol34 subvol_grp8068 2023-11-24T08:05:22.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.762+0000 7f274f819700 1 Processor -- start 2023-11-24T08:05:22.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.762+0000 7f274f819700 1 -- start start 2023-11-24T08:05:22.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.763+0000 7f274f819700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2748144600 0x7f27480b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.763+0000 7f274f819700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f274806e830 0x7f274806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.763+0000 7f274f819700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274806f1c0 con 0x7f274806f480 2023-11-24T08:05:22.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.763+0000 7f274f819700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274806aff0 con 0x7f2748144600 2023-11-24T08:05:22.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.763+0000 7f274f819700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274806c9b0 con 0x7f274806e830 2023-11-24T08:05:22.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.763+0000 7f274cdb4700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f274806f480 0x7f274806c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43702/0 (socket says 172.21.15.153:43702) 2023-11-24T08:05:22.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.763+0000 7f274cdb4700 1 -- 172.21.15.153:0/754273345 learned_addr learned my addr 172.21.15.153:0/754273345 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:22.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.763+0000 7f274ddb6700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f274806e830 0x7f274806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.763+0000 7f274d5b5700 1 --2- 172.21.15.153:0/754273345 >> v2:172.21.15.164:3300/0 conn(0x7f2748144600 0x7f27480b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.763+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223802035 0 0) 0x7f2744001110 con 0x7f274806f480 2023-11-24T08:05:22.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.763+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27340035b0 con 0x7f274806f480 2023-11-24T08:05:22.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 637796761 0 0) 0x7f27340035b0 con 0x7f274806f480 2023-11-24T08:05:22.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f274806e830 msgr2=0x7f274806ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f274806e830 0x7f274806ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 >> v2:172.21.15.164:3300/0 conn(0x7f2748144600 msgr2=0x7f27480b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 --2- 172.21.15.153:0/754273345 >> v2:172.21.15.164:3300/0 conn(0x7f2748144600 0x7f27480b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274806b200 con 0x7f274806f480 2023-11-24T08:05:22.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f2744001800 con 0x7f274806f480 2023-11-24T08:05:22.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f274d5b5700 1 --2- 172.21.15.153:0/754273345 >> v2:172.21.15.164:3300/0 conn(0x7f2748144600 0x7f27480b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:22.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 >> v1:172.21.15.153:6789/0 conn(0x7f274806f480 legacy=0x7f274806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2734003a00 0x7f2734003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2734004850 0x7f2734004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2734005210 0x7f273400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274806aff0 con 0x7f2734005210 2023-11-24T08:05:22.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274806c9b0 con 0x7f2734004850 2023-11-24T08:05:22.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273400e260 con 0x7f2734003a00 2023-11-24T08:05:22.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f274ddb6700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f274806e830 0x7f274806ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:22.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f274ddb6700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2734005210 0x7f273400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f274d5b5700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2734003a00 0x7f2734003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f274cdb4700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2734004850 0x7f2734004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f274ddb6700 1 -- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2734003a00 msgr2=0x7f2734003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f274ddb6700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2734003a00 0x7f2734003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f274ddb6700 1 -- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2734004850 msgr2=0x7f2734004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f274ddb6700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2734004850 0x7f2734004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f274ddb6700 1 -- 172.21.15.153:0/754273345 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27340035b0 con 0x7f2734005210 2023-11-24T08:05:22.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f274ddb6700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2734005210 0x7f273400dc20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2740009f00 tx=0x7f2734005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d712f28fdd9d3aba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740007dc0 con 0x7f2734005210 2023-11-24T08:05:22.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274000f040 con 0x7f2734005210 2023-11-24T08:05:22.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.764+0000 7f273ffff700 1 -- 172.21.15.153:0/754273345 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740003c60 con 0x7f2734005210 2023-11-24T08:05:22.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.765+0000 7f274f819700 1 -- 172.21.15.153:0/754273345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2734005210 msgr2=0x7f273400dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.765+0000 7f274f819700 1 --2- 172.21.15.153:0/754273345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2734005210 0x7f273400dc20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2740009f00 tx=0x7f2734005880 comp rx=0 tx=0).stop 2023-11-24T08:05:22.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.765+0000 7f274ddb6700 1 -- 172.21.15.153:0/754273345 reap_dead start 2023-11-24T08:05:22.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.765+0000 7f274f819700 1 -- 172.21.15.153:0/754273345 shutdown_connections 2023-11-24T08:05:22.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.765+0000 7f274f819700 1 -- 172.21.15.153:0/754273345 >> 172.21.15.153:0/754273345 conn(0x7f27480d0b40 msgr2=0x7f27480d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:22.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.765+0000 7f274f819700 1 -- 172.21.15.153:0/754273345 shutdown_connections 2023-11-24T08:05:22.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.765+0000 7f274f819700 1 -- 172.21.15.153:0/754273345 wait complete. 2023-11-24T08:05:22.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.766+0000 7f274f819700 1 Processor -- start 2023-11-24T08:05:22.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.766+0000 7f274f819700 1 -- start start 2023-11-24T08:05:22.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274f819700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2748137b00 0x7f274815a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274f819700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2748137ee0 0x7f27480cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274f819700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f274815a7b0 0x7f27480cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274f819700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2748139000 con 0x7f2748137b00 2023-11-24T08:05:22.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274f819700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274815c080 con 0x7f274815a7b0 2023-11-24T08:05:22.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274f819700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274815b470 con 0x7f2748137ee0 2023-11-24T08:05:22.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274d5b5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2748137b00 0x7f274815a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274d5b5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2748137b00 0x7f274815a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37608/0 (socket says 172.21.15.153:37608) 2023-11-24T08:05:22.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274d5b5700 1 -- 172.21.15.153:0/2921951757 learned_addr learned my addr 172.21.15.153:0/2921951757 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:22.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274ddb6700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f274815a7b0 0x7f27480cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274d5b5700 1 -- 172.21.15.153:0/2921951757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2748137ee0 msgr2=0x7f27480cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274d5b5700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2748137ee0 0x7f27480cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274d5b5700 1 -- 172.21.15.153:0/2921951757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f274815a7b0 msgr2=0x7f27480cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274d5b5700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f274815a7b0 0x7f27480cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.767+0000 7f274d5b5700 1 -- 172.21.15.153:0/2921951757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274815b750 con 0x7f2748137b00 2023-11-24T08:05:22.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.768+0000 7f274d5b5700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2748137b00 0x7f274815a270 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2738011900 tx=0x7f2738011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.768+0000 7f273dffb700 1 -- 172.21.15.153:0/2921951757 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738004230 con 0x7f2748137b00 2023-11-24T08:05:22.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.768+0000 7f273dffb700 1 -- 172.21.15.153:0/2921951757 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2738004390 con 0x7f2748137b00 2023-11-24T08:05:22.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.768+0000 7f274f819700 1 -- 172.21.15.153:0/2921951757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274815ba30 con 0x7f2748137b00 2023-11-24T08:05:22.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.768+0000 7f273dffb700 1 -- 172.21.15.153:0/2921951757 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380036a0 con 0x7f2748137b00 2023-11-24T08:05:22.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.768+0000 7f274f819700 1 -- 172.21.15.153:0/2921951757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274813a510 con 0x7f2748137b00 2023-11-24T08:05:22.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.769+0000 7f274f819700 1 -- 172.21.15.153:0/2921951757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2748067f60 con 0x7f2748137b00 2023-11-24T08:05:22.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.769+0000 7f273dffb700 1 -- 172.21.15.153:0/2921951757 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2738003800 con 0x7f2748137b00 2023-11-24T08:05:22.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.770+0000 7f273dffb700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f272c06aed0 0x7f272c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.770+0000 7f273dffb700 1 -- 172.21.15.153:0/2921951757 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2738089a80 con 0x7f2748137b00 2023-11-24T08:05:22.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.770+0000 7f274cdb4700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f272c06aed0 0x7f272c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.770+0000 7f274cdb4700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f272c06aed0 0x7f272c06d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27480d0220 tx=0x7f2744001110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.774+0000 7f273dffb700 1 -- 172.21.15.153:0/2921951757 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2738054b30 con 0x7f2748137b00 2023-11-24T08:05:22.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:22.997+0000 7f274f819700 1 -- 172.21.15.153:0/2921951757 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol34", "group_name": "subvol_grp8068", "target": ["mon-mgr", ""]}) v1 -- 0x7f274806baa0 con 0x7f272c06aed0 2023-11-24T08:05:23.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.001+0000 7f273dffb700 1 -- 172.21.15.153:0/2921951757 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f2744007e00 con 0x7f272c06aed0 2023-11-24T08:05:23.003 INFO:teuthology.orchestra.run.smithi153.stdout:/volumes/subvol_grp8068/subvol34 2023-11-24T08:05:23.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.003+0000 7f274f819700 1 -- 172.21.15.153:0/2921951757 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f272c06aed0 msgr2=0x7f272c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.003+0000 7f274f819700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f272c06aed0 0x7f272c06d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27480d0220 tx=0x7f2744001110 comp rx=0 tx=0).stop 2023-11-24T08:05:23.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.004+0000 7f274f819700 1 -- 172.21.15.153:0/2921951757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2748137b00 msgr2=0x7f274815a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.004+0000 7f274f819700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2748137b00 0x7f274815a270 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2738011900 tx=0x7f2738011cc0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.004+0000 7f274f819700 1 -- 172.21.15.153:0/2921951757 shutdown_connections 2023-11-24T08:05:23.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.004+0000 7f274f819700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f274815a7b0 0x7f27480cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.004+0000 7f274f819700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f272c06aed0 0x7f272c06d390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.004+0000 7f274f819700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2748137b00 0x7f274815a270 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.004+0000 7f274f819700 1 --2- 172.21.15.153:0/2921951757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2748137ee0 0x7f27480cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.004+0000 7f274f819700 1 -- 172.21.15.153:0/2921951757 >> 172.21.15.153:0/2921951757 conn(0x7f27480d0b40 msgr2=0x7f27480d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:23.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.004+0000 7f274f819700 1 -- 172.21.15.153:0/2921951757 shutdown_connections 2023-11-24T08:05:23.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.004+0000 7f274f819700 1 -- 172.21.15.153:0/2921951757 wait complete. 2023-11-24T08:05:23.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:23.017 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/f3cfad03ba5a6b5266b403289b1a825a.meta) 2023-11-24T08:05:23.049 INFO:teuthology.orchestra.run.smithi153.stdout:[GLOBAL] 2023-11-24T08:05:23.049 INFO:teuthology.orchestra.run.smithi153.stdout:version = 1 2023-11-24T08:05:23.050 INFO:teuthology.orchestra.run.smithi153.stdout:type = subvolume 2023-11-24T08:05:23.050 INFO:teuthology.orchestra.run.smithi153.stdout:path = /volumes/subvol_grp8068/subvol34 2023-11-24T08:05:23.050 INFO:teuthology.orchestra.run.smithi153.stdout:state = complete 2023-11-24T08:05:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:23.052 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol34 subvol_grp8068 2023-11-24T08:05:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.218+0000 7fdc790cc700 1 Processor -- start 2023-11-24T08:05:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.218+0000 7fdc790cc700 1 -- start start 2023-11-24T08:05:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.219+0000 7fdc790cc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdc740622a0 0x7fdc740afd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.219+0000 7fdc790cc700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc740ccd50 con 0x7fdc7415c090 2023-11-24T08:05:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.219+0000 7fdc790cc700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc740b0240 con 0x7fdc740cd1e0 2023-11-24T08:05:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.219+0000 7fdc790cc700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc740ccab0 con 0x7fdc740622a0 2023-11-24T08:05:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.219+0000 7fdc72d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdc7415c090 0x7fdc740ca8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43722/0 (socket says 172.21.15.153:43722) 2023-11-24T08:05:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.219+0000 7fdc72d9d700 1 -- 172.21.15.153:0/4200388456 learned_addr learned my addr 172.21.15.153:0/4200388456 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.219+0000 7fdc7259c700 1 --2- 172.21.15.153:0/4200388456 >> v2:172.21.15.164:3300/0 conn(0x7fdc740622a0 0x7fdc740afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.219+0000 7fdc7259c700 1 -- 172.21.15.153:0/4200388456 >> v1:172.21.15.164:6789/0 conn(0x7fdc740cd1e0 legacy=0x7fdc740cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.219+0000 7fdc7259c700 1 -- 172.21.15.153:0/4200388456 >> v1:172.21.15.153:6789/0 conn(0x7fdc7415c090 legacy=0x7fdc740ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.219+0000 7fdc7259c700 1 -- 172.21.15.153:0/4200388456 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc740cafc0 con 0x7fdc740622a0 2023-11-24T08:05:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.220+0000 7fdc7259c700 1 --2- 172.21.15.153:0/4200388456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc740622a0 0x7fdc740afd00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009840 tx=0x7fdc64009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14f41fef7ae920e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.223+0000 7fdc71d9b700 1 -- 172.21.15.153:0/4200388456 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64011830 con 0x7fdc740622a0 2023-11-24T08:05:23.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.223+0000 7fdc71d9b700 1 -- 172.21.15.153:0/4200388456 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc64011990 con 0x7fdc740622a0 2023-11-24T08:05:23.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.223+0000 7fdc71d9b700 1 -- 172.21.15.153:0/4200388456 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64011d20 con 0x7fdc740622a0 2023-11-24T08:05:23.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.224+0000 7fdc790cc700 1 -- 172.21.15.153:0/4200388456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc740622a0 msgr2=0x7fdc740afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.224+0000 7fdc790cc700 1 --2- 172.21.15.153:0/4200388456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc740622a0 0x7fdc740afd00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009840 tx=0x7fdc64009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:23.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.224+0000 7fdc790cc700 1 -- 172.21.15.153:0/4200388456 shutdown_connections 2023-11-24T08:05:23.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.224+0000 7fdc790cc700 1 --2- 172.21.15.153:0/4200388456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc740622a0 0x7fdc740afd00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.224+0000 7fdc790cc700 1 -- 172.21.15.153:0/4200388456 >> 172.21.15.153:0/4200388456 conn(0x7fdc740b1e90 msgr2=0x7fdc740b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.224+0000 7fdc790cc700 1 -- 172.21.15.153:0/4200388456 shutdown_connections 2023-11-24T08:05:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.224+0000 7fdc790cc700 1 -- 172.21.15.153:0/4200388456 wait complete. 2023-11-24T08:05:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.226+0000 7fdc790cc700 1 Processor -- start 2023-11-24T08:05:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.226+0000 7fdc790cc700 1 -- start start 2023-11-24T08:05:23.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc790cc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc740622a0 0x7fdc741f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc790cc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc740cd1e0 0x7fdc740b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc790cc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc7415c090 0x7fdc740af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc790cc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7415d9c0 con 0x7fdc740622a0 2023-11-24T08:05:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc790cc700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7415cdf0 con 0x7fdc7415c090 2023-11-24T08:05:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc790cc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7415d090 con 0x7fdc740cd1e0 2023-11-24T08:05:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc72d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc740622a0 0x7fdc741f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc72d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc740622a0 0x7fdc741f1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37626/0 (socket says 172.21.15.153:37626) 2023-11-24T08:05:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc72d9d700 1 -- 172.21.15.153:0/1326622755 learned_addr learned my addr 172.21.15.153:0/1326622755 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc7359e700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc7415c090 0x7fdc740af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc7259c700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc740cd1e0 0x7fdc740b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc72d9d700 1 -- 172.21.15.153:0/1326622755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc740cd1e0 msgr2=0x7fdc740b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc72d9d700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc740cd1e0 0x7fdc740b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc72d9d700 1 -- 172.21.15.153:0/1326622755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc7415c090 msgr2=0x7fdc740af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc72d9d700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc7415c090 0x7fdc740af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.227+0000 7fdc72d9d700 1 -- 172.21.15.153:0/1326622755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc640094a0 con 0x7fdc740622a0 2023-11-24T08:05:23.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.228+0000 7fdc72d9d700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc740622a0 0x7fdc741f1ea0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c480 tx=0x7fdc6800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.228+0000 7fdc5b7fe700 1 -- 172.21.15.153:0/1326622755 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68005d70 con 0x7fdc740622a0 2023-11-24T08:05:23.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.228+0000 7fdc5b7fe700 1 -- 172.21.15.153:0/1326622755 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6800ce90 con 0x7fdc740622a0 2023-11-24T08:05:23.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.228+0000 7fdc790cc700 1 -- 172.21.15.153:0/1326622755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7415d370 con 0x7fdc740622a0 2023-11-24T08:05:23.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.228+0000 7fdc5b7fe700 1 -- 172.21.15.153:0/1326622755 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc680072d0 con 0x7fdc740622a0 2023-11-24T08:05:23.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.228+0000 7fdc790cc700 1 -- 172.21.15.153:0/1326622755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc740b3730 con 0x7fdc740622a0 2023-11-24T08:05:23.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.229+0000 7fdc790cc700 1 -- 172.21.15.153:0/1326622755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc740b3920 con 0x7fdc740622a0 2023-11-24T08:05:23.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.229+0000 7fdc5b7fe700 1 -- 172.21.15.153:0/1326622755 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc68007430 con 0x7fdc740622a0 2023-11-24T08:05:23.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.230+0000 7fdc5b7fe700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdc6006aed0 0x7fdc6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.230+0000 7fdc5b7fe700 1 -- 172.21.15.153:0/1326622755 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc680888c0 con 0x7fdc740622a0 2023-11-24T08:05:23.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.230+0000 7fdc7259c700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdc6006aed0 0x7fdc6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.230+0000 7fdc7259c700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdc6006aed0 0x7fdc6006d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009840 tx=0x7fdc64008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.234+0000 7fdc5b7fe700 1 -- 172.21.15.153:0/1326622755 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc68053910 con 0x7fdc740622a0 2023-11-24T08:05:23.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.454+0000 7fdc790cc700 1 -- 172.21.15.153:0/1326622755 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol34", "group_name": "subvol_grp8068", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc740686e0 con 0x7fdc6006aed0 2023-11-24T08:05:23.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.469+0000 7fdc5b7fe700 1 -- 172.21.15.153:0/1326622755 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdc740686e0 con 0x7fdc6006aed0 2023-11-24T08:05:23.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 -- 172.21.15.153:0/1326622755 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdc6006aed0 msgr2=0x7fdc6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdc6006aed0 0x7fdc6006d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009840 tx=0x7fdc64008030 comp rx=0 tx=0).stop 2023-11-24T08:05:23.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 -- 172.21.15.153:0/1326622755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc740622a0 msgr2=0x7fdc741f1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc740622a0 0x7fdc741f1ea0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c480 tx=0x7fdc6800c790 comp rx=0 tx=0).stop 2023-11-24T08:05:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 -- 172.21.15.153:0/1326622755 shutdown_connections 2023-11-24T08:05:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc7415c090 0x7fdc740af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdc6006aed0 0x7fdc6006d390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc740622a0 0x7fdc741f1ea0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 --2- 172.21.15.153:0/1326622755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc740cd1e0 0x7fdc740b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 -- 172.21.15.153:0/1326622755 >> 172.21.15.153:0/1326622755 conn(0x7fdc740b1e90 msgr2=0x7fdc7415b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 -- 172.21.15.153:0/1326622755 shutdown_connections 2023-11-24T08:05:23.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.471+0000 7fdc790cc700 1 -- 172.21.15.153:0/1326622755 wait complete. 2023-11-24T08:05:23.475 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:23.472+0000 7f67dbee2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:23.475 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:23.472+0000 7f67dbee2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:23.475 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:23.472+0000 7f67dbee2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:23.475 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:23.472+0000 7f67dbee2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:23.475 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:23.472+0000 7f67dbee2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:23.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:23.487 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-24T08:05:23.488 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:23.486+0000 7f67db6e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:23.488 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:23.486+0000 7f67db6e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:23.488 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:23.486+0000 7f67db6e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:23.488 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:23.486+0000 7f67db6e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:23.488 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:23.486+0000 7f67db6e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:23.520 INFO:teuthology.orchestra.run.smithi153.stdout:2 2023-11-24T08:05:23.521 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp8068 2023-11-24T08:05:23.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.682+0000 7fb56bbf2700 1 Processor -- start 2023-11-24T08:05:23.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.683+0000 7fb56bbf2700 1 -- start start 2023-11-24T08:05:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.683+0000 7fb56bbf2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5640b5da0 0x7fb5640afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.683+0000 7fb56bbf2700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5640b3c60 con 0x7fb56415e160 2023-11-24T08:05:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.683+0000 7fb56bbf2700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5640b58c0 con 0x7fb5640746a0 2023-11-24T08:05:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.683+0000 7fb56bbf2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b4500 con 0x7fb5640b5da0 2023-11-24T08:05:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.683+0000 7fb56998e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb56415e160 0x7fb564073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43764/0 (socket says 172.21.15.153:43764) 2023-11-24T08:05:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56998e700 1 -- 172.21.15.153:0/3382680664 learned_addr learned my addr 172.21.15.153:0/3382680664 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56a18f700 1 --2- 172.21.15.153:0/3382680664 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5640b5da0 0x7fb5640afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56898c700 1 -- 172.21.15.153:0/3382680664 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456461033 0 0) 0x7fb5640b3c60 con 0x7fb56415e160 2023-11-24T08:05:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56898c700 1 -- 172.21.15.153:0/3382680664 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5500035b0 con 0x7fb56415e160 2023-11-24T08:05:23.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56898c700 1 -- 172.21.15.153:0/3382680664 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583909084 0 0) 0x7fb5640b58c0 con 0x7fb5640746a0 2023-11-24T08:05:23.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56898c700 1 -- 172.21.15.153:0/3382680664 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5640b3c60 con 0x7fb5640746a0 2023-11-24T08:05:23.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56a18f700 1 -- 172.21.15.153:0/3382680664 >> v1:172.21.15.164:6789/0 conn(0x7fb5640746a0 legacy=0x7fb56406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56a18f700 1 -- 172.21.15.153:0/3382680664 >> v1:172.21.15.153:6789/0 conn(0x7fb56415e160 legacy=0x7fb564073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56898c700 1 -- 172.21.15.153:0/3382680664 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811495448 0 0) 0x7fb5500035b0 con 0x7fb56415e160 2023-11-24T08:05:23.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56a18f700 1 -- 172.21.15.153:0/3382680664 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56406bdc0 con 0x7fb5640b5da0 2023-11-24T08:05:23.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56a18f700 1 --2- 172.21.15.153:0/3382680664 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5640b5da0 0x7fb5640afc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009dc0 tx=0x7fb55c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3df2e881356c730 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56898c700 1 -- 172.21.15.153:0/3382680664 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c00e070 con 0x7fb5640b5da0 2023-11-24T08:05:23.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56898c700 1 -- 172.21.15.153:0/3382680664 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c003a20 con 0x7fb5640b5da0 2023-11-24T08:05:23.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.684+0000 7fb56898c700 1 -- 172.21.15.153:0/3382680664 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554001670 con 0x7fb5640b5da0 2023-11-24T08:05:23.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.685+0000 7fb56bbf2700 1 -- 172.21.15.153:0/3382680664 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5640b5da0 msgr2=0x7fb5640afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.685+0000 7fb56bbf2700 1 --2- 172.21.15.153:0/3382680664 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5640b5da0 0x7fb5640afc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009dc0 tx=0x7fb55c00b330 comp rx=0 tx=0).stop 2023-11-24T08:05:23.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.685+0000 7fb56bbf2700 1 -- 172.21.15.153:0/3382680664 shutdown_connections 2023-11-24T08:05:23.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.685+0000 7fb56bbf2700 1 --2- 172.21.15.153:0/3382680664 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5640b5da0 0x7fb5640afc90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.685+0000 7fb56bbf2700 1 -- 172.21.15.153:0/3382680664 >> 172.21.15.153:0/3382680664 conn(0x7fb5640d0bf0 msgr2=0x7fb5640d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:23.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.685+0000 7fb56bbf2700 1 -- 172.21.15.153:0/3382680664 shutdown_connections 2023-11-24T08:05:23.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.685+0000 7fb56bbf2700 1 -- 172.21.15.153:0/3382680664 wait complete. 2023-11-24T08:05:23.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.686+0000 7fb56bbf2700 1 Processor -- start 2023-11-24T08:05:23.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.686+0000 7fb56bbf2700 1 -- start start 2023-11-24T08:05:23.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56bbf2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5640746a0 0x7fb5641424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56bbf2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5640b5da0 0x7fb5640b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56bbf2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb56415e160 0x7fb5641514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56bbf2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b0a10 con 0x7fb56415e160 2023-11-24T08:05:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56bbf2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb564142a30 con 0x7fb5640b5da0 2023-11-24T08:05:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56bbf2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b2350 con 0x7fb5640746a0 2023-11-24T08:05:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56a18f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb56415e160 0x7fb5641514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56a18f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb56415e160 0x7fb5641514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37668/0 (socket says 172.21.15.153:37668) 2023-11-24T08:05:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56a18f700 1 -- 172.21.15.153:0/1439993240 learned_addr learned my addr 172.21.15.153:0/1439993240 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56998e700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5640746a0 0x7fb5641424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56918d700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5640b5da0 0x7fb5640b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56a18f700 1 -- 172.21.15.153:0/1439993240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5640746a0 msgr2=0x7fb5641424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56a18f700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5640746a0 0x7fb5641424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56a18f700 1 -- 172.21.15.153:0/1439993240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5640b5da0 msgr2=0x7fb5640b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56a18f700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5640b5da0 0x7fb5640b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56a18f700 1 -- 172.21.15.153:0/1439993240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c009a70 con 0x7fb56415e160 2023-11-24T08:05:23.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.687+0000 7fb56a18f700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb56415e160 0x7fb5641514d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009d90 tx=0x7fb55c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.688+0000 7fb55a7fc700 1 -- 172.21.15.153:0/1439993240 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c004540 con 0x7fb56415e160 2023-11-24T08:05:23.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.688+0000 7fb55a7fc700 1 -- 172.21.15.153:0/1439993240 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c0046a0 con 0x7fb56415e160 2023-11-24T08:05:23.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.688+0000 7fb55a7fc700 1 -- 172.21.15.153:0/1439993240 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c01d470 con 0x7fb56415e160 2023-11-24T08:05:23.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.688+0000 7fb56bbf2700 1 -- 172.21.15.153:0/1439993240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5640b2630 con 0x7fb56415e160 2023-11-24T08:05:23.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.688+0000 7fb56bbf2700 1 -- 172.21.15.153:0/1439993240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5640b0630 con 0x7fb56415e160 2023-11-24T08:05:23.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.689+0000 7fb56bbf2700 1 -- 172.21.15.153:0/1439993240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb564068fb0 con 0x7fb56415e160 2023-11-24T08:05:23.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.689+0000 7fb55a7fc700 1 -- 172.21.15.153:0/1439993240 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb55c01d5d0 con 0x7fb56415e160 2023-11-24T08:05:23.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.689+0000 7fb55a7fc700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb54806aed0 0x7fb54806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.690+0000 7fb56998e700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb54806aed0 0x7fb54806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.690+0000 7fb55a7fc700 1 -- 172.21.15.153:0/1439993240 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb55c08b260 con 0x7fb56415e160 2023-11-24T08:05:23.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.690+0000 7fb56998e700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb54806aed0 0x7fb54806d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb554000f60 tx=0x7fb554001690 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.694+0000 7fb55a7fc700 1 -- 172.21.15.153:0/1439993240 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb55c056320 con 0x7fb56415e160 2023-11-24T08:05:23.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.914+0000 7fb56bbf2700 1 -- 172.21.15.153:0/1439993240 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp8068", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5640b4190 con 0x7fb54806aed0 2023-11-24T08:05:23.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.918+0000 7fb55a7fc700 1 -- 172.21.15.153:0/1439993240 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb554001ce0 con 0x7fb54806aed0 2023-11-24T08:05:23.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 -- 172.21.15.153:0/1439993240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb54806aed0 msgr2=0x7fb54806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb54806aed0 0x7fb54806d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb554000f60 tx=0x7fb554001690 comp rx=0 tx=0).stop 2023-11-24T08:05:23.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 -- 172.21.15.153:0/1439993240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb56415e160 msgr2=0x7fb5641514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb56415e160 0x7fb5641514d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009d90 tx=0x7fb55c004ad0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 -- 172.21.15.153:0/1439993240 shutdown_connections 2023-11-24T08:05:23.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb54806aed0 0x7fb54806d390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb56415e160 0x7fb5641514d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5640746a0 0x7fb5641424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 --2- 172.21.15.153:0/1439993240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5640b5da0 0x7fb5640b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 -- 172.21.15.153:0/1439993240 >> 172.21.15.153:0/1439993240 conn(0x7fb5640d0bf0 msgr2=0x7fb564073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:23.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 -- 172.21.15.153:0/1439993240 shutdown_connections 2023-11-24T08:05:23.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:23.920+0000 7fb56bbf2700 1 -- 172.21.15.153:0/1439993240 wait complete. 2023-11-24T08:05:23.934 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:05:23.935 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:05:23.975 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:05:24.019 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:05:24.020 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:05:24.020 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:24.037 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:05:24.037 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:24.095 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:24.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.256+0000 7f42b25c5700 1 Processor -- start 2023-11-24T08:05:24.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.256+0000 7f42b25c5700 1 -- start start 2023-11-24T08:05:24.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.256+0000 7f42b25c5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f42ac15e080 0x7f42ac0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.256+0000 7f42b25c5700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f42ac0af4d0 0x7f42ac0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.256+0000 7f42b25c5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42ac06c000 0x7f42ac06c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.256+0000 7f42b25c5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ac0af0b0 con 0x7f42ac15e080 2023-11-24T08:05:24.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.256+0000 7f42b25c5700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ac06c9f0 con 0x7f42ac0af4d0 2023-11-24T08:05:24.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.256+0000 7f42b25c5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac0b05a0 con 0x7f42ac06c000 2023-11-24T08:05:24.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42abfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f42ac15e080 0x7f42ac0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42abfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f42ac15e080 0x7f42ac0b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37674/0 (socket says 172.21.15.153:37674) 2023-11-24T08:05:24.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42abfff700 1 -- 172.21.15.153:0/3535438063 learned_addr learned my addr 172.21.15.153:0/3535438063 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:24.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42b0b62700 1 --2- 172.21.15.153:0/3535438063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42ac06c000 0x7f42ac06c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42abfff700 1 -- 172.21.15.153:0/3535438063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42ac06c000 msgr2=0x7f42ac06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42ab7fe700 1 --2- 172.21.15.153:0/3535438063 >> v2:172.21.15.164:3300/0 conn(0x7f42ac0af4d0 0x7f42ac0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42abfff700 1 --2- 172.21.15.153:0/3535438063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42ac06c000 0x7f42ac06c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42abfff700 1 -- 172.21.15.153:0/3535438063 >> v2:172.21.15.164:3300/0 conn(0x7f42ac0af4d0 msgr2=0x7f42ac0afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42abfff700 1 --2- 172.21.15.153:0/3535438063 >> v2:172.21.15.164:3300/0 conn(0x7f42ac0af4d0 0x7f42ac0afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42abfff700 1 -- 172.21.15.153:0/3535438063 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac0ae430 con 0x7f42ac15e080 2023-11-24T08:05:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42abfff700 1 --2- 172.21.15.153:0/3535438063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42ac15e080 0x7f42ac0b5050 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f42ac06e4e0 tx=0x7f429c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec064b5ef2672ab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42aaffd700 1 -- 172.21.15.153:0/3535438063 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00b870 con 0x7f42ac15e080 2023-11-24T08:05:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42aaffd700 1 -- 172.21.15.153:0/3535438063 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c00b9d0 con 0x7f42ac15e080 2023-11-24T08:05:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.257+0000 7f42aaffd700 1 -- 172.21.15.153:0/3535438063 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00bd60 con 0x7f42ac15e080 2023-11-24T08:05:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.258+0000 7f42b25c5700 1 -- 172.21.15.153:0/3535438063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42ac15e080 msgr2=0x7f42ac0b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.258+0000 7f42b25c5700 1 --2- 172.21.15.153:0/3535438063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42ac15e080 0x7f42ac0b5050 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f42ac06e4e0 tx=0x7f429c009bd0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.258+0000 7f42b25c5700 1 -- 172.21.15.153:0/3535438063 shutdown_connections 2023-11-24T08:05:24.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.258+0000 7f42b25c5700 1 --2- 172.21.15.153:0/3535438063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42ac06c000 0x7f42ac06c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.258+0000 7f42b25c5700 1 --2- 172.21.15.153:0/3535438063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42ac15e080 0x7f42ac0b5050 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.258+0000 7f42b25c5700 1 --2- 172.21.15.153:0/3535438063 >> v2:172.21.15.164:3300/0 conn(0x7f42ac0af4d0 0x7f42ac0afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.258+0000 7f42b25c5700 1 -- 172.21.15.153:0/3535438063 >> 172.21.15.153:0/3535438063 conn(0x7f42ac071b90 msgr2=0x7f42ac071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:24.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.258+0000 7f42b25c5700 1 -- 172.21.15.153:0/3535438063 shutdown_connections 2023-11-24T08:05:24.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.258+0000 7f42b25c5700 1 -- 172.21.15.153:0/3535438063 wait complete. 2023-11-24T08:05:24.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.259+0000 7f42b25c5700 1 Processor -- start 2023-11-24T08:05:24.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.259+0000 7f42b25c5700 1 -- start start 2023-11-24T08:05:24.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42b25c5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f42ac06c000 0x7f42ac141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42b25c5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42ac0af4d0 0x7f42ac145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42b25c5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42ac15e080 0x7f42ac06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42b25c5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac1455c0 con 0x7f42ac0af4d0 2023-11-24T08:05:24.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42b25c5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac160f90 con 0x7f42ac06c000 2023-11-24T08:05:24.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42b25c5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac161270 con 0x7f42ac15e080 2023-11-24T08:05:24.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42ab7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42ac0af4d0 0x7f42ac145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42ab7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42ac0af4d0 0x7f42ac145080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37680/0 (socket says 172.21.15.153:37680) 2023-11-24T08:05:24.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42ab7fe700 1 -- 172.21.15.153:0/3016059033 learned_addr learned my addr 172.21.15.153:0/3016059033 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:24.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42abfff700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f42ac06c000 0x7f42ac141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42b0b62700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42ac15e080 0x7f42ac06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42ab7fe700 1 -- 172.21.15.153:0/3016059033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42ac15e080 msgr2=0x7f42ac06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42ab7fe700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42ac15e080 0x7f42ac06ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42ab7fe700 1 -- 172.21.15.153:0/3016059033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f42ac06c000 msgr2=0x7f42ac141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42ab7fe700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f42ac06c000 0x7f42ac141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.260+0000 7f42ab7fe700 1 -- 172.21.15.153:0/3016059033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c009550 con 0x7f42ac0af4d0 2023-11-24T08:05:24.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.261+0000 7f42ab7fe700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42ac0af4d0 0x7f42ac145080 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c7f0 tx=0x7f42a000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:24.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.261+0000 7f42a8ff9700 1 -- 172.21.15.153:0/3016059033 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a0004230 con 0x7f42ac0af4d0 2023-11-24T08:05:24.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.261+0000 7f42a8ff9700 1 -- 172.21.15.153:0/3016059033 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a0004390 con 0x7f42ac0af4d0 2023-11-24T08:05:24.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.261+0000 7f42b25c5700 1 -- 172.21.15.153:0/3016059033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ac153950 con 0x7f42ac0af4d0 2023-11-24T08:05:24.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.261+0000 7f42a8ff9700 1 -- 172.21.15.153:0/3016059033 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a00036a0 con 0x7f42ac0af4d0 2023-11-24T08:05:24.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.261+0000 7f42b25c5700 1 -- 172.21.15.153:0/3016059033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ac153f10 con 0x7f42ac0af4d0 2023-11-24T08:05:24.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.262+0000 7f42b25c5700 1 -- 172.21.15.153:0/3016059033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ac0753f0 con 0x7f42ac0af4d0 2023-11-24T08:05:24.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.262+0000 7f42a8ff9700 1 -- 172.21.15.153:0/3016059033 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42a0003800 con 0x7f42ac0af4d0 2023-11-24T08:05:24.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.262+0000 7f42a8ff9700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f429806aed0 0x7f429806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.263+0000 7f42a8ff9700 1 -- 172.21.15.153:0/3016059033 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42a00892b0 con 0x7f42ac0af4d0 2023-11-24T08:05:24.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.263+0000 7f42abfff700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f429806aed0 0x7f429806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.263+0000 7f42abfff700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f429806aed0 0x7f429806d390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f429c014040 tx=0x7f429c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:24.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.267+0000 7f42a8ff9700 1 -- 172.21.15.153:0/3016059033 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42a0054360 con 0x7f42ac0af4d0 2023-11-24T08:05:24.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.458+0000 7f42b25c5700 1 -- 172.21.15.153:0/3016059033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42ac1537b0 con 0x7f42ac0af4d0 2023-11-24T08:05:24.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.459+0000 7f42a8ff9700 1 -- 172.21.15.153:0/3016059033 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f42ac1537b0 con 0x7f42ac0af4d0 2023-11-24T08:05:24.462 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:24.462 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":32,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:08.158007+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:04.517274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:05.507139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 -- 172.21.15.153:0/3016059033 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f429806aed0 msgr2=0x7f429806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f429806aed0 0x7f429806d390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f429c014040 tx=0x7f429c008030 comp rx=0 tx=0).stop 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 -- 172.21.15.153:0/3016059033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42ac0af4d0 msgr2=0x7f42ac145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42ac0af4d0 0x7f42ac145080 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c7f0 tx=0x7f42a000cb00 comp rx=0 tx=0).stop 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 -- 172.21.15.153:0/3016059033 shutdown_connections 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42ac15e080 0x7f42ac06ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f42ac06c000 0x7f42ac141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f429806aed0 0x7f429806d390 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 --2- 172.21.15.153:0/3016059033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42ac0af4d0 0x7f42ac145080 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 -- 172.21.15.153:0/3016059033 >> 172.21.15.153:0/3016059033 conn(0x7f42ac071b90 msgr2=0x7f42ac0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 -- 172.21.15.153:0/3016059033 shutdown_connections 2023-11-24T08:05:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.462+0000 7f42b25c5700 1 -- 172.21.15.153:0/3016059033 wait complete. 2023-11-24T08:05:24.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:05:04.517274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:05:05.507139+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:24.476 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:24.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.600+0000 7f394297c700 1 Processor -- start 2023-11-24T08:05:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.600+0000 7f394297c700 1 -- start start 2023-11-24T08:05:24.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f394297c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f393c0c6c30 0x7f393c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f394297c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f393c0cef40 0x7f393c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f394297c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393c0d0140 con 0x7f393c15bf50 2023-11-24T08:05:24.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f394297c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393c15c330 con 0x7f393c0c6c30 2023-11-24T08:05:24.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f394297c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0cf3d0 con 0x7f393c0cef40 2023-11-24T08:05:24.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f393c0c6c30 0x7f393c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f393c0c6c30 0x7f393c0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37690/0 (socket says 172.21.15.153:37690) 2023-11-24T08:05:24.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393b7fe700 1 -- 172.21.15.153:0/934491341 learned_addr learned my addr 172.21.15.153:0/934491341 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:24.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393bfff700 1 --1- 172.21.15.153:0/934491341 >> v1:172.21.15.153:6789/0 conn(0x7f393c15bf50 0x7f393c0ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43792/0 (socket says 172.21.15.153:43792) 2023-11-24T08:05:24.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f3940f19700 1 --2- 172.21.15.153:0/934491341 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f393c0cef40 0x7f393c0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393b7fe700 1 -- 172.21.15.153:0/934491341 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f393c0cef40 msgr2=0x7f393c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:24.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393b7fe700 1 --2- 172.21.15.153:0/934491341 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f393c0cef40 0x7f393c0cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393b7fe700 1 -- 172.21.15.153:0/934491341 >> v1:172.21.15.153:6789/0 conn(0x7f393c15bf50 legacy=0x7f393c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393b7fe700 1 -- 172.21.15.153:0/934491341 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c0d03e0 con 0x7f393c0c6c30 2023-11-24T08:05:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393affd700 1 -- 172.21.15.153:0/934491341 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159236955 0 0) 0x7f393c0d0140 con 0x7f393c15bf50 2023-11-24T08:05:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393b7fe700 1 --2- 172.21.15.153:0/934491341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f393c0c6c30 0x7f393c0cea00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f39300098f0 tx=0x7f3930009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df612907ca1869ef server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393affd700 1 -- 172.21.15.153:0/934491341 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000b8a0 con 0x7f393c0c6c30 2023-11-24T08:05:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393affd700 1 -- 172.21.15.153:0/934491341 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393000ba00 con 0x7f393c0c6c30 2023-11-24T08:05:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.601+0000 7f393affd700 1 -- 172.21.15.153:0/934491341 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000bd90 con 0x7f393c0c6c30 2023-11-24T08:05:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.602+0000 7f394297c700 1 -- 172.21.15.153:0/934491341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f393c0c6c30 msgr2=0x7f393c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.602+0000 7f394297c700 1 --2- 172.21.15.153:0/934491341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f393c0c6c30 0x7f393c0cea00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f39300098f0 tx=0x7f3930009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.602+0000 7f394297c700 1 -- 172.21.15.153:0/934491341 shutdown_connections 2023-11-24T08:05:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.602+0000 7f394297c700 1 --2- 172.21.15.153:0/934491341 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f393c0cef40 0x7f393c0cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.602+0000 7f394297c700 1 --2- 172.21.15.153:0/934491341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f393c0c6c30 0x7f393c0cea00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.602+0000 7f394297c700 1 -- 172.21.15.153:0/934491341 >> 172.21.15.153:0/934491341 conn(0x7f393c0b3780 msgr2=0x7f393c0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.602+0000 7f394297c700 1 -- 172.21.15.153:0/934491341 shutdown_connections 2023-11-24T08:05:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.602+0000 7f394297c700 1 -- 172.21.15.153:0/934491341 wait complete. 2023-11-24T08:05:24.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.603+0000 7f394297c700 1 Processor -- start 2023-11-24T08:05:24.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.603+0000 7f394297c700 1 -- start start 2023-11-24T08:05:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f394297c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f393c0c6c30 0x7f393c14f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f394297c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f393c0cef40 0x7f393c09e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f394297c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f393c15bf50 0x7f393c06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f394297c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c14f5f0 con 0x7f393c15bf50 2023-11-24T08:05:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f394297c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c09fa20 con 0x7f393c0cef40 2023-11-24T08:05:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f394297c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c09eea0 con 0x7f393c0c6c30 2023-11-24T08:05:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f3940f19700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f393c15bf50 0x7f393c06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f3940f19700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f393c15bf50 0x7f393c06fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37698/0 (socket says 172.21.15.153:37698) 2023-11-24T08:05:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f3940f19700 1 -- 172.21.15.153:0/2777905435 learned_addr learned my addr 172.21.15.153:0/2777905435 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f393bfff700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f393c0c6c30 0x7f393c14f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f393b7fe700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f393c0cef40 0x7f393c09e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f3940f19700 1 -- 172.21.15.153:0/2777905435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f393c0c6c30 msgr2=0x7f393c14f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f3940f19700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f393c0c6c30 0x7f393c14f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f3940f19700 1 -- 172.21.15.153:0/2777905435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f393c0cef40 msgr2=0x7f393c09e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f3940f19700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f393c0cef40 0x7f393c09e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.604+0000 7f3940f19700 1 -- 172.21.15.153:0/2777905435 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3930009550 con 0x7f393c15bf50 2023-11-24T08:05:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.605+0000 7f3940f19700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f393c15bf50 0x7f393c06fea0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3934007e40 tx=0x7f393400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.605+0000 7f3938ff9700 1 -- 172.21.15.153:0/2777905435 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400eea0 con 0x7f393c15bf50 2023-11-24T08:05:24.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.605+0000 7f3938ff9700 1 -- 172.21.15.153:0/2777905435 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3934014420 con 0x7f393c15bf50 2023-11-24T08:05:24.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.605+0000 7f394297c700 1 -- 172.21.15.153:0/2777905435 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c09f180 con 0x7f393c15bf50 2023-11-24T08:05:24.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.605+0000 7f3938ff9700 1 -- 172.21.15.153:0/2777905435 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340147b0 con 0x7f393c15bf50 2023-11-24T08:05:24.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.605+0000 7f394297c700 1 -- 172.21.15.153:0/2777905435 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c09f740 con 0x7f393c15bf50 2023-11-24T08:05:24.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.606+0000 7f394297c700 1 -- 172.21.15.153:0/2777905435 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c068fb0 con 0x7f393c15bf50 2023-11-24T08:05:24.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.606+0000 7f3938ff9700 1 -- 172.21.15.153:0/2777905435 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3934014910 con 0x7f393c15bf50 2023-11-24T08:05:24.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.607+0000 7f3938ff9700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f392806aed0 0x7f392806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.607+0000 7f3938ff9700 1 -- 172.21.15.153:0/2777905435 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3934089d90 con 0x7f393c15bf50 2023-11-24T08:05:24.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.607+0000 7f393bfff700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f392806aed0 0x7f392806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.607+0000 7f393bfff700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f392806aed0 0x7f392806d390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f392c000f60 tx=0x7f392c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:24.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.611+0000 7f3938ff9700 1 -- 172.21.15.153:0/2777905435 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3934054ed0 con 0x7f393c15bf50 2023-11-24T08:05:24.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.801+0000 7f394297c700 1 -- 172.21.15.153:0/2777905435 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f393c0b7ab0 con 0x7f393c15bf50 2023-11-24T08:05:24.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.802+0000 7f3938ff9700 1 -- 172.21.15.153:0/2777905435 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39340584f0 con 0x7f393c15bf50 2023-11-24T08:05:24.804 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:05:24.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 -- 172.21.15.153:0/2777905435 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f392806aed0 msgr2=0x7f392806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f392806aed0 0x7f392806d390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f392c000f60 tx=0x7f392c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:24.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 -- 172.21.15.153:0/2777905435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f393c15bf50 msgr2=0x7f393c06fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f393c15bf50 0x7f393c06fea0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3934007e40 tx=0x7f393400e3c0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 -- 172.21.15.153:0/2777905435 shutdown_connections 2023-11-24T08:05:24.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f392806aed0 0x7f392806d390 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f393c15bf50 0x7f393c06fea0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f393c0c6c30 0x7f393c14f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 --2- 172.21.15.153:0/2777905435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f393c0cef40 0x7f393c09e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 -- 172.21.15.153:0/2777905435 >> 172.21.15.153:0/2777905435 conn(0x7f393c0b3780 msgr2=0x7f393c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:24.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 -- 172.21.15.153:0/2777905435 shutdown_connections 2023-11-24T08:05:24.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.804+0000 7f394297c700 1 -- 172.21.15.153:0/2777905435 wait complete. 2023-11-24T08:05:24.818 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:24.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.940+0000 7f36a4d4f700 1 Processor -- start 2023-11-24T08:05:24.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.940+0000 7f36a4d4f700 1 -- start start 2023-11-24T08:05:24.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f36a4d4f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36a015e160 0x7f36a00b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f36a4d4f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a00b3c60 con 0x7f36a00746a0 2023-11-24T08:05:24.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f36a4d4f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a00b58c0 con 0x7f36a00afc90 2023-11-24T08:05:24.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f36a4d4f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00b4500 con 0x7f36a015e160 2023-11-24T08:05:24.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369ed9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f36a00746a0 0x7f36a006d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43808/0 (socket says 172.21.15.153:43808) 2023-11-24T08:05:24.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369ed9d700 1 -- 172.21.15.153:0/306729623 learned_addr learned my addr 172.21.15.153:0/306729623 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:24.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369e59c700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36a015e160 0x7f36a00b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138324669 0 0) 0x7f36a00b3c60 con 0x7f36a00746a0 2023-11-24T08:05:24.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36880035b0 con 0x7f36a00746a0 2023-11-24T08:05:24.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508549913 0 0) 0x7f36a00b58c0 con 0x7f36a00afc90 2023-11-24T08:05:24.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a00b3c60 con 0x7f36a00afc90 2023-11-24T08:05:24.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2092965893 0 0) 0x7f36880035b0 con 0x7f36a00746a0 2023-11-24T08:05:24.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36a015e160 msgr2=0x7f36a00b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:24.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369d59a700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36a015e160 0x7f36a00b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 >> v1:172.21.15.164:6789/0 conn(0x7f36a00afc90 legacy=0x7f36a0073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a006bdc0 con 0x7f36a00746a0 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.941+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f36980019f0 con 0x7f36a00746a0 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 >> v1:172.21.15.153:6789/0 conn(0x7f36a00746a0 legacy=0x7f36a006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369d59a700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 0x7f3688003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369d59a700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3688004850 0x7f3688004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369d59a700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3688005210 0x7f368800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00b4500 con 0x7f3688003bc0 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368800c000 con 0x7f3688005210 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368800c1c0 con 0x7f3688004850 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369e59c700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36a015e160 0x7f36a00b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369ed9d700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3688005210 0x7f368800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369e59c700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 0x7f3688003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369dd9b700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3688004850 0x7f3688004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369e59c700 1 -- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3688004850 msgr2=0x7f3688004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369e59c700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3688004850 0x7f3688004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369e59c700 1 -- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3688005210 msgr2=0x7f368800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369e59c700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3688005210 0x7f368800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369e59c700 1 -- 172.21.15.153:0/306729623 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36880035b0 con 0x7f3688003bc0 2023-11-24T08:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369e59c700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 0x7f3688003fc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f36a00730e0 tx=0x7f3688005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7591ab3606b9e073 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690004030 con 0x7f3688003bc0 2023-11-24T08:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3690004190 con 0x7f3688003bc0 2023-11-24T08:05:24.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.942+0000 7f369d59a700 1 -- 172.21.15.153:0/306729623 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690004540 con 0x7f3688003bc0 2023-11-24T08:05:24.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.943+0000 7f36a4d4f700 1 -- 172.21.15.153:0/306729623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 msgr2=0x7f3688003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.943+0000 7f36a4d4f700 1 --2- 172.21.15.153:0/306729623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 0x7f3688003fc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f36a00730e0 tx=0x7f3688005880 comp rx=0 tx=0).stop 2023-11-24T08:05:24.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.943+0000 7f369ed9d700 1 -- 172.21.15.153:0/306729623 reap_dead start 2023-11-24T08:05:24.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.943+0000 7f36a4d4f700 1 -- 172.21.15.153:0/306729623 shutdown_connections 2023-11-24T08:05:24.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.943+0000 7f36a4d4f700 1 -- 172.21.15.153:0/306729623 >> 172.21.15.153:0/306729623 conn(0x7f36a00d0bf0 msgr2=0x7f36a00d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:24.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.943+0000 7f36a4d4f700 1 -- 172.21.15.153:0/306729623 shutdown_connections 2023-11-24T08:05:24.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.943+0000 7f36a4d4f700 1 -- 172.21.15.153:0/306729623 wait complete. 2023-11-24T08:05:24.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.944+0000 7f36a4d4f700 1 Processor -- start 2023-11-24T08:05:24.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.944+0000 7f36a4d4f700 1 -- start start 2023-11-24T08:05:24.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.945+0000 7f36a4d4f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 0x7f36a01f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.945+0000 7f36a4d4f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36a014a250 0x7f36a0161f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.945+0000 7f36a4d4f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36a01624d0 0x7f36a014cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.945+0000 7f36a4d4f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a0162980 con 0x7f3688003bc0 2023-11-24T08:05:24.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.945+0000 7f36a4d4f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00d01f0 con 0x7f36a01624d0 2023-11-24T08:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.945+0000 7f36a4d4f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a01f49d0 con 0x7f36a014a250 2023-11-24T08:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.945+0000 7f369e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 0x7f36a01f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.945+0000 7f369e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 0x7f36a01f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37714/0 (socket says 172.21.15.153:37714) 2023-11-24T08:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.945+0000 7f369e59c700 1 -- 172.21.15.153:0/1842692910 learned_addr learned my addr 172.21.15.153:0/1842692910 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.945+0000 7f369ed9d700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36a01624d0 0x7f36a014cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.945+0000 7f369dd9b700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36a014a250 0x7f36a0161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f369e59c700 1 -- 172.21.15.153:0/1842692910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36a014a250 msgr2=0x7f36a0161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f369e59c700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36a014a250 0x7f36a0161f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f369e59c700 1 -- 172.21.15.153:0/1842692910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36a01624d0 msgr2=0x7f36a014cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f369e59c700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36a01624d0 0x7f36a014cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f369e59c700 1 -- 172.21.15.153:0/1842692910 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a01f4130 con 0x7f3688003bc0 2023-11-24T08:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f369ed9d700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36a01624d0 0x7f36a014cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f369e59c700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 0x7f36a01f3a30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3688005810 tx=0x7f36900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f368effd700 1 -- 172.21.15.153:0/1842692910 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690003ab0 con 0x7f3688003bc0 2023-11-24T08:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f368effd700 1 -- 172.21.15.153:0/1842692910 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36900045e0 con 0x7f3688003bc0 2023-11-24T08:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f36a4d4f700 1 -- 172.21.15.153:0/1842692910 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a01f4410 con 0x7f3688003bc0 2023-11-24T08:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f368effd700 1 -- 172.21.15.153:0/1842692910 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690003e10 con 0x7f3688003bc0 2023-11-24T08:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.946+0000 7f36a4d4f700 1 -- 172.21.15.153:0/1842692910 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a014a880 con 0x7f3688003bc0 2023-11-24T08:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.947+0000 7f36a4d4f700 1 -- 172.21.15.153:0/1842692910 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a014aa10 con 0x7f3688003bc0 2023-11-24T08:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.947+0000 7f368effd700 1 -- 172.21.15.153:0/1842692910 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3690013470 con 0x7f3688003bc0 2023-11-24T08:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.948+0000 7f368effd700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f368006aed0 0x7f368006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.948+0000 7f368effd700 1 -- 172.21.15.153:0/1842692910 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f369008ade0 con 0x7f3688003bc0 2023-11-24T08:05:24.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.948+0000 7f369dd9b700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f368006aed0 0x7f368006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.948+0000 7f369dd9b700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f368006aed0 0x7f368006d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3694000c00 tx=0x7f3694009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:24.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:24.952+0000 7f368effd700 1 -- 172.21.15.153:0/1842692910 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3690055f20 con 0x7f3688003bc0 2023-11-24T08:05:25.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.147+0000 7f36a4d4f700 1 -- 172.21.15.153:0/1842692910 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36a00b51c0 con 0x7f3688003bc0 2023-11-24T08:05:25.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.147+0000 7f368effd700 1 -- 172.21.15.153:0/1842692910 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3690059540 con 0x7f3688003bc0 2023-11-24T08:05:25.150 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:05:25.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 -- 172.21.15.153:0/1842692910 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f368006aed0 msgr2=0x7f368006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f368006aed0 0x7f368006d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3694000c00 tx=0x7f3694009040 comp rx=0 tx=0).stop 2023-11-24T08:05:25.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 -- 172.21.15.153:0/1842692910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 msgr2=0x7f36a01f3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 0x7f36a01f3a30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3688005810 tx=0x7f36900047c0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 -- 172.21.15.153:0/1842692910 shutdown_connections 2023-11-24T08:05:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36a01624d0 0x7f36a014cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f368006aed0 0x7f368006d390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3688003bc0 0x7f36a01f3a30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 --2- 172.21.15.153:0/1842692910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36a014a250 0x7f36a0161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 -- 172.21.15.153:0/1842692910 >> 172.21.15.153:0/1842692910 conn(0x7f36a00d0bf0 msgr2=0x7f36a006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 -- 172.21.15.153:0/1842692910 shutdown_connections 2023-11-24T08:05:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.150+0000 7f36a4d4f700 1 -- 172.21.15.153:0/1842692910 wait complete. 2023-11-24T08:05:25.164 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:25.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.291+0000 7f3037ed1700 1 Processor -- start 2023-11-24T08:05:25.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.291+0000 7f3037ed1700 1 -- start start 2023-11-24T08:05:25.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.292+0000 7f3037ed1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f303015bf50 0x7f30300ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.292+0000 7f3037ed1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30300d0140 con 0x7f30300c6c30 2023-11-24T08:05:25.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.292+0000 7f3037ed1700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30300cf3c0 con 0x7f30300ce830 2023-11-24T08:05:25.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.292+0000 7f3037ed1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303015c330 con 0x7f303015bf50 2023-11-24T08:05:25.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.292+0000 7f3035c6d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f303015bf50 0x7f30300ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.292+0000 7f303646e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f30300c6c30 0x7f30300cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43830/0 (socket says 172.21.15.153:43830) 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.292+0000 7f303646e700 1 -- 172.21.15.153:0/1971743110 learned_addr learned my addr 172.21.15.153:0/1971743110 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.292+0000 7f3035c6d700 1 -- 172.21.15.153:0/1971743110 >> v1:172.21.15.164:6789/0 conn(0x7f30300ce830 legacy=0x7f30300cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.292+0000 7f3034c6b700 1 -- 172.21.15.153:0/1971743110 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651342019 0 0) 0x7f30300d0140 con 0x7f30300c6c30 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.292+0000 7f3035c6d700 1 -- 172.21.15.153:0/1971743110 >> v1:172.21.15.153:6789/0 conn(0x7f30300c6c30 legacy=0x7f30300cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3035c6d700 1 -- 172.21.15.153:0/1971743110 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30300d03e0 con 0x7f303015bf50 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3035c6d700 1 --2- 172.21.15.153:0/1971743110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f303015bf50 0x7f30300ce2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3020009840 tx=0x7f3020009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d146a619a57a848 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3034c6b700 1 -- 172.21.15.153:0/1971743110 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020004230 con 0x7f303015bf50 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3034c6b700 1 -- 172.21.15.153:0/1971743110 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3020004390 con 0x7f303015bf50 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3034c6b700 1 -- 172.21.15.153:0/1971743110 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30200036a0 con 0x7f303015bf50 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3037ed1700 1 -- 172.21.15.153:0/1971743110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f303015bf50 msgr2=0x7f30300ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3037ed1700 1 --2- 172.21.15.153:0/1971743110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f303015bf50 0x7f30300ce2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3020009840 tx=0x7f3020009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3037ed1700 1 -- 172.21.15.153:0/1971743110 shutdown_connections 2023-11-24T08:05:25.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3037ed1700 1 --2- 172.21.15.153:0/1971743110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f303015bf50 0x7f30300ce2f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3037ed1700 1 -- 172.21.15.153:0/1971743110 >> 172.21.15.153:0/1971743110 conn(0x7f30300b3780 msgr2=0x7f30300b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:25.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3037ed1700 1 -- 172.21.15.153:0/1971743110 shutdown_connections 2023-11-24T08:05:25.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.293+0000 7f3037ed1700 1 -- 172.21.15.153:0/1971743110 wait complete. 2023-11-24T08:05:25.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.295+0000 7f3037ed1700 1 Processor -- start 2023-11-24T08:05:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.295+0000 7f3037ed1700 1 -- start start 2023-11-24T08:05:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.295+0000 7f3037ed1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30300c6c30 0x7f30301f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.295+0000 7f3037ed1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30300ce830 0x7f3030158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.295+0000 7f3037ed1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f303015bf50 0x7f30300b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.295+0000 7f3037ed1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30300c9f80 con 0x7f303015bf50 2023-11-24T08:05:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.295+0000 7f3037ed1700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30300caa90 con 0x7f30300c6c30 2023-11-24T08:05:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.295+0000 7f3037ed1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30300ca160 con 0x7f30300ce830 2023-11-24T08:05:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.295+0000 7f303646e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f303015bf50 0x7f30300b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.295+0000 7f303646e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f303015bf50 0x7f30300b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37732/0 (socket says 172.21.15.153:37732) 2023-11-24T08:05:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f303646e700 1 -- 172.21.15.153:0/1397090318 learned_addr learned my addr 172.21.15.153:0/1397090318 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f3035c6d700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30300c6c30 0x7f30301f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f303546c700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30300ce830 0x7f3030158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f303646e700 1 -- 172.21.15.153:0/1397090318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30300ce830 msgr2=0x7f3030158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f303646e700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30300ce830 0x7f3030158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f303646e700 1 -- 172.21.15.153:0/1397090318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30300c6c30 msgr2=0x7f30301f1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f303646e700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30300c6c30 0x7f30301f1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f303646e700 1 -- 172.21.15.153:0/1397090318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30200094a0 con 0x7f303015bf50 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f303646e700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f303015bf50 0x7f30300b21a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f302800cc40 tx=0x7f302800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f30267fc700 1 -- 172.21.15.153:0/1397090318 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302800aa80 con 0x7f303015bf50 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f30267fc700 1 -- 172.21.15.153:0/1397090318 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302800abe0 con 0x7f303015bf50 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f3037ed1700 1 -- 172.21.15.153:0/1397090318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30300ca440 con 0x7f303015bf50 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f30267fc700 1 -- 172.21.15.153:0/1397090318 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30280070d0 con 0x7f303015bf50 2023-11-24T08:05:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.296+0000 7f3037ed1700 1 -- 172.21.15.153:0/1397090318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3030158ac0 con 0x7f303015bf50 2023-11-24T08:05:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.297+0000 7f3037ed1700 1 -- 172.21.15.153:0/1397090318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3030068fb0 con 0x7f303015bf50 2023-11-24T08:05:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.297+0000 7f30267fc700 1 -- 172.21.15.153:0/1397090318 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3028007230 con 0x7f303015bf50 2023-11-24T08:05:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.298+0000 7f30267fc700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f301406b080 0x7f301406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.298+0000 7f3035c6d700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f301406b080 0x7f301406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.298+0000 7f30267fc700 1 -- 172.21.15.153:0/1397090318 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3028089680 con 0x7f303015bf50 2023-11-24T08:05:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.298+0000 7f3035c6d700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f301406b080 0x7f301406d540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f30200090b0 tx=0x7f302001f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.302+0000 7f30267fc700 1 -- 172.21.15.153:0/1397090318 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3028054420 con 0x7f303015bf50 2023-11-24T08:05:25.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.495+0000 7f3037ed1700 1 -- 172.21.15.153:0/1397090318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30300cabd0 con 0x7f303015bf50 2023-11-24T08:05:25.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.495+0000 7f30267fc700 1 -- 172.21.15.153:0/1397090318 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30280180a0 con 0x7f303015bf50 2023-11-24T08:05:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:05:25.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 -- 172.21.15.153:0/1397090318 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f301406b080 msgr2=0x7f301406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f301406b080 0x7f301406d540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f30200090b0 tx=0x7f302001f040 comp rx=0 tx=0).stop 2023-11-24T08:05:25.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 -- 172.21.15.153:0/1397090318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f303015bf50 msgr2=0x7f30300b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f303015bf50 0x7f30300b21a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f302800cc40 tx=0x7f302800cf50 comp rx=0 tx=0).stop 2023-11-24T08:05:25.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 -- 172.21.15.153:0/1397090318 shutdown_connections 2023-11-24T08:05:25.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f301406b080 0x7f301406d540 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f303015bf50 0x7f30300b21a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30300c6c30 0x7f30301f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 --2- 172.21.15.153:0/1397090318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30300ce830 0x7f3030158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 -- 172.21.15.153:0/1397090318 >> 172.21.15.153:0/1397090318 conn(0x7f30300b3780 msgr2=0x7f303006ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:25.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 -- 172.21.15.153:0/1397090318 shutdown_connections 2023-11-24T08:05:25.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.497+0000 7f3037ed1700 1 -- 172.21.15.153:0/1397090318 wait complete. 2023-11-24T08:05:25.511 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:05:25.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.631+0000 7f011e899700 1 Processor -- start 2023-11-24T08:05:25.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.631+0000 7f011e899700 1 -- start start 2023-11-24T08:05:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f011e899700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f01180af4d0 0x7f01180b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f011e899700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01180ae430 con 0x7f011806c710 2023-11-24T08:05:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f011e899700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01180ae710 con 0x7f011815e080 2023-11-24T08:05:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f011e899700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01180af0b0 con 0x7f01180af4d0 2023-11-24T08:05:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f011ce36700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f01180af4d0 0x7f01180b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f01177fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f011806c710 0x7f011806e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43842/0 (socket says 172.21.15.153:43842) 2023-11-24T08:05:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f011ce36700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f01180af4d0 0x7f01180b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37740/0 (socket says 172.21.15.153:37740) 2023-11-24T08:05:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f01177fe700 1 -- 172.21.15.153:0/4136338019 learned_addr learned my addr 172.21.15.153:0/4136338019 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f011ce36700 1 -- 172.21.15.153:0/4136338019 >> v1:172.21.15.164:6789/0 conn(0x7f011815e080 legacy=0x7f011806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f011ce36700 1 -- 172.21.15.153:0/4136338019 >> v1:172.21.15.153:6789/0 conn(0x7f011806c710 legacy=0x7f011806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f011ce36700 1 -- 172.21.15.153:0/4136338019 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180ae9f0 con 0x7f01180af4d0 2023-11-24T08:05:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.632+0000 7f0116ffd700 1 -- 172.21.15.153:0/4136338019 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805962506 0 0) 0x7f01180ae430 con 0x7f011806c710 2023-11-24T08:05:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.633+0000 7f011ce36700 1 --2- 172.21.15.153:0/4136338019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180af4d0 0x7f01180b5050 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0110009d90 tx=0x7f011000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44befb639a11882 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.633+0000 7f0116ffd700 1 -- 172.21.15.153:0/4136338019 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000e070 con 0x7f01180af4d0 2023-11-24T08:05:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.633+0000 7f0116ffd700 1 -- 172.21.15.153:0/4136338019 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011000bb90 con 0x7f01180af4d0 2023-11-24T08:05:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.633+0000 7f0116ffd700 1 -- 172.21.15.153:0/4136338019 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110003a20 con 0x7f01180af4d0 2023-11-24T08:05:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.633+0000 7f011e899700 1 -- 172.21.15.153:0/4136338019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180af4d0 msgr2=0x7f01180b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.633+0000 7f011e899700 1 --2- 172.21.15.153:0/4136338019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180af4d0 0x7f01180b5050 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0110009d90 tx=0x7f011000b330 comp rx=0 tx=0).stop 2023-11-24T08:05:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.633+0000 7f011e899700 1 -- 172.21.15.153:0/4136338019 shutdown_connections 2023-11-24T08:05:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.633+0000 7f011e899700 1 --2- 172.21.15.153:0/4136338019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180af4d0 0x7f01180b5050 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.633+0000 7f011e899700 1 -- 172.21.15.153:0/4136338019 >> 172.21.15.153:0/4136338019 conn(0x7f0118071b90 msgr2=0x7f0118071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.633+0000 7f011e899700 1 -- 172.21.15.153:0/4136338019 shutdown_connections 2023-11-24T08:05:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.633+0000 7f011e899700 1 -- 172.21.15.153:0/4136338019 wait complete. 2023-11-24T08:05:25.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.634+0000 7f011e899700 1 Processor -- start 2023-11-24T08:05:25.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.635+0000 7f011e899700 1 -- start start 2023-11-24T08:05:25.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.635+0000 7f011e899700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f011806c710 0x7f0118156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.635+0000 7f011e899700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180af4d0 0x7f011815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.635+0000 7f011e899700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f011815e080 0x7f01181510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.635+0000 7f011e899700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011815b910 con 0x7f01180af4d0 2023-11-24T08:05:25.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.635+0000 7f011e899700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01181606f0 con 0x7f011815e080 2023-11-24T08:05:25.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.635+0000 7f011e899700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011815fab0 con 0x7f011806c710 2023-11-24T08:05:25.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f01177fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180af4d0 0x7f011815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f01177fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180af4d0 0x7f011815b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37744/0 (socket says 172.21.15.153:37744) 2023-11-24T08:05:25.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f01177fe700 1 -- 172.21.15.153:0/3275159763 learned_addr learned my addr 172.21.15.153:0/3275159763 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:25.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f011ce36700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f011815e080 0x7f01181510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f0117fff700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f011806c710 0x7f0118156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f01177fe700 1 -- 172.21.15.153:0/3275159763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f011806c710 msgr2=0x7f0118156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f01177fe700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f011806c710 0x7f0118156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f01177fe700 1 -- 172.21.15.153:0/3275159763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f011815e080 msgr2=0x7f01181510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f01177fe700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f011815e080 0x7f01181510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f01177fe700 1 -- 172.21.15.153:0/3275159763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0110009a70 con 0x7f01180af4d0 2023-11-24T08:05:25.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f011ce36700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f011815e080 0x7f01181510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:25.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f01177fe700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180af4d0 0x7f011815b0e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f01080011e0 tx=0x7f010800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f0114ff9700 1 -- 172.21.15.153:0/3275159763 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108004c80 con 0x7f01180af4d0 2023-11-24T08:05:25.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f0114ff9700 1 -- 172.21.15.153:0/3275159763 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0108004e00 con 0x7f01180af4d0 2023-11-24T08:05:25.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f0114ff9700 1 -- 172.21.15.153:0/3275159763 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108007310 con 0x7f01180af4d0 2023-11-24T08:05:25.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f011e899700 1 -- 172.21.15.153:0/3275159763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011815fd50 con 0x7f01180af4d0 2023-11-24T08:05:25.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.636+0000 7f011e899700 1 -- 172.21.15.153:0/3275159763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0118160310 con 0x7f01180af4d0 2023-11-24T08:05:25.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.637+0000 7f011e899700 1 -- 172.21.15.153:0/3275159763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011815b6e0 con 0x7f01180af4d0 2023-11-24T08:05:25.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.638+0000 7f0114ff9700 1 -- 172.21.15.153:0/3275159763 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0108007470 con 0x7f01180af4d0 2023-11-24T08:05:25.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.638+0000 7f0114ff9700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f010406b080 0x7f010406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.638+0000 7f0114ff9700 1 -- 172.21.15.153:0/3275159763 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01080896a0 con 0x7f01180af4d0 2023-11-24T08:05:25.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.638+0000 7f0117fff700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f010406b080 0x7f010406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.638+0000 7f0117fff700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f010406b080 0x7f010406d540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f011815c270 tx=0x7f010c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.642+0000 7f0114ff9700 1 -- 172.21.15.153:0/3275159763 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0108054560 con 0x7f01180af4d0 2023-11-24T08:05:25.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.848+0000 7f011e899700 1 -- 172.21.15.153:0/3275159763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f01180753f0 con 0x7f01180af4d0 2023-11-24T08:05:25.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.848+0000 7f0114ff9700 1 -- 172.21.15.153:0/3275159763 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0108057b80 con 0x7f01180af4d0 2023-11-24T08:05:25.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 -- 172.21.15.153:0/3275159763 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f010406b080 msgr2=0x7f010406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f010406b080 0x7f010406d540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f011815c270 tx=0x7f010c008040 comp rx=0 tx=0).stop 2023-11-24T08:05:25.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 -- 172.21.15.153:0/3275159763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180af4d0 msgr2=0x7f011815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180af4d0 0x7f011815b0e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f01080011e0 tx=0x7f010800cae0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 -- 172.21.15.153:0/3275159763 shutdown_connections 2023-11-24T08:05:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f011815e080 0x7f01181510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f011806c710 0x7f0118156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f010406b080 0x7f010406d540 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 --2- 172.21.15.153:0/3275159763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180af4d0 0x7f011815b0e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 -- 172.21.15.153:0/3275159763 >> 172.21.15.153:0/3275159763 conn(0x7f0118071b90 msgr2=0x7f01180b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 -- 172.21.15.153:0/3275159763 shutdown_connections 2023-11-24T08:05:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:25.850+0000 7f011e899700 1 -- 172.21.15.153:0/3275159763 wait complete. 2023-11-24T08:05:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2023-11-24T08:05:25.864 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T08:05:25.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:25.864 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:25.915 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:05:25.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:25.916 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:05:25.947 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:05:25.947 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:25.967 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:05:25.967 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:26.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:26.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.148+0000 7f3a072ac700 1 Processor -- start 2023-11-24T08:05:26.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.149+0000 7f3a072ac700 1 -- start start 2023-11-24T08:05:26.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.149+0000 7f3a072ac700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a000adf00 0x7f3a0006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.149+0000 7f3a072ac700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a0006c540 0x7f3a000b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.149+0000 7f3a072ac700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a000af950 con 0x7f3a001446a0 2023-11-24T08:05:26.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.149+0000 7f3a072ac700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a00144a80 con 0x7f3a0006c540 2023-11-24T08:05:26.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.149+0000 7f3a072ac700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0006c9b0 con 0x7f3a000adf00 2023-11-24T08:05:26.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.149+0000 7f3a05849700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a0006c540 0x7f3a000b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.149+0000 7f3a05048700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3a001446a0 0x7f3a000b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43854/0 (socket says 172.21.15.153:43854) 2023-11-24T08:05:26.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.150+0000 7f3a05048700 1 -- 172.21.15.153:0/3486772555 learned_addr learned my addr 172.21.15.153:0/3486772555 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:26.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.150+0000 7f3a04847700 1 --2- 172.21.15.153:0/3486772555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a000adf00 0x7f3a0006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.150+0000 7f3a05849700 1 -- 172.21.15.153:0/3486772555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a000adf00 msgr2=0x7f3a0006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:26.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.150+0000 7f3a05849700 1 --2- 172.21.15.153:0/3486772555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a000adf00 0x7f3a0006c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.150+0000 7f3a05849700 1 -- 172.21.15.153:0/3486772555 >> v1:172.21.15.153:6789/0 conn(0x7f3a001446a0 legacy=0x7f3a000b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.150+0000 7f3a05849700 1 -- 172.21.15.153:0/3486772555 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a000afc30 con 0x7f3a0006c540 2023-11-24T08:05:26.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.150+0000 7f3a05849700 1 --2- 172.21.15.153:0/3486772555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0006c540 0x7f3a000b3d40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009dc0 tx=0x7f39f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e8338d1180b8f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.150+0000 7f39f3fff700 1 -- 172.21.15.153:0/3486772555 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f800e070 con 0x7f3a0006c540 2023-11-24T08:05:26.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.150+0000 7f39f3fff700 1 -- 172.21.15.153:0/3486772555 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f800bb90 con 0x7f3a0006c540 2023-11-24T08:05:26.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.150+0000 7f39f3fff700 1 -- 172.21.15.153:0/3486772555 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8012430 con 0x7f3a0006c540 2023-11-24T08:05:26.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.151+0000 7f3a072ac700 1 -- 172.21.15.153:0/3486772555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0006c540 msgr2=0x7f3a000b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.151+0000 7f3a072ac700 1 --2- 172.21.15.153:0/3486772555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0006c540 0x7f3a000b3d40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009dc0 tx=0x7f39f800b330 comp rx=0 tx=0).stop 2023-11-24T08:05:26.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.151+0000 7f3a072ac700 1 -- 172.21.15.153:0/3486772555 shutdown_connections 2023-11-24T08:05:26.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.151+0000 7f3a072ac700 1 --2- 172.21.15.153:0/3486772555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0006c540 0x7f3a000b3d40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.151+0000 7f3a072ac700 1 --2- 172.21.15.153:0/3486772555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a000adf00 0x7f3a0006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.151+0000 7f3a072ac700 1 -- 172.21.15.153:0/3486772555 >> 172.21.15.153:0/3486772555 conn(0x7f3a00071b90 msgr2=0x7f3a00071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:26.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.151+0000 7f3a072ac700 1 -- 172.21.15.153:0/3486772555 shutdown_connections 2023-11-24T08:05:26.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.151+0000 7f3a072ac700 1 -- 172.21.15.153:0/3486772555 wait complete. 2023-11-24T08:05:26.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.152+0000 7f3a072ac700 1 Processor -- start 2023-11-24T08:05:26.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.152+0000 7f3a072ac700 1 -- start start 2023-11-24T08:05:26.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a072ac700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0006c540 0x7f3a000cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a072ac700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a000adf00 0x7f3a001f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a072ac700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a001446a0 0x7f3a001f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a072ac700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a000cde50 con 0x7f3a0006c540 2023-11-24T08:05:26.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a072ac700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a000ce130 con 0x7f3a001446a0 2023-11-24T08:05:26.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a072ac700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a000ce410 con 0x7f3a000adf00 2023-11-24T08:05:26.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a05048700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0006c540 0x7f3a000cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a05048700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0006c540 0x7f3a000cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37756/0 (socket says 172.21.15.153:37756) 2023-11-24T08:05:26.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a05048700 1 -- 172.21.15.153:0/1613793705 learned_addr learned my addr 172.21.15.153:0/1613793705 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:26.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a04847700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a000adf00 0x7f3a001f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a05849700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a001446a0 0x7f3a001f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a05048700 1 -- 172.21.15.153:0/1613793705 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a000adf00 msgr2=0x7f3a001f3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a05048700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a000adf00 0x7f3a001f3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a05048700 1 -- 172.21.15.153:0/1613793705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a001446a0 msgr2=0x7f3a001f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a05048700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a001446a0 0x7f3a001f4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a05048700 1 -- 172.21.15.153:0/1613793705 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f8009a70 con 0x7f3a0006c540 2023-11-24T08:05:26.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a04847700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a000adf00 0x7f3a001f3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:26.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a05048700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0006c540 0x7f3a000cd600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00c480 tx=0x7f39fc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f39f1ffb700 1 -- 172.21.15.153:0/1613793705 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc005d70 con 0x7f3a0006c540 2023-11-24T08:05:26.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f39f1ffb700 1 -- 172.21.15.153:0/1613793705 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc0070d0 con 0x7f3a0006c540 2023-11-24T08:05:26.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f3a072ac700 1 -- 172.21.15.153:0/1613793705 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a000ce6f0 con 0x7f3a0006c540 2023-11-24T08:05:26.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.153+0000 7f39f1ffb700 1 -- 172.21.15.153:0/1613793705 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc007440 con 0x7f3a0006c540 2023-11-24T08:05:26.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.154+0000 7f3a072ac700 1 -- 172.21.15.153:0/1613793705 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a000cdb40 con 0x7f3a0006c540 2023-11-24T08:05:26.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.154+0000 7f3a072ac700 1 -- 172.21.15.153:0/1613793705 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a000753f0 con 0x7f3a0006c540 2023-11-24T08:05:26.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.155+0000 7f39f1ffb700 1 -- 172.21.15.153:0/1613793705 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f39fc0075a0 con 0x7f3a0006c540 2023-11-24T08:05:26.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.155+0000 7f39f1ffb700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39e406b080 0x7f39e406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.155+0000 7f39f1ffb700 1 -- 172.21.15.153:0/1613793705 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39fc088b00 con 0x7f3a0006c540 2023-11-24T08:05:26.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.155+0000 7f3a04847700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39e406b080 0x7f39e406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.156+0000 7f3a04847700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39e406b080 0x7f39e406d540 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a0015f290 tx=0x7f39f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.160+0000 7f39f1ffb700 1 -- 172.21.15.153:0/1613793705 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f39fc053b30 con 0x7f3a0006c540 2023-11-24T08:05:26.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.353+0000 7f3a072ac700 1 -- 172.21.15.153:0/1613793705 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a00067f60 con 0x7f3a0006c540 2023-11-24T08:05:26.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.355+0000 7f39f1ffb700 1 -- 172.21.15.153:0/1613793705 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f39fc017090 con 0x7f3a0006c540 2023-11-24T08:05:26.357 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:26.357 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":32,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:08.158007+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:04.517274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:05.507139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:26.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 -- 172.21.15.153:0/1613793705 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39e406b080 msgr2=0x7f39e406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39e406b080 0x7f39e406d540 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a0015f290 tx=0x7f39f4008040 comp rx=0 tx=0).stop 2023-11-24T08:05:26.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 -- 172.21.15.153:0/1613793705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0006c540 msgr2=0x7f3a000cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0006c540 0x7f3a000cd600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00c480 tx=0x7f39fc00c790 comp rx=0 tx=0).stop 2023-11-24T08:05:26.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 -- 172.21.15.153:0/1613793705 shutdown_connections 2023-11-24T08:05:26.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a001446a0 0x7f3a001f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f39e406b080 0x7f39e406d540 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0006c540 0x7f3a000cd600 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 --2- 172.21.15.153:0/1613793705 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a000adf00 0x7f3a001f3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 -- 172.21.15.153:0/1613793705 >> 172.21.15.153:0/1613793705 conn(0x7f3a00071b90 msgr2=0x7f3a0015e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:26.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 -- 172.21.15.153:0/1613793705 shutdown_connections 2023-11-24T08:05:26.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.357+0000 7f3a072ac700 1 -- 172.21.15.153:0/1613793705 wait complete. 2023-11-24T08:05:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:05:04.517274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:05:05.507139+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:26.372 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:26.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.494+0000 7f239de6b700 1 Processor -- start 2023-11-24T08:05:26.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.494+0000 7f239de6b700 1 -- start start 2023-11-24T08:05:26.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.495+0000 7f239de6b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23980cf610 0x7f23980add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.495+0000 7f239de6b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f239815f9e0 0x7f23980b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.495+0000 7f239de6b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239806b080 con 0x7f2398073f90 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.495+0000 7f239de6b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239815c290 con 0x7f239815f9e0 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.495+0000 7f239de6b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23980cf9f0 con 0x7f23980cf610 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.495+0000 7f2396ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f239815f9e0 0x7f23980b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.495+0000 7f2396ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f239815f9e0 0x7f23980b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37764/0 (socket says 172.21.15.153:37764) 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.495+0000 7f2396ffd700 1 -- 172.21.15.153:0/3390069965 learned_addr learned my addr 172.21.15.153:0/3390069965 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.496+0000 7f23977fe700 1 --2- 172.21.15.153:0/3390069965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23980cf610 0x7f23980add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.496+0000 7f2396ffd700 1 -- 172.21.15.153:0/3390069965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23980cf610 msgr2=0x7f23980add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.496+0000 7f2396ffd700 1 --2- 172.21.15.153:0/3390069965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23980cf610 0x7f23980add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.496+0000 7f2396ffd700 1 -- 172.21.15.153:0/3390069965 >> v1:172.21.15.164:6789/0 conn(0x7f2398073f90 legacy=0x7f239806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.496+0000 7f2396ffd700 1 -- 172.21.15.153:0/3390069965 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239815ff80 con 0x7f239815f9e0 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.496+0000 7f2396ffd700 1 --2- 172.21.15.153:0/3390069965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239815f9e0 0x7f23980b3c60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f23880098f0 tx=0x7f2388009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84713010b452a9aa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.496+0000 7f23967fc700 1 -- 172.21.15.153:0/3390069965 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388011830 con 0x7f239815f9e0 2023-11-24T08:05:26.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.496+0000 7f23967fc700 1 -- 172.21.15.153:0/3390069965 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2388011990 con 0x7f239815f9e0 2023-11-24T08:05:26.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.496+0000 7f23967fc700 1 -- 172.21.15.153:0/3390069965 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388011d20 con 0x7f239815f9e0 2023-11-24T08:05:26.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.497+0000 7f239de6b700 1 -- 172.21.15.153:0/3390069965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239815f9e0 msgr2=0x7f23980b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.497+0000 7f239de6b700 1 --2- 172.21.15.153:0/3390069965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239815f9e0 0x7f23980b3c60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f23880098f0 tx=0x7f2388009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:26.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.497+0000 7f239de6b700 1 -- 172.21.15.153:0/3390069965 shutdown_connections 2023-11-24T08:05:26.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.497+0000 7f239de6b700 1 --2- 172.21.15.153:0/3390069965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23980cf610 0x7f23980add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.497+0000 7f239de6b700 1 --2- 172.21.15.153:0/3390069965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239815f9e0 0x7f23980b3c60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.497+0000 7f239de6b700 1 -- 172.21.15.153:0/3390069965 >> 172.21.15.153:0/3390069965 conn(0x7f23980d0bf0 msgr2=0x7f23980d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:26.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.497+0000 7f239de6b700 1 -- 172.21.15.153:0/3390069965 shutdown_connections 2023-11-24T08:05:26.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.497+0000 7f239de6b700 1 -- 172.21.15.153:0/3390069965 wait complete. 2023-11-24T08:05:26.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.498+0000 7f239de6b700 1 Processor -- start 2023-11-24T08:05:26.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.498+0000 7f239de6b700 1 -- start start 2023-11-24T08:05:26.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f239de6b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2398073f90 0x7f2398153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f239de6b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23980cf610 0x7f2398154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f239de6b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239815f9e0 0x7f23981501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f239de6b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23981f2060 con 0x7f239815f9e0 2023-11-24T08:05:26.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f239de6b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23981f2340 con 0x7f23980cf610 2023-11-24T08:05:26.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f239de6b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23981f2620 con 0x7f2398073f90 2023-11-24T08:05:26.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f2397fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239815f9e0 0x7f23981501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f23977fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2398073f90 0x7f2398153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f2397fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239815f9e0 0x7f23981501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37774/0 (socket says 172.21.15.153:37774) 2023-11-24T08:05:26.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f2397fff700 1 -- 172.21.15.153:0/3985453652 learned_addr learned my addr 172.21.15.153:0/3985453652 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:26.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f2396ffd700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23980cf610 0x7f2398154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f2397fff700 1 -- 172.21.15.153:0/3985453652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2398073f90 msgr2=0x7f2398153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f2397fff700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2398073f90 0x7f2398153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f2397fff700 1 -- 172.21.15.153:0/3985453652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23980cf610 msgr2=0x7f2398154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f2397fff700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23980cf610 0x7f2398154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f2397fff700 1 -- 172.21.15.153:0/3985453652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388009550 con 0x7f239815f9e0 2023-11-24T08:05:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f2397fff700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239815f9e0 0x7f23981501f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f239000cb50 tx=0x7f239000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f237ffff700 1 -- 172.21.15.153:0/3985453652 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390003c00 con 0x7f239815f9e0 2023-11-24T08:05:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f237ffff700 1 -- 172.21.15.153:0/3985453652 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2390003d60 con 0x7f239815f9e0 2023-11-24T08:05:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f239de6b700 1 -- 172.21.15.153:0/3985453652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23981f2900 con 0x7f239815f9e0 2023-11-24T08:05:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f237ffff700 1 -- 172.21.15.153:0/3985453652 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239000aa20 con 0x7f239815f9e0 2023-11-24T08:05:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.499+0000 7f239de6b700 1 -- 172.21.15.153:0/3985453652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2398153c80 con 0x7f239815f9e0 2023-11-24T08:05:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.500+0000 7f239de6b700 1 -- 172.21.15.153:0/3985453652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2398153e70 con 0x7f239815f9e0 2023-11-24T08:05:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.501+0000 7f237ffff700 1 -- 172.21.15.153:0/3985453652 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f239000ab80 con 0x7f239815f9e0 2023-11-24T08:05:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.501+0000 7f237ffff700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f238406b0b0 0x7f238406d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.501+0000 7f237ffff700 1 -- 172.21.15.153:0/3985453652 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2390089860 con 0x7f239815f9e0 2023-11-24T08:05:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.501+0000 7f23977fe700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f238406b0b0 0x7f238406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.502+0000 7f23977fe700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f238406b0b0 0x7f238406d570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f238c009be0 tx=0x7f238c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.506+0000 7f237ffff700 1 -- 172.21.15.153:0/3985453652 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2390054720 con 0x7f239815f9e0 2023-11-24T08:05:26.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.696+0000 7f239de6b700 1 -- 172.21.15.153:0/3985453652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2398156660 con 0x7f239815f9e0 2023-11-24T08:05:26.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.696+0000 7f237ffff700 1 -- 172.21.15.153:0/3985453652 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2398156660 con 0x7f239815f9e0 2023-11-24T08:05:26.699 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:05:26.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 -- 172.21.15.153:0/3985453652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f238406b0b0 msgr2=0x7f238406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f238406b0b0 0x7f238406d570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f238c009be0 tx=0x7f238c009210 comp rx=0 tx=0).stop 2023-11-24T08:05:26.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 -- 172.21.15.153:0/3985453652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239815f9e0 msgr2=0x7f23981501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239815f9e0 0x7f23981501f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f239000cb50 tx=0x7f239000ce60 comp rx=0 tx=0).stop 2023-11-24T08:05:26.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 -- 172.21.15.153:0/3985453652 shutdown_connections 2023-11-24T08:05:26.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f238406b0b0 0x7f238406d570 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239815f9e0 0x7f23981501f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2398073f90 0x7f2398153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 --2- 172.21.15.153:0/3985453652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23980cf610 0x7f2398154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 -- 172.21.15.153:0/3985453652 >> 172.21.15.153:0/3985453652 conn(0x7f23980d0bf0 msgr2=0x7f23980b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:26.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 -- 172.21.15.153:0/3985453652 shutdown_connections 2023-11-24T08:05:26.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.698+0000 7f239de6b700 1 -- 172.21.15.153:0/3985453652 wait complete. 2023-11-24T08:05:26.713 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:26.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.835+0000 7ff9afde0700 1 Processor -- start 2023-11-24T08:05:26.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.835+0000 7ff9afde0700 1 -- start start 2023-11-24T08:05:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.836+0000 7ff9afde0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9a80746a0 0x7ff9a80b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.836+0000 7ff9afde0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a80b3c60 con 0x7ff9a815e160 2023-11-24T08:05:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.836+0000 7ff9afde0700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a80b58c0 con 0x7ff9a80afc90 2023-11-24T08:05:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.836+0000 7ff9afde0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a80b4500 con 0x7ff9a80746a0 2023-11-24T08:05:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.836+0000 7ff9ad37b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9a80746a0 0x7ff9a80b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.836+0000 7ff9adb7c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff9a815e160 0x7ff9a8073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43882/0 (socket says 172.21.15.153:43882) 2023-11-24T08:05:26.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.836+0000 7ff9ad37b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9a80746a0 0x7ff9a80b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37780/0 (socket says 172.21.15.153:37780) 2023-11-24T08:05:26.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.836+0000 7ff9adb7c700 1 -- 172.21.15.153:0/899819384 learned_addr learned my addr 172.21.15.153:0/899819384 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:26.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.837+0000 7ff9ad37b700 1 -- 172.21.15.153:0/899819384 >> v1:172.21.15.164:6789/0 conn(0x7ff9a80afc90 legacy=0x7ff9a806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:26.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.837+0000 7ff9ad37b700 1 -- 172.21.15.153:0/899819384 >> v1:172.21.15.153:6789/0 conn(0x7ff9a815e160 legacy=0x7ff9a8073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.837+0000 7ff9acb7a700 1 -- 172.21.15.153:0/899819384 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309089548 0 0) 0x7ff9a80b3c60 con 0x7ff9a815e160 2023-11-24T08:05:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.837+0000 7ff9ad37b700 1 -- 172.21.15.153:0/899819384 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a806bdc0 con 0x7ff9a80746a0 2023-11-24T08:05:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.837+0000 7ff9ad37b700 1 --2- 172.21.15.153:0/899819384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a80746a0 0x7ff9a80b5da0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009840 tx=0x7ff9a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe0aa474617a3ab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.837+0000 7ff9acb7a700 1 -- 172.21.15.153:0/899819384 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4004230 con 0x7ff9a80746a0 2023-11-24T08:05:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.837+0000 7ff9acb7a700 1 -- 172.21.15.153:0/899819384 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4004390 con 0x7ff9a80746a0 2023-11-24T08:05:26.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.837+0000 7ff9acb7a700 1 -- 172.21.15.153:0/899819384 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40036a0 con 0x7ff9a80746a0 2023-11-24T08:05:26.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.838+0000 7ff9afde0700 1 -- 172.21.15.153:0/899819384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a80746a0 msgr2=0x7ff9a80b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.838+0000 7ff9afde0700 1 --2- 172.21.15.153:0/899819384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a80746a0 0x7ff9a80b5da0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009840 tx=0x7ff9a4009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:26.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.838+0000 7ff9afde0700 1 -- 172.21.15.153:0/899819384 shutdown_connections 2023-11-24T08:05:26.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.838+0000 7ff9afde0700 1 --2- 172.21.15.153:0/899819384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a80746a0 0x7ff9a80b5da0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.838+0000 7ff9afde0700 1 -- 172.21.15.153:0/899819384 >> 172.21.15.153:0/899819384 conn(0x7ff9a80d0bf0 msgr2=0x7ff9a80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.838+0000 7ff9afde0700 1 -- 172.21.15.153:0/899819384 shutdown_connections 2023-11-24T08:05:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.838+0000 7ff9afde0700 1 -- 172.21.15.153:0/899819384 wait complete. 2023-11-24T08:05:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.839+0000 7ff9afde0700 1 Processor -- start 2023-11-24T08:05:26.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.839+0000 7ff9afde0700 1 -- start start 2023-11-24T08:05:26.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9afde0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80746a0 0x7ff9a81f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9afde0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a80afc90 0x7ff9a8153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9afde0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a815e160 0x7ff9a81525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9afde0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a815e750 con 0x7ff9a80afc90 2023-11-24T08:05:26.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9afde0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a815e9a0 con 0x7ff9a815e160 2023-11-24T08:05:26.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9afde0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a815ec80 con 0x7ff9a80746a0 2023-11-24T08:05:26.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9ad37b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a80afc90 0x7ff9a8153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9ad37b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a80afc90 0x7ff9a8153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37786/0 (socket says 172.21.15.153:37786) 2023-11-24T08:05:26.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9ad37b700 1 -- 172.21.15.153:0/1689274456 learned_addr learned my addr 172.21.15.153:0/1689274456 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:26.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9adb7c700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80746a0 0x7ff9a81f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9ae37d700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a815e160 0x7ff9a81525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9ad37b700 1 -- 172.21.15.153:0/1689274456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80746a0 msgr2=0x7ff9a81f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9ad37b700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80746a0 0x7ff9a81f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9ad37b700 1 -- 172.21.15.153:0/1689274456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a815e160 msgr2=0x7ff9a81525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9ad37b700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a815e160 0x7ff9a81525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9ad37b700 1 -- 172.21.15.153:0/1689274456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40094a0 con 0x7ff9a80afc90 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9ae37d700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a815e160 0x7ff9a81525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff9ad37b700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a80afc90 0x7ff9a8153a50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40090b0 tx=0x7ff9a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff99e7fc700 1 -- 172.21.15.153:0/1689274456 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4011630 con 0x7ff9a80afc90 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.840+0000 7ff99e7fc700 1 -- 172.21.15.153:0/1689274456 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a401e070 con 0x7ff9a80afc90 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.841+0000 7ff9afde0700 1 -- 172.21.15.153:0/1689274456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a815ef60 con 0x7ff9a80afc90 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.841+0000 7ff99e7fc700 1 -- 172.21.15.153:0/1689274456 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40119f0 con 0x7ff9a80afc90 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.841+0000 7ff9afde0700 1 -- 172.21.15.153:0/1689274456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a815f520 con 0x7ff9a80afc90 2023-11-24T08:05:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.841+0000 7ff9afde0700 1 -- 172.21.15.153:0/1689274456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a815f6b0 con 0x7ff9a80afc90 2023-11-24T08:05:26.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.842+0000 7ff99e7fc700 1 -- 172.21.15.153:0/1689274456 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff9a4011b50 con 0x7ff9a80afc90 2023-11-24T08:05:26.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.842+0000 7ff99e7fc700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff98c06b080 0x7ff98c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.842+0000 7ff99e7fc700 1 -- 172.21.15.153:0/1689274456 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9a408abc0 con 0x7ff9a80afc90 2023-11-24T08:05:26.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.842+0000 7ff9adb7c700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff98c06b080 0x7ff98c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.843+0000 7ff9adb7c700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff98c06b080 0x7ff98c06d540 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff998000f60 tx=0x7ff998007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:26.847+0000 7ff99e7fc700 1 -- 172.21.15.153:0/1689274456 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9a4055a80 con 0x7ff9a80afc90 2023-11-24T08:05:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.036+0000 7ff9afde0700 1 -- 172.21.15.153:0/1689274456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9a80b51c0 con 0x7ff9a80afc90 2023-11-24T08:05:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.037+0000 7ff99e7fc700 1 -- 172.21.15.153:0/1689274456 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9a40200a0 con 0x7ff9a80afc90 2023-11-24T08:05:27.039 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:05:27.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 -- 172.21.15.153:0/1689274456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff98c06b080 msgr2=0x7ff98c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff98c06b080 0x7ff98c06d540 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff998000f60 tx=0x7ff998007e70 comp rx=0 tx=0).stop 2023-11-24T08:05:27.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 -- 172.21.15.153:0/1689274456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a80afc90 msgr2=0x7ff9a8153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a80afc90 0x7ff9a8153a50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40090b0 tx=0x7ff9a4004750 comp rx=0 tx=0).stop 2023-11-24T08:05:27.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 -- 172.21.15.153:0/1689274456 shutdown_connections 2023-11-24T08:05:27.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a815e160 0x7ff9a81525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80746a0 0x7ff9a81f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff98c06b080 0x7ff98c06d540 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 --2- 172.21.15.153:0/1689274456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a80afc90 0x7ff9a8153a50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 -- 172.21.15.153:0/1689274456 >> 172.21.15.153:0/1689274456 conn(0x7ff9a80d0bf0 msgr2=0x7ff9a80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:27.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 -- 172.21.15.153:0/1689274456 shutdown_connections 2023-11-24T08:05:27.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.039+0000 7ff9afde0700 1 -- 172.21.15.153:0/1689274456 wait complete. 2023-11-24T08:05:27.052 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:27.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.174+0000 7f070fb83700 1 Processor -- start 2023-11-24T08:05:27.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.175+0000 7f070fb83700 1 -- start start 2023-11-24T08:05:27.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.175+0000 7f070fb83700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f070815e160 0x7f07080b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.175+0000 7f070fb83700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07080afc90 0x7f0708073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.175+0000 7f070fb83700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07080b3c60 con 0x7f07080744d0 2023-11-24T08:05:27.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.175+0000 7f070fb83700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07080b4500 con 0x7f070815e160 2023-11-24T08:05:27.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.175+0000 7f070fb83700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0708074960 con 0x7f07080afc90 2023-11-24T08:05:27.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070d91f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f070815e160 0x7f07080b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070e120700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f07080744d0 0x7f070806d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43896/0 (socket says 172.21.15.153:43896) 2023-11-24T08:05:27.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070d91f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f070815e160 0x7f07080b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37792/0 (socket says 172.21.15.153:37792) 2023-11-24T08:05:27.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070e120700 1 -- 172.21.15.153:0/1012575929 learned_addr learned my addr 172.21.15.153:0/1012575929 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:27.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070d11e700 1 --2- 172.21.15.153:0/1012575929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07080afc90 0x7f0708073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070d91f700 1 -- 172.21.15.153:0/1012575929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07080afc90 msgr2=0x7f0708073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:27.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070d91f700 1 --2- 172.21.15.153:0/1012575929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07080afc90 0x7f0708073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070d91f700 1 -- 172.21.15.153:0/1012575929 >> v1:172.21.15.153:6789/0 conn(0x7f07080744d0 legacy=0x7f070806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070d91f700 1 -- 172.21.15.153:0/1012575929 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07080b58c0 con 0x7f070815e160 2023-11-24T08:05:27.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070c91d700 1 -- 172.21.15.153:0/1012575929 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087878580 0 0) 0x7f07080b3c60 con 0x7f07080744d0 2023-11-24T08:05:27.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070d91f700 1 --2- 172.21.15.153:0/1012575929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f070815e160 0x7f07080b5da0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009840 tx=0x7f06f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538e98981f4f403e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070c91d700 1 -- 172.21.15.153:0/1012575929 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8011830 con 0x7f070815e160 2023-11-24T08:05:27.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070c91d700 1 -- 172.21.15.153:0/1012575929 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f8011990 con 0x7f070815e160 2023-11-24T08:05:27.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.176+0000 7f070c91d700 1 -- 172.21.15.153:0/1012575929 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8011d20 con 0x7f070815e160 2023-11-24T08:05:27.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.177+0000 7f070fb83700 1 -- 172.21.15.153:0/1012575929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f070815e160 msgr2=0x7f07080b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.177+0000 7f070fb83700 1 --2- 172.21.15.153:0/1012575929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f070815e160 0x7f07080b5da0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009840 tx=0x7f06f8009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:27.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.177+0000 7f070fb83700 1 -- 172.21.15.153:0/1012575929 shutdown_connections 2023-11-24T08:05:27.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.177+0000 7f070fb83700 1 --2- 172.21.15.153:0/1012575929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f070815e160 0x7f07080b5da0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.177+0000 7f070fb83700 1 --2- 172.21.15.153:0/1012575929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07080afc90 0x7f0708073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.177+0000 7f070fb83700 1 -- 172.21.15.153:0/1012575929 >> 172.21.15.153:0/1012575929 conn(0x7f07080d0bf0 msgr2=0x7f07080d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:27.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.177+0000 7f070fb83700 1 -- 172.21.15.153:0/1012575929 shutdown_connections 2023-11-24T08:05:27.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.177+0000 7f070fb83700 1 -- 172.21.15.153:0/1012575929 wait complete. 2023-11-24T08:05:27.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.178+0000 7f070fb83700 1 Processor -- start 2023-11-24T08:05:27.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.178+0000 7f070fb83700 1 -- start start 2023-11-24T08:05:27.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070fb83700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07080744d0 0x7f07080adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070fb83700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07080afc90 0x7f07080ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070fb83700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f070815e160 0x7f07080cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070fb83700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070815f590 con 0x7f07080744d0 2023-11-24T08:05:27.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070fb83700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708150360 con 0x7f07080afc90 2023-11-24T08:05:27.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070fb83700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0708150c00 con 0x7f070815e160 2023-11-24T08:05:27.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070d91f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07080744d0 0x7f07080adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070d91f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07080744d0 0x7f07080adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37798/0 (socket says 172.21.15.153:37798) 2023-11-24T08:05:27.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070d91f700 1 -- 172.21.15.153:0/3222311199 learned_addr learned my addr 172.21.15.153:0/3222311199 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:27.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070e120700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f070815e160 0x7f07080cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070d11e700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07080afc90 0x7f07080ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070d91f700 1 -- 172.21.15.153:0/3222311199 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f070815e160 msgr2=0x7f07080cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070d91f700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f070815e160 0x7f07080cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070d91f700 1 -- 172.21.15.153:0/3222311199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07080afc90 msgr2=0x7f07080ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070d91f700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07080afc90 0x7f07080ce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070d91f700 1 -- 172.21.15.153:0/3222311199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80094a0 con 0x7f07080744d0 2023-11-24T08:05:27.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070d91f700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07080744d0 0x7f07080adfb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f06f80090b0 tx=0x7f06f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f06fe7fc700 1 -- 172.21.15.153:0/3222311199 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f80038a0 con 0x7f07080744d0 2023-11-24T08:05:27.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f06fe7fc700 1 -- 172.21.15.153:0/3222311199 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f801e070 con 0x7f07080744d0 2023-11-24T08:05:27.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f06fe7fc700 1 -- 172.21.15.153:0/3222311199 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8003c00 con 0x7f07080744d0 2023-11-24T08:05:27.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.179+0000 7f070fb83700 1 -- 172.21.15.153:0/3222311199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07080cef40 con 0x7f07080744d0 2023-11-24T08:05:27.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.180+0000 7f070fb83700 1 -- 172.21.15.153:0/3222311199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07081505b0 con 0x7f07080744d0 2023-11-24T08:05:27.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.181+0000 7f070fb83700 1 -- 172.21.15.153:0/3222311199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07080b51c0 con 0x7f07080744d0 2023-11-24T08:05:27.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.181+0000 7f06fe7fc700 1 -- 172.21.15.153:0/3222311199 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f06f801a420 con 0x7f07080744d0 2023-11-24T08:05:27.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.181+0000 7f06fe7fc700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f06ec06b080 0x7f06ec06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.181+0000 7f06fe7fc700 1 -- 172.21.15.153:0/3222311199 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06f808a980 con 0x7f07080744d0 2023-11-24T08:05:27.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.181+0000 7f070d11e700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f06ec06b080 0x7f06ec06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.182+0000 7f070d11e700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f06ec06b080 0x7f06ec06d540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07081fbac0 tx=0x7f0704008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.186+0000 7f06fe7fc700 1 -- 172.21.15.153:0/3222311199 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06f8055840 con 0x7f07080744d0 2023-11-24T08:05:27.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.375+0000 7f070fb83700 1 -- 172.21.15.153:0/3222311199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0708150ee0 con 0x7f07080744d0 2023-11-24T08:05:27.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.376+0000 7f06fe7fc700 1 -- 172.21.15.153:0/3222311199 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06f80150a0 con 0x7f07080744d0 2023-11-24T08:05:27.378 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:05:27.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 -- 172.21.15.153:0/3222311199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f06ec06b080 msgr2=0x7f06ec06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f06ec06b080 0x7f06ec06d540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07081fbac0 tx=0x7f0704008040 comp rx=0 tx=0).stop 2023-11-24T08:05:27.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 -- 172.21.15.153:0/3222311199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07080744d0 msgr2=0x7f07080adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07080744d0 0x7f07080adfb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f06f80090b0 tx=0x7f06f8004750 comp rx=0 tx=0).stop 2023-11-24T08:05:27.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 -- 172.21.15.153:0/3222311199 shutdown_connections 2023-11-24T08:05:27.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f070815e160 0x7f07080cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f06ec06b080 0x7f06ec06d540 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07080744d0 0x7f07080adfb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 --2- 172.21.15.153:0/3222311199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07080afc90 0x7f07080ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 -- 172.21.15.153:0/3222311199 >> 172.21.15.153:0/3222311199 conn(0x7f07080d0bf0 msgr2=0x7f070815d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:27.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 -- 172.21.15.153:0/3222311199 shutdown_connections 2023-11-24T08:05:27.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.378+0000 7f070fb83700 1 -- 172.21.15.153:0/3222311199 wait complete. 2023-11-24T08:05:27.391 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:05:27.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.511+0000 7f3251c34700 1 Processor -- start 2023-11-24T08:05:27.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.512+0000 7f3251c34700 1 -- start start 2023-11-24T08:05:27.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.512+0000 7f3251c34700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f324c0b3370 0x7f324c1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.512+0000 7f3251c34700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f324c0d1c70 0x7f324c0d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.512+0000 7f3251c34700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c0b22d0 con 0x7f324c15bdd0 2023-11-24T08:05:27.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.512+0000 7f3251c34700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c0b2f50 con 0x7f324c0b3370 2023-11-24T08:05:27.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.512+0000 7f3251c34700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c0d2640 con 0x7f324c0d1c70 2023-11-24T08:05:27.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.512+0000 7f324affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f324c0b3370 0x7f324c1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.512+0000 7f324affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f324c0b3370 0x7f324c1604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37808/0 (socket says 172.21.15.153:37808) 2023-11-24T08:05:27.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.513+0000 7f324affd700 1 -- 172.21.15.153:0/1448427660 learned_addr learned my addr 172.21.15.153:0/1448427660 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:27.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.513+0000 7f324bfff700 1 --2- 172.21.15.153:0/1448427660 >> v2:172.21.15.164:3300/0 conn(0x7f324c0d1c70 0x7f324c0d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.513+0000 7f324affd700 1 -- 172.21.15.153:0/1448427660 >> v2:172.21.15.164:3300/0 conn(0x7f324c0d1c70 msgr2=0x7f324c0d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.513+0000 7f324affd700 1 --2- 172.21.15.153:0/1448427660 >> v2:172.21.15.164:3300/0 conn(0x7f324c0d1c70 0x7f324c0d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.513+0000 7f324affd700 1 -- 172.21.15.153:0/1448427660 >> v1:172.21.15.164:6789/0 conn(0x7f324c15bdd0 legacy=0x7f324c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.513+0000 7f324affd700 1 -- 172.21.15.153:0/1448427660 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c0b25b0 con 0x7f324c0b3370 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.513+0000 7f324affd700 1 --2- 172.21.15.153:0/1448427660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f324c0b3370 0x7f324c1604e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f324c160a50 tx=0x7f323c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dba32ba9fcb6c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.513+0000 7f324a7fc700 1 -- 172.21.15.153:0/1448427660 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c004230 con 0x7f324c0b3370 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.513+0000 7f324a7fc700 1 -- 172.21.15.153:0/1448427660 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c004390 con 0x7f324c0b3370 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.513+0000 7f324a7fc700 1 -- 172.21.15.153:0/1448427660 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c0036a0 con 0x7f324c0b3370 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.514+0000 7f3251c34700 1 -- 172.21.15.153:0/1448427660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f324c0b3370 msgr2=0x7f324c1604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.514+0000 7f3251c34700 1 --2- 172.21.15.153:0/1448427660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f324c0b3370 0x7f324c1604e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f324c160a50 tx=0x7f323c009bd0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.514+0000 7f3251c34700 1 -- 172.21.15.153:0/1448427660 shutdown_connections 2023-11-24T08:05:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.514+0000 7f3251c34700 1 --2- 172.21.15.153:0/1448427660 >> v2:172.21.15.164:3300/0 conn(0x7f324c0d1c70 0x7f324c0d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.514+0000 7f3251c34700 1 --2- 172.21.15.153:0/1448427660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f324c0b3370 0x7f324c1604e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.514+0000 7f3251c34700 1 -- 172.21.15.153:0/1448427660 >> 172.21.15.153:0/1448427660 conn(0x7f324c0731a0 msgr2=0x7f324c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:27.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.514+0000 7f3251c34700 1 -- 172.21.15.153:0/1448427660 shutdown_connections 2023-11-24T08:05:27.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.514+0000 7f3251c34700 1 -- 172.21.15.153:0/1448427660 wait complete. 2023-11-24T08:05:27.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.515+0000 7f3251c34700 1 Processor -- start 2023-11-24T08:05:27.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.515+0000 7f3251c34700 1 -- start start 2023-11-24T08:05:27.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f3251c34700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f324c0b3370 0x7f324c0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f3251c34700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f324c0d1c70 0x7f324c0b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f3251c34700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f324c15bdd0 0x7f324c1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f3251c34700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0b74e0 con 0x7f324c0b3370 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f3251c34700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0ca570 con 0x7f324c0d1c70 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f3251c34700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0ca850 con 0x7f324c15bdd0 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f324c0b3370 0x7f324c0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f324c0b3370 0x7f324c0c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37812/0 (socket says 172.21.15.153:37812) 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324b7fe700 1 -- 172.21.15.153:0/2479151380 learned_addr learned my addr 172.21.15.153:0/2479151380 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324affd700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f324c0d1c70 0x7f324c0b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324bfff700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f324c15bdd0 0x7f324c1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324b7fe700 1 -- 172.21.15.153:0/2479151380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f324c15bdd0 msgr2=0x7f324c1571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324b7fe700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f324c15bdd0 0x7f324c1571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324b7fe700 1 -- 172.21.15.153:0/2479151380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f324c0d1c70 msgr2=0x7f324c0b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324b7fe700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f324c0d1c70 0x7f324c0b57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324b7fe700 1 -- 172.21.15.153:0/2479151380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c009550 con 0x7f324c0b3370 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324bfff700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f324c15bdd0 0x7f324c1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f324b7fe700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f324c0b3370 0x7f324c0c9ee0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f324000b4a0 tx=0x7f324000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f3233fff700 1 -- 172.21.15.153:0/2479151380 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240011830 con 0x7f324c0b3370 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f3233fff700 1 -- 172.21.15.153:0/2479151380 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3240011990 con 0x7f324c0b3370 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f3251c34700 1 -- 172.21.15.153:0/2479151380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c0cab30 con 0x7f324c0b3370 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.516+0000 7f3233fff700 1 -- 172.21.15.153:0/2479151380 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240011d40 con 0x7f324c0b3370 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.517+0000 7f3251c34700 1 -- 172.21.15.153:0/2479151380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c0cb0f0 con 0x7f324c0b3370 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.517+0000 7f3251c34700 1 -- 172.21.15.153:0/2479151380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324c067f60 con 0x7f324c0b3370 2023-11-24T08:05:27.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.518+0000 7f3233fff700 1 -- 172.21.15.153:0/2479151380 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f324001a400 con 0x7f324c0b3370 2023-11-24T08:05:27.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.518+0000 7f3233fff700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f323806b080 0x7f323806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.518+0000 7f3233fff700 1 -- 172.21.15.153:0/2479151380 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3240089730 con 0x7f324c0b3370 2023-11-24T08:05:27.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.518+0000 7f324affd700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f323806b080 0x7f323806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.519+0000 7f324affd700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f323806b080 0x7f323806d540 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f323c009130 tx=0x7f323c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.523+0000 7f3233fff700 1 -- 172.21.15.153:0/2479151380 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3240054570 con 0x7f324c0b3370 2023-11-24T08:05:27.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.729+0000 7f3251c34700 1 -- 172.21.15.153:0/2479151380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f324c0b7c60 con 0x7f324c0b3370 2023-11-24T08:05:27.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.729+0000 7f3233fff700 1 -- 172.21.15.153:0/2479151380 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3240057b90 con 0x7f324c0b3370 2023-11-24T08:05:27.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.731+0000 7f3251c34700 1 -- 172.21.15.153:0/2479151380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f323806b080 msgr2=0x7f323806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.731+0000 7f3251c34700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f323806b080 0x7f323806d540 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f323c009130 tx=0x7f323c008030 comp rx=0 tx=0).stop 2023-11-24T08:05:27.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.731+0000 7f3251c34700 1 -- 172.21.15.153:0/2479151380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f324c0b3370 msgr2=0x7f324c0c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.731+0000 7f3251c34700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f324c0b3370 0x7f324c0c9ee0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f324000b4a0 tx=0x7f324000b860 comp rx=0 tx=0).stop 2023-11-24T08:05:27.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.731+0000 7f3251c34700 1 -- 172.21.15.153:0/2479151380 shutdown_connections 2023-11-24T08:05:27.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.731+0000 7f3251c34700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f324c15bdd0 0x7f324c1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.731+0000 7f3251c34700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f323806b080 0x7f323806d540 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.731+0000 7f3251c34700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f324c0b3370 0x7f324c0c9ee0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.731+0000 7f3251c34700 1 --2- 172.21.15.153:0/2479151380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f324c0d1c70 0x7f324c0b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.731+0000 7f3251c34700 1 -- 172.21.15.153:0/2479151380 >> 172.21.15.153:0/2479151380 conn(0x7f324c0731a0 msgr2=0x7f324c15a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:27.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.732+0000 7f3251c34700 1 -- 172.21.15.153:0/2479151380 shutdown_connections 2023-11-24T08:05:27.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.732+0000 7f3251c34700 1 -- 172.21.15.153:0/2479151380 wait complete. 2023-11-24T08:05:27.736 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2023-11-24T08:05:27.745 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T08:05:27.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:27.745 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:27.794 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:05:27.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:27.795 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:05:27.814 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:05:27.814 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:27.833 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3433 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T08:05:27.833 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:05:27.833 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:27.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=427 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T08:05:27.874 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:27.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.995+0000 7f288d304700 1 Processor -- start 2023-11-24T08:05:27.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.995+0000 7f288d304700 1 -- start start 2023-11-24T08:05:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.995+0000 7f288d304700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288815e090 0x7f288806bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.995+0000 7f288d304700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f288806c090 0x7f28880d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.995+0000 7f288d304700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28880cfd80 0x7f28880d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.995+0000 7f288d304700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28880d0ee0 con 0x7f28880cfd80 2023-11-24T08:05:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.995+0000 7f288d304700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28880d02d0 con 0x7f288806c090 2023-11-24T08:05:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.995+0000 7f288d304700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28880d05b0 con 0x7f288815e090 2023-11-24T08:05:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f28877fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28880cfd80 0x7f28880d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f28877fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28880cfd80 0x7f28880d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37824/0 (socket says 172.21.15.153:37824) 2023-11-24T08:05:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f28877fe700 1 -- 172.21.15.153:0/997690828 learned_addr learned my addr 172.21.15.153:0/997690828 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f2886ffd700 1 --2- 172.21.15.153:0/997690828 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288815e090 0x7f288806bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f28867fc700 1 --2- 172.21.15.153:0/997690828 >> v2:172.21.15.164:3300/0 conn(0x7f288806c090 0x7f28880d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f28877fe700 1 -- 172.21.15.153:0/997690828 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288815e090 msgr2=0x7f288806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f28877fe700 1 --2- 172.21.15.153:0/997690828 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288815e090 0x7f288806bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f28877fe700 1 -- 172.21.15.153:0/997690828 >> v2:172.21.15.164:3300/0 conn(0x7f288806c090 msgr2=0x7f28880d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f28877fe700 1 --2- 172.21.15.153:0/997690828 >> v2:172.21.15.164:3300/0 conn(0x7f288806c090 0x7f28880d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f28877fe700 1 -- 172.21.15.153:0/997690828 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880d0890 con 0x7f28880cfd80 2023-11-24T08:05:28.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f28877fe700 1 --2- 172.21.15.153:0/997690828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28880cfd80 0x7f28880d2080 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f28880b4850 tx=0x7f288000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9671e997c778b3cd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f2885ffb700 1 -- 172.21.15.153:0/997690828 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000e070 con 0x7f28880cfd80 2023-11-24T08:05:28.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f2885ffb700 1 -- 172.21.15.153:0/997690828 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288000b9c0 con 0x7f28880cfd80 2023-11-24T08:05:28.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.996+0000 7f2885ffb700 1 -- 172.21.15.153:0/997690828 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000bd70 con 0x7f28880cfd80 2023-11-24T08:05:28.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.997+0000 7f288d304700 1 -- 172.21.15.153:0/997690828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28880cfd80 msgr2=0x7f28880d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.997+0000 7f288d304700 1 --2- 172.21.15.153:0/997690828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28880cfd80 0x7f28880d2080 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f28880b4850 tx=0x7f288000b330 comp rx=0 tx=0).stop 2023-11-24T08:05:28.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.997+0000 7f288d304700 1 -- 172.21.15.153:0/997690828 shutdown_connections 2023-11-24T08:05:28.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.997+0000 7f288d304700 1 --2- 172.21.15.153:0/997690828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28880cfd80 0x7f28880d2080 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.997+0000 7f288d304700 1 --2- 172.21.15.153:0/997690828 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288815e090 0x7f288806bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.997+0000 7f288d304700 1 --2- 172.21.15.153:0/997690828 >> v2:172.21.15.164:3300/0 conn(0x7f288806c090 0x7f28880d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.997+0000 7f288d304700 1 -- 172.21.15.153:0/997690828 >> 172.21.15.153:0/997690828 conn(0x7f28880731a0 msgr2=0x7f288809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.997+0000 7f288d304700 1 -- 172.21.15.153:0/997690828 shutdown_connections 2023-11-24T08:05:28.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.997+0000 7f288d304700 1 -- 172.21.15.153:0/997690828 wait complete. 2023-11-24T08:05:28.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.998+0000 7f288d304700 1 Processor -- start 2023-11-24T08:05:28.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.999+0000 7f288d304700 1 -- start start 2023-11-24T08:05:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.999+0000 7f288d304700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288806c090 0x7f28881f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.999+0000 7f288d304700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28880cfd80 0x7f28881e6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.999+0000 7f288d304700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f288815e090 0x7f28880afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.999+0000 7f288d304700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880cc7e0 con 0x7f288815e090 2023-11-24T08:05:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.999+0000 7f288d304700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880ccac0 con 0x7f28880cfd80 2023-11-24T08:05:28.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:27.999+0000 7f288d304700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28880ccda0 con 0x7f288806c090 2023-11-24T08:05:28.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f28877fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f288815e090 0x7f28880afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f28877fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f288815e090 0x7f28880afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37828/0 (socket says 172.21.15.153:37828) 2023-11-24T08:05:28.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f28877fe700 1 -- 172.21.15.153:0/642195543 learned_addr learned my addr 172.21.15.153:0/642195543 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:28.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f2886ffd700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288806c090 0x7f28881f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f28867fc700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28880cfd80 0x7f28881e6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f28877fe700 1 -- 172.21.15.153:0/642195543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288806c090 msgr2=0x7f28881f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f28877fe700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288806c090 0x7f28881f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f28877fe700 1 -- 172.21.15.153:0/642195543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28880cfd80 msgr2=0x7f28881e6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f28877fe700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28880cfd80 0x7f28881e6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f28877fe700 1 -- 172.21.15.153:0/642195543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2880009b30 con 0x7f288815e090 2023-11-24T08:05:28.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f28877fe700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f288815e090 0x7f28880afa40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f28880cf7e0 tx=0x7f2880004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f286f7fe700 1 -- 172.21.15.153:0/642195543 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800099b0 con 0x7f288815e090 2023-11-24T08:05:28.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f286f7fe700 1 -- 172.21.15.153:0/642195543 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2880004250 con 0x7f288815e090 2023-11-24T08:05:28.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f286f7fe700 1 -- 172.21.15.153:0/642195543 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880004600 con 0x7f288815e090 2023-11-24T08:05:28.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f288d304700 1 -- 172.21.15.153:0/642195543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28880c9a20 con 0x7f288815e090 2023-11-24T08:05:28.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.000+0000 7f288d304700 1 -- 172.21.15.153:0/642195543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28880c96f0 con 0x7f288815e090 2023-11-24T08:05:28.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.001+0000 7f288d304700 1 -- 172.21.15.153:0/642195543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28880c9be0 con 0x7f288815e090 2023-11-24T08:05:28.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.002+0000 7f286f7fe700 1 -- 172.21.15.153:0/642195543 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2880004760 con 0x7f288815e090 2023-11-24T08:05:28.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.002+0000 7f286f7fe700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f287406b080 0x7f287406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.002+0000 7f286f7fe700 1 -- 172.21.15.153:0/642195543 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f288008ada0 con 0x7f288815e090 2023-11-24T08:05:28.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.002+0000 7f2886ffd700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f287406b080 0x7f287406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.002+0000 7f2886ffd700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f287406b080 0x7f287406d540 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f28881f70a0 tx=0x7f2878008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.006+0000 7f286f7fe700 1 -- 172.21.15.153:0/642195543 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2880055c00 con 0x7f288815e090 2023-11-24T08:05:28.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.239+0000 7f288d304700 1 -- 172.21.15.153:0/642195543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28880751e0 con 0x7f288815e090 2023-11-24T08:05:28.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.239+0000 7f286f7fe700 1 -- 172.21.15.153:0/642195543 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f2880020090 con 0x7f288815e090 2023-11-24T08:05:28.241 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:28.241 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2772655217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2772655217},{"type":"v1","addr":"172.21.15.164:6834","nonce":2772655217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2600357639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2600357639},{"type":"v1","addr":"172.21.15.153:6836","nonce":2600357639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5037,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3970007773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3970007773},{"type":"v1","addr":"172.21.15.153:6837","nonce":3970007773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:06.541701+0000","modified":"2023-11-24T08:05:09.566528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2977715145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2977715145},{"type":"v1","addr":"172.21.15.164:6835","nonce":2977715145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:05:28.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.241+0000 7f288d304700 1 -- 172.21.15.153:0/642195543 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f287406b080 msgr2=0x7f287406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.241+0000 7f288d304700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f287406b080 0x7f287406d540 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f28881f70a0 tx=0x7f2878008040 comp rx=0 tx=0).stop 2023-11-24T08:05:28.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.241+0000 7f288d304700 1 -- 172.21.15.153:0/642195543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f288815e090 msgr2=0x7f28880afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.241+0000 7f288d304700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f288815e090 0x7f28880afa40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f28880cf7e0 tx=0x7f2880004ad0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.241+0000 7f288d304700 1 -- 172.21.15.153:0/642195543 shutdown_connections 2023-11-24T08:05:28.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.241+0000 7f288d304700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f287406b080 0x7f287406d540 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.241+0000 7f288d304700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f288815e090 0x7f28880afa40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.241+0000 7f288d304700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288806c090 0x7f28881f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.242+0000 7f288d304700 1 --2- 172.21.15.153:0/642195543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28880cfd80 0x7f28881e6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.242+0000 7f288d304700 1 -- 172.21.15.153:0/642195543 >> 172.21.15.153:0/642195543 conn(0x7f28880731a0 msgr2=0x7f28880cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.242+0000 7f288d304700 1 -- 172.21.15.153:0/642195543 shutdown_connections 2023-11-24T08:05:28.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.242+0000 7f288d304700 1 -- 172.21.15.153:0/642195543 wait complete. 2023-11-24T08:05:28.245 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 17 2023-11-24T08:05:28.256 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:28.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.375+0000 7f6f0e37d700 1 Processor -- start 2023-11-24T08:05:28.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.375+0000 7f6f0e37d700 1 -- start start 2023-11-24T08:05:28.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f0e37d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0815f180 0x7f6f080cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f0e37d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f080b4290 con 0x7f6f0813e000 2023-11-24T08:05:28.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f0e37d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0813e570 con 0x7f6f080cfd40 2023-11-24T08:05:28.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f0e37d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080d05d0 con 0x7f6f0815f180 2023-11-24T08:05:28.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f07fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6f0813e000 0x7f6f0815ea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43938/0 (socket says 172.21.15.153:43938) 2023-11-24T08:05:28.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f07fff700 1 -- 172.21.15.153:0/649351579 learned_addr learned my addr 172.21.15.153:0/649351579 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:28.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f077fe700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0815f180 0x7f6f080cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148036358 0 0) 0x7f6f080b4290 con 0x7f6f0813e000 2023-11-24T08:05:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ef40035b0 con 0x7f6f0813e000 2023-11-24T08:05:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3113536796 0 0) 0x7f6ef40035b0 con 0x7f6f0813e000 2023-11-24T08:05:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0815f180 msgr2=0x7f6f080cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0815f180 0x7f6f080cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 >> v1:172.21.15.164:6789/0 conn(0x7f6f080cfd40 legacy=0x7f6f080b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f080d08b0 con 0x7f6f0813e000 2023-11-24T08:05:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f6ef0001670 con 0x7f6f0813e000 2023-11-24T08:05:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 >> v1:172.21.15.153:6789/0 conn(0x7f6f0813e000 legacy=0x7f6f0815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 0x7f6ef4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0815f180 0x7f6ef4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ef4004d90 0x7f6ef4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080d05d0 con 0x7f6ef4003a30 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef400bb40 con 0x7f6ef4004d90 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef400df10 con 0x7f6f0815f180 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.376+0000 7f6f07fff700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 0x7f6ef4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f077fe700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0815f180 0x7f6ef4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f0c91a700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ef4004d90 0x7f6ef4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f07fff700 1 -- 172.21.15.153:0/649351579 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0815f180 msgr2=0x7f6ef4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f07fff700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0815f180 0x7f6ef4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f07fff700 1 -- 172.21.15.153:0/649351579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ef4004d90 msgr2=0x7f6ef4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f07fff700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ef4004d90 0x7f6ef4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f07fff700 1 -- 172.21.15.153:0/649351579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef40035b0 con 0x7f6ef4003a30 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f07fff700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 0x7f6ef4003e50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000c240 tx=0x7f6ef4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b63bd4af61f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0007c10 con 0x7f6ef4003a30 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef000cd40 con 0x7f6ef4003a30 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f06ffd700 1 -- 172.21.15.153:0/649351579 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0005ba0 con 0x7f6ef4003a30 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f0e37d700 1 -- 172.21.15.153:0/649351579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 msgr2=0x7f6ef4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f0e37d700 1 --2- 172.21.15.153:0/649351579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 0x7f6ef4003e50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000c240 tx=0x7f6ef4005880 comp rx=0 tx=0).stop 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f0c91a700 1 -- 172.21.15.153:0/649351579 reap_dead start 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f0e37d700 1 -- 172.21.15.153:0/649351579 shutdown_connections 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.377+0000 7f6f0e37d700 1 -- 172.21.15.153:0/649351579 >> 172.21.15.153:0/649351579 conn(0x7f6f08072990 msgr2=0x7f6f0806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.378+0000 7f6f0e37d700 1 -- 172.21.15.153:0/649351579 shutdown_connections 2023-11-24T08:05:28.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.378+0000 7f6f0e37d700 1 -- 172.21.15.153:0/649351579 wait complete. 2023-11-24T08:05:28.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.379+0000 7f6f0e37d700 1 Processor -- start 2023-11-24T08:05:28.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.379+0000 7f6f0e37d700 1 -- start start 2023-11-24T08:05:28.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f0e37d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 0x7f6f0815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f0e37d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0813f920 0x7f6f080b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f0e37d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f080b1a90 0x7f6f081395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f0e37d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0813f500 con 0x7f6ef4003a30 2023-11-24T08:05:28.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f0e37d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0813e880 con 0x7f6f080b1a90 2023-11-24T08:05:28.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f0e37d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0813eb60 con 0x7f6f0813f920 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f07fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 0x7f6f0815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f07fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 0x7f6f0815a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37846/0 (socket says 172.21.15.153:37846) 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f07fff700 1 -- 172.21.15.153:0/3247200052 learned_addr learned my addr 172.21.15.153:0/3247200052 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f07fff700 1 -- 172.21.15.153:0/3247200052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0813f920 msgr2=0x7f6f080b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f07fff700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0813f920 0x7f6f080b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f07fff700 1 -- 172.21.15.153:0/3247200052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f080b1a90 msgr2=0x7f6f081395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f07fff700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f080b1a90 0x7f6f081395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.380+0000 7f6f07fff700 1 -- 172.21.15.153:0/3247200052 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0813ee40 con 0x7f6ef4003a30 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.381+0000 7f6f07fff700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 0x7f6f0815a6a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400bb10 tx=0x7f6ef0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.381+0000 7f6f04ff9700 1 -- 172.21.15.153:0/3247200052 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef00072d0 con 0x7f6ef4003a30 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.381+0000 7f6f04ff9700 1 -- 172.21.15.153:0/3247200052 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef0007450 con 0x7f6ef4003a30 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.381+0000 7f6f04ff9700 1 -- 172.21.15.153:0/3247200052 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0007800 con 0x7f6ef4003a30 2023-11-24T08:05:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.381+0000 7f6f0e37d700 1 -- 172.21.15.153:0/3247200052 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0813f120 con 0x7f6ef4003a30 2023-11-24T08:05:28.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.381+0000 7f6f0e37d700 1 -- 172.21.15.153:0/3247200052 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0815abe0 con 0x7f6ef4003a30 2023-11-24T08:05:28.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.382+0000 7f6f0e37d700 1 -- 172.21.15.153:0/3247200052 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0815add0 con 0x7f6ef4003a30 2023-11-24T08:05:28.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.382+0000 7f6f04ff9700 1 -- 172.21.15.153:0/3247200052 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6ef0019030 con 0x7f6ef4003a30 2023-11-24T08:05:28.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.383+0000 7f6f04ff9700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6ee806b080 0x7f6ee806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.383+0000 7f6f04ff9700 1 -- 172.21.15.153:0/3247200052 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ef008aa70 con 0x7f6ef4003a30 2023-11-24T08:05:28.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.383+0000 7f6f077fe700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6ee806b080 0x7f6ee806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.383+0000 7f6f077fe700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6ee806b080 0x7f6ee806d540 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f080b2140 tx=0x7f6ef8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.387+0000 7f6f04ff9700 1 -- 172.21.15.153:0/3247200052 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ef0055890 con 0x7f6ef4003a30 2023-11-24T08:05:28.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.582+0000 7f6f0e37d700 1 -- 172.21.15.153:0/3247200052 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f08067f60 con 0x7f6ef4003a30 2023-11-24T08:05:28.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.583+0000 7f6f04ff9700 1 -- 172.21.15.153:0/3247200052 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f6ef0058eb0 con 0x7f6ef4003a30 2023-11-24T08:05:28.585 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:28.585 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":32,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:08.158007+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:04.517274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:05.507139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:28.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.585+0000 7f6f0e37d700 1 -- 172.21.15.153:0/3247200052 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6ee806b080 msgr2=0x7f6ee806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.585+0000 7f6f0e37d700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6ee806b080 0x7f6ee806d540 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f080b2140 tx=0x7f6ef8008040 comp rx=0 tx=0).stop 2023-11-24T08:05:28.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.585+0000 7f6f0e37d700 1 -- 172.21.15.153:0/3247200052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 msgr2=0x7f6f0815a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.585+0000 7f6f0e37d700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 0x7f6f0815a6a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400bb10 tx=0x7f6ef0001a00 comp rx=0 tx=0).stop 2023-11-24T08:05:28.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.585+0000 7f6f0e37d700 1 -- 172.21.15.153:0/3247200052 shutdown_connections 2023-11-24T08:05:28.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.585+0000 7f6f0e37d700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f080b1a90 0x7f6f081395b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.585+0000 7f6f0e37d700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6ee806b080 0x7f6ee806d540 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.585+0000 7f6f0e37d700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ef4003a30 0x7f6f0815a6a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.585+0000 7f6f0e37d700 1 --2- 172.21.15.153:0/3247200052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f0813f920 0x7f6f080b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.586+0000 7f6f0e37d700 1 -- 172.21.15.153:0/3247200052 >> 172.21.15.153:0/3247200052 conn(0x7f6f08072990 msgr2=0x7f6f0815d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.586+0000 7f6f0e37d700 1 -- 172.21.15.153:0/3247200052 shutdown_connections 2023-11-24T08:05:28.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.586+0000 7f6f0e37d700 1 -- 172.21.15.153:0/3247200052 wait complete. 2023-11-24T08:05:28.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:05:04.517274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:05:05.507139+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:28.600 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:28.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.722+0000 7fe01508f700 1 Processor -- start 2023-11-24T08:05:28.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.722+0000 7fe01508f700 1 -- start start 2023-11-24T08:05:28.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe01508f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe01015a620 0x7fe0100ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe01508f700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe0100cc540 0x7fe01006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe01508f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe01006eb20 0x7fe01006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe01508f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01006efb0 con 0x7fe01006eb20 2023-11-24T08:05:28.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe01508f700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0100b2f20 con 0x7fe0100cc540 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe01508f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100ce690 con 0x7fe01015a620 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe00f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe01006eb20 0x7fe01006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe00f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe01006eb20 0x7fe01006d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37858/0 (socket says 172.21.15.153:37858) 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe00f59e700 1 -- 172.21.15.153:0/2793834954 learned_addr learned my addr 172.21.15.153:0/2793834954 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe00e59c700 1 --2- 172.21.15.153:0/2793834954 >> v2:172.21.15.164:3300/0 conn(0x7fe0100cc540 0x7fe01006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe00ed9d700 1 --2- 172.21.15.153:0/2793834954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe01015a620 0x7fe0100ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe00f59e700 1 -- 172.21.15.153:0/2793834954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe01015a620 msgr2=0x7fe0100ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe00f59e700 1 --2- 172.21.15.153:0/2793834954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe01015a620 0x7fe0100ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe00f59e700 1 -- 172.21.15.153:0/2793834954 >> v2:172.21.15.164:3300/0 conn(0x7fe0100cc540 msgr2=0x7fe01006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe00f59e700 1 --2- 172.21.15.153:0/2793834954 >> v2:172.21.15.164:3300/0 conn(0x7fe0100cc540 0x7fe01006e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.723+0000 7fe00f59e700 1 -- 172.21.15.153:0/2793834954 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01015aa00 con 0x7fe01006eb20 2023-11-24T08:05:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe00f59e700 1 --2- 172.21.15.153:0/2793834954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01006eb20 0x7fe01006d3c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe010071050 tx=0x7fe00800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae2cdb074d382ff server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe00dd9b700 1 -- 172.21.15.153:0/2793834954 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800e070 con 0x7fe01006eb20 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe00dd9b700 1 -- 172.21.15.153:0/2793834954 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00800b9c0 con 0x7fe01006eb20 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe00dd9b700 1 -- 172.21.15.153:0/2793834954 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800bd70 con 0x7fe01006eb20 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe01508f700 1 -- 172.21.15.153:0/2793834954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01006eb20 msgr2=0x7fe01006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe01508f700 1 --2- 172.21.15.153:0/2793834954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01006eb20 0x7fe01006d3c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe010071050 tx=0x7fe00800b330 comp rx=0 tx=0).stop 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe01508f700 1 -- 172.21.15.153:0/2793834954 shutdown_connections 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe01508f700 1 --2- 172.21.15.153:0/2793834954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01006eb20 0x7fe01006d3c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe01508f700 1 --2- 172.21.15.153:0/2793834954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe01015a620 0x7fe0100ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe01508f700 1 --2- 172.21.15.153:0/2793834954 >> v2:172.21.15.164:3300/0 conn(0x7fe0100cc540 0x7fe01006e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe01508f700 1 -- 172.21.15.153:0/2793834954 >> 172.21.15.153:0/2793834954 conn(0x7fe0100b2050 msgr2=0x7fe0100b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe01508f700 1 -- 172.21.15.153:0/2793834954 shutdown_connections 2023-11-24T08:05:28.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.724+0000 7fe01508f700 1 -- 172.21.15.153:0/2793834954 wait complete. 2023-11-24T08:05:28.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.726+0000 7fe01508f700 1 Processor -- start 2023-11-24T08:05:28.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.726+0000 7fe01508f700 1 -- start start 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe01508f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01006eb20 0x7fe01014e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe01508f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0100cc540 0x7fe01015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe01508f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe01015a620 0x7fe01015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe01508f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01015bc30 con 0x7fe01006eb20 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe01508f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe010144110 con 0x7fe0100cc540 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe01508f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01015b020 con 0x7fe01015a620 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01006eb20 0x7fe01014e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01006eb20 0x7fe01014e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37860/0 (socket says 172.21.15.153:37860) 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00ed9d700 1 -- 172.21.15.153:0/569635708 learned_addr learned my addr 172.21.15.153:0/569635708 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00e59c700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0100cc540 0x7fe01015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00f59e700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe01015a620 0x7fe01015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00ed9d700 1 -- 172.21.15.153:0/569635708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe01015a620 msgr2=0x7fe01015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00ed9d700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe01015a620 0x7fe01015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00ed9d700 1 -- 172.21.15.153:0/569635708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0100cc540 msgr2=0x7fe01015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00ed9d700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0100cc540 0x7fe01015d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00ed9d700 1 -- 172.21.15.153:0/569635708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe008009b30 con 0x7fe01006eb20 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00e59c700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0100cc540 0x7fe01015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe00ed9d700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01006eb20 0x7fe01014e600 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe00400e810 tx=0x7fe00400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fdff77fe700 1 -- 172.21.15.153:0/569635708 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004013610 con 0x7fe01006eb20 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fdff77fe700 1 -- 172.21.15.153:0/569635708 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe004013770 con 0x7fe01006eb20 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fe01508f700 1 -- 172.21.15.153:0/569635708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01015b300 con 0x7fe01006eb20 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.727+0000 7fdff77fe700 1 -- 172.21.15.153:0/569635708 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004013b20 con 0x7fe01006eb20 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.728+0000 7fe01508f700 1 -- 172.21.15.153:0/569635708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01015b8c0 con 0x7fe01006eb20 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.729+0000 7fe01508f700 1 -- 172.21.15.153:0/569635708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe010068d90 con 0x7fe01006eb20 2023-11-24T08:05:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.729+0000 7fdff77fe700 1 -- 172.21.15.153:0/569635708 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe004013c80 con 0x7fe01006eb20 2023-11-24T08:05:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.729+0000 7fdff77fe700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdffc06b080 0x7fdffc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.730+0000 7fe00e59c700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdffc06b080 0x7fdffc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.730+0000 7fdff77fe700 1 -- 172.21.15.153:0/569635708 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0040896a0 con 0x7fe01006eb20 2023-11-24T08:05:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.730+0000 7fe00e59c700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdffc06b080 0x7fdffc06d540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0101e3430 tx=0x7fe000008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.734+0000 7fdff77fe700 1 -- 172.21.15.153:0/569635708 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe0040543d0 con 0x7fe01006eb20 2023-11-24T08:05:28.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.925+0000 7fe01508f700 1 -- 172.21.15.153:0/569635708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe010068fb0 con 0x7fe01006eb20 2023-11-24T08:05:28.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.925+0000 7fdff77fe700 1 -- 172.21.15.153:0/569635708 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0040579f0 con 0x7fe01006eb20 2023-11-24T08:05:28.927 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:05:28.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.927+0000 7fe01508f700 1 -- 172.21.15.153:0/569635708 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdffc06b080 msgr2=0x7fdffc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.927+0000 7fe01508f700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdffc06b080 0x7fdffc06d540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0101e3430 tx=0x7fe000008040 comp rx=0 tx=0).stop 2023-11-24T08:05:28.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.927+0000 7fe01508f700 1 -- 172.21.15.153:0/569635708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01006eb20 msgr2=0x7fe01014e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.927+0000 7fe01508f700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01006eb20 0x7fe01014e600 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe00400e810 tx=0x7fe00400ebd0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.927+0000 7fe01508f700 1 -- 172.21.15.153:0/569635708 shutdown_connections 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.927+0000 7fe01508f700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe01015a620 0x7fe01015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.927+0000 7fe01508f700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdffc06b080 0x7fdffc06d540 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.927+0000 7fe01508f700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01006eb20 0x7fe01014e600 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.927+0000 7fe01508f700 1 --2- 172.21.15.153:0/569635708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0100cc540 0x7fe01015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.927+0000 7fe01508f700 1 -- 172.21.15.153:0/569635708 >> 172.21.15.153:0/569635708 conn(0x7fe0100b2050 msgr2=0x7fe010071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.927+0000 7fe01508f700 1 -- 172.21.15.153:0/569635708 shutdown_connections 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:28.928+0000 7fe01508f700 1 -- 172.21.15.153:0/569635708 wait complete. 2023-11-24T08:05:28.942 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:29.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.064+0000 7f2a320b9700 1 Processor -- start 2023-11-24T08:05:29.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.064+0000 7f2a320b9700 1 -- start start 2023-11-24T08:05:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a320b9700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2a2c0746a0 0x7f2a2c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a320b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2a2c0afc90 0x7f2a2c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a320b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c0b3c60 con 0x7f2a2c15e160 2023-11-24T08:05:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a320b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0b4500 con 0x7f2a2c0afc90 2023-11-24T08:05:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a320b9700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0b58c0 con 0x7f2a2c0746a0 2023-11-24T08:05:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2b7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2a2c15e160 0x7f2a2c073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43972/0 (socket says 172.21.15.153:43972) 2023-11-24T08:05:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2a2c0afc90 0x7f2a2c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2b7fe700 1 -- 172.21.15.153:0/3731827011 learned_addr learned my addr 172.21.15.153:0/3731827011 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2affd700 1 --2- 172.21.15.153:0/3731827011 >> v2:172.21.15.164:3300/0 conn(0x7f2a2c0746a0 0x7f2a2c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2bfff700 1 -- 172.21.15.153:0/3731827011 >> v2:172.21.15.164:3300/0 conn(0x7f2a2c0746a0 msgr2=0x7f2a2c0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2bfff700 1 --2- 172.21.15.153:0/3731827011 >> v2:172.21.15.164:3300/0 conn(0x7f2a2c0746a0 0x7f2a2c0b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2bfff700 1 -- 172.21.15.153:0/3731827011 >> v1:172.21.15.153:6789/0 conn(0x7f2a2c15e160 legacy=0x7f2a2c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2bfff700 1 -- 172.21.15.153:0/3731827011 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c06bdc0 con 0x7f2a2c0afc90 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2a7fc700 1 -- 172.21.15.153:0/3731827011 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926290600 0 0) 0x7f2a2c0b3c60 con 0x7f2a2c15e160 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2affd700 1 --2- 172.21.15.153:0/3731827011 >> v2:172.21.15.164:3300/0 conn(0x7f2a2c0746a0 0x7f2a2c0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2bfff700 1 --2- 172.21.15.153:0/3731827011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c0afc90 0x7f2a2c06d930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0d0880 tx=0x7f2a2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b262c3c61ad2315 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2a7fc700 1 -- 172.21.15.153:0/3731827011 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400e070 con 0x7f2a2c0afc90 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2a7fc700 1 -- 172.21.15.153:0/3731827011 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2400bbd0 con 0x7f2a2c0afc90 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.065+0000 7f2a2a7fc700 1 -- 172.21.15.153:0/3731827011 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24012430 con 0x7f2a2c0afc90 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.066+0000 7f2a320b9700 1 -- 172.21.15.153:0/3731827011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c0afc90 msgr2=0x7f2a2c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.066+0000 7f2a320b9700 1 --2- 172.21.15.153:0/3731827011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c0afc90 0x7f2a2c06d930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0d0880 tx=0x7f2a2400b330 comp rx=0 tx=0).stop 2023-11-24T08:05:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.066+0000 7f2a320b9700 1 -- 172.21.15.153:0/3731827011 shutdown_connections 2023-11-24T08:05:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.066+0000 7f2a320b9700 1 --2- 172.21.15.153:0/3731827011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c0afc90 0x7f2a2c06d930 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.066+0000 7f2a320b9700 1 --2- 172.21.15.153:0/3731827011 >> v2:172.21.15.164:3300/0 conn(0x7f2a2c0746a0 0x7f2a2c0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.066+0000 7f2a320b9700 1 -- 172.21.15.153:0/3731827011 >> 172.21.15.153:0/3731827011 conn(0x7f2a2c0d0bf0 msgr2=0x7f2a2c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.066+0000 7f2a320b9700 1 -- 172.21.15.153:0/3731827011 shutdown_connections 2023-11-24T08:05:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.066+0000 7f2a320b9700 1 -- 172.21.15.153:0/3731827011 wait complete. 2023-11-24T08:05:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.067+0000 7f2a320b9700 1 Processor -- start 2023-11-24T08:05:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.067+0000 7f2a320b9700 1 -- start start 2023-11-24T08:05:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.068+0000 7f2a320b9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a2c0746a0 0x7f2a2c161f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.068+0000 7f2a320b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c0afc90 0x7f2a2c152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.068+0000 7f2a320b9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a2c15e160 0x7f2a2c1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.068+0000 7f2a320b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c15f640 con 0x7f2a2c0afc90 2023-11-24T08:05:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.068+0000 7f2a320b9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c1f49b0 con 0x7f2a2c0746a0 2023-11-24T08:05:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.068+0000 7f2a320b9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c15e880 con 0x7f2a2c15e160 2023-11-24T08:05:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.068+0000 7f2a2affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c0afc90 0x7f2a2c152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.068+0000 7f2a2affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c0afc90 0x7f2a2c152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37874/0 (socket says 172.21.15.153:37874) 2023-11-24T08:05:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.068+0000 7f2a2affd700 1 -- 172.21.15.153:0/3770910083 learned_addr learned my addr 172.21.15.153:0/3770910083 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.068+0000 7f2a2b7fe700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a2c0746a0 0x7f2a2c161f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.068+0000 7f2a2bfff700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a2c15e160 0x7f2a2c1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a2affd700 1 -- 172.21.15.153:0/3770910083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a2c15e160 msgr2=0x7f2a2c1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a2affd700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a2c15e160 0x7f2a2c1528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a2affd700 1 -- 172.21.15.153:0/3770910083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a2c0746a0 msgr2=0x7f2a2c161f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a2affd700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a2c0746a0 0x7f2a2c161f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a2affd700 1 -- 172.21.15.153:0/3770910083 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a24009a70 con 0x7f2a2c0afc90 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a2bfff700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a2c15e160 0x7f2a2c1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a2affd700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c0afc90 0x7f2a2c152380 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000e810 tx=0x7f2a2000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a13fff700 1 -- 172.21.15.153:0/3770910083 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20013610 con 0x7f2a2c0afc90 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a13fff700 1 -- 172.21.15.153:0/3770910083 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a20013770 con 0x7f2a2c0afc90 2023-11-24T08:05:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a320b9700 1 -- 172.21.15.153:0/3770910083 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c15eb60 con 0x7f2a2c0afc90 2023-11-24T08:05:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a13fff700 1 -- 172.21.15.153:0/3770910083 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20013b20 con 0x7f2a2c0afc90 2023-11-24T08:05:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.069+0000 7f2a320b9700 1 -- 172.21.15.153:0/3770910083 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c15f120 con 0x7f2a2c0afc90 2023-11-24T08:05:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.070+0000 7f2a320b9700 1 -- 172.21.15.153:0/3770910083 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c068fb0 con 0x7f2a2c0afc90 2023-11-24T08:05:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.070+0000 7f2a13fff700 1 -- 172.21.15.153:0/3770910083 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2a20013c80 con 0x7f2a2c0afc90 2023-11-24T08:05:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.071+0000 7f2a13fff700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2a1806b080 0x7f2a1806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.071+0000 7f2a13fff700 1 -- 172.21.15.153:0/3770910083 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a20089620 con 0x7f2a2c0afc90 2023-11-24T08:05:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.071+0000 7f2a2b7fe700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2a1806b080 0x7f2a1806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.071+0000 7f2a2b7fe700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2a1806b080 0x7f2a1806d540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000f60 tx=0x7f2a1c007c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.075+0000 7f2a13fff700 1 -- 172.21.15.153:0/3770910083 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a200543d0 con 0x7f2a2c0afc90 2023-11-24T08:05:29.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.266+0000 7f2a320b9700 1 -- 172.21.15.153:0/3770910083 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a2c06c140 con 0x7f2a2c0afc90 2023-11-24T08:05:29.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.266+0000 7f2a13fff700 1 -- 172.21.15.153:0/3770910083 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a200579f0 con 0x7f2a2c0afc90 2023-11-24T08:05:29.270 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:05:29.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.268+0000 7f2a320b9700 1 -- 172.21.15.153:0/3770910083 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2a1806b080 msgr2=0x7f2a1806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.268+0000 7f2a320b9700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2a1806b080 0x7f2a1806d540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000f60 tx=0x7f2a1c007c90 comp rx=0 tx=0).stop 2023-11-24T08:05:29.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.269+0000 7f2a320b9700 1 -- 172.21.15.153:0/3770910083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c0afc90 msgr2=0x7f2a2c152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.269+0000 7f2a320b9700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c0afc90 0x7f2a2c152380 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000e810 tx=0x7f2a2000ebd0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.269+0000 7f2a320b9700 1 -- 172.21.15.153:0/3770910083 shutdown_connections 2023-11-24T08:05:29.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.269+0000 7f2a320b9700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a2c15e160 0x7f2a2c1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.269+0000 7f2a320b9700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a2c0746a0 0x7f2a2c161f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.269+0000 7f2a320b9700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2a1806b080 0x7f2a1806d540 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.269+0000 7f2a320b9700 1 --2- 172.21.15.153:0/3770910083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c0afc90 0x7f2a2c152380 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.269+0000 7f2a320b9700 1 -- 172.21.15.153:0/3770910083 >> 172.21.15.153:0/3770910083 conn(0x7f2a2c0d0bf0 msgr2=0x7f2a2c073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.269+0000 7f2a320b9700 1 -- 172.21.15.153:0/3770910083 shutdown_connections 2023-11-24T08:05:29.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.269+0000 7f2a320b9700 1 -- 172.21.15.153:0/3770910083 wait complete. 2023-11-24T08:05:29.283 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.405+0000 7f634a587700 1 Processor -- start 2023-11-24T08:05:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.405+0000 7f634a587700 1 -- start start 2023-11-24T08:05:29.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f634a587700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f634406c000 0x7f634406c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f634a587700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f634415e3e0 0x7f63440b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f634a587700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f63440b5ee0 0x7f634406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f634a587700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63440b3fb0 con 0x7f634415e3e0 2023-11-24T08:05:29.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f634a587700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634406c920 con 0x7f63440b5ee0 2023-11-24T08:05:29.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f634a587700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63440b4200 con 0x7f634406c000 2023-11-24T08:05:29.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f63437fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f634415e3e0 0x7f63440b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f63437fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f634415e3e0 0x7f63440b4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37882/0 (socket says 172.21.15.153:37882) 2023-11-24T08:05:29.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f63437fe700 1 -- 172.21.15.153:0/4110019938 learned_addr learned my addr 172.21.15.153:0/4110019938 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:29.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f6343fff700 1 --2- 172.21.15.153:0/4110019938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f634406c000 0x7f634406c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f6348b24700 1 --2- 172.21.15.153:0/4110019938 >> v2:172.21.15.164:3300/0 conn(0x7f63440b5ee0 0x7f634406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f63437fe700 1 -- 172.21.15.153:0/4110019938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f634406c000 msgr2=0x7f634406c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f63437fe700 1 --2- 172.21.15.153:0/4110019938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f634406c000 0x7f634406c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f63437fe700 1 -- 172.21.15.153:0/4110019938 >> v2:172.21.15.164:3300/0 conn(0x7f63440b5ee0 msgr2=0x7f634406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f63437fe700 1 --2- 172.21.15.153:0/4110019938 >> v2:172.21.15.164:3300/0 conn(0x7f63440b5ee0 0x7f634406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f63437fe700 1 -- 172.21.15.153:0/4110019938 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63440b44e0 con 0x7f634415e3e0 2023-11-24T08:05:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f6348b24700 1 --2- 172.21.15.153:0/4110019938 >> v2:172.21.15.164:3300/0 conn(0x7f63440b5ee0 0x7f634406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:29.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f63437fe700 1 --2- 172.21.15.153:0/4110019938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f634415e3e0 0x7f63440b4fc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f63440b3cf0 tx=0x7f6334009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3d42dac2ec2565 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.406+0000 7f6342ffd700 1 -- 172.21.15.153:0/4110019938 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633400b870 con 0x7f634415e3e0 2023-11-24T08:05:29.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.407+0000 7f6342ffd700 1 -- 172.21.15.153:0/4110019938 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633400b9d0 con 0x7f634415e3e0 2023-11-24T08:05:29.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.407+0000 7f6342ffd700 1 -- 172.21.15.153:0/4110019938 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633400bd60 con 0x7f634415e3e0 2023-11-24T08:05:29.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.407+0000 7f634a587700 1 -- 172.21.15.153:0/4110019938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f634415e3e0 msgr2=0x7f63440b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.407+0000 7f634a587700 1 --2- 172.21.15.153:0/4110019938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f634415e3e0 0x7f63440b4fc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f63440b3cf0 tx=0x7f6334009bd0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.407+0000 7f634a587700 1 -- 172.21.15.153:0/4110019938 shutdown_connections 2023-11-24T08:05:29.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.407+0000 7f634a587700 1 --2- 172.21.15.153:0/4110019938 >> v2:172.21.15.164:3300/0 conn(0x7f63440b5ee0 0x7f634406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.407+0000 7f634a587700 1 --2- 172.21.15.153:0/4110019938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f634406c000 0x7f634406c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.407+0000 7f634a587700 1 --2- 172.21.15.153:0/4110019938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f634415e3e0 0x7f63440b4fc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.407+0000 7f634a587700 1 -- 172.21.15.153:0/4110019938 >> 172.21.15.153:0/4110019938 conn(0x7f6344071ac0 msgr2=0x7f6344071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.407+0000 7f634a587700 1 -- 172.21.15.153:0/4110019938 shutdown_connections 2023-11-24T08:05:29.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.407+0000 7f634a587700 1 -- 172.21.15.153:0/4110019938 wait complete. 2023-11-24T08:05:29.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.408+0000 7f634a587700 1 Processor -- start 2023-11-24T08:05:29.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.408+0000 7f634a587700 1 -- start start 2023-11-24T08:05:29.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.409+0000 7f634a587700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f634406c000 0x7f634414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.409+0000 7f634a587700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63440b5ee0 0x7f63440cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.409+0000 7f634a587700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f634415e3e0 0x7f634415b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.409+0000 7f634a587700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63440ce290 con 0x7f634415e3e0 2023-11-24T08:05:29.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.409+0000 7f634a587700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634414ff60 con 0x7f63440b5ee0 2023-11-24T08:05:29.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.409+0000 7f634a587700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63440ce4c0 con 0x7f634406c000 2023-11-24T08:05:29.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.409+0000 7f6348b24700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f634415e3e0 0x7f634415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.409+0000 7f6348b24700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f634415e3e0 0x7f634415b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37892/0 (socket says 172.21.15.153:37892) 2023-11-24T08:05:29.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.409+0000 7f6348b24700 1 -- 172.21.15.153:0/1187384997 learned_addr learned my addr 172.21.15.153:0/1187384997 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:29.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f6343fff700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f634406c000 0x7f634414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f63437fe700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63440b5ee0 0x7f63440cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f6348b24700 1 -- 172.21.15.153:0/1187384997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f634406c000 msgr2=0x7f634414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f6348b24700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f634406c000 0x7f634414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f6348b24700 1 -- 172.21.15.153:0/1187384997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63440b5ee0 msgr2=0x7f63440cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f6348b24700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63440b5ee0 0x7f63440cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f6348b24700 1 -- 172.21.15.153:0/1187384997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6334009550 con 0x7f634415e3e0 2023-11-24T08:05:29.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f63437fe700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63440b5ee0 0x7f63440cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:29.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f6348b24700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f634415e3e0 0x7f634415b130 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f633c007e70 tx=0x7f633c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f6340ff9700 1 -- 172.21.15.153:0/1187384997 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c00de40 con 0x7f634415e3e0 2023-11-24T08:05:29.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f6340ff9700 1 -- 172.21.15.153:0/1187384997 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c00f040 con 0x7f634415e3e0 2023-11-24T08:05:29.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f634a587700 1 -- 172.21.15.153:0/1187384997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63440b5680 con 0x7f634415e3e0 2023-11-24T08:05:29.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f6340ff9700 1 -- 172.21.15.153:0/1187384997 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c003c60 con 0x7f634415e3e0 2023-11-24T08:05:29.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.410+0000 7f634a587700 1 -- 172.21.15.153:0/1187384997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6344160240 con 0x7f634415e3e0 2023-11-24T08:05:29.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.411+0000 7f634a587700 1 -- 172.21.15.153:0/1187384997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6344068f10 con 0x7f634415e3e0 2023-11-24T08:05:29.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.411+0000 7f6340ff9700 1 -- 172.21.15.153:0/1187384997 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f633c004030 con 0x7f634415e3e0 2023-11-24T08:05:29.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.412+0000 7f6340ff9700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f633006b080 0x7f633006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.412+0000 7f6340ff9700 1 -- 172.21.15.153:0/1187384997 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f633c089b50 con 0x7f634415e3e0 2023-11-24T08:05:29.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.412+0000 7f6343fff700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f633006b080 0x7f633006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.412+0000 7f6343fff700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f633006b080 0x7f633006d540 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f633800ba10 tx=0x7f6338008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.416+0000 7f6340ff9700 1 -- 172.21.15.153:0/1187384997 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f633c054870 con 0x7f634415e3e0 2023-11-24T08:05:29.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.606+0000 7f634a587700 1 -- 172.21.15.153:0/1187384997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63440ae720 con 0x7f634415e3e0 2023-11-24T08:05:29.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.606+0000 7f6340ff9700 1 -- 172.21.15.153:0/1187384997 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f633c01a0a0 con 0x7f634415e3e0 2023-11-24T08:05:29.609 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:05:29.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.608+0000 7f634a587700 1 -- 172.21.15.153:0/1187384997 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f633006b080 msgr2=0x7f633006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.608+0000 7f634a587700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f633006b080 0x7f633006d540 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f633800ba10 tx=0x7f6338008040 comp rx=0 tx=0).stop 2023-11-24T08:05:29.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.608+0000 7f634a587700 1 -- 172.21.15.153:0/1187384997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f634415e3e0 msgr2=0x7f634415b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.608+0000 7f634a587700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f634415e3e0 0x7f634415b130 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f633c007e70 tx=0x7f633c00d3b0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.608+0000 7f634a587700 1 -- 172.21.15.153:0/1187384997 shutdown_connections 2023-11-24T08:05:29.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.608+0000 7f634a587700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f633006b080 0x7f633006d540 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.608+0000 7f634a587700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f634415e3e0 0x7f634415b130 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.608+0000 7f634a587700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f634406c000 0x7f634414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.608+0000 7f634a587700 1 --2- 172.21.15.153:0/1187384997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63440b5ee0 0x7f63440cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.608+0000 7f634a587700 1 -- 172.21.15.153:0/1187384997 >> 172.21.15.153:0/1187384997 conn(0x7f6344071ac0 msgr2=0x7f63440b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.609+0000 7f634a587700 1 -- 172.21.15.153:0/1187384997 shutdown_connections 2023-11-24T08:05:29.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.609+0000 7f634a587700 1 -- 172.21.15.153:0/1187384997 wait complete. 2023-11-24T08:05:29.623 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:29.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.743+0000 7f446db05700 1 Processor -- start 2023-11-24T08:05:29.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.743+0000 7f446db05700 1 -- start start 2023-11-24T08:05:29.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.744+0000 7f446db05700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 0x7f44680b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.744+0000 7f446db05700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f44680adf00 0x7f446806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.744+0000 7f446db05700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44680af950 con 0x7f446806c540 2023-11-24T08:05:29.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.744+0000 7f446db05700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4468144a80 con 0x7f44680adf00 2023-11-24T08:05:29.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.744+0000 7f446db05700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446806c9b0 con 0x7f44681446a0 2023-11-24T08:05:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.744+0000 7f44677fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 0x7f44680b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.744+0000 7f4466ffd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f44680adf00 0x7f446806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.744+0000 7f44677fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 0x7f44680b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:49966/0 (socket says 172.21.15.153:49966) 2023-11-24T08:05:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.744+0000 7f44677fe700 1 -- 172.21.15.153:0/138980036 learned_addr learned my addr 172.21.15.153:0/138980036 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f44677fe700 1 -- 172.21.15.153:0/138980036 >> v2:172.21.15.164:3300/0 conn(0x7f44680adf00 msgr2=0x7f446806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f44677fe700 1 --2- 172.21.15.153:0/138980036 >> v2:172.21.15.164:3300/0 conn(0x7f44680adf00 0x7f446806c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f44677fe700 1 -- 172.21.15.153:0/138980036 >> v1:172.21.15.164:6789/0 conn(0x7f446806c540 legacy=0x7f446806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f44667fc700 1 -- 172.21.15.153:0/138980036 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296485817 0 0) 0x7f44680af950 con 0x7f446806c540 2023-11-24T08:05:29.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f44677fe700 1 -- 172.21.15.153:0/138980036 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44680afc30 con 0x7f44681446a0 2023-11-24T08:05:29.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f4466ffd700 1 --2- 172.21.15.153:0/138980036 >> v2:172.21.15.164:3300/0 conn(0x7f44680adf00 0x7f446806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:29.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f44677fe700 1 --2- 172.21.15.153:0/138980036 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 0x7f44680b5ae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f44580098f0 tx=0x7f4458009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7615e5ca56eccd68 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f44667fc700 1 -- 172.21.15.153:0/138980036 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458011830 con 0x7f44681446a0 2023-11-24T08:05:29.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f44667fc700 1 -- 172.21.15.153:0/138980036 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458011990 con 0x7f44681446a0 2023-11-24T08:05:29.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f44667fc700 1 -- 172.21.15.153:0/138980036 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458011d20 con 0x7f44681446a0 2023-11-24T08:05:29.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f446db05700 1 -- 172.21.15.153:0/138980036 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 msgr2=0x7f44680b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.745+0000 7f446db05700 1 --2- 172.21.15.153:0/138980036 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 0x7f44680b5ae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f44580098f0 tx=0x7f4458009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:29.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.746+0000 7f446db05700 1 -- 172.21.15.153:0/138980036 shutdown_connections 2023-11-24T08:05:29.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.746+0000 7f446db05700 1 --2- 172.21.15.153:0/138980036 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 0x7f44680b5ae0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.746+0000 7f446db05700 1 --2- 172.21.15.153:0/138980036 >> v2:172.21.15.164:3300/0 conn(0x7f44680adf00 0x7f446806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.746+0000 7f446db05700 1 -- 172.21.15.153:0/138980036 >> 172.21.15.153:0/138980036 conn(0x7f4468071b90 msgr2=0x7f4468071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.746+0000 7f446db05700 1 -- 172.21.15.153:0/138980036 shutdown_connections 2023-11-24T08:05:29.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.746+0000 7f446db05700 1 -- 172.21.15.153:0/138980036 wait complete. 2023-11-24T08:05:29.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.747+0000 7f446db05700 1 Processor -- start 2023-11-24T08:05:29.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.747+0000 7f446db05700 1 -- start start 2023-11-24T08:05:29.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f446db05700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f446806c540 0x7f44681534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f446db05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44680adf00 0x7f446813f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f446db05700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 0x7f446813fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f446db05700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4468141750 con 0x7f44680adf00 2023-11-24T08:05:29.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f446db05700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446813ad60 con 0x7f446806c540 2023-11-24T08:05:29.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f446db05700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4468153a20 con 0x7f44681446a0 2023-11-24T08:05:29.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f4466ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44680adf00 0x7f446813f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f4466ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44680adf00 0x7f446813f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37904/0 (socket says 172.21.15.153:37904) 2023-11-24T08:05:29.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f4466ffd700 1 -- 172.21.15.153:0/2795986796 learned_addr learned my addr 172.21.15.153:0/2795986796 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:29.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f44677fe700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f446806c540 0x7f44681534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f4467fff700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 0x7f446813fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f4466ffd700 1 -- 172.21.15.153:0/2795986796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 msgr2=0x7f446813fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f4466ffd700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 0x7f446813fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f4466ffd700 1 -- 172.21.15.153:0/2795986796 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f446806c540 msgr2=0x7f44681534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f4466ffd700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f446806c540 0x7f44681534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f4466ffd700 1 -- 172.21.15.153:0/2795986796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0094a0 con 0x7f44680adf00 2023-11-24T08:05:29.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f4466ffd700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44680adf00 0x7f446813f5a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f445c00ec10 tx=0x7f445c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f444ffff700 1 -- 172.21.15.153:0/2795986796 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c0097a0 con 0x7f44680adf00 2023-11-24T08:05:29.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f444ffff700 1 -- 172.21.15.153:0/2795986796 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c00c850 con 0x7f44680adf00 2023-11-24T08:05:29.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.748+0000 7f446db05700 1 -- 172.21.15.153:0/2795986796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4458009550 con 0x7f44680adf00 2023-11-24T08:05:29.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.749+0000 7f444ffff700 1 -- 172.21.15.153:0/2795986796 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c00cbe0 con 0x7f44680adf00 2023-11-24T08:05:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.749+0000 7f446db05700 1 -- 172.21.15.153:0/2795986796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4468140db0 con 0x7f44680adf00 2023-11-24T08:05:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.749+0000 7f446db05700 1 -- 172.21.15.153:0/2795986796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44680753f0 con 0x7f44680adf00 2023-11-24T08:05:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.750+0000 7f444ffff700 1 -- 172.21.15.153:0/2795986796 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f445c00cd40 con 0x7f44680adf00 2023-11-24T08:05:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.750+0000 7f444ffff700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f445406b080 0x7f445406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.750+0000 7f44677fe700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f445406b080 0x7f445406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.750+0000 7f444ffff700 1 -- 172.21.15.153:0/2795986796 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f445c089660 con 0x7f44680adf00 2023-11-24T08:05:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.751+0000 7f44677fe700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f445406b080 0x7f445406d540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4458000c00 tx=0x7f445801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.755+0000 7f444ffff700 1 -- 172.21.15.153:0/2795986796 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f445c054410 con 0x7f44680adf00 2023-11-24T08:05:29.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.985+0000 7f446db05700 1 -- 172.21.15.153:0/2795986796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4468141890 con 0x7f44680adf00 2023-11-24T08:05:29.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.986+0000 7f444ffff700 1 -- 172.21.15.153:0/2795986796 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f4468141890 con 0x7f44680adf00 2023-11-24T08:05:29.988 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:29.988 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2772655217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2772655217},{"type":"v1","addr":"172.21.15.164:6834","nonce":2772655217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2600357639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2600357639},{"type":"v1","addr":"172.21.15.153:6836","nonce":2600357639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5037,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3970007773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3970007773},{"type":"v1","addr":"172.21.15.153:6837","nonce":3970007773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:06.541701+0000","modified":"2023-11-24T08:05:09.566528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2977715145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2977715145},{"type":"v1","addr":"172.21.15.164:6835","nonce":2977715145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:05:29.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 -- 172.21.15.153:0/2795986796 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f445406b080 msgr2=0x7f445406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f445406b080 0x7f445406d540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4458000c00 tx=0x7f445801c040 comp rx=0 tx=0).stop 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 -- 172.21.15.153:0/2795986796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44680adf00 msgr2=0x7f446813f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44680adf00 0x7f446813f5a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f445c00ec10 tx=0x7f445c00ef20 comp rx=0 tx=0).stop 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 -- 172.21.15.153:0/2795986796 shutdown_connections 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44681446a0 0x7f446813fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f446806c540 0x7f44681534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f445406b080 0x7f445406d540 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 --2- 172.21.15.153:0/2795986796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44680adf00 0x7f446813f5a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 -- 172.21.15.153:0/2795986796 >> 172.21.15.153:0/2795986796 conn(0x7f4468071b90 msgr2=0x7f446806da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 -- 172.21.15.153:0/2795986796 shutdown_connections 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:29.988+0000 7f446db05700 1 -- 172.21.15.153:0/2795986796 wait complete. 2023-11-24T08:05:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 17 2023-11-24T08:05:30.002 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:30.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.122+0000 7f2d2df8b700 1 Processor -- start 2023-11-24T08:05:30.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.122+0000 7f2d2df8b700 1 -- start start 2023-11-24T08:05:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.123+0000 7f2d2df8b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2d28152cc0 0x7f2d2806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.123+0000 7f2d2df8b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2815c4b0 con 0x7f2d280b49a0 2023-11-24T08:05:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.123+0000 7f2d2df8b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2815c790 con 0x7f2d280d0630 2023-11-24T08:05:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.123+0000 7f2d2df8b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2815ca70 con 0x7f2d28152cc0 2023-11-24T08:05:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.123+0000 7f2d277fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2d28152cc0 0x7f2d2806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.123+0000 7f2d26ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2d280b49a0 0x7f2d280cff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44014/0 (socket says 172.21.15.153:44014) 2023-11-24T08:05:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.123+0000 7f2d26ffd700 1 -- 172.21.15.153:0/4155549715 learned_addr learned my addr 172.21.15.153:0/4155549715 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.123+0000 7f2d277fe700 1 -- 172.21.15.153:0/4155549715 >> v1:172.21.15.164:6789/0 conn(0x7f2d280d0630 legacy=0x7f2d2815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.123+0000 7f2d277fe700 1 -- 172.21.15.153:0/4155549715 >> v1:172.21.15.153:6789/0 conn(0x7f2d280b49a0 legacy=0x7f2d280cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.123+0000 7f2d277fe700 1 -- 172.21.15.153:0/4155549715 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2815cd50 con 0x7f2d28152cc0 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.123+0000 7f2d277fe700 1 --2- 172.21.15.153:0/4155549715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d28152cc0 0x7f2d2806c000 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009840 tx=0x7f2d1c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c15f18f58f5a709 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.124+0000 7f2d267fc700 1 -- 172.21.15.153:0/4155549715 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c011830 con 0x7f2d28152cc0 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.124+0000 7f2d267fc700 1 -- 172.21.15.153:0/4155549715 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c011990 con 0x7f2d28152cc0 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.124+0000 7f2d267fc700 1 -- 172.21.15.153:0/4155549715 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c011d20 con 0x7f2d28152cc0 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.124+0000 7f2d2df8b700 1 -- 172.21.15.153:0/4155549715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d28152cc0 msgr2=0x7f2d2806c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.124+0000 7f2d2df8b700 1 --2- 172.21.15.153:0/4155549715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d28152cc0 0x7f2d2806c000 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009840 tx=0x7f2d1c009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.124+0000 7f2d2df8b700 1 -- 172.21.15.153:0/4155549715 shutdown_connections 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.124+0000 7f2d2df8b700 1 --2- 172.21.15.153:0/4155549715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d28152cc0 0x7f2d2806c000 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.124+0000 7f2d2df8b700 1 -- 172.21.15.153:0/4155549715 >> 172.21.15.153:0/4155549715 conn(0x7f2d28071b90 msgr2=0x7f2d28071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.124+0000 7f2d2df8b700 1 -- 172.21.15.153:0/4155549715 shutdown_connections 2023-11-24T08:05:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.124+0000 7f2d2df8b700 1 -- 172.21.15.153:0/4155549715 wait complete. 2023-11-24T08:05:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.125+0000 7f2d2df8b700 1 Processor -- start 2023-11-24T08:05:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.126+0000 7f2d2df8b700 1 -- start start 2023-11-24T08:05:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.126+0000 7f2d2df8b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d280b49a0 0x7f2d2813db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.126+0000 7f2d2df8b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d280d0630 0x7f2d28140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.126+0000 7f2d2df8b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d28152cc0 0x7f2d2813e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.126+0000 7f2d2df8b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28155970 con 0x7f2d280d0630 2023-11-24T08:05:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.126+0000 7f2d2df8b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2813e050 con 0x7f2d280b49a0 2023-11-24T08:05:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.126+0000 7f2d2df8b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d281412f0 con 0x7f2d28152cc0 2023-11-24T08:05:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.126+0000 7f2d26ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d280d0630 0x7f2d28140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.126+0000 7f2d26ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d280d0630 0x7f2d28140db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37916/0 (socket says 172.21.15.153:37916) 2023-11-24T08:05:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.126+0000 7f2d26ffd700 1 -- 172.21.15.153:0/2170711369 learned_addr learned my addr 172.21.15.153:0/2170711369 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.126+0000 7f2d277fe700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d280b49a0 0x7f2d2813db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d27fff700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d28152cc0 0x7f2d2813e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d26ffd700 1 -- 172.21.15.153:0/2170711369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d28152cc0 msgr2=0x7f2d2813e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d26ffd700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d28152cc0 0x7f2d2813e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d26ffd700 1 -- 172.21.15.153:0/2170711369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d280b49a0 msgr2=0x7f2d2813db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d26ffd700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d280b49a0 0x7f2d2813db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d26ffd700 1 -- 172.21.15.153:0/2170711369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c0094a0 con 0x7f2d280d0630 2023-11-24T08:05:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d277fe700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d280b49a0 0x7f2d2813db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d26ffd700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d280d0630 0x7f2d28140db0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800c520 tx=0x7f2d1800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d0ffff700 1 -- 172.21.15.153:0/2170711369 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18005d70 con 0x7f2d280d0630 2023-11-24T08:05:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d0ffff700 1 -- 172.21.15.153:0/2170711369 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d180070d0 con 0x7f2d280d0630 2023-11-24T08:05:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d2df8b700 1 -- 172.21.15.153:0/2170711369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d28154cf0 con 0x7f2d280d0630 2023-11-24T08:05:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d0ffff700 1 -- 172.21.15.153:0/2170711369 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18007440 con 0x7f2d280d0630 2023-11-24T08:05:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.127+0000 7f2d2df8b700 1 -- 172.21.15.153:0/2170711369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d281552b0 con 0x7f2d280d0630 2023-11-24T08:05:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.128+0000 7f2d2df8b700 1 -- 172.21.15.153:0/2170711369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d280753f0 con 0x7f2d280d0630 2023-11-24T08:05:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.128+0000 7f2d0ffff700 1 -- 172.21.15.153:0/2170711369 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2d180075a0 con 0x7f2d280d0630 2023-11-24T08:05:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.129+0000 7f2d0ffff700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2d1406b0b0 0x7f2d1406d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.129+0000 7f2d0ffff700 1 -- 172.21.15.153:0/2170711369 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d18088c90 con 0x7f2d280d0630 2023-11-24T08:05:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.129+0000 7f2d277fe700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2d1406b0b0 0x7f2d1406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.129+0000 7f2d277fe700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2d1406b0b0 0x7f2d1406d570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0090b0 tx=0x7f2d1c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.133+0000 7f2d0ffff700 1 -- 172.21.15.153:0/2170711369 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d18053b70 con 0x7f2d280d0630 2023-11-24T08:05:30.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.330+0000 7f2d2df8b700 1 -- 172.21.15.153:0/2170711369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d28155ab0 con 0x7f2d280d0630 2023-11-24T08:05:30.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.331+0000 7f2d0ffff700 1 -- 172.21.15.153:0/2170711369 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f2d18080e60 con 0x7f2d280d0630 2023-11-24T08:05:30.332 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:30.333 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":32,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:08.158007+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:04.517274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:05.507139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 -- 172.21.15.153:0/2170711369 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2d1406b0b0 msgr2=0x7f2d1406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2d1406b0b0 0x7f2d1406d570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0090b0 tx=0x7f2d1c01c040 comp rx=0 tx=0).stop 2023-11-24T08:05:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 -- 172.21.15.153:0/2170711369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d280d0630 msgr2=0x7f2d28140db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d280d0630 0x7f2d28140db0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800c520 tx=0x7f2d1800c8e0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 -- 172.21.15.153:0/2170711369 shutdown_connections 2023-11-24T08:05:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d28152cc0 0x7f2d2813e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d280b49a0 0x7f2d2813db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2d1406b0b0 0x7f2d1406d570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 --2- 172.21.15.153:0/2170711369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d280d0630 0x7f2d28140db0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 -- 172.21.15.153:0/2170711369 >> 172.21.15.153:0/2170711369 conn(0x7f2d28071b90 msgr2=0x7f2d280adf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 -- 172.21.15.153:0/2170711369 shutdown_connections 2023-11-24T08:05:30.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.333+0000 7f2d2df8b700 1 -- 172.21.15.153:0/2170711369 wait complete. 2023-11-24T08:05:30.347 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:05:30.347 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:30.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.466+0000 7f7cabfbd700 1 Processor -- start 2023-11-24T08:05:30.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.466+0000 7f7cabfbd700 1 -- start start 2023-11-24T08:05:30.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7cabfbd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca41446a0 0x7f7ca40b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7cabfbd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7ca406c710 0x7f7ca40b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7cabfbd700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca40af950 con 0x7f7ca40adf00 2023-11-24T08:05:30.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7cabfbd700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca4144a80 con 0x7f7ca406c710 2023-11-24T08:05:30.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7cabfbd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40afc30 con 0x7f7ca41446a0 2023-11-24T08:05:30.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca9558700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7ca40adf00 0x7f7ca406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44028/0 (socket says 172.21.15.153:44028) 2023-11-24T08:05:30.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca9558700 1 -- 172.21.15.153:0/385600550 learned_addr learned my addr 172.21.15.153:0/385600550 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:30.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7caa55a700 1 --2- 172.21.15.153:0/385600550 >> v2:172.21.15.164:3300/0 conn(0x7f7ca406c710 0x7f7ca40b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca9d59700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca41446a0 0x7f7ca40b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564007736 0 0) 0x7f7ca40af950 con 0x7f7ca40adf00 2023-11-24T08:05:30.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c900035b0 con 0x7f7ca40adf00 2023-11-24T08:05:30.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4267998345 0 0) 0x7f7c900035b0 con 0x7f7ca40adf00 2023-11-24T08:05:30.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca41446a0 msgr2=0x7f7ca40b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:30.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca41446a0 0x7f7ca40b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 >> v2:172.21.15.164:3300/0 conn(0x7f7ca406c710 msgr2=0x7f7ca40b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:30.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 --2- 172.21.15.153:0/385600550 >> v2:172.21.15.164:3300/0 conn(0x7f7ca406c710 0x7f7ca40b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40aff10 con 0x7f7ca40adf00 2023-11-24T08:05:30.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f7c94001670 con 0x7f7ca40adf00 2023-11-24T08:05:30.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 >> v1:172.21.15.153:6789/0 conn(0x7f7ca40adf00 legacy=0x7f7ca406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca41446a0 0x7f7c90003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 0x7f7c90004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c90004d90 0x7f7c90005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4144a80 con 0x7f7c90003f80 2023-11-24T08:05:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40afc30 con 0x7f7c90004d90 2023-11-24T08:05:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.467+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9000ba10 con 0x7f7ca41446a0 2023-11-24T08:05:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7ca9558700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 0x7f7c90004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7ca9d59700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca41446a0 0x7f7c90003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7caa55a700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c90004d90 0x7f7c90005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7ca9558700 1 -- 172.21.15.153:0/385600550 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca41446a0 msgr2=0x7f7c90003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7ca9558700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca41446a0 0x7f7c90003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7ca9558700 1 -- 172.21.15.153:0/385600550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c90004d90 msgr2=0x7f7c90005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7ca9558700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c90004d90 0x7f7c90005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7ca9558700 1 -- 172.21.15.153:0/385600550 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900035b0 con 0x7f7c90003f80 2023-11-24T08:05:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7ca9558700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 0x7f7c90004850 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40ae2e0 tx=0x7f7c90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf978d9a8f4eccd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94007c60 con 0x7f7c90003f80 2023-11-24T08:05:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400ce20 con 0x7f7c90003f80 2023-11-24T08:05:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.468+0000 7f7ca8d57700 1 -- 172.21.15.153:0/385600550 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94005ba0 con 0x7f7c90003f80 2023-11-24T08:05:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.469+0000 7f7cabfbd700 1 -- 172.21.15.153:0/385600550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 msgr2=0x7f7c90004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.469+0000 7f7cabfbd700 1 --2- 172.21.15.153:0/385600550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 0x7f7c90004850 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40ae2e0 tx=0x7f7c90005880 comp rx=0 tx=0).stop 2023-11-24T08:05:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.469+0000 7f7caa55a700 1 -- 172.21.15.153:0/385600550 reap_dead start 2023-11-24T08:05:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.469+0000 7f7cabfbd700 1 -- 172.21.15.153:0/385600550 shutdown_connections 2023-11-24T08:05:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.469+0000 7f7cabfbd700 1 -- 172.21.15.153:0/385600550 >> 172.21.15.153:0/385600550 conn(0x7f7ca4071b90 msgr2=0x7f7ca4071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.469+0000 7f7cabfbd700 1 -- 172.21.15.153:0/385600550 shutdown_connections 2023-11-24T08:05:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.469+0000 7f7cabfbd700 1 -- 172.21.15.153:0/385600550 wait complete. 2023-11-24T08:05:30.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.470+0000 7f7cabfbd700 1 Processor -- start 2023-11-24T08:05:30.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.470+0000 7f7cabfbd700 1 -- start start 2023-11-24T08:05:30.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7cabfbd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 0x7f7ca41430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7cabfbd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca409db40 0x7f7ca41415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7cabfbd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ca4141b20 0x7f7ca40cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7cabfbd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4143600 con 0x7f7c90003f80 2023-11-24T08:05:30.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7cabfbd700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca413e9f0 con 0x7f7ca4141b20 2023-11-24T08:05:30.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7cabfbd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4140540 con 0x7f7ca409db40 2023-11-24T08:05:30.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7ca9d59700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 0x7f7ca41430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7ca9d59700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 0x7f7ca41430c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37934/0 (socket says 172.21.15.153:37934) 2023-11-24T08:05:30.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7ca9d59700 1 -- 172.21.15.153:0/2669016192 learned_addr learned my addr 172.21.15.153:0/2669016192 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:30.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7ca9558700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca409db40 0x7f7ca41415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7caa55a700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ca4141b20 0x7f7ca40cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7ca9d59700 1 -- 172.21.15.153:0/2669016192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca409db40 msgr2=0x7f7ca41415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7ca9d59700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca409db40 0x7f7ca41415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7ca9d59700 1 -- 172.21.15.153:0/2669016192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ca4141b20 msgr2=0x7f7ca40cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7ca9d59700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ca4141b20 0x7f7ca40cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7ca9d59700 1 -- 172.21.15.153:0/2669016192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca4140820 con 0x7f7c90003f80 2023-11-24T08:05:30.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7ca9d59700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 0x7f7ca41430c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0011aa0 tx=0x7f7ca0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7c9a7fc700 1 -- 172.21.15.153:0/2669016192 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0011ee0 con 0x7f7c90003f80 2023-11-24T08:05:30.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7c9a7fc700 1 -- 172.21.15.153:0/2669016192 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca000f940 con 0x7f7c90003f80 2023-11-24T08:05:30.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7cabfbd700 1 -- 172.21.15.153:0/2669016192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca4140b00 con 0x7f7c90003f80 2023-11-24T08:05:30.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7c9a7fc700 1 -- 172.21.15.153:0/2669016192 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000fcf0 con 0x7f7c90003f80 2023-11-24T08:05:30.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.471+0000 7f7cabfbd700 1 -- 172.21.15.153:0/2669016192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca41410c0 con 0x7f7c90003f80 2023-11-24T08:05:30.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.472+0000 7f7cabfbd700 1 -- 172.21.15.153:0/2669016192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca4141430 con 0x7f7c90003f80 2023-11-24T08:05:30.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.473+0000 7f7c9a7fc700 1 -- 172.21.15.153:0/2669016192 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7ca0014440 con 0x7f7c90003f80 2023-11-24T08:05:30.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.473+0000 7f7c9a7fc700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7c8806b070 0x7f7c8806d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.473+0000 7f7c9a7fc700 1 -- 172.21.15.153:0/2669016192 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ca0089f00 con 0x7f7c90003f80 2023-11-24T08:05:30.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.473+0000 7f7ca9558700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7c8806b070 0x7f7c8806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.474+0000 7f7ca9558700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7c8806b070 0x7f7c8806d530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c94015040 tx=0x7f7c9400a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.478+0000 7f7c9a7fc700 1 -- 172.21.15.153:0/2669016192 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ca0054ea0 con 0x7f7c90003f80 2023-11-24T08:05:30.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.710+0000 7f7cabfbd700 1 -- 172.21.15.153:0/2669016192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ca40753f0 con 0x7f7c90003f80 2023-11-24T08:05:30.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.711+0000 7f7c9a7fc700 1 -- 172.21.15.153:0/2669016192 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f7ca00584c0 con 0x7f7c90003f80 2023-11-24T08:05:30.713 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:30.713 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2772655217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2772655217},{"type":"v1","addr":"172.21.15.164:6834","nonce":2772655217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2600357639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2600357639},{"type":"v1","addr":"172.21.15.153:6836","nonce":2600357639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5037,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3970007773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3970007773},{"type":"v1","addr":"172.21.15.153:6837","nonce":3970007773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:06.541701+0000","modified":"2023-11-24T08:05:09.566528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2977715145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2977715145},{"type":"v1","addr":"172.21.15.164:6835","nonce":2977715145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:05:30.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 -- 172.21.15.153:0/2669016192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7c8806b070 msgr2=0x7f7c8806d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7c8806b070 0x7f7c8806d530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c94015040 tx=0x7f7c9400a000 comp rx=0 tx=0).stop 2023-11-24T08:05:30.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 -- 172.21.15.153:0/2669016192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 msgr2=0x7f7ca41430c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 0x7f7ca41430c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0011aa0 tx=0x7f7ca0011db0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 -- 172.21.15.153:0/2669016192 shutdown_connections 2023-11-24T08:05:30.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ca4141b20 0x7f7ca40cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7c8806b070 0x7f7c8806d530 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c90003f80 0x7f7ca41430c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 --2- 172.21.15.153:0/2669016192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ca409db40 0x7f7ca41415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 -- 172.21.15.153:0/2669016192 >> 172.21.15.153:0/2669016192 conn(0x7f7ca4071b90 msgr2=0x7f7ca406c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 -- 172.21.15.153:0/2669016192 shutdown_connections 2023-11-24T08:05:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.713+0000 7f7cabfbd700 1 -- 172.21.15.153:0/2669016192 wait complete. 2023-11-24T08:05:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 17 2023-11-24T08:05:30.727 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:30.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.846+0000 7f1d2eaa5700 1 Processor -- start 2023-11-24T08:05:30.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.846+0000 7f1d2eaa5700 1 -- start start 2023-11-24T08:05:30.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2eaa5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d2815e080 0x7f1d280b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2eaa5700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1d280af4d0 0x7f1d280afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2eaa5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d2806c000 0x7f1d2806c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2eaa5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d280af0b0 con 0x7f1d2815e080 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2eaa5700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2806c9f0 con 0x7f1d280af4d0 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2eaa5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280b05a0 con 0x7f1d2806c000 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2c841700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d2815e080 0x7f1d280b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2c841700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d2815e080 0x7f1d280b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37942/0 (socket says 172.21.15.153:37942) 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2c841700 1 -- 172.21.15.153:0/2043425800 learned_addr learned my addr 172.21.15.153:0/2043425800 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d27fff700 1 --2- 172.21.15.153:0/2043425800 >> v2:172.21.15.164:3300/0 conn(0x7f1d280af4d0 0x7f1d280afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2d042700 1 --2- 172.21.15.153:0/2043425800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d2806c000 0x7f1d2806c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2c841700 1 -- 172.21.15.153:0/2043425800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d2806c000 msgr2=0x7f1d2806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2c841700 1 --2- 172.21.15.153:0/2043425800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d2806c000 0x7f1d2806c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2c841700 1 -- 172.21.15.153:0/2043425800 >> v2:172.21.15.164:3300/0 conn(0x7f1d280af4d0 msgr2=0x7f1d280afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2c841700 1 --2- 172.21.15.153:0/2043425800 >> v2:172.21.15.164:3300/0 conn(0x7f1d280af4d0 0x7f1d280afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2c841700 1 -- 172.21.15.153:0/2043425800 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d280ae430 con 0x7f1d2815e080 2023-11-24T08:05:30.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d27fff700 1 --2- 172.21.15.153:0/2043425800 >> v2:172.21.15.164:3300/0 conn(0x7f1d280af4d0 0x7f1d280afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:30.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.847+0000 7f1d2c841700 1 --2- 172.21.15.153:0/2043425800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d2815e080 0x7f1d280b5050 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d2806e4e0 tx=0x7f1d1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888d41b1c175296b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d277fe700 1 -- 172.21.15.153:0/2043425800 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c00b870 con 0x7f1d2815e080 2023-11-24T08:05:30.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d277fe700 1 -- 172.21.15.153:0/2043425800 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c00b9d0 con 0x7f1d2815e080 2023-11-24T08:05:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d277fe700 1 -- 172.21.15.153:0/2043425800 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c00bd60 con 0x7f1d2815e080 2023-11-24T08:05:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/2043425800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d2815e080 msgr2=0x7f1d280b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d2eaa5700 1 --2- 172.21.15.153:0/2043425800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d2815e080 0x7f1d280b5050 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d2806e4e0 tx=0x7f1d1c009bd0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/2043425800 shutdown_connections 2023-11-24T08:05:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d2eaa5700 1 --2- 172.21.15.153:0/2043425800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d2806c000 0x7f1d2806c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d2eaa5700 1 --2- 172.21.15.153:0/2043425800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d2815e080 0x7f1d280b5050 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d2eaa5700 1 --2- 172.21.15.153:0/2043425800 >> v2:172.21.15.164:3300/0 conn(0x7f1d280af4d0 0x7f1d280afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/2043425800 >> 172.21.15.153:0/2043425800 conn(0x7f1d28071b90 msgr2=0x7f1d28071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/2043425800 shutdown_connections 2023-11-24T08:05:30.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.848+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/2043425800 wait complete. 2023-11-24T08:05:30.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.849+0000 7f1d2eaa5700 1 Processor -- start 2023-11-24T08:05:30.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.849+0000 7f1d2eaa5700 1 -- start start 2023-11-24T08:05:30.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.850+0000 7f1d2eaa5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d2806c000 0x7f1d28151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.850+0000 7f1d2eaa5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d280af4d0 0x7f1d2815f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.850+0000 7f1d2eaa5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d2815e080 0x7f1d28154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.850+0000 7f1d2eaa5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28156840 con 0x7f1d2815e080 2023-11-24T08:05:30.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.850+0000 7f1d2eaa5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28151e80 con 0x7f1d280af4d0 2023-11-24T08:05:30.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.850+0000 7f1d2eaa5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28157340 con 0x7f1d2806c000 2023-11-24T08:05:30.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.850+0000 7f1d2d042700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d2815e080 0x7f1d28154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.850+0000 7f1d2d042700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d2815e080 0x7f1d28154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37950/0 (socket says 172.21.15.153:37950) 2023-11-24T08:05:30.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.850+0000 7f1d2d042700 1 -- 172.21.15.153:0/1409959800 learned_addr learned my addr 172.21.15.153:0/1409959800 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d2c841700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d2806c000 0x7f1d28151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d27fff700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d280af4d0 0x7f1d2815f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d2d042700 1 -- 172.21.15.153:0/1409959800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d2806c000 msgr2=0x7f1d28151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d2d042700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d2806c000 0x7f1d28151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d2d042700 1 -- 172.21.15.153:0/1409959800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d280af4d0 msgr2=0x7f1d2815f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d2d042700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d280af4d0 0x7f1d2815f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d2d042700 1 -- 172.21.15.153:0/1409959800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c009550 con 0x7f1d2815e080 2023-11-24T08:05:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d2c841700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d2806c000 0x7f1d28151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d27fff700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d280af4d0 0x7f1d2815f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d2d042700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d2815e080 0x7f1d28154630 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d20007e60 tx=0x7f1d2000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d257fa700 1 -- 172.21.15.153:0/1409959800 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000ede0 con 0x7f1d2815e080 2023-11-24T08:05:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d257fa700 1 -- 172.21.15.153:0/1409959800 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d20014420 con 0x7f1d2815e080 2023-11-24T08:05:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d257fa700 1 -- 172.21.15.153:0/1409959800 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d200147d0 con 0x7f1d2815e080 2023-11-24T08:05:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/1409959800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d28157620 con 0x7f1d2815e080 2023-11-24T08:05:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.851+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/1409959800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d28157be0 con 0x7f1d2815e080 2023-11-24T08:05:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.852+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/1409959800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d28157da0 con 0x7f1d2815e080 2023-11-24T08:05:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.853+0000 7f1d257fa700 1 -- 172.21.15.153:0/1409959800 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1d20014930 con 0x7f1d2815e080 2023-11-24T08:05:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.853+0000 7f1d257fa700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d0c06b080 0x7f1d0c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.853+0000 7f1d257fa700 1 -- 172.21.15.153:0/1409959800 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d2008a020 con 0x7f1d2815e080 2023-11-24T08:05:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.853+0000 7f1d2c841700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d0c06b080 0x7f1d0c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.853+0000 7f1d2c841700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d0c06b080 0x7f1d0c06d540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009130 tx=0x7f1d1c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:30.857+0000 7f1d257fa700 1 -- 172.21.15.153:0/1409959800 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d20054e50 con 0x7f1d2815e080 2023-11-24T08:05:31.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.091+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/1409959800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d280753f0 con 0x7f1d2815e080 2023-11-24T08:05:31.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.092+0000 7f1d257fa700 1 -- 172.21.15.153:0/1409959800 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f1d20058470 con 0x7f1d2815e080 2023-11-24T08:05:31.095 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:31.095 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2772655217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2772655217},{"type":"v1","addr":"172.21.15.164:6834","nonce":2772655217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2600357639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2600357639},{"type":"v1","addr":"172.21.15.153:6836","nonce":2600357639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5037,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3970007773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3970007773},{"type":"v1","addr":"172.21.15.153:6837","nonce":3970007773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:06.541701+0000","modified":"2023-11-24T08:05:09.566528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2977715145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2977715145},{"type":"v1","addr":"172.21.15.164:6835","nonce":2977715145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:05:31.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/1409959800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d0c06b080 msgr2=0x7f1d0c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d0c06b080 0x7f1d0c06d540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009130 tx=0x7f1d1c008030 comp rx=0 tx=0).stop 2023-11-24T08:05:31.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/1409959800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d2815e080 msgr2=0x7f1d28154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d2815e080 0x7f1d28154630 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d20007e60 tx=0x7f1d2000e3c0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/1409959800 shutdown_connections 2023-11-24T08:05:31.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d0c06b080 0x7f1d0c06d540 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d2815e080 0x7f1d28154630 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d2806c000 0x7f1d28151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 --2- 172.21.15.153:0/1409959800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d280af4d0 0x7f1d2815f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/1409959800 >> 172.21.15.153:0/1409959800 conn(0x7f1d28071b90 msgr2=0x7f1d28073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/1409959800 shutdown_connections 2023-11-24T08:05:31.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.094+0000 7f1d2eaa5700 1 -- 172.21.15.153:0/1409959800 wait complete. 2023-11-24T08:05:31.097 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 17 2023-11-24T08:05:31.108 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:31.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.229+0000 7fc2c96d9700 1 Processor -- start 2023-11-24T08:05:31.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.229+0000 7fc2c96d9700 1 -- start start 2023-11-24T08:05:31.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.230+0000 7fc2c96d9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc2c406c710 0x7fc2c40b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.230+0000 7fc2c96d9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2c40af4d0 0x7fc2c40afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.230+0000 7fc2c96d9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c40ae430 con 0x7fc2c415e080 2023-11-24T08:05:31.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.230+0000 7fc2c96d9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c40af0b0 con 0x7fc2c406c710 2023-11-24T08:05:31.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.230+0000 7fc2c96d9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c40b05a0 con 0x7fc2c40af4d0 2023-11-24T08:05:31.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.230+0000 7fc2c27fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc2c406c710 0x7fc2c40b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.230+0000 7fc2c27fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc2c406c710 0x7fc2c40b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37956/0 (socket says 172.21.15.153:37956) 2023-11-24T08:05:31.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.230+0000 7fc2c27fc700 1 -- 172.21.15.153:0/893520919 learned_addr learned my addr 172.21.15.153:0/893520919 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:31.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.231+0000 7fc2c27fc700 1 -- 172.21.15.153:0/893520919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2c40af4d0 msgr2=0x7fc2c40afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.231+0000 7fc2c27fc700 1 --2- 172.21.15.153:0/893520919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2c40af4d0 0x7fc2c40afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.231+0000 7fc2c27fc700 1 -- 172.21.15.153:0/893520919 >> v1:172.21.15.164:6789/0 conn(0x7fc2c415e080 legacy=0x7fc2c406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.231+0000 7fc2c27fc700 1 -- 172.21.15.153:0/893520919 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c40ae710 con 0x7fc2c406c710 2023-11-24T08:05:31.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.231+0000 7fc2c27fc700 1 --2- 172.21.15.153:0/893520919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2c406c710 0x7fc2c40b5050 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40098f0 tx=0x7fc2b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b07e7d09be9b544 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.231+0000 7fc2c1ffb700 1 -- 172.21.15.153:0/893520919 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4004230 con 0x7fc2c406c710 2023-11-24T08:05:31.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.231+0000 7fc2c1ffb700 1 -- 172.21.15.153:0/893520919 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b4004390 con 0x7fc2c406c710 2023-11-24T08:05:31.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.231+0000 7fc2c1ffb700 1 -- 172.21.15.153:0/893520919 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b40036a0 con 0x7fc2c406c710 2023-11-24T08:05:31.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.231+0000 7fc2c96d9700 1 -- 172.21.15.153:0/893520919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2c406c710 msgr2=0x7fc2c40b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.231+0000 7fc2c96d9700 1 --2- 172.21.15.153:0/893520919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2c406c710 0x7fc2c40b5050 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40098f0 tx=0x7fc2b4009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:31.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.232+0000 7fc2c96d9700 1 -- 172.21.15.153:0/893520919 shutdown_connections 2023-11-24T08:05:31.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.232+0000 7fc2c96d9700 1 --2- 172.21.15.153:0/893520919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2c40af4d0 0x7fc2c40afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.232+0000 7fc2c96d9700 1 --2- 172.21.15.153:0/893520919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2c406c710 0x7fc2c40b5050 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.232+0000 7fc2c96d9700 1 -- 172.21.15.153:0/893520919 >> 172.21.15.153:0/893520919 conn(0x7fc2c4071b90 msgr2=0x7fc2c4071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.232+0000 7fc2c96d9700 1 -- 172.21.15.153:0/893520919 shutdown_connections 2023-11-24T08:05:31.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.232+0000 7fc2c96d9700 1 -- 172.21.15.153:0/893520919 wait complete. 2023-11-24T08:05:31.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.233+0000 7fc2c96d9700 1 Processor -- start 2023-11-24T08:05:31.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.233+0000 7fc2c96d9700 1 -- start start 2023-11-24T08:05:31.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c96d9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2c406c710 0x7fc2c4149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c96d9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2c40af4d0 0x7fc2c415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c96d9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2c415e080 0x7fc2c40b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c96d9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c415feb0 con 0x7fc2c415e080 2023-11-24T08:05:31.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c96d9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4149c70 con 0x7fc2c40af4d0 2023-11-24T08:05:31.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c96d9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c415ed60 con 0x7fc2c406c710 2023-11-24T08:05:31.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2c415e080 0x7fc2c40b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2c415e080 0x7fc2c40b1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37964/0 (socket says 172.21.15.153:37964) 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c37fe700 1 -- 172.21.15.153:0/2433940504 learned_addr learned my addr 172.21.15.153:0/2433940504 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c27fc700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2c40af4d0 0x7fc2c415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c2ffd700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2c406c710 0x7fc2c4149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c37fe700 1 -- 172.21.15.153:0/2433940504 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2c406c710 msgr2=0x7fc2c4149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c37fe700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2c406c710 0x7fc2c4149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c37fe700 1 -- 172.21.15.153:0/2433940504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2c40af4d0 msgr2=0x7fc2c415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c37fe700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2c40af4d0 0x7fc2c415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c37fe700 1 -- 172.21.15.153:0/2433940504 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b4009550 con 0x7fc2c415e080 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c37fe700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2c415e080 0x7fc2c40b1360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00b970 tx=0x7fc2bc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2ab7fe700 1 -- 172.21.15.153:0/2433940504 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00d860 con 0x7fc2c415e080 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2ab7fe700 1 -- 172.21.15.153:0/2433940504 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc00d9e0 con 0x7fc2c415e080 2023-11-24T08:05:31.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2ab7fe700 1 -- 172.21.15.153:0/2433940504 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00dd90 con 0x7fc2c415e080 2023-11-24T08:05:31.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c96d9700 1 -- 172.21.15.153:0/2433940504 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c415f040 con 0x7fc2c415e080 2023-11-24T08:05:31.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.234+0000 7fc2c96d9700 1 -- 172.21.15.153:0/2433940504 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c415fad0 con 0x7fc2c415e080 2023-11-24T08:05:31.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.235+0000 7fc2c96d9700 1 -- 172.21.15.153:0/2433940504 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c40753f0 con 0x7fc2c415e080 2023-11-24T08:05:31.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.236+0000 7fc2ab7fe700 1 -- 172.21.15.153:0/2433940504 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc2bc00e430 con 0x7fc2c415e080 2023-11-24T08:05:31.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.236+0000 7fc2ab7fe700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc2b006b080 0x7fc2b006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.236+0000 7fc2ab7fe700 1 -- 172.21.15.153:0/2433940504 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2bc006e40 con 0x7fc2c415e080 2023-11-24T08:05:31.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.236+0000 7fc2c2ffd700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc2b006b080 0x7fc2b006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.237+0000 7fc2c2ffd700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc2b006b080 0x7fc2b006d540 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009960 tx=0x7fc2b80090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.241+0000 7fc2ab7fe700 1 -- 172.21.15.153:0/2433940504 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc2bc0548a0 con 0x7fc2c415e080 2023-11-24T08:05:31.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.432+0000 7fc2c96d9700 1 -- 172.21.15.153:0/2433940504 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2c415fff0 con 0x7fc2c415e080 2023-11-24T08:05:31.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.433+0000 7fc2ab7fe700 1 -- 172.21.15.153:0/2433940504 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fc2c415fff0 con 0x7fc2c415e080 2023-11-24T08:05:31.435 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:31.435 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":32,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:08.158007+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:04.517274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:05.507139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 -- 172.21.15.153:0/2433940504 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc2b006b080 msgr2=0x7fc2b006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc2b006b080 0x7fc2b006d540 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009960 tx=0x7fc2b80090e0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 -- 172.21.15.153:0/2433940504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2c415e080 msgr2=0x7fc2c40b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2c415e080 0x7fc2c40b1360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00b970 tx=0x7fc2bc00bc80 comp rx=0 tx=0).stop 2023-11-24T08:05:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 -- 172.21.15.153:0/2433940504 shutdown_connections 2023-11-24T08:05:31.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc2b006b080 0x7fc2b006d540 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2c415e080 0x7fc2c40b1360 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2c406c710 0x7fc2c4149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 --2- 172.21.15.153:0/2433940504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2c40af4d0 0x7fc2c415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 -- 172.21.15.153:0/2433940504 >> 172.21.15.153:0/2433940504 conn(0x7fc2c4071b90 msgr2=0x7fc2c406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 -- 172.21.15.153:0/2433940504 shutdown_connections 2023-11-24T08:05:31.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.435+0000 7fc2c96d9700 1 -- 172.21.15.153:0/2433940504 wait complete. 2023-11-24T08:05:31.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:05:31.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.569+0000 7fabe4f4d700 1 Processor -- start 2023-11-24T08:05:31.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.569+0000 7fabe4f4d700 1 -- start start 2023-11-24T08:05:31.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.570+0000 7fabe4f4d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabe0152cc0 0x7fabe006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.570+0000 7fabe4f4d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fabe00d0630 0x7fabe006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.570+0000 7fabe4f4d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe015c4b0 con 0x7fabe00b49a0 2023-11-24T08:05:31.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.570+0000 7fabe4f4d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe015c790 con 0x7fabe00d0630 2023-11-24T08:05:31.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.570+0000 7fabe4f4d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe015ca70 con 0x7fabe0152cc0 2023-11-24T08:05:31.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.570+0000 7fabded9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fabe00d0630 0x7fabe006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.570+0000 7fabddd9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fabe00b49a0 0x7fabe00cff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44072/0 (socket says 172.21.15.153:44072) 2023-11-24T08:05:31.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.570+0000 7fabddd9b700 1 -- 172.21.15.153:0/1739443575 learned_addr learned my addr 172.21.15.153:0/1739443575 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:31.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabde59c700 1 --2- 172.21.15.153:0/1739443575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabe0152cc0 0x7fabe006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabded9d700 1 -- 172.21.15.153:0/1739443575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabe0152cc0 msgr2=0x7fabe006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabded9d700 1 --2- 172.21.15.153:0/1739443575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabe0152cc0 0x7fabe006c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabded9d700 1 -- 172.21.15.153:0/1739443575 >> v1:172.21.15.153:6789/0 conn(0x7fabe00b49a0 legacy=0x7fabe00cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabded9d700 1 -- 172.21.15.153:0/1739443575 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe015cd50 con 0x7fabe00d0630 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabdd59a700 1 -- 172.21.15.153:0/1739443575 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662330417 0 0) 0x7fabe015c4b0 con 0x7fabe00b49a0 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabde59c700 1 --2- 172.21.15.153:0/1739443575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabe0152cc0 0x7fabe006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabded9d700 1 --2- 172.21.15.153:0/1739443575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabe00d0630 0x7fabe006c540 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009d90 tx=0x7fabd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3bcd695968b75c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabdd59a700 1 -- 172.21.15.153:0/1739443575 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800e070 con 0x7fabe00d0630 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabdd59a700 1 -- 172.21.15.153:0/1739443575 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd800bbd0 con 0x7fabe00d0630 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabdd59a700 1 -- 172.21.15.153:0/1739443575 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8012430 con 0x7fabe00d0630 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabe4f4d700 1 -- 172.21.15.153:0/1739443575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabe00d0630 msgr2=0x7fabe006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.571+0000 7fabe4f4d700 1 --2- 172.21.15.153:0/1739443575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabe00d0630 0x7fabe006c540 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009d90 tx=0x7fabd800b330 comp rx=0 tx=0).stop 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.572+0000 7fabe4f4d700 1 -- 172.21.15.153:0/1739443575 shutdown_connections 2023-11-24T08:05:31.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.572+0000 7fabe4f4d700 1 --2- 172.21.15.153:0/1739443575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabe0152cc0 0x7fabe006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.572+0000 7fabe4f4d700 1 --2- 172.21.15.153:0/1739443575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabe00d0630 0x7fabe006c540 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.572+0000 7fabe4f4d700 1 -- 172.21.15.153:0/1739443575 >> 172.21.15.153:0/1739443575 conn(0x7fabe0071b90 msgr2=0x7fabe0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.572+0000 7fabe4f4d700 1 -- 172.21.15.153:0/1739443575 shutdown_connections 2023-11-24T08:05:31.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.572+0000 7fabe4f4d700 1 -- 172.21.15.153:0/1739443575 wait complete. 2023-11-24T08:05:31.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.573+0000 7fabe4f4d700 1 Processor -- start 2023-11-24T08:05:31.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.573+0000 7fabe4f4d700 1 -- start start 2023-11-24T08:05:31.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabe4f4d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabe00b49a0 0x7fabe014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabe4f4d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabe00d0630 0x7fabe006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabe4f4d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabe0152cc0 0x7fabe00b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabe4f4d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe01535f0 con 0x7fabe00d0630 2023-11-24T08:05:31.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabe4f4d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe014aaf0 con 0x7fabe0152cc0 2023-11-24T08:05:31.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabe4f4d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe006da30 con 0x7fabe00b49a0 2023-11-24T08:05:31.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabddd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabe00d0630 0x7fabe006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabddd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabe00d0630 0x7fabe006f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37976/0 (socket says 172.21.15.153:37976) 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabddd9b700 1 -- 172.21.15.153:0/2193789630 learned_addr learned my addr 172.21.15.153:0/2193789630 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabde59c700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabe00b49a0 0x7fabe014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabded9d700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabe0152cc0 0x7fabe00b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabddd9b700 1 -- 172.21.15.153:0/2193789630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabe00b49a0 msgr2=0x7fabe014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabddd9b700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabe00b49a0 0x7fabe014a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabddd9b700 1 -- 172.21.15.153:0/2193789630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabe0152cc0 msgr2=0x7fabe00b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabddd9b700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabe0152cc0 0x7fabe00b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabddd9b700 1 -- 172.21.15.153:0/2193789630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009a70 con 0x7fabe00d0630 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabddd9b700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabe00d0630 0x7fabe006f2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fabd00011e0 tx=0x7fabd000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabceffd700 1 -- 172.21.15.153:0/2193789630 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0004c80 con 0x7fabe00d0630 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.574+0000 7fabceffd700 1 -- 172.21.15.153:0/2193789630 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0004e00 con 0x7fabe00d0630 2023-11-24T08:05:31.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.575+0000 7fabe4f4d700 1 -- 172.21.15.153:0/2193789630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe006dd10 con 0x7fabe00d0630 2023-11-24T08:05:31.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.575+0000 7fabceffd700 1 -- 172.21.15.153:0/2193789630 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0007310 con 0x7fabe00d0630 2023-11-24T08:05:31.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.575+0000 7fabe4f4d700 1 -- 172.21.15.153:0/2193789630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe006e2d0 con 0x7fabe00d0630 2023-11-24T08:05:31.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.575+0000 7fabe4f4d700 1 -- 172.21.15.153:0/2193789630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe00753f0 con 0x7fabe00d0630 2023-11-24T08:05:31.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.576+0000 7fabceffd700 1 -- 172.21.15.153:0/2193789630 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fabd0007470 con 0x7fabe00d0630 2023-11-24T08:05:31.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.576+0000 7fabceffd700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabc006b080 0x7fabc006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.577+0000 7fabceffd700 1 -- 172.21.15.153:0/2193789630 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabd0089530 con 0x7fabe00d0630 2023-11-24T08:05:31.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.577+0000 7fabde59c700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabc006b080 0x7fabc006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.577+0000 7fabde59c700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabc006b080 0x7fabc006d540 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fabe01565e0 tx=0x7fabd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.581+0000 7fabceffd700 1 -- 172.21.15.153:0/2193789630 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fabd0054360 con 0x7fabe00d0630 2023-11-24T08:05:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.815+0000 7fabe4f4d700 1 -- 172.21.15.153:0/2193789630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fabe0067f60 con 0x7fabe00d0630 2023-11-24T08:05:31.817 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-11-24T08:05:31.816+0000 7f3f0fc90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:05:31.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.817+0000 7fabceffd700 1 -- 172.21.15.153:0/2193789630 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fabd0057980 con 0x7fabe00d0630 2023-11-24T08:05:31.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 -- 172.21.15.153:0/2193789630 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabc006b080 msgr2=0x7fabc006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabc006b080 0x7fabc006d540 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fabe01565e0 tx=0x7fabd4008040 comp rx=0 tx=0).stop 2023-11-24T08:05:31.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 -- 172.21.15.153:0/2193789630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabe00d0630 msgr2=0x7fabe006f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabe00d0630 0x7fabe006f2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fabd00011e0 tx=0x7fabd000ca30 comp rx=0 tx=0).stop 2023-11-24T08:05:31.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 -- 172.21.15.153:0/2193789630 shutdown_connections 2023-11-24T08:05:31.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabe0152cc0 0x7fabe00b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabe00b49a0 0x7fabe014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fabc006b080 0x7fabc006d540 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 --2- 172.21.15.153:0/2193789630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabe00d0630 0x7fabe006f2f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 -- 172.21.15.153:0/2193789630 >> 172.21.15.153:0/2193789630 conn(0x7fabe0071b90 msgr2=0x7fabe0152500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 -- 172.21.15.153:0/2193789630 shutdown_connections 2023-11-24T08:05:31.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.820+0000 7fabe4f4d700 1 -- 172.21.15.153:0/2193789630 wait complete. 2023-11-24T08:05:31.824 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:05:31.834 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:05:31.862 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-11-24T08:05:31.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.956+0000 7fd76b5f7700 1 Processor -- start 2023-11-24T08:05:31.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.957+0000 7fd76b5f7700 1 -- start start 2023-11-24T08:05:31.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.957+0000 7fd76b5f7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd76415e290 0x7fd7640ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.957+0000 7fd76b5f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7640ad870 0x7fd76406f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.957+0000 7fd76b5f7700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76406e400 con 0x7fd7640aedc0 2023-11-24T08:05:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.957+0000 7fd76b5f7700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76406e630 con 0x7fd7640ad870 2023-11-24T08:05:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.957+0000 7fd76b5f7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76406e910 con 0x7fd76415e290 2023-11-24T08:05:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd769b94700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7640ad870 0x7fd76406f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd769b94700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7640ad870 0x7fd76406f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37986/0 (socket says 172.21.15.153:37986) 2023-11-24T08:05:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd769b94700 1 -- 172.21.15.153:0/3997135296 learned_addr learned my addr 172.21.15.153:0/3997135296 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd768b92700 1 --2- 172.21.15.153:0/3997135296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd76415e290 0x7fd7640ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd769b94700 1 -- 172.21.15.153:0/3997135296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd76415e290 msgr2=0x7fd7640ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd769b94700 1 --2- 172.21.15.153:0/3997135296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd76415e290 0x7fd7640ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd769b94700 1 -- 172.21.15.153:0/3997135296 >> v1:172.21.15.164:6789/0 conn(0x7fd7640aedc0 legacy=0x7fd7640af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd769b94700 1 -- 172.21.15.153:0/3997135296 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76406ebf0 con 0x7fd7640ad870 2023-11-24T08:05:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd769b94700 1 --2- 172.21.15.153:0/3997135296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7640ad870 0x7fd76406f6d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009e50 tx=0x7fd75c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498a88c9260bb722 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd75bfff700 1 -- 172.21.15.153:0/3997135296 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00e070 con 0x7fd7640ad870 2023-11-24T08:05:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd75bfff700 1 -- 172.21.15.153:0/3997135296 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c00b910 con 0x7fd7640ad870 2023-11-24T08:05:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.958+0000 7fd75bfff700 1 -- 172.21.15.153:0/3997135296 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00bcc0 con 0x7fd7640ad870 2023-11-24T08:05:31.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.959+0000 7fd76b5f7700 1 -- 172.21.15.153:0/3997135296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7640ad870 msgr2=0x7fd76406f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.959+0000 7fd76b5f7700 1 --2- 172.21.15.153:0/3997135296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7640ad870 0x7fd76406f6d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009e50 tx=0x7fd75c00b330 comp rx=0 tx=0).stop 2023-11-24T08:05:31.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.959+0000 7fd76b5f7700 1 -- 172.21.15.153:0/3997135296 shutdown_connections 2023-11-24T08:05:31.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.959+0000 7fd76b5f7700 1 --2- 172.21.15.153:0/3997135296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7640ad870 0x7fd76406f6d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.959+0000 7fd76b5f7700 1 --2- 172.21.15.153:0/3997135296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd76415e290 0x7fd7640ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.959+0000 7fd76b5f7700 1 -- 172.21.15.153:0/3997135296 >> 172.21.15.153:0/3997135296 conn(0x7fd7640b2050 msgr2=0x7fd7640b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.959+0000 7fd76b5f7700 1 -- 172.21.15.153:0/3997135296 shutdown_connections 2023-11-24T08:05:31.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.959+0000 7fd76b5f7700 1 -- 172.21.15.153:0/3997135296 wait complete. 2023-11-24T08:05:31.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.960+0000 7fd76b5f7700 1 Processor -- start 2023-11-24T08:05:31.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.960+0000 7fd76b5f7700 1 -- start start 2023-11-24T08:05:31.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd76b5f7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7640ad870 0x7fd764156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd76b5f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7640aedc0 0x7fd764158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd76b5f7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd76415e290 0x7fd76415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd76b5f7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd764161230 con 0x7fd7640aedc0 2023-11-24T08:05:31.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd76b5f7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd764161510 con 0x7fd76415e290 2023-11-24T08:05:31.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd76b5f7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd764156490 con 0x7fd7640ad870 2023-11-24T08:05:31.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd768b92700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7640aedc0 0x7fd764158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd768b92700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7640aedc0 0x7fd764158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37990/0 (socket says 172.21.15.153:37990) 2023-11-24T08:05:31.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd768b92700 1 -- 172.21.15.153:0/756244282 learned_addr learned my addr 172.21.15.153:0/756244282 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:31.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd769b94700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd76415e290 0x7fd76415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd769393700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7640ad870 0x7fd764156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd768b92700 1 -- 172.21.15.153:0/756244282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7640ad870 msgr2=0x7fd764156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd768b92700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7640ad870 0x7fd764156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd768b92700 1 -- 172.21.15.153:0/756244282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd76415e290 msgr2=0x7fd76415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd768b92700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd76415e290 0x7fd76415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd768b92700 1 -- 172.21.15.153:0/756244282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c009b30 con 0x7fd7640aedc0 2023-11-24T08:05:31.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd769393700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7640ad870 0x7fd764156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:31.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd769b94700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd76415e290 0x7fd76415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:31.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd768b92700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7640aedc0 0x7fd764158f40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd76000e840 tx=0x7fd76000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd759ffb700 1 -- 172.21.15.153:0/756244282 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760009590 con 0x7fd7640aedc0 2023-11-24T08:05:31.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd759ffb700 1 -- 172.21.15.153:0/756244282 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd760013680 con 0x7fd7640aedc0 2023-11-24T08:05:31.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd759ffb700 1 -- 172.21.15.153:0/756244282 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760013a30 con 0x7fd7640aedc0 2023-11-24T08:05:31.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.961+0000 7fd76b5f7700 1 -- 172.21.15.153:0/756244282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd764156770 con 0x7fd7640aedc0 2023-11-24T08:05:31.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.962+0000 7fd76b5f7700 1 -- 172.21.15.153:0/756244282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd764157490 con 0x7fd7640aedc0 2023-11-24T08:05:31.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.963+0000 7fd76b5f7700 1 -- 172.21.15.153:0/756244282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd764068d90 con 0x7fd7640aedc0 2023-11-24T08:05:31.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.963+0000 7fd759ffb700 1 -- 172.21.15.153:0/756244282 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd760013b90 con 0x7fd7640aedc0 2023-11-24T08:05:31.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.964+0000 7fd759ffb700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd74806b080 0x7fd74806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.964+0000 7fd759ffb700 1 -- 172.21.15.153:0/756244282 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd7600898e0 con 0x7fd7640aedc0 2023-11-24T08:05:31.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.964+0000 7fd769393700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd74806b080 0x7fd74806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.964+0000 7fd769393700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd74806b080 0x7fd74806d540 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd754000f60 tx=0x7fd754009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:31.968+0000 7fd759ffb700 1 -- 172.21.15.153:0/756244282 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7600546a0 con 0x7fd7640aedc0 2023-11-24T08:05:32.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.209+0000 7fd76b5f7700 1 -- 172.21.15.153:0/756244282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd764068fb0 con 0x7fd7640aedc0 2023-11-24T08:05:32.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.824+0000 7fd759ffb700 1 -- 172.21.15.153:0/756244282 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd760057cc0 con 0x7fd7640aedc0 2023-11-24T08:05:32.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.826+0000 7fd76b5f7700 1 -- 172.21.15.153:0/756244282 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd74806b080 msgr2=0x7fd74806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.826+0000 7fd76b5f7700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd74806b080 0x7fd74806d540 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd754000f60 tx=0x7fd754009040 comp rx=0 tx=0).stop 2023-11-24T08:05:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.826+0000 7fd76b5f7700 1 -- 172.21.15.153:0/756244282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7640aedc0 msgr2=0x7fd764158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.826+0000 7fd76b5f7700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7640aedc0 0x7fd764158f40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd76000e840 tx=0x7fd76000ec00 comp rx=0 tx=0).stop 2023-11-24T08:05:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.827+0000 7fd76b5f7700 1 -- 172.21.15.153:0/756244282 shutdown_connections 2023-11-24T08:05:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.827+0000 7fd76b5f7700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd76415e290 0x7fd76415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.827+0000 7fd76b5f7700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7640ad870 0x7fd764156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.827+0000 7fd76b5f7700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd74806b080 0x7fd74806d540 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.827+0000 7fd76b5f7700 1 --2- 172.21.15.153:0/756244282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7640aedc0 0x7fd764158f40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.827+0000 7fd76b5f7700 1 -- 172.21.15.153:0/756244282 >> 172.21.15.153:0/756244282 conn(0x7fd7640b2050 msgr2=0x7fd764061ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.827+0000 7fd76b5f7700 1 -- 172.21.15.153:0/756244282 shutdown_connections 2023-11-24T08:05:32.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.827+0000 7fd76b5f7700 1 -- 172.21.15.153:0/756244282 wait complete. 2023-11-24T08:05:32.841 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:05:32.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.964+0000 7f622e0af700 1 Processor -- start 2023-11-24T08:05:32.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.964+0000 7f622e0af700 1 -- start start 2023-11-24T08:05:32.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.965+0000 7f622e0af700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f622806e9c0 0x7f62280b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.965+0000 7f622e0af700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622806ee50 con 0x7f62280746a0 2023-11-24T08:05:32.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.965+0000 7f622e0af700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62280b05c0 con 0x7f62280b01e0 2023-11-24T08:05:32.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.965+0000 7f622e0af700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62281470a0 con 0x7f622806e9c0 2023-11-24T08:05:32.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.965+0000 7f6226ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f62280746a0 0x7f622806aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44102/0 (socket says 172.21.15.153:44102) 2023-11-24T08:05:32.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.965+0000 7f6226ffd700 1 -- 172.21.15.153:0/1571739091 learned_addr learned my addr 172.21.15.153:0/1571739091 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:32.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.965+0000 7f6227fff700 1 --2- 172.21.15.153:0/1571739091 >> v2:172.21.15.164:3300/0 conn(0x7f622806e9c0 0x7f62280b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.965+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291135906 0 0) 0x7f622806ee50 con 0x7f62280746a0 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.965+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62140035b0 con 0x7f62280746a0 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3716611274 0 0) 0x7f62140035b0 con 0x7f62280746a0 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 >> v2:172.21.15.164:3300/0 conn(0x7f622806e9c0 msgr2=0x7f62280b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 --2- 172.21.15.153:0/1571739091 >> v2:172.21.15.164:3300/0 conn(0x7f622806e9c0 0x7f62280b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 >> v1:172.21.15.164:6789/0 conn(0x7f62280b01e0 legacy=0x7f6228073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62280b4250 con 0x7f62280746a0 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f6218001670 con 0x7f62280746a0 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 >> v1:172.21.15.153:6789/0 conn(0x7f62280746a0 legacy=0x7f622806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6214003a00 0x7f6214003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 0x7f62140048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6214005170 0x7f621400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62281470a0 con 0x7f6214004400 2023-11-24T08:05:32.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621400c0b0 con 0x7f6214005170 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621400c270 con 0x7f6214003a00 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f6226ffd700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 0x7f62140048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f6227fff700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6214005170 0x7f621400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62277fe700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6214003a00 0x7f6214003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f6226ffd700 1 -- 172.21.15.153:0/1571739091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6214003a00 msgr2=0x7f6214003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f6226ffd700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6214003a00 0x7f6214003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f6226ffd700 1 -- 172.21.15.153:0/1571739091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6214005170 msgr2=0x7f621400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f6226ffd700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6214005170 0x7f621400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f6226ffd700 1 -- 172.21.15.153:0/1571739091 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62140035b0 con 0x7f6214004400 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f6227fff700 1 -- 172.21.15.153:0/1571739091 reap_dead start 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62277fe700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6214003a00 0x7f6214003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f6226ffd700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 0x7f62140048d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f62280d1b40 tx=0x7f6214005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e8f657e169b8bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621800cd80 con 0x7f6214004400 2023-11-24T08:05:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6218005960 con 0x7f6214004400 2023-11-24T08:05:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.966+0000 7f62267fc700 1 -- 172.21.15.153:0/1571739091 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218005d10 con 0x7f6214004400 2023-11-24T08:05:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.967+0000 7f622e0af700 1 -- 172.21.15.153:0/1571739091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 msgr2=0x7f62140048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.967+0000 7f622e0af700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 0x7f62140048d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f62280d1b40 tx=0x7f6214005880 comp rx=0 tx=0).stop 2023-11-24T08:05:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.967+0000 7f622e0af700 1 -- 172.21.15.153:0/1571739091 shutdown_connections 2023-11-24T08:05:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.967+0000 7f622e0af700 1 --2- 172.21.15.153:0/1571739091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 0x7f62140048d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.967+0000 7f622e0af700 1 -- 172.21.15.153:0/1571739091 >> 172.21.15.153:0/1571739091 conn(0x7f62280d0b40 msgr2=0x7f62280d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.967+0000 7f622e0af700 1 -- 172.21.15.153:0/1571739091 shutdown_connections 2023-11-24T08:05:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.967+0000 7f622e0af700 1 -- 172.21.15.153:0/1571739091 wait complete. 2023-11-24T08:05:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.968+0000 7f622e0af700 1 Processor -- start 2023-11-24T08:05:32.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.968+0000 7f622e0af700 1 -- start start 2023-11-24T08:05:32.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f622e0af700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 0x7f62280c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f622e0af700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62280cecf0 0x7f62281537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f622e0af700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62280cf170 0x7f6228142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f622e0af700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62280cb2e0 con 0x7f6214004400 2023-11-24T08:05:32.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f622e0af700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62280c6b10 con 0x7f62280cf170 2023-11-24T08:05:32.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f622e0af700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62280c7a60 con 0x7f62280cecf0 2023-11-24T08:05:32.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f62277fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 0x7f62280c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f62277fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 0x7f62280c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38008/0 (socket says 172.21.15.153:38008) 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f62277fe700 1 -- 172.21.15.153:0/1086580193 learned_addr learned my addr 172.21.15.153:0/1086580193 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f6226ffd700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62280cecf0 0x7f62281537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f62277fe700 1 -- 172.21.15.153:0/1086580193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62280cecf0 msgr2=0x7f62281537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f62277fe700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62280cecf0 0x7f62281537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f62277fe700 1 -- 172.21.15.153:0/1086580193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62280cf170 msgr2=0x7f6228142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f6227fff700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62280cf170 0x7f6228142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f62277fe700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62280cf170 0x7f6228142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.969+0000 7f62277fe700 1 -- 172.21.15.153:0/1086580193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62281542b0 con 0x7f6214004400 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.970+0000 7f62277fe700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 0x7f62280c7520 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f621000e5b0 tx=0x7f621000e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.970+0000 7f621ffff700 1 -- 172.21.15.153:0/1086580193 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100053a0 con 0x7f6214004400 2023-11-24T08:05:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.970+0000 7f621ffff700 1 -- 172.21.15.153:0/1086580193 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6210005500 con 0x7f6214004400 2023-11-24T08:05:32.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.970+0000 7f622e0af700 1 -- 172.21.15.153:0/1086580193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6228154590 con 0x7f6214004400 2023-11-24T08:05:32.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.970+0000 7f621ffff700 1 -- 172.21.15.153:0/1086580193 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100038a0 con 0x7f6214004400 2023-11-24T08:05:32.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.970+0000 7f622e0af700 1 -- 172.21.15.153:0/1086580193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62280c7000 con 0x7f6214004400 2023-11-24T08:05:32.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.971+0000 7f622e0af700 1 -- 172.21.15.153:0/1086580193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62280c7190 con 0x7f6214004400 2023-11-24T08:05:32.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.971+0000 7f621ffff700 1 -- 172.21.15.153:0/1086580193 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6210003a00 con 0x7f6214004400 2023-11-24T08:05:32.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.971+0000 7f621ffff700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f620806b080 0x7f620806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.972+0000 7f621ffff700 1 -- 172.21.15.153:0/1086580193 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f62100890e0 con 0x7f6214004400 2023-11-24T08:05:32.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.972+0000 7f6226ffd700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f620806b080 0x7f620806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.972+0000 7f6226ffd700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f620806b080 0x7f620806d540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f62280c7c40 tx=0x7f6218007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:32.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:32.976+0000 7f621ffff700 1 -- 172.21.15.153:0/1086580193 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6210053f60 con 0x7f6214004400 2023-11-24T08:05:33.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.166+0000 7f622e0af700 1 -- 172.21.15.153:0/1086580193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6228067f60 con 0x7f6214004400 2023-11-24T08:05:33.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.825+0000 7f621ffff700 1 -- 172.21.15.153:0/1086580193 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6210003cb0 con 0x7f6214004400 2023-11-24T08:05:33.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 -- 172.21.15.153:0/1086580193 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f620806b080 msgr2=0x7f620806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f620806b080 0x7f620806d540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f62280c7c40 tx=0x7f6218007000 comp rx=0 tx=0).stop 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 -- 172.21.15.153:0/1086580193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 msgr2=0x7f62280c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 0x7f62280c7520 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f621000e5b0 tx=0x7f621000e970 comp rx=0 tx=0).stop 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 -- 172.21.15.153:0/1086580193 shutdown_connections 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62280cf170 0x7f6228142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f620806b080 0x7f620806d540 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6214004400 0x7f62280c7520 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 --2- 172.21.15.153:0/1086580193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62280cecf0 0x7f62281537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 -- 172.21.15.153:0/1086580193 >> 172.21.15.153:0/1086580193 conn(0x7f62280d0b40 msgr2=0x7f62280ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 -- 172.21.15.153:0/1086580193 shutdown_connections 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.829+0000 7f622e0af700 1 -- 172.21.15.153:0/1086580193 wait complete. 2023-11-24T08:05:33.832 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:05:33.846 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:05:33.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.975+0000 7f3e16bad700 1 Processor -- start 2023-11-24T08:05:33.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.975+0000 7f3e16bad700 1 -- start start 2023-11-24T08:05:33.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e16bad700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e100cd810 0x7f3e1006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e16bad700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3e10073f90 0x7f3e10074400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e16bad700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100cf530 con 0x7f3e10145620 2023-11-24T08:05:33.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e16bad700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1006b700 con 0x7f3e10073f90 2023-11-24T08:05:33.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e16bad700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e10074940 con 0x7f3e100cd810 2023-11-24T08:05:33.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e1514a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3e10073f90 0x7f3e10074400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e1514a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3e10073f90 0x7f3e10074400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38020/0 (socket says 172.21.15.153:38020) 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e1514a700 1 -- 172.21.15.153:0/4117503427 learned_addr learned my addr 172.21.15.153:0/4117503427 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e0ffff700 1 --2- 172.21.15.153:0/4117503427 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e100cd810 0x7f3e1006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e1514a700 1 -- 172.21.15.153:0/4117503427 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e100cd810 msgr2=0x7f3e1006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e1514a700 1 --2- 172.21.15.153:0/4117503427 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e100cd810 0x7f3e1006dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e1514a700 1 -- 172.21.15.153:0/4117503427 >> v1:172.21.15.164:6789/0 conn(0x7f3e10145620 legacy=0x7f3e1006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e1514a700 1 -- 172.21.15.153:0/4117503427 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1006b8f0 con 0x7f3e10073f90 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e1514a700 1 --2- 172.21.15.153:0/4117503427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e10073f90 0x7f3e10074400 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009e80 tx=0x7f3e0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15a108c7a83c349 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.976+0000 7f3e0f7fe700 1 -- 172.21.15.153:0/4117503427 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800e070 con 0x7f3e10073f90 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.977+0000 7f3e0f7fe700 1 -- 172.21.15.153:0/4117503427 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0800b980 con 0x7f3e10073f90 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.977+0000 7f3e0f7fe700 1 -- 172.21.15.153:0/4117503427 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800bd30 con 0x7f3e10073f90 2023-11-24T08:05:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.977+0000 7f3e16bad700 1 -- 172.21.15.153:0/4117503427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e10073f90 msgr2=0x7f3e10074400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.977+0000 7f3e16bad700 1 --2- 172.21.15.153:0/4117503427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e10073f90 0x7f3e10074400 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009e80 tx=0x7f3e0800b330 comp rx=0 tx=0).stop 2023-11-24T08:05:33.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.977+0000 7f3e16bad700 1 -- 172.21.15.153:0/4117503427 shutdown_connections 2023-11-24T08:05:33.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.977+0000 7f3e16bad700 1 --2- 172.21.15.153:0/4117503427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e10073f90 0x7f3e10074400 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.977+0000 7f3e16bad700 1 --2- 172.21.15.153:0/4117503427 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e100cd810 0x7f3e1006dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.977+0000 7f3e16bad700 1 -- 172.21.15.153:0/4117503427 >> 172.21.15.153:0/4117503427 conn(0x7f3e100d0b40 msgr2=0x7f3e100d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:33.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.977+0000 7f3e16bad700 1 -- 172.21.15.153:0/4117503427 shutdown_connections 2023-11-24T08:05:33.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.977+0000 7f3e16bad700 1 -- 172.21.15.153:0/4117503427 wait complete. 2023-11-24T08:05:33.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.978+0000 7f3e16bad700 1 Processor -- start 2023-11-24T08:05:33.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.978+0000 7f3e16bad700 1 -- start start 2023-11-24T08:05:33.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e16bad700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e10073f90 0x7f3e100cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e16bad700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e100cd810 0x7f3e1015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e16bad700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e10145620 0x7f3e10144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e16bad700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e101f47f0 con 0x7f3e10073f90 2023-11-24T08:05:33.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e16bad700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e101f4510 con 0x7f3e100cd810 2023-11-24T08:05:33.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e16bad700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1015a4d0 con 0x7f3e10145620 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e14949700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e10073f90 0x7f3e100cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e14949700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e10073f90 0x7f3e100cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38022/0 (socket says 172.21.15.153:38022) 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e14949700 1 -- 172.21.15.153:0/1090499328 learned_addr learned my addr 172.21.15.153:0/1090499328 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e1514a700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e10145620 0x7f3e10144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e0ffff700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e100cd810 0x7f3e1015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e14949700 1 -- 172.21.15.153:0/1090499328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e10145620 msgr2=0x7f3e10144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e14949700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e10145620 0x7f3e10144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.979+0000 7f3e14949700 1 -- 172.21.15.153:0/1090499328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e100cd810 msgr2=0x7f3e1015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.980+0000 7f3e14949700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e100cd810 0x7f3e1015afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.980+0000 7f3e14949700 1 -- 172.21.15.153:0/1090499328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e08009b30 con 0x7f3e10073f90 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.980+0000 7f3e1514a700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e10145620 0x7f3e10144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:33.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.980+0000 7f3e0ffff700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e100cd810 0x7f3e1015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.980+0000 7f3e14949700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e10073f90 0x7f3e100cc570 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c450 tx=0x7f3e0400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.980+0000 7f3e0d7fa700 1 -- 172.21.15.153:0/1090499328 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e040052d0 con 0x7f3e10073f90 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.980+0000 7f3e0d7fa700 1 -- 172.21.15.153:0/1090499328 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e04005430 con 0x7f3e10073f90 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.980+0000 7f3e16bad700 1 -- 172.21.15.153:0/1090499328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1015a7b0 con 0x7f3e10073f90 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.980+0000 7f3e0d7fa700 1 -- 172.21.15.153:0/1090499328 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e040038c0 con 0x7f3e10073f90 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.980+0000 7f3e16bad700 1 -- 172.21.15.153:0/1090499328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1013f290 con 0x7f3e10073f90 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.981+0000 7f3e16bad700 1 -- 172.21.15.153:0/1090499328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e10067f60 con 0x7f3e10073f90 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.981+0000 7f3e0d7fa700 1 -- 172.21.15.153:0/1090499328 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3e04003a20 con 0x7f3e10073f90 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.982+0000 7f3e0d7fa700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3df406b080 0x7f3df406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.982+0000 7f3e0d7fa700 1 -- 172.21.15.153:0/1090499328 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f3e04088b90 con 0x7f3e10073f90 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.982+0000 7f3e0ffff700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3df406b080 0x7f3df406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.982+0000 7f3e0ffff700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3df406b080 0x7f3df406d540 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e100cdf60 tx=0x7f3dfc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:33.986+0000 7f3e0d7fa700 1 -- 172.21.15.153:0/1090499328 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e04053a80 con 0x7f3e10073f90 2023-11-24T08:05:34.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:34.179+0000 7f3e16bad700 1 -- 172.21.15.153:0/1090499328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e1015a330 con 0x7f3e10073f90 2023-11-24T08:05:35.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.146+0000 7f3e0d7fa700 1 -- 172.21.15.153:0/1090499328 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3e1015a330 con 0x7f3e10073f90 2023-11-24T08:05:35.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 -- 172.21.15.153:0/1090499328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3df406b080 msgr2=0x7f3df406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3df406b080 0x7f3df406d540 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e100cdf60 tx=0x7f3dfc008040 comp rx=0 tx=0).stop 2023-11-24T08:05:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 -- 172.21.15.153:0/1090499328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e10073f90 msgr2=0x7f3e100cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e10073f90 0x7f3e100cc570 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c450 tx=0x7f3e0400c810 comp rx=0 tx=0).stop 2023-11-24T08:05:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 -- 172.21.15.153:0/1090499328 shutdown_connections 2023-11-24T08:05:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e10145620 0x7f3e10144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3df406b080 0x7f3df406d540 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e10073f90 0x7f3e100cc570 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 --2- 172.21.15.153:0/1090499328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e100cd810 0x7f3e1015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 -- 172.21.15.153:0/1090499328 >> 172.21.15.153:0/1090499328 conn(0x7f3e100d0b40 msgr2=0x7f3e100b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 -- 172.21.15.153:0/1090499328 shutdown_connections 2023-11-24T08:05:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.149+0000 7f3e16bad700 1 -- 172.21.15.153:0/1090499328 wait complete. 2023-11-24T08:05:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-11-24T08:05:35.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T08:05:35.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.292+0000 7ff1816c9700 1 Processor -- start 2023-11-24T08:05:35.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.292+0000 7ff1816c9700 1 -- start start 2023-11-24T08:05:35.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.293+0000 7ff1816c9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff17c144bb0 0x7ff17c06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.293+0000 7ff1816c9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17c15f940 con 0x7ff17c06c540 2023-11-24T08:05:35.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.293+0000 7ff1816c9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17c1604c0 con 0x7ff17c0b68d0 2023-11-24T08:05:35.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.293+0000 7ff1816c9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17c06c9f0 con 0x7ff17c144bb0 2023-11-24T08:05:35.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.293+0000 7ff17affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff17c144bb0 0x7ff17c06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.293+0000 7ff17a7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff17c06c540 0x7ff17c0b61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44134/0 (socket says 172.21.15.153:44134) 2023-11-24T08:05:35.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.293+0000 7ff17a7fc700 1 -- 172.21.15.153:0/4229139835 learned_addr learned my addr 172.21.15.153:0/4229139835 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:35.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.294+0000 7ff17affd700 1 -- 172.21.15.153:0/4229139835 >> v1:172.21.15.164:6789/0 conn(0x7ff17c0b68d0 legacy=0x7ff17c0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.294+0000 7ff17affd700 1 -- 172.21.15.153:0/4229139835 >> v1:172.21.15.153:6789/0 conn(0x7ff17c06c540 legacy=0x7ff17c0b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.294+0000 7ff179ffb700 1 -- 172.21.15.153:0/4229139835 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049933059 0 0) 0x7ff17c15f940 con 0x7ff17c06c540 2023-11-24T08:05:35.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.294+0000 7ff17affd700 1 -- 172.21.15.153:0/4229139835 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c15fb90 con 0x7ff17c144bb0 2023-11-24T08:05:35.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.294+0000 7ff17affd700 1 --2- 172.21.15.153:0/4229139835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff17c144bb0 0x7ff17c06c000 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff170009840 tx=0x7ff170009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3637621c06db52 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.294+0000 7ff179ffb700 1 -- 172.21.15.153:0/4229139835 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170004230 con 0x7ff17c144bb0 2023-11-24T08:05:35.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.294+0000 7ff179ffb700 1 -- 172.21.15.153:0/4229139835 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff170004390 con 0x7ff17c144bb0 2023-11-24T08:05:35.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.294+0000 7ff179ffb700 1 -- 172.21.15.153:0/4229139835 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1700036a0 con 0x7ff17c144bb0 2023-11-24T08:05:35.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.295+0000 7ff1816c9700 1 -- 172.21.15.153:0/4229139835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff17c144bb0 msgr2=0x7ff17c06c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.295+0000 7ff1816c9700 1 --2- 172.21.15.153:0/4229139835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff17c144bb0 0x7ff17c06c000 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff170009840 tx=0x7ff170009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:35.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.295+0000 7ff1816c9700 1 -- 172.21.15.153:0/4229139835 shutdown_connections 2023-11-24T08:05:35.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.295+0000 7ff1816c9700 1 --2- 172.21.15.153:0/4229139835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff17c144bb0 0x7ff17c06c000 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.295+0000 7ff1816c9700 1 -- 172.21.15.153:0/4229139835 >> 172.21.15.153:0/4229139835 conn(0x7ff17c071a70 msgr2=0x7ff17c071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.295+0000 7ff1816c9700 1 -- 172.21.15.153:0/4229139835 shutdown_connections 2023-11-24T08:05:35.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.295+0000 7ff1816c9700 1 -- 172.21.15.153:0/4229139835 wait complete. 2023-11-24T08:05:35.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.296+0000 7ff1816c9700 1 Processor -- start 2023-11-24T08:05:35.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.296+0000 7ff1816c9700 1 -- start start 2023-11-24T08:05:35.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff1816c9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff17c06c540 0x7ff17c15d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff1816c9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff17c0b68d0 0x7ff17c139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff1816c9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff17c144bb0 0x7ff17c140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff1816c9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c0b6d40 con 0x7ff17c0b68d0 2023-11-24T08:05:35.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff1816c9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c13b6a0 con 0x7ff17c06c540 2023-11-24T08:05:35.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff1816c9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c1e6d30 con 0x7ff17c144bb0 2023-11-24T08:05:35.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff17a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff17c0b68d0 0x7ff17c139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff17a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff17c0b68d0 0x7ff17c139ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38038/0 (socket says 172.21.15.153:38038) 2023-11-24T08:05:35.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff17a7fc700 1 -- 172.21.15.153:0/690128488 learned_addr learned my addr 172.21.15.153:0/690128488 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:35.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff17affd700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff17c06c540 0x7ff17c15d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff17b7fe700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff17c144bb0 0x7ff17c140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff17a7fc700 1 -- 172.21.15.153:0/690128488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff17c144bb0 msgr2=0x7ff17c140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff17a7fc700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff17c144bb0 0x7ff17c140e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff17a7fc700 1 -- 172.21.15.153:0/690128488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff17c06c540 msgr2=0x7ff17c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff17a7fc700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff17c06c540 0x7ff17c15d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff17a7fc700 1 -- 172.21.15.153:0/690128488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1700094a0 con 0x7ff17c0b68d0 2023-11-24T08:05:35.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff17a7fc700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff17c0b68d0 0x7ff17c139ff0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0011e0 tx=0x7ff16c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.297+0000 7ff1637fe700 1 -- 172.21.15.153:0/690128488 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c004c80 con 0x7ff17c0b68d0 2023-11-24T08:05:35.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.298+0000 7ff1637fe700 1 -- 172.21.15.153:0/690128488 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c004e00 con 0x7ff17c0b68d0 2023-11-24T08:05:35.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.298+0000 7ff1816c9700 1 -- 172.21.15.153:0/690128488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17c13cf10 con 0x7ff17c0b68d0 2023-11-24T08:05:35.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.298+0000 7ff1637fe700 1 -- 172.21.15.153:0/690128488 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c007310 con 0x7ff17c0b68d0 2023-11-24T08:05:35.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.298+0000 7ff1816c9700 1 -- 172.21.15.153:0/690128488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17c1e7260 con 0x7ff17c0b68d0 2023-11-24T08:05:35.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.299+0000 7ff1816c9700 1 -- 172.21.15.153:0/690128488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17c06f960 con 0x7ff17c0b68d0 2023-11-24T08:05:35.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.299+0000 7ff1637fe700 1 -- 172.21.15.153:0/690128488 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff16c007470 con 0x7ff17c0b68d0 2023-11-24T08:05:35.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.299+0000 7ff1637fe700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff16806b080 0x7ff16806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.299+0000 7ff17affd700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff16806b080 0x7ff16806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.300+0000 7ff1637fe700 1 -- 172.21.15.153:0/690128488 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff16c0893e0 con 0x7ff17c0b68d0 2023-11-24T08:05:35.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.300+0000 7ff17affd700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff16806b080 0x7ff16806d540 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff170009b90 tx=0x7ff170013040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.304+0000 7ff1637fe700 1 -- 172.21.15.153:0/690128488 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff16c054500 con 0x7ff17c0b68d0 2023-11-24T08:05:35.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.501+0000 7ff1816c9700 1 -- 172.21.15.153:0/690128488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff17c068fb0 con 0x7ff17c0b68d0 2023-11-24T08:05:35.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.508+0000 7ff1637fe700 1 -- 172.21.15.153:0/690128488 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff16c057b20 con 0x7ff17c0b68d0 2023-11-24T08:05:35.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.511+0000 7ff1816c9700 1 -- 172.21.15.153:0/690128488 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff16806b080 msgr2=0x7ff16806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.511+0000 7ff1816c9700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff16806b080 0x7ff16806d540 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff170009b90 tx=0x7ff170013040 comp rx=0 tx=0).stop 2023-11-24T08:05:35.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.511+0000 7ff1816c9700 1 -- 172.21.15.153:0/690128488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff17c0b68d0 msgr2=0x7ff17c139ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.511+0000 7ff1816c9700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff17c0b68d0 0x7ff17c139ff0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0011e0 tx=0x7ff16c00cae0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.511+0000 7ff1816c9700 1 -- 172.21.15.153:0/690128488 shutdown_connections 2023-11-24T08:05:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.511+0000 7ff1816c9700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff17c144bb0 0x7ff17c140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.511+0000 7ff1816c9700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff17c06c540 0x7ff17c15d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.511+0000 7ff1816c9700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff16806b080 0x7ff16806d540 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.511+0000 7ff1816c9700 1 --2- 172.21.15.153:0/690128488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff17c0b68d0 0x7ff17c139ff0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.511+0000 7ff1816c9700 1 -- 172.21.15.153:0/690128488 >> 172.21.15.153:0/690128488 conn(0x7ff17c071a70 msgr2=0x7ff17c0b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.512+0000 7ff1816c9700 1 -- 172.21.15.153:0/690128488 shutdown_connections 2023-11-24T08:05:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.512+0000 7ff1816c9700 1 -- 172.21.15.153:0/690128488 wait complete. 2023-11-24T08:05:35.528 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:05:35.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.646+0000 7f740d8d4700 1 Processor -- start 2023-11-24T08:05:35.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.646+0000 7f740d8d4700 1 -- start start 2023-11-24T08:05:35.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.647+0000 7f740d8d4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f740815bdd0 0x7f74081604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.647+0000 7f740d8d4700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f74080b3370 0x7f74080b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.647+0000 7f740d8d4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f74080d1c70 0x7f74080d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.647+0000 7f740d8d4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74080b2f50 con 0x7f74080d1c70 2023-11-24T08:05:35.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.647+0000 7f740d8d4700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74080d2660 con 0x7f74080b3370 2023-11-24T08:05:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.647+0000 7f740d8d4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74080b2030 con 0x7f740815bdd0 2023-11-24T08:05:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.647+0000 7f74077fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f74080d1c70 0x7f74080d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.647+0000 7f74077fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f74080d1c70 0x7f74080d2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38048/0 (socket says 172.21.15.153:38048) 2023-11-24T08:05:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.647+0000 7f74077fe700 1 -- 172.21.15.153:0/3945340439 learned_addr learned my addr 172.21.15.153:0/3945340439 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f74067fc700 1 --2- 172.21.15.153:0/3945340439 >> v2:172.21.15.164:3300/0 conn(0x7f74080b3370 0x7f74080b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f7406ffd700 1 --2- 172.21.15.153:0/3945340439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f740815bdd0 0x7f74081604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f74077fe700 1 -- 172.21.15.153:0/3945340439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f740815bdd0 msgr2=0x7f74081604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f74077fe700 1 --2- 172.21.15.153:0/3945340439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f740815bdd0 0x7f74081604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f74077fe700 1 -- 172.21.15.153:0/3945340439 >> v2:172.21.15.164:3300/0 conn(0x7f74080b3370 msgr2=0x7f74080b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f74077fe700 1 --2- 172.21.15.153:0/3945340439 >> v2:172.21.15.164:3300/0 conn(0x7f74080b3370 0x7f74080b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f74077fe700 1 -- 172.21.15.153:0/3945340439 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74080b22d0 con 0x7f74080d1c70 2023-11-24T08:05:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f74077fe700 1 --2- 172.21.15.153:0/3945340439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74080d1c70 0x7f74080d2120 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f74080cf7a0 tx=0x7f740000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df8217b42de5e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f7405ffb700 1 -- 172.21.15.153:0/3945340439 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000e070 con 0x7f74080d1c70 2023-11-24T08:05:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f7405ffb700 1 -- 172.21.15.153:0/3945340439 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740000b9c0 con 0x7f74080d1c70 2023-11-24T08:05:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f7405ffb700 1 -- 172.21.15.153:0/3945340439 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000bd70 con 0x7f74080d1c70 2023-11-24T08:05:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.648+0000 7f740d8d4700 1 -- 172.21.15.153:0/3945340439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74080d1c70 msgr2=0x7f74080d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.649+0000 7f740d8d4700 1 --2- 172.21.15.153:0/3945340439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74080d1c70 0x7f74080d2120 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f74080cf7a0 tx=0x7f740000b330 comp rx=0 tx=0).stop 2023-11-24T08:05:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.649+0000 7f740d8d4700 1 -- 172.21.15.153:0/3945340439 shutdown_connections 2023-11-24T08:05:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.649+0000 7f740d8d4700 1 --2- 172.21.15.153:0/3945340439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74080d1c70 0x7f74080d2120 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.649+0000 7f740d8d4700 1 --2- 172.21.15.153:0/3945340439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f740815bdd0 0x7f74081604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.649+0000 7f740d8d4700 1 --2- 172.21.15.153:0/3945340439 >> v2:172.21.15.164:3300/0 conn(0x7f74080b3370 0x7f74080b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.649+0000 7f740d8d4700 1 -- 172.21.15.153:0/3945340439 >> 172.21.15.153:0/3945340439 conn(0x7f74080731a0 msgr2=0x7f740809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.649+0000 7f740d8d4700 1 -- 172.21.15.153:0/3945340439 shutdown_connections 2023-11-24T08:05:35.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.649+0000 7f740d8d4700 1 -- 172.21.15.153:0/3945340439 wait complete. 2023-11-24T08:05:35.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.650+0000 7f740d8d4700 1 Processor -- start 2023-11-24T08:05:35.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.650+0000 7f740d8d4700 1 -- start start 2023-11-24T08:05:35.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f740d8d4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080b3370 0x7f7408156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f740d8d4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74080d1c70 0x7f74080c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f740d8d4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f740815bdd0 0x7f740806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f740d8d4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740806ba70 con 0x7f74080d1c70 2023-11-24T08:05:35.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f740d8d4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740806bd50 con 0x7f74080b3370 2023-11-24T08:05:35.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f740d8d4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74080c6c20 con 0x7f740815bdd0 2023-11-24T08:05:35.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f74067fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74080d1c70 0x7f74080c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f74067fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74080d1c70 0x7f74080c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38052/0 (socket says 172.21.15.153:38052) 2023-11-24T08:05:35.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f74067fc700 1 -- 172.21.15.153:0/3312023611 learned_addr learned my addr 172.21.15.153:0/3312023611 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:35.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f74077fe700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f740815bdd0 0x7f740806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f7406ffd700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080b3370 0x7f7408156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f74067fc700 1 -- 172.21.15.153:0/3312023611 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f740815bdd0 msgr2=0x7f740806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f74067fc700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f740815bdd0 0x7f740806aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f74067fc700 1 -- 172.21.15.153:0/3312023611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080b3370 msgr2=0x7f7408156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f74067fc700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080b3370 0x7f7408156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f74067fc700 1 -- 172.21.15.153:0/3312023611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7400009b30 con 0x7f74080d1c70 2023-11-24T08:05:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f74067fc700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74080d1c70 0x7f74080c9af0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f73f800d800 tx=0x7f73f800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f73effff700 1 -- 172.21.15.153:0/3312023611 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f80125f0 con 0x7f74080d1c70 2023-11-24T08:05:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f73effff700 1 -- 172.21.15.153:0/3312023611 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f8012750 con 0x7f74080d1c70 2023-11-24T08:05:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f740d8d4700 1 -- 172.21.15.153:0/3312023611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74080c6f00 con 0x7f74080d1c70 2023-11-24T08:05:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f73effff700 1 -- 172.21.15.153:0/3312023611 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8012ae0 con 0x7f74080d1c70 2023-11-24T08:05:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.651+0000 7f740d8d4700 1 -- 172.21.15.153:0/3312023611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7408157730 con 0x7f74080d1c70 2023-11-24T08:05:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.652+0000 7f740d8d4700 1 -- 172.21.15.153:0/3312023611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74080c7090 con 0x7f74080d1c70 2023-11-24T08:05:35.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.653+0000 7f73effff700 1 -- 172.21.15.153:0/3312023611 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f73f8012c40 con 0x7f74080d1c70 2023-11-24T08:05:35.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.653+0000 7f73effff700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73f406b080 0x7f73f406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.653+0000 7f73effff700 1 -- 172.21.15.153:0/3312023611 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f73f8089610 con 0x7f74080d1c70 2023-11-24T08:05:35.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.653+0000 7f7406ffd700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73f406b080 0x7f73f406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.654+0000 7f7406ffd700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73f406b080 0x7f73f406d540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f73fc006b20 tx=0x7f73fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.658+0000 7f73effff700 1 -- 172.21.15.153:0/3312023611 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73f80547f0 con 0x7f74080d1c70 2023-11-24T08:05:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:35.928+0000 7f740d8d4700 1 -- 172.21.15.153:0/3312023611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f7408067f60 con 0x7f74080d1c70 2023-11-24T08:05:36.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.147+0000 7f73effff700 1 -- 172.21.15.153:0/3312023611 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v96) v1 ==== 158+0+0 (secure 0 0 0) 0x7f73f8057e10 con 0x7f74080d1c70 2023-11-24T08:05:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.149+0000 7f740d8d4700 1 -- 172.21.15.153:0/3312023611 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73f406b080 msgr2=0x7f73f406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.149+0000 7f740d8d4700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73f406b080 0x7f73f406d540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f73fc006b20 tx=0x7f73fc008040 comp rx=0 tx=0).stop 2023-11-24T08:05:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.149+0000 7f740d8d4700 1 -- 172.21.15.153:0/3312023611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74080d1c70 msgr2=0x7f74080c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.149+0000 7f740d8d4700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74080d1c70 0x7f74080c9af0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f73f800d800 tx=0x7f73f800db10 comp rx=0 tx=0).stop 2023-11-24T08:05:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.149+0000 7f740d8d4700 1 -- 172.21.15.153:0/3312023611 shutdown_connections 2023-11-24T08:05:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.149+0000 7f740d8d4700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f740815bdd0 0x7f740806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.149+0000 7f740d8d4700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080b3370 0x7f7408156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.149+0000 7f740d8d4700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f73f406b080 0x7f73f406d540 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.149+0000 7f740d8d4700 1 --2- 172.21.15.153:0/3312023611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74080d1c70 0x7f74080c9af0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.150+0000 7f740d8d4700 1 -- 172.21.15.153:0/3312023611 >> 172.21.15.153:0/3312023611 conn(0x7f74080731a0 msgr2=0x7f740815aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.150+0000 7f740d8d4700 1 -- 172.21.15.153:0/3312023611 shutdown_connections 2023-11-24T08:05:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.150+0000 7f740d8d4700 1 -- 172.21.15.153:0/3312023611 wait complete. 2023-11-24T08:05:36.163 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ok 2023-11-24T08:05:36.164 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:05:36.164 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:36.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.283+0000 7ff48735b700 1 Processor -- start 2023-11-24T08:05:36.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.283+0000 7ff48735b700 1 -- start start 2023-11-24T08:05:36.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff48735b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff48015ae20 0x7ff4800b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff48735b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4800b1a70 0x7ff480164b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff48735b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4800cfd40 con 0x7ff48015b200 2023-11-24T08:05:36.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff48735b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4800d0020 con 0x7ff4800b1a70 2023-11-24T08:05:36.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff48735b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4800affa0 con 0x7ff48015ae20 2023-11-24T08:05:36.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff4858f8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4800b1a70 0x7ff480164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff4858f8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4800b1a70 0x7ff480164b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38062/0 (socket says 172.21.15.153:38062) 2023-11-24T08:05:36.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff4858f8700 1 -- 172.21.15.153:0/3990410457 learned_addr learned my addr 172.21.15.153:0/3990410457 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:36.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff4850f7700 1 --2- 172.21.15.153:0/3990410457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff48015ae20 0x7ff4800b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff4858f8700 1 -- 172.21.15.153:0/3990410457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff48015ae20 msgr2=0x7ff4800b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:36.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff4858f8700 1 --2- 172.21.15.153:0/3990410457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff48015ae20 0x7ff4800b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff4858f8700 1 -- 172.21.15.153:0/3990410457 >> v1:172.21.15.164:6789/0 conn(0x7ff48015b200 legacy=0x7ff4800b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff4858f8700 1 -- 172.21.15.153:0/3990410457 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4800b0280 con 0x7ff4800b1a70 2023-11-24T08:05:36.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff4858f8700 1 --2- 172.21.15.153:0/3990410457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4800b1a70 0x7ff480164b50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff478009e50 tx=0x7ff47800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2271a7b21ddf032 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.284+0000 7ff477fff700 1 -- 172.21.15.153:0/3990410457 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47800e070 con 0x7ff4800b1a70 2023-11-24T08:05:36.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.285+0000 7ff477fff700 1 -- 172.21.15.153:0/3990410457 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47800b9c0 con 0x7ff4800b1a70 2023-11-24T08:05:36.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.285+0000 7ff477fff700 1 -- 172.21.15.153:0/3990410457 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47800bd70 con 0x7ff4800b1a70 2023-11-24T08:05:36.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.285+0000 7ff48735b700 1 -- 172.21.15.153:0/3990410457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4800b1a70 msgr2=0x7ff480164b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.285+0000 7ff48735b700 1 --2- 172.21.15.153:0/3990410457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4800b1a70 0x7ff480164b50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff478009e50 tx=0x7ff47800b330 comp rx=0 tx=0).stop 2023-11-24T08:05:36.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.285+0000 7ff48735b700 1 -- 172.21.15.153:0/3990410457 shutdown_connections 2023-11-24T08:05:36.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.285+0000 7ff48735b700 1 --2- 172.21.15.153:0/3990410457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4800b1a70 0x7ff480164b50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.285+0000 7ff48735b700 1 --2- 172.21.15.153:0/3990410457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff48015ae20 0x7ff4800b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.285+0000 7ff48735b700 1 -- 172.21.15.153:0/3990410457 >> 172.21.15.153:0/3990410457 conn(0x7ff4800b57b0 msgr2=0x7ff4800b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:36.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.285+0000 7ff48735b700 1 -- 172.21.15.153:0/3990410457 shutdown_connections 2023-11-24T08:05:36.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.285+0000 7ff48735b700 1 -- 172.21.15.153:0/3990410457 wait complete. 2023-11-24T08:05:36.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.286+0000 7ff48735b700 1 Processor -- start 2023-11-24T08:05:36.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.287+0000 7ff48735b700 1 -- start start 2023-11-24T08:05:36.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.287+0000 7ff48735b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff4800b1a70 0x7ff4801f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.287+0000 7ff48735b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff48015ae20 0x7ff48014c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.287+0000 7ff48735b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff48015b200 0x7ff4801596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.287+0000 7ff48735b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48014ccd0 con 0x7ff48015b200 2023-11-24T08:05:36.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.287+0000 7ff48735b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4801f2030 con 0x7ff48015ae20 2023-11-24T08:05:36.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.287+0000 7ff48735b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4801f2310 con 0x7ff4800b1a70 2023-11-24T08:05:36.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff4858f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff48015b200 0x7ff4801596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff4850f7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff4800b1a70 0x7ff4801f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff4858f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff48015b200 0x7ff4801596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38068/0 (socket says 172.21.15.153:38068) 2023-11-24T08:05:36.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff4848f6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff48015ae20 0x7ff48014c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff4858f8700 1 -- 172.21.15.153:0/744539769 learned_addr learned my addr 172.21.15.153:0/744539769 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:36.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff4858f8700 1 -- 172.21.15.153:0/744539769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff4800b1a70 msgr2=0x7ff4801f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff4858f8700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff4800b1a70 0x7ff4801f2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff4858f8700 1 -- 172.21.15.153:0/744539769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff48015ae20 msgr2=0x7ff48014c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff4858f8700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff48015ae20 0x7ff48014c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff4858f8700 1 -- 172.21.15.153:0/744539769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff478009b30 con 0x7ff48015b200 2023-11-24T08:05:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff4858f8700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff48015b200 0x7ff4801596d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff478012000 tx=0x7ff478004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff475ffb700 1 -- 172.21.15.153:0/744539769 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478004800 con 0x7ff48015b200 2023-11-24T08:05:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff475ffb700 1 -- 172.21.15.153:0/744539769 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478004960 con 0x7ff48015b200 2023-11-24T08:05:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff48735b700 1 -- 172.21.15.153:0/744539769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4801f25f0 con 0x7ff48015b200 2023-11-24T08:05:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff475ffb700 1 -- 172.21.15.153:0/744539769 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47801c680 con 0x7ff48015b200 2023-11-24T08:05:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.288+0000 7ff48735b700 1 -- 172.21.15.153:0/744539769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4801f2bb0 con 0x7ff48015b200 2023-11-24T08:05:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.289+0000 7ff48735b700 1 -- 172.21.15.153:0/744539769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff480067f60 con 0x7ff48015b200 2023-11-24T08:05:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.290+0000 7ff475ffb700 1 -- 172.21.15.153:0/744539769 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff47801c7e0 con 0x7ff48015b200 2023-11-24T08:05:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.290+0000 7ff475ffb700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff46406b080 0x7ff46406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.290+0000 7ff475ffb700 1 -- 172.21.15.153:0/744539769 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff47808b010 con 0x7ff48015b200 2023-11-24T08:05:36.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.290+0000 7ff4850f7700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff46406b080 0x7ff46406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.291+0000 7ff4850f7700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff46406b080 0x7ff46406d540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff47c006b20 tx=0x7ff47c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.295+0000 7ff475ffb700 1 -- 172.21.15.153:0/744539769 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff478056020 con 0x7ff48015b200 2023-11-24T08:05:36.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.486+0000 7ff48735b700 1 -- 172.21.15.153:0/744539769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4800cde80 con 0x7ff48015b200 2023-11-24T08:05:36.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.487+0000 7ff475ffb700 1 -- 172.21.15.153:0/744539769 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13024 (secure 0 0 0) 0x7ff478059640 con 0x7ff48015b200 2023-11-24T08:05:36.490 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:36.491 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":35,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:35.143720+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:6835/2977715145":"2023-11-25T08:05:31.816698+0000","172.21.15.164:6833/2977715145":"2023-11-25T08:05:31.816698+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:36.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.489+0000 7ff48735b700 1 -- 172.21.15.153:0/744539769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff46406b080 msgr2=0x7ff46406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.489+0000 7ff48735b700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff46406b080 0x7ff46406d540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff47c006b20 tx=0x7ff47c008040 comp rx=0 tx=0).stop 2023-11-24T08:05:36.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.489+0000 7ff48735b700 1 -- 172.21.15.153:0/744539769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff48015b200 msgr2=0x7ff4801596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.489+0000 7ff48735b700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff48015b200 0x7ff4801596d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff478012000 tx=0x7ff478004ad0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.489+0000 7ff48735b700 1 -- 172.21.15.153:0/744539769 shutdown_connections 2023-11-24T08:05:36.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.489+0000 7ff48735b700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff46406b080 0x7ff46406d540 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.489+0000 7ff48735b700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff48015b200 0x7ff4801596d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.489+0000 7ff48735b700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff4800b1a70 0x7ff4801f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.489+0000 7ff48735b700 1 --2- 172.21.15.153:0/744539769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff48015ae20 0x7ff48014c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.489+0000 7ff48735b700 1 -- 172.21.15.153:0/744539769 >> 172.21.15.153:0/744539769 conn(0x7ff4800b57b0 msgr2=0x7ff4800d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:36.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.490+0000 7ff48735b700 1 -- 172.21.15.153:0/744539769 shutdown_connections 2023-11-24T08:05:36.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.490+0000 7ff48735b700 1 -- 172.21.15.153:0/744539769 wait complete. 2023-11-24T08:05:36.503 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:36.504 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.626+0000 7f54c20f1700 1 Processor -- start 2023-11-24T08:05:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.626+0000 7f54c20f1700 1 -- start start 2023-11-24T08:05:36.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.627+0000 7f54c20f1700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f54bc144760 0x7f54bc0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.627+0000 7f54c20f1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 0x7f54bc06c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.627+0000 7f54c20f1700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc06c990 con 0x7f54bc0b4cd0 2023-11-24T08:05:36.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.627+0000 7f54c20f1700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc0b4300 con 0x7f54bc144760 2023-11-24T08:05:36.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.627+0000 7f54c20f1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc144b40 con 0x7f54bc06c000 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54bbfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 0x7f54bc06c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54bb7fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f54bc144760 0x7f54bc0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54bbfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 0x7f54bc06c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:50146/0 (socket says 172.21.15.153:50146) 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54bb7fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f54bc144760 0x7f54bc0b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:59658/0 (socket says 172.21.15.153:59658) 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54bbfff700 1 -- 172.21.15.153:0/328369815 learned_addr learned my addr 172.21.15.153:0/328369815 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54baffd700 1 --1- 172.21.15.153:0/328369815 >> v1:172.21.15.164:6789/0 conn(0x7f54bc0b4cd0 0x7f54bc06db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:51858/0 (socket says 172.21.15.153:51858) 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54bb7fe700 1 -- 172.21.15.153:0/328369815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 msgr2=0x7f54bc06c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54bb7fe700 1 --2- 172.21.15.153:0/328369815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 0x7f54bc06c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54bb7fe700 1 -- 172.21.15.153:0/328369815 >> v1:172.21.15.164:6789/0 conn(0x7f54bc0b4cd0 legacy=0x7f54bc06db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54bb7fe700 1 -- 172.21.15.153:0/328369815 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc15ec80 con 0x7f54bc144760 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54bbfff700 1 --2- 172.21.15.153:0/328369815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 0x7f54bc06c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:36.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54bb7fe700 1 --2- 172.21.15.153:0/328369815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54bc144760 0x7f54bc0b4790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009840 tx=0x7f54b0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21ac1a214d1f1660 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54ba7fc700 1 -- 172.21.15.153:0/328369815 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0011830 con 0x7f54bc144760 2023-11-24T08:05:36.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54ba7fc700 1 -- 172.21.15.153:0/328369815 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b0011990 con 0x7f54bc144760 2023-11-24T08:05:36.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.628+0000 7f54ba7fc700 1 -- 172.21.15.153:0/328369815 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0011d20 con 0x7f54bc144760 2023-11-24T08:05:36.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.629+0000 7f54c20f1700 1 -- 172.21.15.153:0/328369815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54bc144760 msgr2=0x7f54bc0b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.629+0000 7f54c20f1700 1 --2- 172.21.15.153:0/328369815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54bc144760 0x7f54bc0b4790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009840 tx=0x7f54b0009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:36.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.629+0000 7f54c20f1700 1 -- 172.21.15.153:0/328369815 shutdown_connections 2023-11-24T08:05:36.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.629+0000 7f54c20f1700 1 --2- 172.21.15.153:0/328369815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 0x7f54bc06c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.629+0000 7f54c20f1700 1 --2- 172.21.15.153:0/328369815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54bc144760 0x7f54bc0b4790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.629+0000 7f54c20f1700 1 -- 172.21.15.153:0/328369815 >> 172.21.15.153:0/328369815 conn(0x7f54bc071a70 msgr2=0x7f54bc071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:36.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.629+0000 7f54c20f1700 1 -- 172.21.15.153:0/328369815 shutdown_connections 2023-11-24T08:05:36.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.629+0000 7f54c20f1700 1 -- 172.21.15.153:0/328369815 wait complete. 2023-11-24T08:05:36.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.630+0000 7f54c20f1700 1 Processor -- start 2023-11-24T08:05:36.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.630+0000 7f54c20f1700 1 -- start start 2023-11-24T08:05:36.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.631+0000 7f54c20f1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 0x7f54bc1f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.631+0000 7f54c20f1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54bc0b4cd0 0x7f54bc15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.631+0000 7f54c20f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54bc144760 0x7f54bc141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.631+0000 7f54c20f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0cbb50 con 0x7f54bc144760 2023-11-24T08:05:36.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.631+0000 7f54c20f1700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc1f6f40 con 0x7f54bc0b4cd0 2023-11-24T08:05:36.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.631+0000 7f54c20f1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0caf40 con 0x7f54bc06c000 2023-11-24T08:05:36.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.631+0000 7f54bbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54bc144760 0x7f54bc141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.631+0000 7f54bbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54bc144760 0x7f54bc141320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38082/0 (socket says 172.21.15.153:38082) 2023-11-24T08:05:36.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.631+0000 7f54bbfff700 1 -- 172.21.15.153:0/3711611451 learned_addr learned my addr 172.21.15.153:0/3711611451 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:36.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.631+0000 7f54bb7fe700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 0x7f54bc1f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.631+0000 7f54baffd700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54bc0b4cd0 0x7f54bc15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.632+0000 7f54bbfff700 1 -- 172.21.15.153:0/3711611451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 msgr2=0x7f54bc1f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.632+0000 7f54bbfff700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 0x7f54bc1f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.632+0000 7f54bbfff700 1 -- 172.21.15.153:0/3711611451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54bc0b4cd0 msgr2=0x7f54bc15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.632+0000 7f54bbfff700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54bc0b4cd0 0x7f54bc15d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.632+0000 7f54bbfff700 1 -- 172.21.15.153:0/3711611451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b400bd40 con 0x7f54bc144760 2023-11-24T08:05:36.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.632+0000 7f54bbfff700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54bc144760 0x7f54bc141320 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f54b400e340 tx=0x7f54b400e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.632+0000 7f54a3fff700 1 -- 172.21.15.153:0/3711611451 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4010040 con 0x7f54bc144760 2023-11-24T08:05:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.632+0000 7f54a3fff700 1 -- 172.21.15.153:0/3711611451 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b400ed30 con 0x7f54bc144760 2023-11-24T08:05:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.632+0000 7f54c20f1700 1 -- 172.21.15.153:0/3711611451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b00094a0 con 0x7f54bc144760 2023-11-24T08:05:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.632+0000 7f54a3fff700 1 -- 172.21.15.153:0/3711611451 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b400b2d0 con 0x7f54bc144760 2023-11-24T08:05:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.632+0000 7f54c20f1700 1 -- 172.21.15.153:0/3711611451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc0cb500 con 0x7f54bc144760 2023-11-24T08:05:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.633+0000 7f54c20f1700 1 -- 172.21.15.153:0/3711611451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc062450 con 0x7f54bc144760 2023-11-24T08:05:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.634+0000 7f54a3fff700 1 -- 172.21.15.153:0/3711611451 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f54b4009600 con 0x7f54bc144760 2023-11-24T08:05:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.634+0000 7f54a3fff700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54a806b080 0x7f54a806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.634+0000 7f54a3fff700 1 -- 172.21.15.153:0/3711611451 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f54b4089ce0 con 0x7f54bc144760 2023-11-24T08:05:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.634+0000 7f54bb7fe700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54a806b080 0x7f54a806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.635+0000 7f54bb7fe700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54a806b080 0x7f54a806d540 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f54b0000c00 tx=0x7f54b001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.639+0000 7f54a3fff700 1 -- 172.21.15.153:0/3711611451 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f54bc062450 con 0x7f54bc144760 2023-11-24T08:05:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.827+0000 7f54c20f1700 1 -- 172.21.15.153:0/3711611451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54bc062450 con 0x7f54bc144760 2023-11-24T08:05:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.828+0000 7f54a3fff700 1 -- 172.21.15.153:0/3711611451 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54bc062450 con 0x7f54bc144760 2023-11-24T08:05:36.830 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:05:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 -- 172.21.15.153:0/3711611451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54a806b080 msgr2=0x7f54a806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54a806b080 0x7f54a806d540 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f54b0000c00 tx=0x7f54b001c040 comp rx=0 tx=0).stop 2023-11-24T08:05:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 -- 172.21.15.153:0/3711611451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54bc144760 msgr2=0x7f54bc141320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54bc144760 0x7f54bc141320 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f54b400e340 tx=0x7f54b400e650 comp rx=0 tx=0).stop 2023-11-24T08:05:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 -- 172.21.15.153:0/3711611451 shutdown_connections 2023-11-24T08:05:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54a806b080 0x7f54a806d540 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54bc144760 0x7f54bc141320 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54bc06c000 0x7f54bc1f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 --2- 172.21.15.153:0/3711611451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54bc0b4cd0 0x7f54bc15d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 -- 172.21.15.153:0/3711611451 >> 172.21.15.153:0/3711611451 conn(0x7f54bc071a70 msgr2=0x7f54bc071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 -- 172.21.15.153:0/3711611451 shutdown_connections 2023-11-24T08:05:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.830+0000 7f54c20f1700 1 -- 172.21.15.153:0/3711611451 wait complete. 2023-11-24T08:05:36.844 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2023-11-24T08:05:36.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.964+0000 7f3ee9428700 1 Processor -- start 2023-11-24T08:05:36.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.964+0000 7f3ee9428700 1 -- start start 2023-11-24T08:05:36.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.965+0000 7f3ee9428700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee415e1e0 0x7f3ee40d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.965+0000 7f3ee9428700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40d20b0 con 0x7f3ee40d0f80 2023-11-24T08:05:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.965+0000 7f3ee9428700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40d2390 con 0x7f3ee40d3a00 2023-11-24T08:05:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.965+0000 7f3ee9428700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40d3150 con 0x7f3ee415e1e0 2023-11-24T08:05:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.965+0000 7f3ee37fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3ee40d0f80 0x7f3ee40b6ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44190/0 (socket says 172.21.15.153:44190) 2023-11-24T08:05:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.965+0000 7f3ee37fe700 1 -- 172.21.15.153:0/1031731326 learned_addr learned my addr 172.21.15.153:0/1031731326 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.965+0000 7f3ee2ffd700 1 --2- 172.21.15.153:0/1031731326 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee415e1e0 0x7f3ee40d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.965+0000 7f3ee1ffb700 1 -- 172.21.15.153:0/1031731326 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425404329 0 0) 0x7f3ee40d20b0 con 0x7f3ee40d0f80 2023-11-24T08:05:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.966+0000 7f3ee1ffb700 1 -- 172.21.15.153:0/1031731326 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ecc0035b0 con 0x7f3ee40d0f80 2023-11-24T08:05:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.966+0000 7f3ee1ffb700 1 -- 172.21.15.153:0/1031731326 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545847206 0 0) 0x7f3ee40d2390 con 0x7f3ee40d3a00 2023-11-24T08:05:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.966+0000 7f3ee1ffb700 1 -- 172.21.15.153:0/1031731326 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee40d20b0 con 0x7f3ee40d3a00 2023-11-24T08:05:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.966+0000 7f3ee2ffd700 1 -- 172.21.15.153:0/1031731326 >> v1:172.21.15.164:6789/0 conn(0x7f3ee40d3a00 legacy=0x7f3ee40d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.966+0000 7f3ee2ffd700 1 -- 172.21.15.153:0/1031731326 >> v1:172.21.15.153:6789/0 conn(0x7f3ee40d0f80 legacy=0x7f3ee40b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.966+0000 7f3ee2ffd700 1 -- 172.21.15.153:0/1031731326 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40d2670 con 0x7f3ee415e1e0 2023-11-24T08:05:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.966+0000 7f3ee2ffd700 1 --2- 172.21.15.153:0/1031731326 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee415e1e0 0x7f3ee40d34c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009870 tx=0x7f3ed8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52d96358b0ae5ca9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.966+0000 7f3ee1ffb700 1 -- 172.21.15.153:0/1031731326 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8011830 con 0x7f3ee415e1e0 2023-11-24T08:05:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.966+0000 7f3ee1ffb700 1 -- 172.21.15.153:0/1031731326 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed8011990 con 0x7f3ee415e1e0 2023-11-24T08:05:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.966+0000 7f3ee1ffb700 1 -- 172.21.15.153:0/1031731326 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8011d20 con 0x7f3ee415e1e0 2023-11-24T08:05:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.967+0000 7f3ee9428700 1 -- 172.21.15.153:0/1031731326 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee415e1e0 msgr2=0x7f3ee40d34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.967+0000 7f3ee9428700 1 --2- 172.21.15.153:0/1031731326 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee415e1e0 0x7f3ee40d34c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009870 tx=0x7f3ed8009b80 comp rx=0 tx=0).stop 2023-11-24T08:05:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.967+0000 7f3ee9428700 1 -- 172.21.15.153:0/1031731326 shutdown_connections 2023-11-24T08:05:36.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.967+0000 7f3ee9428700 1 --2- 172.21.15.153:0/1031731326 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee415e1e0 0x7f3ee40d34c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.967+0000 7f3ee9428700 1 -- 172.21.15.153:0/1031731326 >> 172.21.15.153:0/1031731326 conn(0x7f3ee40b5b50 msgr2=0x7f3ee40b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:36.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.967+0000 7f3ee9428700 1 -- 172.21.15.153:0/1031731326 shutdown_connections 2023-11-24T08:05:36.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.967+0000 7f3ee9428700 1 -- 172.21.15.153:0/1031731326 wait complete. 2023-11-24T08:05:36.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.968+0000 7f3ee9428700 1 Processor -- start 2023-11-24T08:05:36.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.968+0000 7f3ee9428700 1 -- start start 2023-11-24T08:05:36.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee9428700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ee40d0f80 0x7f3ee41541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee9428700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee40d3a00 0x7f3ee4157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee9428700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee415e1e0 0x7f3ee40cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee9428700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4154730 con 0x7f3ee415e1e0 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee9428700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40cb950 con 0x7f3ee40d0f80 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee9428700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40cbc30 con 0x7f3ee40d3a00 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee415e1e0 0x7f3ee40cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee415e1e0 0x7f3ee40cc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38096/0 (socket says 172.21.15.153:38096) 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee37fe700 1 -- 172.21.15.153:0/813123368 learned_addr learned my addr 172.21.15.153:0/813123368 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee2ffd700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ee40d0f80 0x7f3ee41541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee27fc700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee40d3a00 0x7f3ee4157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee37fe700 1 -- 172.21.15.153:0/813123368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee40d3a00 msgr2=0x7f3ee4157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee37fe700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee40d3a00 0x7f3ee4157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee37fe700 1 -- 172.21.15.153:0/813123368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ee40d0f80 msgr2=0x7f3ee41541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee37fe700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ee40d0f80 0x7f3ee41541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee37fe700 1 -- 172.21.15.153:0/813123368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed80094a0 con 0x7f3ee415e1e0 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee37fe700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee415e1e0 0x7f3ee40cc9f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00cac0 tx=0x7f3edc00cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ecb7fe700 1 -- 172.21.15.153:0/813123368 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00a9e0 con 0x7f3ee415e1e0 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ecb7fe700 1 -- 172.21.15.153:0/813123368 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc00ab40 con 0x7f3ee415e1e0 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.969+0000 7f3ee9428700 1 -- 172.21.15.153:0/813123368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee40cbf10 con 0x7f3ee415e1e0 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.970+0000 7f3ecb7fe700 1 -- 172.21.15.153:0/813123368 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc012400 con 0x7f3ee415e1e0 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.970+0000 7f3ee9428700 1 -- 172.21.15.153:0/813123368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee40cc4d0 con 0x7f3ee415e1e0 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.970+0000 7f3ee9428700 1 -- 172.21.15.153:0/813123368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee40751e0 con 0x7f3ee415e1e0 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.971+0000 7f3ecb7fe700 1 -- 172.21.15.153:0/813123368 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3edc01b3b0 con 0x7f3ee415e1e0 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.971+0000 7f3ecb7fe700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ed006b080 0x7f3ed006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.971+0000 7f3ecb7fe700 1 -- 172.21.15.153:0/813123368 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3edc089240 con 0x7f3ee415e1e0 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.971+0000 7f3ee2ffd700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ed006b080 0x7f3ed006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.972+0000 7f3ee2ffd700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ed006b080 0x7f3ed006d540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80090b0 tx=0x7f3ed801d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:36.976+0000 7f3ecb7fe700 1 -- 172.21.15.153:0/813123368 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3edc0542f0 con 0x7f3ee415e1e0 2023-11-24T08:05:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:37.244+0000 7f3ee9428700 1 -- 172.21.15.153:0/813123368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7f3ee40b5590 con 0x7f3ee415e1e0 2023-11-24T08:05:38.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.152+0000 7f3ecb7fe700 1 -- 172.21.15.153:0/813123368 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v98) v1 ==== 143+0+0 (secure 0 0 0) 0x7f3edc057910 con 0x7f3ee415e1e0 2023-11-24T08:05:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 -- 172.21.15.153:0/813123368 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ed006b080 msgr2=0x7f3ed006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ed006b080 0x7f3ed006d540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80090b0 tx=0x7f3ed801d040 comp rx=0 tx=0).stop 2023-11-24T08:05:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 -- 172.21.15.153:0/813123368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee415e1e0 msgr2=0x7f3ee40cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee415e1e0 0x7f3ee40cc9f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00cac0 tx=0x7f3edc00cdd0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 -- 172.21.15.153:0/813123368 shutdown_connections 2023-11-24T08:05:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3ed006b080 0x7f3ed006d540 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee415e1e0 0x7f3ee40cc9f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ee40d0f80 0x7f3ee41541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 --2- 172.21.15.153:0/813123368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee40d3a00 0x7f3ee4157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 -- 172.21.15.153:0/813123368 >> 172.21.15.153:0/813123368 conn(0x7f3ee40b5b50 msgr2=0x7f3ee415d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:38.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 -- 172.21.15.153:0/813123368 shutdown_connections 2023-11-24T08:05:38.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.156+0000 7f3ee9428700 1 -- 172.21.15.153:0/813123368 wait complete. 2023-11-24T08:05:38.177 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:05:38.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.310+0000 7f85595cb700 1 Processor -- start 2023-11-24T08:05:38.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.310+0000 7f85595cb700 1 -- start start 2023-11-24T08:05:38.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.311+0000 7f85595cb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85541587f0 0x7f855406aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.311+0000 7f85595cb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f855415b370 0x7f855415b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.311+0000 7f85595cb700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855406b530 con 0x7f85540b3c60 2023-11-24T08:05:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.311+0000 7f85595cb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85540ae5e0 con 0x7f855415b370 2023-11-24T08:05:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.311+0000 7f85595cb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855415be30 con 0x7f85541587f0 2023-11-24T08:05:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.311+0000 7f85527fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f855415b370 0x7f855415b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.311+0000 7f85527fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f855415b370 0x7f855415b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38102/0 (socket says 172.21.15.153:38102) 2023-11-24T08:05:38.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.311+0000 7f85527fc700 1 -- 172.21.15.153:0/3092246959 learned_addr learned my addr 172.21.15.153:0/3092246959 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:38.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.312+0000 7f8552ffd700 1 --2- 172.21.15.153:0/3092246959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85541587f0 0x7f855406aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.312+0000 7f85527fc700 1 -- 172.21.15.153:0/3092246959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85541587f0 msgr2=0x7f855406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.312+0000 7f85527fc700 1 --2- 172.21.15.153:0/3092246959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85541587f0 0x7f855406aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.312+0000 7f85527fc700 1 -- 172.21.15.153:0/3092246959 >> v1:172.21.15.164:6789/0 conn(0x7f85540b3c60 legacy=0x7f85540af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.312+0000 7f85527fc700 1 -- 172.21.15.153:0/3092246959 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855415c110 con 0x7f855415b370 2023-11-24T08:05:38.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.312+0000 7f85527fc700 1 --2- 172.21.15.153:0/3092246959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f855415b370 0x7f855415b7f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f85440098f0 tx=0x7f8544009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0b3b55b89d90f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.312+0000 7f8551ffb700 1 -- 172.21.15.153:0/3092246959 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400b8a0 con 0x7f855415b370 2023-11-24T08:05:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.312+0000 7f8551ffb700 1 -- 172.21.15.153:0/3092246959 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854400ba00 con 0x7f855415b370 2023-11-24T08:05:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.312+0000 7f8551ffb700 1 -- 172.21.15.153:0/3092246959 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400bd90 con 0x7f855415b370 2023-11-24T08:05:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.313+0000 7f85595cb700 1 -- 172.21.15.153:0/3092246959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f855415b370 msgr2=0x7f855415b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.313+0000 7f85595cb700 1 --2- 172.21.15.153:0/3092246959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f855415b370 0x7f855415b7f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f85440098f0 tx=0x7f8544009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.313+0000 7f85595cb700 1 -- 172.21.15.153:0/3092246959 shutdown_connections 2023-11-24T08:05:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.313+0000 7f85595cb700 1 --2- 172.21.15.153:0/3092246959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85541587f0 0x7f855406aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.313+0000 7f85595cb700 1 --2- 172.21.15.153:0/3092246959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f855415b370 0x7f855415b7f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.313+0000 7f85595cb700 1 -- 172.21.15.153:0/3092246959 >> 172.21.15.153:0/3092246959 conn(0x7f85540d0bf0 msgr2=0x7f85540d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:38.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.313+0000 7f85595cb700 1 -- 172.21.15.153:0/3092246959 shutdown_connections 2023-11-24T08:05:38.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.313+0000 7f85595cb700 1 -- 172.21.15.153:0/3092246959 wait complete. 2023-11-24T08:05:38.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.314+0000 7f85595cb700 1 Processor -- start 2023-11-24T08:05:38.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.314+0000 7f85595cb700 1 -- start start 2023-11-24T08:05:38.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.315+0000 7f85595cb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85540b3c60 0x7f8554154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.315+0000 7f85595cb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85541587f0 0x7f855413f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.315+0000 7f85595cb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f855415b370 0x7f85541422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.315+0000 7f85595cb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554140390 con 0x7f855415b370 2023-11-24T08:05:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.315+0000 7f85595cb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554140670 con 0x7f85540b3c60 2023-11-24T08:05:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.315+0000 7f85595cb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8554140950 con 0x7f85541587f0 2023-11-24T08:05:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f855415b370 0x7f85541422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f855415b370 0x7f85541422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38110/0 (socket says 172.21.15.153:38110) 2023-11-24T08:05:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85537fe700 1 -- 172.21.15.153:0/309902486 learned_addr learned my addr 172.21.15.153:0/309902486 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f8552ffd700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85540b3c60 0x7f8554154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85527fc700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85541587f0 0x7f855413f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85537fe700 1 -- 172.21.15.153:0/309902486 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85541587f0 msgr2=0x7f855413f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85537fe700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85541587f0 0x7f855413f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85537fe700 1 -- 172.21.15.153:0/309902486 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85540b3c60 msgr2=0x7f8554154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85537fe700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85540b3c60 0x7f8554154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85537fe700 1 -- 172.21.15.153:0/309902486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544009550 con 0x7f855415b370 2023-11-24T08:05:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85537fe700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f855415b370 0x7f85541422a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f854c00cc50 tx=0x7f854c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:38.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f853b7fe700 1 -- 172.21.15.153:0/309902486 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c003c00 con 0x7f855415b370 2023-11-24T08:05:38.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f853b7fe700 1 -- 172.21.15.153:0/309902486 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c003d60 con 0x7f855415b370 2023-11-24T08:05:38.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85595cb700 1 -- 172.21.15.153:0/309902486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8554140c30 con 0x7f855415b370 2023-11-24T08:05:38.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f853b7fe700 1 -- 172.21.15.153:0/309902486 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00aab0 con 0x7f855415b370 2023-11-24T08:05:38.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.316+0000 7f85595cb700 1 -- 172.21.15.153:0/309902486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85541549c0 con 0x7f855415b370 2023-11-24T08:05:38.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.317+0000 7f85595cb700 1 -- 172.21.15.153:0/309902486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8554140fa0 con 0x7f855415b370 2023-11-24T08:05:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.318+0000 7f853b7fe700 1 -- 172.21.15.153:0/309902486 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f854c00ac10 con 0x7f855415b370 2023-11-24T08:05:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.318+0000 7f853b7fe700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f854006b080 0x7f854006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.318+0000 7f853b7fe700 1 -- 172.21.15.153:0/309902486 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f854c089540 con 0x7f855415b370 2023-11-24T08:05:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.318+0000 7f8552ffd700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f854006b080 0x7f854006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.319+0000 7f8552ffd700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f854006b080 0x7f854006d540 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8554062250 tx=0x7f8548008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:38.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.324+0000 7f853b7fe700 1 -- 172.21.15.153:0/309902486 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f854c054700 con 0x7f855415b370 2023-11-24T08:05:38.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.515+0000 7f85595cb700 1 -- 172.21.15.153:0/309902486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f85541404d0 con 0x7f855415b370 2023-11-24T08:05:38.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.521+0000 7f853b7fe700 1 -- 172.21.15.153:0/309902486 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85541404d0 con 0x7f855415b370 2023-11-24T08:05:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 -- 172.21.15.153:0/309902486 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f854006b080 msgr2=0x7f854006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f854006b080 0x7f854006d540 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8554062250 tx=0x7f8548008040 comp rx=0 tx=0).stop 2023-11-24T08:05:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 -- 172.21.15.153:0/309902486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f855415b370 msgr2=0x7f85541422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f855415b370 0x7f85541422a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f854c00cc50 tx=0x7f854c00cf60 comp rx=0 tx=0).stop 2023-11-24T08:05:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 -- 172.21.15.153:0/309902486 shutdown_connections 2023-11-24T08:05:38.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f854006b080 0x7f854006d540 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f855415b370 0x7f85541422a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85540b3c60 0x7f8554154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 --2- 172.21.15.153:0/309902486 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85541587f0 0x7f855413f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 -- 172.21.15.153:0/309902486 >> 172.21.15.153:0/309902486 conn(0x7f85540d0bf0 msgr2=0x7f85540d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:38.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 -- 172.21.15.153:0/309902486 shutdown_connections 2023-11-24T08:05:38.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.524+0000 7f85595cb700 1 -- 172.21.15.153:0/309902486 wait complete. 2023-11-24T08:05:38.539 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:05:38.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:05:38.585 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:05:38.630 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:05:38.630 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:05:38.630 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:38.648 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3433 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T08:05:38.648 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:05:38.648 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:38.690 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=427 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T08:05:38.690 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:05:38.690 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:38.707 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3433 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T08:05:38.707 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:05:38.707 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:38.749 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=427 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T08:05:38.750 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T08:05:38.750 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.868+0000 7f91ab0e5700 1 Processor -- start 2023-11-24T08:05:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.868+0000 7f91ab0e5700 1 -- start start 2023-11-24T08:05:38.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91ab0e5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91a40b3370 0x7f91a41604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91ab0e5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91a40d1c70 0x7f91a40d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91ab0e5700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a40b22d0 con 0x7f91a415bdd0 2023-11-24T08:05:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91ab0e5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a40b2f50 con 0x7f91a40b3370 2023-11-24T08:05:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91ab0e5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a40d2640 con 0x7f91a40d1c70 2023-11-24T08:05:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91a3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91a40b3370 0x7f91a41604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91a3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91a40b3370 0x7f91a41604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38116/0 (socket says 172.21.15.153:38116) 2023-11-24T08:05:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91a3fff700 1 -- 172.21.15.153:0/34667873 learned_addr learned my addr 172.21.15.153:0/34667873 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91a9682700 1 --2- 172.21.15.153:0/34667873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91a40d1c70 0x7f91a40d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91a3fff700 1 -- 172.21.15.153:0/34667873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91a40d1c70 msgr2=0x7f91a40d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91a3fff700 1 --2- 172.21.15.153:0/34667873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91a40d1c70 0x7f91a40d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91a3fff700 1 -- 172.21.15.153:0/34667873 >> v1:172.21.15.164:6789/0 conn(0x7f91a415bdd0 legacy=0x7f91a40b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.869+0000 7f91a3fff700 1 -- 172.21.15.153:0/34667873 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a40b25b0 con 0x7f91a40b3370 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91a3fff700 1 --2- 172.21.15.153:0/34667873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a40b3370 0x7f91a41604e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f91900098f0 tx=0x7f9190009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d1e17bd3106c9d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91a37fe700 1 -- 172.21.15.153:0/34667873 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919000b8a0 con 0x7f91a40b3370 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91a37fe700 1 -- 172.21.15.153:0/34667873 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919000ba00 con 0x7f91a40b3370 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91a37fe700 1 -- 172.21.15.153:0/34667873 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919000bd90 con 0x7f91a40b3370 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91ab0e5700 1 -- 172.21.15.153:0/34667873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a40b3370 msgr2=0x7f91a41604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91ab0e5700 1 --2- 172.21.15.153:0/34667873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a40b3370 0x7f91a41604e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f91900098f0 tx=0x7f9190009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91ab0e5700 1 -- 172.21.15.153:0/34667873 shutdown_connections 2023-11-24T08:05:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91ab0e5700 1 --2- 172.21.15.153:0/34667873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91a40d1c70 0x7f91a40d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91ab0e5700 1 --2- 172.21.15.153:0/34667873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a40b3370 0x7f91a41604e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91ab0e5700 1 -- 172.21.15.153:0/34667873 >> 172.21.15.153:0/34667873 conn(0x7f91a40731a0 msgr2=0x7f91a409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91ab0e5700 1 -- 172.21.15.153:0/34667873 shutdown_connections 2023-11-24T08:05:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.870+0000 7f91ab0e5700 1 -- 172.21.15.153:0/34667873 wait complete. 2023-11-24T08:05:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.872+0000 7f91ab0e5700 1 Processor -- start 2023-11-24T08:05:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.872+0000 7f91ab0e5700 1 -- start start 2023-11-24T08:05:38.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91ab0e5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a40b3370 0x7f91a414d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91ab0e5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91a40d1c70 0x7f91a40cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91ab0e5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91a415bdd0 0x7f91a40cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91ab0e5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a40c7ff0 con 0x7f91a40b3370 2023-11-24T08:05:38.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91ab0e5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a40c8480 con 0x7f91a40d1c70 2023-11-24T08:05:38.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91ab0e5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a40cbb20 con 0x7f91a415bdd0 2023-11-24T08:05:38.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a8e81700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a40b3370 0x7f91a414d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a8e81700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a40b3370 0x7f91a414d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38120/0 (socket says 172.21.15.153:38120) 2023-11-24T08:05:38.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a8e81700 1 -- 172.21.15.153:0/1652503676 learned_addr learned my addr 172.21.15.153:0/1652503676 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:38.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a3fff700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91a40d1c70 0x7f91a40cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a9682700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91a415bdd0 0x7f91a40cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a8e81700 1 -- 172.21.15.153:0/1652503676 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91a415bdd0 msgr2=0x7f91a40cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a8e81700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91a415bdd0 0x7f91a40cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a8e81700 1 -- 172.21.15.153:0/1652503676 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91a40d1c70 msgr2=0x7f91a40cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a8e81700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91a40d1c70 0x7f91a40cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a8e81700 1 -- 172.21.15.153:0/1652503676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9190009550 con 0x7f91a40b3370 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a8e81700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a40b3370 0x7f91a414d230 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f919800c450 tx=0x7f919800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a17fa700 1 -- 172.21.15.153:0/1652503676 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980052d0 con 0x7f91a40b3370 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a17fa700 1 -- 172.21.15.153:0/1652503676 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9198005430 con 0x7f91a40b3370 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91ab0e5700 1 -- 172.21.15.153:0/1652503676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a40c73e0 con 0x7f91a40b3370 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91a17fa700 1 -- 172.21.15.153:0/1652503676 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980038c0 con 0x7f91a40b3370 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.874+0000 7f91ab0e5700 1 -- 172.21.15.153:0/1652503676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a40c79a0 con 0x7f91a40b3370 2023-11-24T08:05:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.875+0000 7f91ab0e5700 1 -- 172.21.15.153:0/1652503676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a40c82d0 con 0x7f91a40b3370 2023-11-24T08:05:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.875+0000 7f91a17fa700 1 -- 172.21.15.153:0/1652503676 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9198003a20 con 0x7f91a40b3370 2023-11-24T08:05:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.875+0000 7f91a17fa700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f918806b080 0x7f918806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.876+0000 7f91a17fa700 1 -- 172.21.15.153:0/1652503676 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9198088880 con 0x7f91a40b3370 2023-11-24T08:05:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.876+0000 7f91a3fff700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f918806b080 0x7f918806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.876+0000 7f91a3fff700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f918806b080 0x7f918806d540 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9190009c40 tx=0x7f9190008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:38.880+0000 7f91a17fa700 1 -- 172.21.15.153:0/1652503676 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9198053a40 con 0x7f91a40b3370 2023-11-24T08:05:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.112+0000 7f91ab0e5700 1 -- 172.21.15.153:0/1652503676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91a4067f60 con 0x7f91a40b3370 2023-11-24T08:05:39.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.113+0000 7f91a17fa700 1 -- 172.21.15.153:0/1652503676 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f9198017090 con 0x7f91a40b3370 2023-11-24T08:05:39.115 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:39.115 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2772655217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2772655217},{"type":"v1","addr":"172.21.15.164:6834","nonce":2772655217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/2600357639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2600357639},{"type":"v1","addr":"172.21.15.153:6836","nonce":2600357639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5037,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3970007773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3970007773},{"type":"v1","addr":"172.21.15.153:6837","nonce":3970007773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1758383586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":1758383586},{"type":"v1","addr":"172.21.15.164:6835","nonce":1758383586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-11-24T08:05:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 -- 172.21.15.153:0/1652503676 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f918806b080 msgr2=0x7f918806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f918806b080 0x7f918806d540 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9190009c40 tx=0x7f9190008030 comp rx=0 tx=0).stop 2023-11-24T08:05:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 -- 172.21.15.153:0/1652503676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a40b3370 msgr2=0x7f91a414d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a40b3370 0x7f91a414d230 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f919800c450 tx=0x7f919800c760 comp rx=0 tx=0).stop 2023-11-24T08:05:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 -- 172.21.15.153:0/1652503676 shutdown_connections 2023-11-24T08:05:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91a415bdd0 0x7f91a40cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f918806b080 0x7f918806d540 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91a40b3370 0x7f91a414d230 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 --2- 172.21.15.153:0/1652503676 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91a40d1c70 0x7f91a40cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 -- 172.21.15.153:0/1652503676 >> 172.21.15.153:0/1652503676 conn(0x7f91a40731a0 msgr2=0x7f91a40aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 -- 172.21.15.153:0/1652503676 shutdown_connections 2023-11-24T08:05:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.115+0000 7f91ab0e5700 1 -- 172.21.15.153:0/1652503676 wait complete. 2023-11-24T08:05:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 19 2023-11-24T08:05:39.129 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:05:39.129 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T08:05:39.129 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:05:39.129 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:39.130 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:05:39.130 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T08:05:39.130 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:05:39.130 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:39.131 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:05:39.131 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T08:05:39.131 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:05:39.132 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:39.132 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:05:39.132 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T08:05:39.132 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:05:39.133 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:39.139 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:05:39.139 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:05:39.140 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:05:39.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:05:39.143 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:05:39.143 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:05:39.144 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:05:39.145 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:05:39.181 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:05:39.181 DEBUG:teuthology.parallel:result is None 2023-11-24T08:05:39.182 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:05:39.182 DEBUG:teuthology.parallel:result is None 2023-11-24T08:05:39.188 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:05:39.189 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:05:39.189 DEBUG:teuthology.parallel:result is None 2023-11-24T08:05:39.189 DEBUG:teuthology.parallel:result is None 2023-11-24T08:05:39.189 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T08:05:39.262 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-11-24T08:05:39.262 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-11-24T08:05:39.272 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-11-24T08:05:39.273 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-11-24T08:05:39.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.315+0000 7f161d4bd700 1 Processor -- start 2023-11-24T08:05:39.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.316+0000 7f161d4bd700 1 -- start start 2023-11-24T08:05:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.316+0000 7f161d4bd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f161813e000 0x7f161815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.316+0000 7f161d4bd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16180cff10 0x7f16180b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.316+0000 7f161d4bd700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16180d03a0 con 0x7f161815efb0 2023-11-24T08:05:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.316+0000 7f161d4bd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161815f430 con 0x7f16180cff10 2023-11-24T08:05:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.316+0000 7f161d4bd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16180b4290 con 0x7f161813e000 2023-11-24T08:05:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.316+0000 7f16177fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16180cff10 0x7f16180b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.316+0000 7f16167fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f161815efb0 0x7f16180cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44254/0 (socket says 172.21.15.153:44254) 2023-11-24T08:05:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.316+0000 7f16167fc700 1 -- 172.21.15.153:0/4176693335 learned_addr learned my addr 172.21.15.153:0/4176693335 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.317+0000 7f1616ffd700 1 --2- 172.21.15.153:0/4176693335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f161813e000 0x7f161815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.317+0000 7f16177fe700 1 -- 172.21.15.153:0/4176693335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f161813e000 msgr2=0x7f161815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.317+0000 7f16177fe700 1 --2- 172.21.15.153:0/4176693335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f161813e000 0x7f161815ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.317+0000 7f16177fe700 1 -- 172.21.15.153:0/4176693335 >> v1:172.21.15.153:6789/0 conn(0x7f161815efb0 legacy=0x7f16180cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.317+0000 7f1615ffb700 1 -- 172.21.15.153:0/4176693335 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209842599 0 0) 0x7f16180d03a0 con 0x7f161815efb0 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.317+0000 7f16177fe700 1 -- 172.21.15.153:0/4176693335 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161813e570 con 0x7f16180cff10 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.317+0000 7f16177fe700 1 --2- 172.21.15.153:0/4176693335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16180cff10 0x7f16180b4720 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1610009d90 tx=0x7f161000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df121030b9ac32 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.317+0000 7f1615ffb700 1 -- 172.21.15.153:0/4176693335 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000e070 con 0x7f16180cff10 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.317+0000 7f1615ffb700 1 -- 172.21.15.153:0/4176693335 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161000bb20 con 0x7f16180cff10 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.317+0000 7f1615ffb700 1 -- 172.21.15.153:0/4176693335 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610012430 con 0x7f16180cff10 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.318+0000 7f161d4bd700 1 -- 172.21.15.153:0/4176693335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16180cff10 msgr2=0x7f16180b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.318+0000 7f161d4bd700 1 --2- 172.21.15.153:0/4176693335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16180cff10 0x7f16180b4720 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1610009d90 tx=0x7f161000b330 comp rx=0 tx=0).stop 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.318+0000 7f161d4bd700 1 -- 172.21.15.153:0/4176693335 shutdown_connections 2023-11-24T08:05:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.318+0000 7f161d4bd700 1 --2- 172.21.15.153:0/4176693335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f161813e000 0x7f161815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.318+0000 7f161d4bd700 1 --2- 172.21.15.153:0/4176693335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16180cff10 0x7f16180b4720 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.318+0000 7f161d4bd700 1 -- 172.21.15.153:0/4176693335 >> 172.21.15.153:0/4176693335 conn(0x7f1618072990 msgr2=0x7f161806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:39.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.318+0000 7f161d4bd700 1 -- 172.21.15.153:0/4176693335 shutdown_connections 2023-11-24T08:05:39.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.318+0000 7f161d4bd700 1 -- 172.21.15.153:0/4176693335 wait complete. 2023-11-24T08:05:39.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.319+0000 7f161d4bd700 1 Processor -- start 2023-11-24T08:05:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.319+0000 7f161d4bd700 1 -- start start 2023-11-24T08:05:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f161d4bd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16180cff10 0x7f161813d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f161d4bd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f161813e000 0x7f1618157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f161d4bd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f161815efb0 0x7f16180741a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f161d4bd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1618142aa0 con 0x7f16180cff10 2023-11-24T08:05:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f161d4bd700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161813dba0 con 0x7f161813e000 2023-11-24T08:05:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f161d4bd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1618142c30 con 0x7f161815efb0 2023-11-24T08:05:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f1616ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16180cff10 0x7f161813d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f1616ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16180cff10 0x7f161813d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38154/0 (socket says 172.21.15.153:38154) 2023-11-24T08:05:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f1616ffd700 1 -- 172.21.15.153:0/3894001173 learned_addr learned my addr 172.21.15.153:0/3894001173 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f16177fe700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f161815efb0 0x7f16180741a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f16167fc700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f161813e000 0x7f1618157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f1616ffd700 1 -- 172.21.15.153:0/3894001173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f161815efb0 msgr2=0x7f16180741a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f1616ffd700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f161815efb0 0x7f16180741a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f1616ffd700 1 -- 172.21.15.153:0/3894001173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f161813e000 msgr2=0x7f1618157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f1616ffd700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f161813e000 0x7f1618157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f1616ffd700 1 -- 172.21.15.153:0/3894001173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1610009a70 con 0x7f16180cff10 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f16167fc700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f161813e000 0x7f1618157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f16177fe700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f161815efb0 0x7f16180741a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f1616ffd700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16180cff10 0x7f161813d660 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f160c00e9e0 tx=0x7f160c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f15ff7fe700 1 -- 172.21.15.153:0/3894001173 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c009710 con 0x7f16180cff10 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f15ff7fe700 1 -- 172.21.15.153:0/3894001173 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c00c7f0 con 0x7f16180cff10 2023-11-24T08:05:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f161d4bd700 1 -- 172.21.15.153:0/3894001173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161813fc30 con 0x7f16180cff10 2023-11-24T08:05:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.320+0000 7f15ff7fe700 1 -- 172.21.15.153:0/3894001173 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c00cb60 con 0x7f16180cff10 2023-11-24T08:05:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.321+0000 7f161d4bd700 1 -- 172.21.15.153:0/3894001173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16181401f0 con 0x7f16180cff10 2023-11-24T08:05:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.321+0000 7f161d4bd700 1 -- 172.21.15.153:0/3894001173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16180752f0 con 0x7f16180cff10 2023-11-24T08:05:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.322+0000 7f15ff7fe700 1 -- 172.21.15.153:0/3894001173 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f160c00ccc0 con 0x7f16180cff10 2023-11-24T08:05:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.322+0000 7f15ff7fe700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f160406b080 0x7f160406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.322+0000 7f15ff7fe700 1 -- 172.21.15.153:0/3894001173 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f160c0896f0 con 0x7f16180cff10 2023-11-24T08:05:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.322+0000 7f16167fc700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f160406b080 0x7f160406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.323+0000 7f16167fc700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f160406b080 0x7f160406d540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1618142830 tx=0x7f1608009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.327+0000 7f15ff7fe700 1 -- 172.21.15.153:0/3894001173 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f160c054820 con 0x7f16180cff10 2023-11-24T08:05:39.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:39.532+0000 7f161d4bd700 1 -- 172.21.15.153:0/3894001173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1618067f60 con 0x7f16180cff10 2023-11-24T08:05:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.170+0000 7f15ff7fe700 1 -- 172.21.15.153:0/3894001173 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7f160c057e40 con 0x7f16180cff10 2023-11-24T08:05:40.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 -- 172.21.15.153:0/3894001173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f160406b080 msgr2=0x7f160406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f160406b080 0x7f160406d540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1618142830 tx=0x7f1608009040 comp rx=0 tx=0).stop 2023-11-24T08:05:40.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 -- 172.21.15.153:0/3894001173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16180cff10 msgr2=0x7f161813d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16180cff10 0x7f161813d660 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f160c00e9e0 tx=0x7f160c00eda0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 -- 172.21.15.153:0/3894001173 shutdown_connections 2023-11-24T08:05:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f161815efb0 0x7f16180741a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f160406b080 0x7f160406d540 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16180cff10 0x7f161813d660 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 --2- 172.21.15.153:0/3894001173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f161813e000 0x7f1618157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 -- 172.21.15.153:0/3894001173 >> 172.21.15.153:0/3894001173 conn(0x7f1618072990 msgr2=0x7f16180b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 -- 172.21.15.153:0/3894001173 shutdown_connections 2023-11-24T08:05:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.172+0000 7f161d4bd700 1 -- 172.21.15.153:0/3894001173 wait complete. 2023-11-24T08:05:40.175 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-11-24T08:05:40.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T08:05:40.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.309+0000 7f55cd447700 1 Processor -- start 2023-11-24T08:05:40.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.309+0000 7f55cd447700 1 -- start start 2023-11-24T08:05:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.310+0000 7f55cd447700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e1e0 0x7f55c80d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.310+0000 7f55cd447700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f55c80d3a00 0x7f55c80d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.310+0000 7f55cd447700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c80d20b0 con 0x7f55c80d0db0 2023-11-24T08:05:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.310+0000 7f55cd447700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c80d3150 con 0x7f55c80d3a00 2023-11-24T08:05:40.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.310+0000 7f55cd447700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80d1240 con 0x7f55c815e1e0 2023-11-24T08:05:40.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.310+0000 7f55c77fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f55c80d0db0 0x7f55c806aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44272/0 (socket says 172.21.15.153:44272) 2023-11-24T08:05:40.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.310+0000 7f55c77fe700 1 -- 172.21.15.153:0/3050261121 learned_addr learned my addr 172.21.15.153:0/3050261121 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:40.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.310+0000 7f55c6ffd700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e1e0 0x7f55c80d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.310+0000 7f55c67fc700 1 --2- 172.21.15.153:0/3050261121 >> v2:172.21.15.164:3300/0 conn(0x7f55c80d3a00 0x7f55c80d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.310+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046977503 0 0) 0x7f55c80d20b0 con 0x7f55c80d0db0 2023-11-24T08:05:40.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.310+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b00035b0 con 0x7f55c80d0db0 2023-11-24T08:05:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2999109612 0 0) 0x7f55b00035b0 con 0x7f55c80d0db0 2023-11-24T08:05:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e1e0 msgr2=0x7f55c80d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e1e0 0x7f55c80d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 >> v2:172.21.15.164:3300/0 conn(0x7f55c80d3a00 msgr2=0x7f55c80d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 --2- 172.21.15.153:0/3050261121 >> v2:172.21.15.164:3300/0 conn(0x7f55c80d3a00 0x7f55c80d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c80d2390 con 0x7f55c80d0db0 2023-11-24T08:05:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f55c00019f0 con 0x7f55c80d0db0 2023-11-24T08:05:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 >> v1:172.21.15.153:6789/0 conn(0x7f55c80d0db0 legacy=0x7f55c806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e1e0 0x7f55b0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55b0003f80 0x7f55b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55b0004d90 0x7f55b0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80d3150 con 0x7f55b0004d90 2023-11-24T08:05:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80d1240 con 0x7f55b0003f80 2023-11-24T08:05:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b000ba40 con 0x7f55c815e1e0 2023-11-24T08:05:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c77fe700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55b0004d90 0x7f55b0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c6ffd700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e1e0 0x7f55b0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c67fc700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55b0003f80 0x7f55b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c77fe700 1 -- 172.21.15.153:0/3050261121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e1e0 msgr2=0x7f55b0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c77fe700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e1e0 0x7f55b0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c77fe700 1 -- 172.21.15.153:0/3050261121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55b0003f80 msgr2=0x7f55b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c77fe700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55b0003f80 0x7f55b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c77fe700 1 -- 172.21.15.153:0/3050261121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b00035b0 con 0x7f55b0004d90 2023-11-24T08:05:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c77fe700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55b0004d90 0x7f55b0005210 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f55c000a8d0 tx=0x7f55b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5353201fa1c0ae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c000a340 con 0x7f55b0004d90 2023-11-24T08:05:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c0012600 con 0x7f55b0004d90 2023-11-24T08:05:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.311+0000 7f55c5ffb700 1 -- 172.21.15.153:0/3050261121 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c00129b0 con 0x7f55b0004d90 2023-11-24T08:05:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.312+0000 7f55cd447700 1 -- 172.21.15.153:0/3050261121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55b0004d90 msgr2=0x7f55b0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.312+0000 7f55cd447700 1 --2- 172.21.15.153:0/3050261121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55b0004d90 0x7f55b0005210 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f55c000a8d0 tx=0x7f55b0005880 comp rx=0 tx=0).stop 2023-11-24T08:05:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.312+0000 7f55c77fe700 1 -- 172.21.15.153:0/3050261121 reap_dead start 2023-11-24T08:05:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.312+0000 7f55cd447700 1 -- 172.21.15.153:0/3050261121 shutdown_connections 2023-11-24T08:05:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.312+0000 7f55cd447700 1 -- 172.21.15.153:0/3050261121 >> 172.21.15.153:0/3050261121 conn(0x7f55c80b5b50 msgr2=0x7f55c80b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.312+0000 7f55cd447700 1 -- 172.21.15.153:0/3050261121 shutdown_connections 2023-11-24T08:05:40.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.312+0000 7f55cd447700 1 -- 172.21.15.153:0/3050261121 wait complete. 2023-11-24T08:05:40.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.314+0000 7f55cd447700 1 Processor -- start 2023-11-24T08:05:40.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.314+0000 7f55cd447700 1 -- start start 2023-11-24T08:05:40.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55cd447700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c8151460 0x7f55c8156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55cd447700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e740 0x7f55c8160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55cd447700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55c81607c0 0x7f55c8154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55cd447700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8160c40 con 0x7f55c81607c0 2023-11-24T08:05:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55cd447700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c815faa0 con 0x7f55c8151460 2023-11-24T08:05:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55cd447700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c815ff30 con 0x7f55c815e740 2023-11-24T08:05:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55c77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55c81607c0 0x7f55c8154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55c77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55c81607c0 0x7f55c8154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38180/0 (socket says 172.21.15.153:38180) 2023-11-24T08:05:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55c77fe700 1 -- 172.21.15.153:0/1719124417 learned_addr learned my addr 172.21.15.153:0/1719124417 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:40.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55c6ffd700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c8151460 0x7f55c8156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55c67fc700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e740 0x7f55c8160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55c77fe700 1 -- 172.21.15.153:0/1719124417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e740 msgr2=0x7f55c8160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55c77fe700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e740 0x7f55c8160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55c77fe700 1 -- 172.21.15.153:0/1719124417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c8151460 msgr2=0x7f55c8156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55c77fe700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c8151460 0x7f55c8156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55c77fe700 1 -- 172.21.15.153:0/1719124417 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c815ebc0 con 0x7f55c81607c0 2023-11-24T08:05:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55c77fe700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55c81607c0 0x7f55c8154670 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f55c0015040 tx=0x7f55c0001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55af7fe700 1 -- 172.21.15.153:0/1719124417 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c000a340 con 0x7f55c81607c0 2023-11-24T08:05:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55af7fe700 1 -- 172.21.15.153:0/1719124417 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c00019c0 con 0x7f55c81607c0 2023-11-24T08:05:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55cd447700 1 -- 172.21.15.153:0/1719124417 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c815ee90 con 0x7f55c81607c0 2023-11-24T08:05:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55af7fe700 1 -- 172.21.15.153:0/1719124417 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0027410 con 0x7f55c81607c0 2023-11-24T08:05:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.315+0000 7f55cd447700 1 -- 172.21.15.153:0/1719124417 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c815f450 con 0x7f55c81607c0 2023-11-24T08:05:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.316+0000 7f55cd447700 1 -- 172.21.15.153:0/1719124417 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c815fd80 con 0x7f55c81607c0 2023-11-24T08:05:40.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.317+0000 7f55af7fe700 1 -- 172.21.15.153:0/1719124417 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f55c0019070 con 0x7f55c81607c0 2023-11-24T08:05:40.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.317+0000 7f55af7fe700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b406b080 0x7f55b406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.317+0000 7f55af7fe700 1 -- 172.21.15.153:0/1719124417 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f55c008a910 con 0x7f55c81607c0 2023-11-24T08:05:40.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.317+0000 7f55c6ffd700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b406b080 0x7f55b406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.318+0000 7f55c6ffd700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b406b080 0x7f55b406d540 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009ba0 tx=0x7f55bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.322+0000 7f55af7fe700 1 -- 172.21.15.153:0/1719124417 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f55c0055aa0 con 0x7f55c81607c0 2023-11-24T08:05:40.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.589+0000 7f55cd447700 1 -- 172.21.15.153:0/1719124417 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f55c81581f0 con 0x7f55c81607c0 2023-11-24T08:05:40.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.589+0000 7f55af7fe700 1 -- 172.21.15.153:0/1719124417 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f55c00590c0 con 0x7f55c81607c0 2023-11-24T08:05:40.591 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:40.591 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlx+KYHxAAFmTb68c8Q+OPuEy1aTPrRA==", 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlYf05LBAAG8lBFt4GsIw9WCLOz1Nb6w==", 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlVGztJhAAEqdk6SYM6OJ4VTgapBBIvA==", 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.593 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBle4zFMxAAsrvbC5k9Zj3Dz46bnOU0Pw==", 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:05:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDMWGBlqA2SFBAAO/T01CTkjA4nWupGuLvJfA==", 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDPWGBl1D4rFBAAsB5U6NIJd1MnxnYz7iNsbg==", 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDSWGBlh+SCExAAWteEjpmcESWppG2uGuvRhA==", 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.596 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:40.597 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:40.597 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.597 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-11-24T08:05:40.597 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDVWGBlEjPOEhAA6fy3O+YzwFZ625c8GvAdww==", 2023-11-24T08:05:40.597 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.597 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:40.597 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:40.597 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.598 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.598 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-11-24T08:05:40.598 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDbWGBlE8p6FxAA49f3frFNrFYxTVgvUn/UNA==", 2023-11-24T08:05:40.598 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.599 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:40.599 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:40.599 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.599 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-11-24T08:05:40.599 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDeWGBlNlnlFhAAD8/M/46F/1PmYqMFPvatSQ==", 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDhWGBlqQlSFhAAj8WBN4TrdU4xhBALj5+4JQ==", 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:40.600 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDkWGBljhGHFhAAhYVbRp1+nSzfgBwpHAzvKA==", 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-11-24T08:05:40.601 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlu28wOBAATnuO3XTplxrcn9JD3ta5XQ==", 2023-11-24T08:05:40.602 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.602 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:40.602 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-11-24T08:05:40.602 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T08:05:40.602 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.602 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-11-24T08:05:40.602 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDJWGBlT7tPAxAAl1DsWQCIaZcKFC5TNkWxoA==", 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlSJ+FOxAAphdCFULGDZbuhcHaYu318A==", 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:40.603 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDJWGBliyYXCRAA/QCK4goQ9KvHf+XNyGoVnA==", 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlGYiFARAAFj/se3SGAKuQG/xAyzbo9A==", 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBle/UvHBAAeeyUHoDjzbEwVnrh42R/pQ==", 2023-11-24T08:05:40.605 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlXSmiFxAA7jtMExuEpOroMzEOELomPg==", 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.606 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:40.607 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-11-24T08:05:40.607 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:05:40.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 -- 172.21.15.153:0/1719124417 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b406b080 msgr2=0x7f55b406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b406b080 0x7f55b406d540 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009ba0 tx=0x7f55bc008040 comp rx=0 tx=0).stop 2023-11-24T08:05:40.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 -- 172.21.15.153:0/1719124417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55c81607c0 msgr2=0x7f55c8154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55c81607c0 0x7f55c8154670 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f55c0015040 tx=0x7f55c0001360 comp rx=0 tx=0).stop 2023-11-24T08:05:40.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 -- 172.21.15.153:0/1719124417 shutdown_connections 2023-11-24T08:05:40.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55b406b080 0x7f55b406d540 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55c81607c0 0x7f55c8154670 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c8151460 0x7f55c8156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 --2- 172.21.15.153:0/1719124417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55c815e740 0x7f55c8160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 -- 172.21.15.153:0/1719124417 >> 172.21.15.153:0/1719124417 conn(0x7f55c80b5b50 msgr2=0x7f55c806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:40.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 -- 172.21.15.153:0/1719124417 shutdown_connections 2023-11-24T08:05:40.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.592+0000 7f55cd447700 1 -- 172.21.15.153:0/1719124417 wait complete. 2023-11-24T08:05:40.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:40.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.728+0000 7f7303632700 1 Processor -- start 2023-11-24T08:05:40.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.729+0000 7f7303632700 1 -- start start 2023-11-24T08:05:40.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.729+0000 7f7303632700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc15ddd0 0x7f72fc0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.729+0000 7f7303632700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f72fc0d2240 0x7f72fc0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.729+0000 7f7303632700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc0b1d40 con 0x7f72fc15e1b0 2023-11-24T08:05:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f7303632700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc0b28c0 con 0x7f72fc0d2240 2023-11-24T08:05:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f7303632700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc06c000 con 0x7f72fc15ddd0 2023-11-24T08:05:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f7300bcd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f72fc15e1b0 0x7f72fc0d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44288/0 (socket says 172.21.15.153:44288) 2023-11-24T08:05:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f7300bcd700 1 -- 172.21.15.153:0/1956899071 learned_addr learned my addr 172.21.15.153:0/1956899071 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f73013ce700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc15ddd0 0x7f72fc0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460693478 0 0) 0x7f72fc0b1d40 con 0x7f72fc15e1b0 2023-11-24T08:05:40.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f7301bcf700 1 --2- 172.21.15.153:0/1956899071 >> v2:172.21.15.164:3300/0 conn(0x7f72fc0d2240 0x7f72fc0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e80035b0 con 0x7f72fc15e1b0 2023-11-24T08:05:40.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3153726454 0 0) 0x7f72e80035b0 con 0x7f72fc15e1b0 2023-11-24T08:05:40.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc15ddd0 msgr2=0x7f72fc0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc15ddd0 0x7f72fc0b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 >> v2:172.21.15.164:3300/0 conn(0x7f72fc0d2240 msgr2=0x7f72fc0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 --2- 172.21.15.153:0/1956899071 >> v2:172.21.15.164:3300/0 conn(0x7f72fc0d2240 0x7f72fc0cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc0b1f90 con 0x7f72fc15e1b0 2023-11-24T08:05:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f72f8001670 con 0x7f72fc15e1b0 2023-11-24T08:05:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 >> v1:172.21.15.153:6789/0 conn(0x7f72fc15e1b0 legacy=0x7f72fc0d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc15ddd0 0x7f72e8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e8003f80 0x7f72e8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72e8004d90 0x7f72e8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0b28c0 con 0x7f72e8003f80 2023-11-24T08:05:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc06c000 con 0x7f72e8004d90 2023-11-24T08:05:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e800baf0 con 0x7f72fc15ddd0 2023-11-24T08:05:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f7300bcd700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e8003f80 0x7f72e8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f73013ce700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc15ddd0 0x7f72e8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.730+0000 7f7301bcf700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72e8004d90 0x7f72e8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.731+0000 7f7300bcd700 1 -- 172.21.15.153:0/1956899071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc15ddd0 msgr2=0x7f72e8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.731+0000 7f7300bcd700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc15ddd0 0x7f72e8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.731+0000 7f7300bcd700 1 -- 172.21.15.153:0/1956899071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72e8004d90 msgr2=0x7f72e8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.731+0000 7f7300bcd700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72e8004d90 0x7f72e8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.731+0000 7f7300bcd700 1 -- 172.21.15.153:0/1956899071 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e80035b0 con 0x7f72e8003f80 2023-11-24T08:05:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.731+0000 7f7300bcd700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e8003f80 0x7f72e8004850 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c370 tx=0x7f72e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e6285efb329d5a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.731+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8007c60 con 0x7f72e8003f80 2023-11-24T08:05:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.731+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8005960 con 0x7f72e8003f80 2023-11-24T08:05:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.731+0000 7f72f3fff700 1 -- 172.21.15.153:0/1956899071 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8005d10 con 0x7f72e8003f80 2023-11-24T08:05:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.731+0000 7f7303632700 1 -- 172.21.15.153:0/1956899071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e8003f80 msgr2=0x7f72e8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.731+0000 7f7303632700 1 --2- 172.21.15.153:0/1956899071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e8003f80 0x7f72e8004850 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c370 tx=0x7f72e8005880 comp rx=0 tx=0).stop 2023-11-24T08:05:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.732+0000 7f7301bcf700 1 -- 172.21.15.153:0/1956899071 reap_dead start 2023-11-24T08:05:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.732+0000 7f7303632700 1 -- 172.21.15.153:0/1956899071 shutdown_connections 2023-11-24T08:05:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.732+0000 7f7303632700 1 -- 172.21.15.153:0/1956899071 >> 172.21.15.153:0/1956899071 conn(0x7f72fc0731a0 msgr2=0x7f72fc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.732+0000 7f7303632700 1 -- 172.21.15.153:0/1956899071 shutdown_connections 2023-11-24T08:05:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.732+0000 7f7303632700 1 -- 172.21.15.153:0/1956899071 wait complete. 2023-11-24T08:05:40.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.733+0000 7f7303632700 1 Processor -- start 2023-11-24T08:05:40.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.733+0000 7f7303632700 1 -- start start 2023-11-24T08:05:40.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7303632700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72e8003f80 0x7f72fc0b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7303632700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72fc154f90 0x7f72fc154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7303632700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72fc0b11e0 0x7f72fc0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7303632700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0aff30 con 0x7f72fc154f90 2023-11-24T08:05:40.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7303632700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0b7af0 con 0x7f72fc0b11e0 2023-11-24T08:05:40.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7303632700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc154dc0 con 0x7f72e8003f80 2023-11-24T08:05:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7300bcd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72fc154f90 0x7f72fc154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7300bcd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72fc154f90 0x7f72fc154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38198/0 (socket says 172.21.15.153:38198) 2023-11-24T08:05:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7300bcd700 1 -- 172.21.15.153:0/1577235814 learned_addr learned my addr 172.21.15.153:0/1577235814 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f73013ce700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72e8003f80 0x7f72fc0b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7301bcf700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72fc0b11e0 0x7f72fc0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7300bcd700 1 -- 172.21.15.153:0/1577235814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72e8003f80 msgr2=0x7f72fc0b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7300bcd700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72e8003f80 0x7f72fc0b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7300bcd700 1 -- 172.21.15.153:0/1577235814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72fc0b11e0 msgr2=0x7f72fc0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7300bcd700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72fc0b11e0 0x7f72fc0b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7300bcd700 1 -- 172.21.15.153:0/1577235814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc0b2ed0 con 0x7f72fc154f90 2023-11-24T08:05:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7300bcd700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72fc154f90 0x7f72fc154880 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f72e800ba40 tx=0x7f72f8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f72f1ffb700 1 -- 172.21.15.153:0/1577235814 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8004870 con 0x7f72fc154f90 2023-11-24T08:05:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f72f1ffb700 1 -- 172.21.15.153:0/1577235814 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f80049d0 con 0x7f72fc154f90 2023-11-24T08:05:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7303632700 1 -- 172.21.15.153:0/1577235814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc0b0140 con 0x7f72fc154f90 2023-11-24T08:05:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f72f1ffb700 1 -- 172.21.15.153:0/1577235814 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8004d80 con 0x7f72fc154f90 2023-11-24T08:05:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.734+0000 7f7303632700 1 -- 172.21.15.153:0/1577235814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc0b0700 con 0x7f72fc154f90 2023-11-24T08:05:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.735+0000 7f7303632700 1 -- 172.21.15.153:0/1577235814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc067f60 con 0x7f72fc154f90 2023-11-24T08:05:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.736+0000 7f72f1ffb700 1 -- 172.21.15.153:0/1577235814 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f72f80070d0 con 0x7f72fc154f90 2023-11-24T08:05:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.736+0000 7f72f1ffb700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f72e006b080 0x7f72e006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.736+0000 7f72f1ffb700 1 -- 172.21.15.153:0/1577235814 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f72f8089fb0 con 0x7f72fc154f90 2023-11-24T08:05:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.736+0000 7f73013ce700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f72e006b080 0x7f72e006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.737+0000 7f73013ce700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f72e006b080 0x7f72e006d540 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009b80 tx=0x7f72ec009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.740+0000 7f72f1ffb700 1 -- 172.21.15.153:0/1577235814 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72f80bce90 con 0x7f72fc154f90 2023-11-24T08:05:40.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.931+0000 7f7303632700 1 -- 172.21.15.153:0/1577235814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72fc0b7c60 con 0x7f72fc154f90 2023-11-24T08:05:40.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.932+0000 7f72f1ffb700 1 -- 172.21.15.153:0/1577235814 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12893 (secure 0 0 0) 0x7f72f80551c0 con 0x7f72fc154f90 2023-11-24T08:05:40.934 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:40.934 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":39,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:40.177248+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:40.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 -- 172.21.15.153:0/1577235814 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f72e006b080 msgr2=0x7f72e006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f72e006b080 0x7f72e006d540 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009b80 tx=0x7f72ec009210 comp rx=0 tx=0).stop 2023-11-24T08:05:40.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 -- 172.21.15.153:0/1577235814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72fc154f90 msgr2=0x7f72fc154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72fc154f90 0x7f72fc154880 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f72e800ba40 tx=0x7f72f8000fe0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 -- 172.21.15.153:0/1577235814 shutdown_connections 2023-11-24T08:05:40.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72fc0b11e0 0x7f72fc0b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72e8003f80 0x7f72fc0b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f72e006b080 0x7f72e006d540 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 --2- 172.21.15.153:0/1577235814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72fc154f90 0x7f72fc154880 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 -- 172.21.15.153:0/1577235814 >> 172.21.15.153:0/1577235814 conn(0x7f72fc0731a0 msgr2=0x7f72fc15e720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:40.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 -- 172.21.15.153:0/1577235814 shutdown_connections 2023-11-24T08:05:40.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:40.935+0000 7f7303632700 1 -- 172.21.15.153:0/1577235814 wait complete. 2023-11-24T08:05:40.949 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:40.949 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:41.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.071+0000 7fb466f96700 1 Processor -- start 2023-11-24T08:05:41.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.071+0000 7fb466f96700 1 -- start start 2023-11-24T08:05:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.072+0000 7fb466f96700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb4601587f0 0x7fb46006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.072+0000 7fb466f96700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46006b530 con 0x7fb4600b4370 2023-11-24T08:05:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.072+0000 7fb466f96700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4600ae5e0 con 0x7fb46015b370 2023-11-24T08:05:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.072+0000 7fb466f96700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46015be30 con 0x7fb4601587f0 2023-11-24T08:05:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.072+0000 7fb465533700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb4600b4370 0x7fb4600af060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44308/0 (socket says 172.21.15.153:44308) 2023-11-24T08:05:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.072+0000 7fb465533700 1 -- 172.21.15.153:0/3068374386 learned_addr learned my addr 172.21.15.153:0/3068374386 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703849735 0 0) 0x7fb46006b530 con 0x7fb4600b4370 2023-11-24T08:05:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb464d32700 1 --2- 172.21.15.153:0/3068374386 >> v2:172.21.15.164:3300/0 conn(0x7fb4601587f0 0x7fb46006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4500057c0 con 0x7fb4600b4370 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048538824 0 0) 0x7fb4500057c0 con 0x7fb4600b4370 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 >> v2:172.21.15.164:3300/0 conn(0x7fb4601587f0 msgr2=0x7fb46006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 --2- 172.21.15.153:0/3068374386 >> v2:172.21.15.164:3300/0 conn(0x7fb4601587f0 0x7fb46006aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 >> v1:172.21.15.164:6789/0 conn(0x7fb46015b370 legacy=0x7fb4600b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46015c110 con 0x7fb4600b4370 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fb4580019f0 con 0x7fb4600b4370 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 >> v1:172.21.15.153:6789/0 conn(0x7fb4600b4370 legacy=0x7fb4600af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 0x7fb450005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb450006610 0x7fb450006ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb450007380 0x7fb45000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46015be30 con 0x7fb450005c10 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45000e2c0 con 0x7fb450006610 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45000e480 con 0x7fb450007380 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb464d32700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 0x7fb450005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45ffff700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb450006610 0x7fb450006ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb465533700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb450007380 0x7fb45000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb464d32700 1 -- 172.21.15.153:0/3068374386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb450007380 msgr2=0x7fb45000dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb464d32700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb450007380 0x7fb45000dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb464d32700 1 -- 172.21.15.153:0/3068374386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb450006610 msgr2=0x7fb450006ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb464d32700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb450006610 0x7fb450006ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb464d32700 1 -- 172.21.15.153:0/3068374386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4500057c0 con 0x7fb450005c10 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb465533700 1 -- 172.21.15.153:0/3068374386 reap_dead start 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb45ffff700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb450006610 0x7fb450006ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:41.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.073+0000 7fb464d32700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 0x7fb450005ff0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb454009b60 tx=0x7fb450007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74ff11ec5810720 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.074+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400e6c0 con 0x7fb450005c10 2023-11-24T08:05:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.074+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400e820 con 0x7fb450005c10 2023-11-24T08:05:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.074+0000 7fb45f7fe700 1 -- 172.21.15.153:0/3068374386 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400eb90 con 0x7fb450005c10 2023-11-24T08:05:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.074+0000 7fb466f96700 1 -- 172.21.15.153:0/3068374386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 msgr2=0x7fb450005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.074+0000 7fb466f96700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 0x7fb450005ff0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb454009b60 tx=0x7fb450007a90 comp rx=0 tx=0).stop 2023-11-24T08:05:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.074+0000 7fb466f96700 1 -- 172.21.15.153:0/3068374386 shutdown_connections 2023-11-24T08:05:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.074+0000 7fb466f96700 1 --2- 172.21.15.153:0/3068374386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 0x7fb450005ff0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.074+0000 7fb466f96700 1 -- 172.21.15.153:0/3068374386 >> 172.21.15.153:0/3068374386 conn(0x7fb4600d0bf0 msgr2=0x7fb4600d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.074+0000 7fb466f96700 1 -- 172.21.15.153:0/3068374386 shutdown_connections 2023-11-24T08:05:41.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.074+0000 7fb466f96700 1 -- 172.21.15.153:0/3068374386 wait complete. 2023-11-24T08:05:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.075+0000 7fb466f96700 1 Processor -- start 2023-11-24T08:05:41.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.075+0000 7fb466f96700 1 -- start start 2023-11-24T08:05:41.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.076+0000 7fb466f96700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 0x7fb4601527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.076+0000 7fb466f96700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4600aeeb0 0x7fb46014c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.076+0000 7fb466f96700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4600b05e0 0x7fb46015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.076+0000 7fb466f96700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600af330 con 0x7fb450005c10 2023-11-24T08:05:41.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.076+0000 7fb466f96700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46014cd00 con 0x7fb4600b05e0 2023-11-24T08:05:41.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.076+0000 7fb466f96700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600b0150 con 0x7fb4600aeeb0 2023-11-24T08:05:41.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.076+0000 7fb464d32700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 0x7fb4601527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.076+0000 7fb464d32700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 0x7fb4601527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38214/0 (socket says 172.21.15.153:38214) 2023-11-24T08:05:41.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.076+0000 7fb464d32700 1 -- 172.21.15.153:0/1531892570 learned_addr learned my addr 172.21.15.153:0/1531892570 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:41.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb45ffff700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4600aeeb0 0x7fb46014c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb465533700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4600b05e0 0x7fb46015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb464d32700 1 -- 172.21.15.153:0/1531892570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4600aeeb0 msgr2=0x7fb46014c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb464d32700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4600aeeb0 0x7fb46014c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb464d32700 1 -- 172.21.15.153:0/1531892570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4600b05e0 msgr2=0x7fb46015cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb464d32700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4600b05e0 0x7fb46015cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb464d32700 1 -- 172.21.15.153:0/1531892570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4600af540 con 0x7fb450005c10 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb464d32700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 0x7fb4601527c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb45400e4b0 tx=0x7fb4540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb45d7fa700 1 -- 172.21.15.153:0/1531892570 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400e6c0 con 0x7fb450005c10 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb45d7fa700 1 -- 172.21.15.153:0/1531892570 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb454003ad0 con 0x7fb450005c10 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb466f96700 1 -- 172.21.15.153:0/1531892570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4600af820 con 0x7fb450005c10 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb45d7fa700 1 -- 172.21.15.153:0/1531892570 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454003e80 con 0x7fb450005c10 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.077+0000 7fb466f96700 1 -- 172.21.15.153:0/1531892570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4600afde0 con 0x7fb450005c10 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.078+0000 7fb466f96700 1 -- 172.21.15.153:0/1531892570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4600b0430 con 0x7fb450005c10 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.079+0000 7fb45d7fa700 1 -- 172.21.15.153:0/1531892570 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb454013470 con 0x7fb450005c10 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.079+0000 7fb45d7fa700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb44406b080 0x7fb44406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.079+0000 7fb45d7fa700 1 -- 172.21.15.153:0/1531892570 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb45408ac50 con 0x7fb450005c10 2023-11-24T08:05:41.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.079+0000 7fb45ffff700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb44406b080 0x7fb44406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.079+0000 7fb45ffff700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb44406b080 0x7fb44406d540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb4600b20f0 tx=0x7fb44c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.084+0000 7fb45d7fa700 1 -- 172.21.15.153:0/1531892570 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb454090020 con 0x7fb450005c10 2023-11-24T08:05:41.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.277+0000 7fb466f96700 1 -- 172.21.15.153:0/1531892570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb460068fb0 con 0x7fb450005c10 2023-11-24T08:05:41.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.278+0000 7fb45d7fa700 1 -- 172.21.15.153:0/1531892570 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4540170a0 con 0x7fb450005c10 2023-11-24T08:05:41.280 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:05:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 -- 172.21.15.153:0/1531892570 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb44406b080 msgr2=0x7fb44406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb44406b080 0x7fb44406d540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb4600b20f0 tx=0x7fb44c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 -- 172.21.15.153:0/1531892570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 msgr2=0x7fb4601527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 0x7fb4601527c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb45400e4b0 tx=0x7fb4540047c0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 -- 172.21.15.153:0/1531892570 shutdown_connections 2023-11-24T08:05:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4600b05e0 0x7fb46015cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb44406b080 0x7fb44406d540 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb450005c10 0x7fb4601527c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 --2- 172.21.15.153:0/1531892570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4600aeeb0 0x7fb46014c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 -- 172.21.15.153:0/1531892570 >> 172.21.15.153:0/1531892570 conn(0x7fb4600d0bf0 msgr2=0x7fb4600b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:41.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 -- 172.21.15.153:0/1531892570 shutdown_connections 2023-11-24T08:05:41.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.280+0000 7fb466f96700 1 -- 172.21.15.153:0/1531892570 wait complete. 2023-11-24T08:05:41.294 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:05:41.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.413+0000 7f9e45d6b700 1 Processor -- start 2023-11-24T08:05:41.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.413+0000 7f9e45d6b700 1 -- start start 2023-11-24T08:05:41.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e45d6b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e4015b200 0x7f9e400b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e45d6b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e400b1a70 0x7f9e40164b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e45d6b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e400cfd40 con 0x7f9e4015ae20 2023-11-24T08:05:41.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e45d6b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e400d0020 con 0x7f9e400b1a70 2023-11-24T08:05:41.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e45d6b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e400affa0 con 0x7f9e4015b200 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e400b1a70 0x7f9e40164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e400b1a70 0x7f9e40164b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38228/0 (socket says 172.21.15.153:38228) 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3ffff700 1 -- 172.21.15.153:0/3508564514 learned_addr learned my addr 172.21.15.153:0/3508564514 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3effd700 1 --2- 172.21.15.153:0/3508564514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e4015b200 0x7f9e400b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3ffff700 1 -- 172.21.15.153:0/3508564514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e4015b200 msgr2=0x7f9e400b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3ffff700 1 --2- 172.21.15.153:0/3508564514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e4015b200 0x7f9e400b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3ffff700 1 -- 172.21.15.153:0/3508564514 >> v1:172.21.15.164:6789/0 conn(0x7f9e4015ae20 legacy=0x7f9e400b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3ffff700 1 -- 172.21.15.153:0/3508564514 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e400b0280 con 0x7f9e400b1a70 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3effd700 1 --2- 172.21.15.153:0/3508564514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e4015b200 0x7f9e400b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3ffff700 1 --2- 172.21.15.153:0/3508564514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e400b1a70 0x7f9e40164b50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800d150 tx=0x7f9e3800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fe5d6ac356d859 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3e7fc700 1 -- 172.21.15.153:0/3508564514 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e38010070 con 0x7f9e400b1a70 2023-11-24T08:05:41.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3e7fc700 1 -- 172.21.15.153:0/3508564514 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3800dd80 con 0x7f9e400b1a70 2023-11-24T08:05:41.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.414+0000 7f9e3e7fc700 1 -- 172.21.15.153:0/3508564514 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3800b310 con 0x7f9e400b1a70 2023-11-24T08:05:41.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.415+0000 7f9e45d6b700 1 -- 172.21.15.153:0/3508564514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e400b1a70 msgr2=0x7f9e40164b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.415+0000 7f9e45d6b700 1 --2- 172.21.15.153:0/3508564514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e400b1a70 0x7f9e40164b50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800d150 tx=0x7f9e3800d460 comp rx=0 tx=0).stop 2023-11-24T08:05:41.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.415+0000 7f9e45d6b700 1 -- 172.21.15.153:0/3508564514 shutdown_connections 2023-11-24T08:05:41.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.415+0000 7f9e45d6b700 1 --2- 172.21.15.153:0/3508564514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e400b1a70 0x7f9e40164b50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.415+0000 7f9e45d6b700 1 --2- 172.21.15.153:0/3508564514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e4015b200 0x7f9e400b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.415+0000 7f9e45d6b700 1 -- 172.21.15.153:0/3508564514 >> 172.21.15.153:0/3508564514 conn(0x7f9e400b57b0 msgr2=0x7f9e400b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:41.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.415+0000 7f9e45d6b700 1 -- 172.21.15.153:0/3508564514 shutdown_connections 2023-11-24T08:05:41.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.415+0000 7f9e45d6b700 1 -- 172.21.15.153:0/3508564514 wait complete. 2023-11-24T08:05:41.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.416+0000 7f9e45d6b700 1 Processor -- start 2023-11-24T08:05:41.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.416+0000 7f9e45d6b700 1 -- start start 2023-11-24T08:05:41.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e45d6b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e400b1a70 0x7f9e4014b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e45d6b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e4015ae20 0x7f9e40154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e45d6b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4015b200 0x7f9e40156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e45d6b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4014b5b0 con 0x7f9e400b1a70 2023-11-24T08:05:41.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e45d6b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4015a1b0 con 0x7f9e4015b200 2023-11-24T08:05:41.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e45d6b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e40154de0 con 0x7f9e4015ae20 2023-11-24T08:05:41.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e3f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e400b1a70 0x7f9e4014b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e3f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e400b1a70 0x7f9e4014b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38230/0 (socket says 172.21.15.153:38230) 2023-11-24T08:05:41.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e3f7fe700 1 -- 172.21.15.153:0/997625686 learned_addr learned my addr 172.21.15.153:0/997625686 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:41.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e3f7fe700 1 -- 172.21.15.153:0/997625686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e4015ae20 msgr2=0x7f9e40154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e3f7fe700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e4015ae20 0x7f9e40154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e3f7fe700 1 -- 172.21.15.153:0/997625686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4015b200 msgr2=0x7f9e40156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e3f7fe700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4015b200 0x7f9e40156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.417+0000 7f9e3f7fe700 1 -- 172.21.15.153:0/997625686 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3800bd40 con 0x7f9e400b1a70 2023-11-24T08:05:41.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.418+0000 7f9e3f7fe700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e400b1a70 0x7f9e4014b070 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000c500 tx=0x7f9e3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.418+0000 7f9e27fff700 1 -- 172.21.15.153:0/997625686 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30011790 con 0x7f9e400b1a70 2023-11-24T08:05:41.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.418+0000 7f9e27fff700 1 -- 172.21.15.153:0/997625686 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e300118f0 con 0x7f9e400b1a70 2023-11-24T08:05:41.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.418+0000 7f9e45d6b700 1 -- 172.21.15.153:0/997625686 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e400cbdd0 con 0x7f9e400b1a70 2023-11-24T08:05:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.418+0000 7f9e27fff700 1 -- 172.21.15.153:0/997625686 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30011ca0 con 0x7f9e400b1a70 2023-11-24T08:05:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.418+0000 7f9e45d6b700 1 -- 172.21.15.153:0/997625686 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e40154bb0 con 0x7f9e400b1a70 2023-11-24T08:05:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.419+0000 7f9e45d6b700 1 -- 172.21.15.153:0/997625686 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e400b3950 con 0x7f9e400b1a70 2023-11-24T08:05:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.419+0000 7f9e27fff700 1 -- 172.21.15.153:0/997625686 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9e3001c460 con 0x7f9e400b1a70 2023-11-24T08:05:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.420+0000 7f9e27fff700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e2c06b0b0 0x7f9e2c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.420+0000 7f9e27fff700 1 -- 172.21.15.153:0/997625686 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9e300893d0 con 0x7f9e400b1a70 2023-11-24T08:05:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.420+0000 7f9e3effd700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e2c06b0b0 0x7f9e2c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.420+0000 7f9e3effd700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e2c06b0b0 0x7f9e2c06d570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9e400b48c0 tx=0x7f9e34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.424+0000 7f9e27fff700 1 -- 172.21.15.153:0/997625686 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e30054550 con 0x7f9e400b1a70 2023-11-24T08:05:41.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.617+0000 7f9e45d6b700 1 -- 172.21.15.153:0/997625686 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9e40067f60 con 0x7f9e400b1a70 2023-11-24T08:05:41.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.617+0000 7f9e27fff700 1 -- 172.21.15.153:0/997625686 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9e30057b70 con 0x7f9e400b1a70 2023-11-24T08:05:41.619 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:41.620 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-11-24T08:05:41.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:41.620 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-11-24T08:05:41.620 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": ".mgr" 2023-11-24T08:05:41.620 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:41.620 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-11-24T08:05:41.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 -- 172.21.15.153:0/997625686 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e2c06b0b0 msgr2=0x7f9e2c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e2c06b0b0 0x7f9e2c06d570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9e400b48c0 tx=0x7f9e34008040 comp rx=0 tx=0).stop 2023-11-24T08:05:41.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 -- 172.21.15.153:0/997625686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e400b1a70 msgr2=0x7f9e4014b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e400b1a70 0x7f9e4014b070 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000c500 tx=0x7f9e3000c8c0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 -- 172.21.15.153:0/997625686 shutdown_connections 2023-11-24T08:05:41.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4015b200 0x7f9e40156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e2c06b0b0 0x7f9e2c06d570 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e400b1a70 0x7f9e4014b070 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 --2- 172.21.15.153:0/997625686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e4015ae20 0x7f9e40154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 -- 172.21.15.153:0/997625686 >> 172.21.15.153:0/997625686 conn(0x7f9e400b57b0 msgr2=0x7f9e400b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:41.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 -- 172.21.15.153:0/997625686 shutdown_connections 2023-11-24T08:05:41.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.620+0000 7f9e45d6b700 1 -- 172.21.15.153:0/997625686 wait complete. 2023-11-24T08:05:41.634 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:05:41.634 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:05:41.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.757+0000 7f9365339700 1 Processor -- start 2023-11-24T08:05:41.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.757+0000 7f9365339700 1 -- start start 2023-11-24T08:05:41.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.758+0000 7f9365339700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f936015bd70 0x7f936006fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.758+0000 7f9365339700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f93600d07c0 0x7f93600d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.758+0000 7f9365339700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93600d2530 con 0x7f93600d20e0 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.758+0000 7f9365339700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93600aec00 con 0x7f93600d07c0 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.758+0000 7f9365339700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93600705d0 con 0x7f936015bd70 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.758+0000 7f935e7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f93600d07c0 0x7f93600d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.758+0000 7f935e7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f93600d07c0 0x7f93600d1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38238/0 (socket says 172.21.15.153:38238) 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.758+0000 7f935e7fc700 1 -- 172.21.15.153:0/4236931241 learned_addr learned my addr 172.21.15.153:0/4236931241 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.759+0000 7f935effd700 1 --2- 172.21.15.153:0/4236931241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f936015bd70 0x7f936006fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.759+0000 7f935e7fc700 1 -- 172.21.15.153:0/4236931241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f936015bd70 msgr2=0x7f936006fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.759+0000 7f935e7fc700 1 --2- 172.21.15.153:0/4236931241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f936015bd70 0x7f936006fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.759+0000 7f935e7fc700 1 -- 172.21.15.153:0/4236931241 >> v1:172.21.15.164:6789/0 conn(0x7f93600d20e0 legacy=0x7f936015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.759+0000 7f935e7fc700 1 -- 172.21.15.153:0/4236931241 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93600708b0 con 0x7f93600d07c0 2023-11-24T08:05:41.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.759+0000 7f935e7fc700 1 --2- 172.21.15.153:0/4236931241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93600d07c0 0x7f93600d1ba0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f93500098f0 tx=0x7f9350009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8953c4138fcc08e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.759+0000 7f935dffb700 1 -- 172.21.15.153:0/4236931241 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350004230 con 0x7f93600d07c0 2023-11-24T08:05:41.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.759+0000 7f935dffb700 1 -- 172.21.15.153:0/4236931241 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9350004390 con 0x7f93600d07c0 2023-11-24T08:05:41.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.759+0000 7f935dffb700 1 -- 172.21.15.153:0/4236931241 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93500036a0 con 0x7f93600d07c0 2023-11-24T08:05:41.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.759+0000 7f9365339700 1 -- 172.21.15.153:0/4236931241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93600d07c0 msgr2=0x7f93600d1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.759+0000 7f9365339700 1 --2- 172.21.15.153:0/4236931241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93600d07c0 0x7f93600d1ba0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f93500098f0 tx=0x7f9350009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:41.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.760+0000 7f9365339700 1 -- 172.21.15.153:0/4236931241 shutdown_connections 2023-11-24T08:05:41.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.760+0000 7f9365339700 1 --2- 172.21.15.153:0/4236931241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f936015bd70 0x7f936006fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.760+0000 7f9365339700 1 --2- 172.21.15.153:0/4236931241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93600d07c0 0x7f93600d1ba0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.760+0000 7f9365339700 1 -- 172.21.15.153:0/4236931241 >> 172.21.15.153:0/4236931241 conn(0x7f936006dc80 msgr2=0x7f936009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:41.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.760+0000 7f9365339700 1 -- 172.21.15.153:0/4236931241 shutdown_connections 2023-11-24T08:05:41.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.760+0000 7f9365339700 1 -- 172.21.15.153:0/4236931241 wait complete. 2023-11-24T08:05:41.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.761+0000 7f9365339700 1 Processor -- start 2023-11-24T08:05:41.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.761+0000 7f9365339700 1 -- start start 2023-11-24T08:05:41.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f9365339700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93600d07c0 0x7f9360152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f9365339700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93600d20e0 0x7f936015d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f9365339700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f936015bd70 0x7f936015d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f9365339700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936006aff0 con 0x7f93600d07c0 2023-11-24T08:05:41.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f9365339700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936006b240 con 0x7f93600d20e0 2023-11-24T08:05:41.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f9365339700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936006b520 con 0x7f936015bd70 2023-11-24T08:05:41.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93600d07c0 0x7f9360152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93600d07c0 0x7f9360152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38244/0 (socket says 172.21.15.153:38244) 2023-11-24T08:05:41.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935effd700 1 -- 172.21.15.153:0/2496124259 learned_addr learned my addr 172.21.15.153:0/2496124259 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935e7fc700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93600d20e0 0x7f936015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935effd700 1 -- 172.21.15.153:0/2496124259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f936015bd70 msgr2=0x7f936015d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935f7fe700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f936015bd70 0x7f936015d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935effd700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f936015bd70 0x7f936015d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935effd700 1 -- 172.21.15.153:0/2496124259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93600d20e0 msgr2=0x7f936015d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935effd700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93600d20e0 0x7f936015d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935effd700 1 -- 172.21.15.153:0/2496124259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350009550 con 0x7f93600d07c0 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935e7fc700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93600d20e0 0x7f936015d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f935effd700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93600d07c0 0x7f9360152010 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f935400c7f0 tx=0x7f935400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f93477fe700 1 -- 172.21.15.153:0/2496124259 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354011800 con 0x7f93600d07c0 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f93477fe700 1 -- 172.21.15.153:0/2496124259 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9354011960 con 0x7f93600d07c0 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f93477fe700 1 -- 172.21.15.153:0/2496124259 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354011cf0 con 0x7f93600d07c0 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f9365339700 1 -- 172.21.15.153:0/2496124259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936006b800 con 0x7f93600d07c0 2023-11-24T08:05:41.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.762+0000 7f9365339700 1 -- 172.21.15.153:0/2496124259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936006bdc0 con 0x7f93600d07c0 2023-11-24T08:05:41.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.763+0000 7f9365339700 1 -- 172.21.15.153:0/2496124259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93600cd1c0 con 0x7f93600d07c0 2023-11-24T08:05:41.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.764+0000 7f93477fe700 1 -- 172.21.15.153:0/2496124259 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9354018360 con 0x7f93600d07c0 2023-11-24T08:05:41.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.764+0000 7f93477fe700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f934c06b080 0x7f934c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.764+0000 7f935e7fc700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f934c06b080 0x7f934c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.764+0000 7f93477fe700 1 -- 172.21.15.153:0/2496124259 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9354089660 con 0x7f93600d07c0 2023-11-24T08:05:41.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.765+0000 7f935e7fc700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f934c06b080 0x7f934c06d540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f93600cf7d0 tx=0x7f9350008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.769+0000 7f93477fe700 1 -- 172.21.15.153:0/2496124259 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9354054640 con 0x7f93600d07c0 2023-11-24T08:05:41.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:41.959+0000 7f9365339700 1 -- 172.21.15.153:0/2496124259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9360067f60 con 0x7f93600d07c0 2023-11-24T08:05:42.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.168+0000 7f93477fe700 1 -- 172.21.15.153:0/2496124259 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v40) v1 ==== 138+0+0 (secure 0 0 0) 0x7f935401f0b0 con 0x7f93600d07c0 2023-11-24T08:05:42.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 -- 172.21.15.153:0/2496124259 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f934c06b080 msgr2=0x7f934c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f934c06b080 0x7f934c06d540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f93600cf7d0 tx=0x7f9350008030 comp rx=0 tx=0).stop 2023-11-24T08:05:42.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 -- 172.21.15.153:0/2496124259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93600d07c0 msgr2=0x7f9360152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93600d07c0 0x7f9360152010 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f935400c7f0 tx=0x7f935400cbb0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 -- 172.21.15.153:0/2496124259 shutdown_connections 2023-11-24T08:05:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f936015bd70 0x7f936015d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f934c06b080 0x7f934c06d540 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93600d07c0 0x7f9360152010 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 --2- 172.21.15.153:0/2496124259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93600d20e0 0x7f936015d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 -- 172.21.15.153:0/2496124259 >> 172.21.15.153:0/2496124259 conn(0x7f936006dc80 msgr2=0x7f9360155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 -- 172.21.15.153:0/2496124259 shutdown_connections 2023-11-24T08:05:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.171+0000 7f9365339700 1 -- 172.21.15.153:0/2496124259 wait complete. 2023-11-24T08:05:42.178 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-11-24T08:05:42.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:05:42.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.314+0000 7f5f855e1700 1 Processor -- start 2023-11-24T08:05:42.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.314+0000 7f5f855e1700 1 -- start start 2023-11-24T08:05:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f855e1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5f800746a0 0x7f5f800b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f855e1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f800afc90 0x7f5f8006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f855e1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f800b3c60 con 0x7f5f8015e160 2023-11-24T08:05:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f855e1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f800b4500 con 0x7f5f800746a0 2023-11-24T08:05:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f855e1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f800b58c0 con 0x7f5f800afc90 2023-11-24T08:05:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f7e7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5f800746a0 0x7f5f800b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f7effd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5f8015e160 0x7f5f80073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44356/0 (socket says 172.21.15.153:44356) 2023-11-24T08:05:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f7effd700 1 -- 172.21.15.153:0/3313173493 learned_addr learned my addr 172.21.15.153:0/3313173493 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f7f7fe700 1 --2- 172.21.15.153:0/3313173493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f800afc90 0x7f5f8006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f7e7fc700 1 -- 172.21.15.153:0/3313173493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f800afc90 msgr2=0x7f5f8006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f7e7fc700 1 --2- 172.21.15.153:0/3313173493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f800afc90 0x7f5f8006d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f7e7fc700 1 -- 172.21.15.153:0/3313173493 >> v1:172.21.15.153:6789/0 conn(0x7f5f8015e160 legacy=0x7f5f80073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f7e7fc700 1 -- 172.21.15.153:0/3313173493 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f800b0120 con 0x7f5f800746a0 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f7dffb700 1 -- 172.21.15.153:0/3313173493 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680820235 0 0) 0x7f5f800b3c60 con 0x7f5f8015e160 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.315+0000 7f5f7e7fc700 1 --2- 172.21.15.153:0/3313173493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f800746a0 0x7f5f800b5da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009840 tx=0x7f5f68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9004429fd14a55 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.316+0000 7f5f7dffb700 1 -- 172.21.15.153:0/3313173493 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68011830 con 0x7f5f800746a0 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.316+0000 7f5f7dffb700 1 -- 172.21.15.153:0/3313173493 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f68011990 con 0x7f5f800746a0 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.316+0000 7f5f7dffb700 1 -- 172.21.15.153:0/3313173493 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68011d20 con 0x7f5f800746a0 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.316+0000 7f5f855e1700 1 -- 172.21.15.153:0/3313173493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f800746a0 msgr2=0x7f5f800b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.316+0000 7f5f855e1700 1 --2- 172.21.15.153:0/3313173493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f800746a0 0x7f5f800b5da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009840 tx=0x7f5f68009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.316+0000 7f5f855e1700 1 -- 172.21.15.153:0/3313173493 shutdown_connections 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.316+0000 7f5f855e1700 1 --2- 172.21.15.153:0/3313173493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f800afc90 0x7f5f8006d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.316+0000 7f5f855e1700 1 --2- 172.21.15.153:0/3313173493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f800746a0 0x7f5f800b5da0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.316+0000 7f5f855e1700 1 -- 172.21.15.153:0/3313173493 >> 172.21.15.153:0/3313173493 conn(0x7f5f800d0bf0 msgr2=0x7f5f800d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:42.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.316+0000 7f5f855e1700 1 -- 172.21.15.153:0/3313173493 shutdown_connections 2023-11-24T08:05:42.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.316+0000 7f5f855e1700 1 -- 172.21.15.153:0/3313173493 wait complete. 2023-11-24T08:05:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.317+0000 7f5f855e1700 1 Processor -- start 2023-11-24T08:05:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.318+0000 7f5f855e1700 1 -- start start 2023-11-24T08:05:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.318+0000 7f5f855e1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f800746a0 0x7f5f800c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.318+0000 7f5f855e1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f800afc90 0x7f5f800c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.318+0000 7f5f855e1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f8015e160 0x7f5f800ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.318+0000 7f5f855e1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8014cee0 con 0x7f5f800afc90 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.318+0000 7f5f855e1700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8014d1c0 con 0x7f5f8015e160 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.318+0000 7f5f855e1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8006d9d0 con 0x7f5f800746a0 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.318+0000 7f5f7e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f800afc90 0x7f5f800c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.318+0000 7f5f7e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f800afc90 0x7f5f800c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38260/0 (socket says 172.21.15.153:38260) 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.318+0000 7f5f7e7fc700 1 -- 172.21.15.153:0/857904038 learned_addr learned my addr 172.21.15.153:0/857904038 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f7f7fe700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f8015e160 0x7f5f800ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f7effd700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f800746a0 0x7f5f800c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f7e7fc700 1 -- 172.21.15.153:0/857904038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f800746a0 msgr2=0x7f5f800c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f7e7fc700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f800746a0 0x7f5f800c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f7e7fc700 1 -- 172.21.15.153:0/857904038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f8015e160 msgr2=0x7f5f800ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f7e7fc700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f8015e160 0x7f5f800ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f7e7fc700 1 -- 172.21.15.153:0/857904038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f680094a0 con 0x7f5f800afc90 2023-11-24T08:05:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f7f7fe700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f8015e160 0x7f5f800ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f7e7fc700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f800afc90 0x7f5f800c92f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009b90 tx=0x7f5f68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f777fe700 1 -- 172.21.15.153:0/857904038 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680036a0 con 0x7f5f800afc90 2023-11-24T08:05:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f777fe700 1 -- 172.21.15.153:0/857904038 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6801f070 con 0x7f5f800afc90 2023-11-24T08:05:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f777fe700 1 -- 172.21.15.153:0/857904038 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68003a40 con 0x7f5f800afc90 2023-11-24T08:05:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f855e1700 1 -- 172.21.15.153:0/857904038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8006dcb0 con 0x7f5f800afc90 2023-11-24T08:05:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.319+0000 7f5f855e1700 1 -- 172.21.15.153:0/857904038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8014a550 con 0x7f5f800afc90 2023-11-24T08:05:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.320+0000 7f5f855e1700 1 -- 172.21.15.153:0/857904038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f80068fb0 con 0x7f5f800afc90 2023-11-24T08:05:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.321+0000 7f5f777fe700 1 -- 172.21.15.153:0/857904038 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5f68003ba0 con 0x7f5f800afc90 2023-11-24T08:05:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.321+0000 7f5f777fe700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5f6006b080 0x7f5f6006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.321+0000 7f5f777fe700 1 -- 172.21.15.153:0/857904038 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5f68021070 con 0x7f5f800afc90 2023-11-24T08:05:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.321+0000 7f5f7effd700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5f6006b080 0x7f5f6006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.321+0000 7f5f7effd700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5f6006b080 0x7f5f6006d540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5f780012e0 tx=0x7f5f78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.326+0000 7f5f777fe700 1 -- 172.21.15.153:0/857904038 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f68056150 con 0x7f5f800afc90 2023-11-24T08:05:42.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:42.517+0000 7f5f855e1700 1 -- 172.21.15.153:0/857904038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5f8006de40 con 0x7f5f800afc90 2023-11-24T08:05:43.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.170+0000 7f5f777fe700 1 -- 172.21.15.153:0/857904038 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v41) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5f68059770 con 0x7f5f800afc90 2023-11-24T08:05:43.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.173+0000 7f5f855e1700 1 -- 172.21.15.153:0/857904038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5f6006b080 msgr2=0x7f5f6006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.173+0000 7f5f855e1700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5f6006b080 0x7f5f6006d540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5f780012e0 tx=0x7f5f78009040 comp rx=0 tx=0).stop 2023-11-24T08:05:43.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.173+0000 7f5f855e1700 1 -- 172.21.15.153:0/857904038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f800afc90 msgr2=0x7f5f800c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.173+0000 7f5f855e1700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f800afc90 0x7f5f800c92f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009b90 tx=0x7f5f68004750 comp rx=0 tx=0).stop 2023-11-24T08:05:43.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.173+0000 7f5f855e1700 1 -- 172.21.15.153:0/857904038 shutdown_connections 2023-11-24T08:05:43.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.173+0000 7f5f855e1700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f8015e160 0x7f5f800ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.173+0000 7f5f855e1700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f800746a0 0x7f5f800c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.173+0000 7f5f855e1700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5f6006b080 0x7f5f6006d540 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.173+0000 7f5f855e1700 1 --2- 172.21.15.153:0/857904038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f800afc90 0x7f5f800c92f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.173+0000 7f5f855e1700 1 -- 172.21.15.153:0/857904038 >> 172.21.15.153:0/857904038 conn(0x7f5f800d0bf0 msgr2=0x7f5f80072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:43.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.173+0000 7f5f855e1700 1 -- 172.21.15.153:0/857904038 shutdown_connections 2023-11-24T08:05:43.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.174+0000 7f5f855e1700 1 -- 172.21.15.153:0/857904038 wait complete. 2023-11-24T08:05:43.179 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-11-24T08:05:43.200 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:05:43.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.324+0000 7f21721e6700 1 Processor -- start 2023-11-24T08:05:43.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.324+0000 7f21721e6700 1 -- start start 2023-11-24T08:05:43.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.325+0000 7f21721e6700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f216c0b4310 0x7f216c06bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.325+0000 7f21721e6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f216c0ce430 0x7f216c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.325+0000 7f21721e6700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0cedc0 con 0x7f216c15e080 2023-11-24T08:05:43.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.325+0000 7f21721e6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c0d1200 con 0x7f216c0ce430 2023-11-24T08:05:43.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.325+0000 7f21721e6700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c15e460 con 0x7f216c0b4310 2023-11-24T08:05:43.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.325+0000 7f216bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f216c0ce430 0x7f216c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.325+0000 7f216bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f216c0ce430 0x7f216c0ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38270/0 (socket says 172.21.15.153:38270) 2023-11-24T08:05:43.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.325+0000 7f216bfff700 1 -- 172.21.15.153:0/1185555043 learned_addr learned my addr 172.21.15.153:0/1185555043 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.326+0000 7f216affd700 1 --2- 172.21.15.153:0/1185555043 >> v2:172.21.15.164:3300/0 conn(0x7f216c0b4310 0x7f216c06bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.326+0000 7f216bfff700 1 -- 172.21.15.153:0/1185555043 >> v2:172.21.15.164:3300/0 conn(0x7f216c0b4310 msgr2=0x7f216c06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.326+0000 7f216bfff700 1 --2- 172.21.15.153:0/1185555043 >> v2:172.21.15.164:3300/0 conn(0x7f216c0b4310 0x7f216c06bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.326+0000 7f216bfff700 1 -- 172.21.15.153:0/1185555043 >> v1:172.21.15.164:6789/0 conn(0x7f216c15e080 legacy=0x7f216c0d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.326+0000 7f216bfff700 1 -- 172.21.15.153:0/1185555043 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c06ba50 con 0x7f216c0ce430 2023-11-24T08:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.326+0000 7f216bfff700 1 --2- 172.21.15.153:0/1185555043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f216c0ce430 0x7f216c0ce880 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f216c072420 tx=0x7f216400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2423a434b1e8cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.326+0000 7f216a7fc700 1 -- 172.21.15.153:0/1185555043 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400e070 con 0x7f216c0ce430 2023-11-24T08:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.326+0000 7f216a7fc700 1 -- 172.21.15.153:0/1185555043 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164003a20 con 0x7f216c0ce430 2023-11-24T08:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.326+0000 7f216a7fc700 1 -- 172.21.15.153:0/1185555043 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164003dd0 con 0x7f216c0ce430 2023-11-24T08:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.327+0000 7f21721e6700 1 -- 172.21.15.153:0/1185555043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f216c0ce430 msgr2=0x7f216c0ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.327+0000 7f21721e6700 1 --2- 172.21.15.153:0/1185555043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f216c0ce430 0x7f216c0ce880 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f216c072420 tx=0x7f216400b330 comp rx=0 tx=0).stop 2023-11-24T08:05:43.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.327+0000 7f21721e6700 1 -- 172.21.15.153:0/1185555043 shutdown_connections 2023-11-24T08:05:43.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.327+0000 7f21721e6700 1 --2- 172.21.15.153:0/1185555043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f216c0ce430 0x7f216c0ce880 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.327+0000 7f21721e6700 1 --2- 172.21.15.153:0/1185555043 >> v2:172.21.15.164:3300/0 conn(0x7f216c0b4310 0x7f216c06bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.327+0000 7f21721e6700 1 -- 172.21.15.153:0/1185555043 >> 172.21.15.153:0/1185555043 conn(0x7f216c0b3780 msgr2=0x7f216c0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:43.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.327+0000 7f21721e6700 1 -- 172.21.15.153:0/1185555043 shutdown_connections 2023-11-24T08:05:43.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.327+0000 7f21721e6700 1 -- 172.21.15.153:0/1185555043 wait complete. 2023-11-24T08:05:43.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.328+0000 7f21721e6700 1 Processor -- start 2023-11-24T08:05:43.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.328+0000 7f21721e6700 1 -- start start 2023-11-24T08:05:43.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f21721e6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f216c0b4310 0x7f216c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f21721e6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f216c0ce430 0x7f216c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f21721e6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f216c15e080 0x7f216c0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f21721e6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c15f1a0 con 0x7f216c0ce430 2023-11-24T08:05:43.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f21721e6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0b6a20 con 0x7f216c0b4310 2023-11-24T08:05:43.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f21721e6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0b5ea0 con 0x7f216c15e080 2023-11-24T08:05:43.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f216c0ce430 0x7f216c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f216c0ce430 0x7f216c0b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38274/0 (socket says 172.21.15.153:38274) 2023-11-24T08:05:43.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216affd700 1 -- 172.21.15.153:0/1529716038 learned_addr learned my addr 172.21.15.153:0/1529716038 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:43.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216b7fe700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f216c0b4310 0x7f216c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216bfff700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f216c15e080 0x7f216c0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216affd700 1 -- 172.21.15.153:0/1529716038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f216c15e080 msgr2=0x7f216c0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216affd700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f216c15e080 0x7f216c0b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216affd700 1 -- 172.21.15.153:0/1529716038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f216c0b4310 msgr2=0x7f216c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216affd700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f216c0b4310 0x7f216c0b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216affd700 1 -- 172.21.15.153:0/1529716038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2164009b30 con 0x7f216c0ce430 2023-11-24T08:05:43.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216bfff700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f216c15e080 0x7f216c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:43.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f216affd700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f216c0ce430 0x7f216c0b7230 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c7f0 tx=0x7f215c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:43.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f2153fff700 1 -- 172.21.15.153:0/1529716038 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c004220 con 0x7f216c0ce430 2023-11-24T08:05:43.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f2153fff700 1 -- 172.21.15.153:0/1529716038 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c004380 con 0x7f216c0ce430 2023-11-24T08:05:43.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f21721e6700 1 -- 172.21.15.153:0/1529716038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c0b6180 con 0x7f216c0ce430 2023-11-24T08:05:43.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.329+0000 7f2153fff700 1 -- 172.21.15.153:0/1529716038 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c0038e0 con 0x7f216c0ce430 2023-11-24T08:05:43.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.330+0000 7f21721e6700 1 -- 172.21.15.153:0/1529716038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c0b6740 con 0x7f216c0ce430 2023-11-24T08:05:43.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.330+0000 7f21721e6700 1 -- 172.21.15.153:0/1529716038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c068fb0 con 0x7f216c0ce430 2023-11-24T08:05:43.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.331+0000 7f2153fff700 1 -- 172.21.15.153:0/1529716038 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f215c003a40 con 0x7f216c0ce430 2023-11-24T08:05:43.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.331+0000 7f2153fff700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f215806b0b0 0x7f215806d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.331+0000 7f2153fff700 1 -- 172.21.15.153:0/1529716038 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f215c089690 con 0x7f216c0ce430 2023-11-24T08:05:43.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.331+0000 7f216b7fe700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f215806b0b0 0x7f215806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.332+0000 7f216b7fe700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f215806b0b0 0x7f215806d570 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2160009960 tx=0x7f21600090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:43.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.336+0000 7f2153fff700 1 -- 172.21.15.153:0/1529716038 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f215c054380 con 0x7f216c0ce430 2023-11-24T08:05:43.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:43.572+0000 7f21721e6700 1 -- 172.21.15.153:0/1529716038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f216c0b7ab0 con 0x7f216c0ce430 2023-11-24T08:05:44.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.189+0000 7f2153fff700 1 -- 172.21.15.153:0/1529716038 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7f215c0579a0 con 0x7f216c0ce430 2023-11-24T08:05:44.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.193+0000 7f21721e6700 1 -- 172.21.15.153:0/1529716038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f215806b0b0 msgr2=0x7f215806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.193+0000 7f21721e6700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f215806b0b0 0x7f215806d570 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2160009960 tx=0x7f21600090e0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.193+0000 7f21721e6700 1 -- 172.21.15.153:0/1529716038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f216c0ce430 msgr2=0x7f216c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.193+0000 7f21721e6700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f216c0ce430 0x7f216c0b7230 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c7f0 tx=0x7f215c00cb00 comp rx=0 tx=0).stop 2023-11-24T08:05:44.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.193+0000 7f21721e6700 1 -- 172.21.15.153:0/1529716038 shutdown_connections 2023-11-24T08:05:44.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.193+0000 7f21721e6700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f216c15e080 0x7f216c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.193+0000 7f21721e6700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f216c0b4310 0x7f216c0b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.193+0000 7f21721e6700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f215806b0b0 0x7f215806d570 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.193+0000 7f21721e6700 1 --2- 172.21.15.153:0/1529716038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f216c0ce430 0x7f216c0b7230 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.193+0000 7f21721e6700 1 -- 172.21.15.153:0/1529716038 >> 172.21.15.153:0/1529716038 conn(0x7f216c0b3780 msgr2=0x7f216c0cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:44.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.196+0000 7f21721e6700 1 -- 172.21.15.153:0/1529716038 shutdown_connections 2023-11-24T08:05:44.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.196+0000 7f21721e6700 1 -- 172.21.15.153:0/1529716038 wait complete. 2023-11-24T08:05:44.203 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 6 and data pool 7 2023-11-24T08:05:44.212 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:44.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.331+0000 7f37ba7f2700 1 Processor -- start 2023-11-24T08:05:44.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.331+0000 7f37ba7f2700 1 -- start start 2023-11-24T08:05:44.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.332+0000 7f37ba7f2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37b415dea0 0x7f37b40d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.332+0000 7f37ba7f2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f37b415e280 0x7f37b40cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.332+0000 7f37ba7f2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37b40cf250 0x7f37b406b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.332+0000 7f37ba7f2700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b40d2670 con 0x7f37b40cf250 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.332+0000 7f37ba7f2700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b406c4a0 con 0x7f37b415e280 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.332+0000 7f37ba7f2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40d0a80 con 0x7f37b415dea0 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.332+0000 7f37b8d8f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37b40cf250 0x7f37b406b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.332+0000 7f37b8d8f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37b40cf250 0x7f37b406b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38298/0 (socket says 172.21.15.153:38298) 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.332+0000 7f37b8d8f700 1 -- 172.21.15.153:0/541678815 learned_addr learned my addr 172.21.15.153:0/541678815 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b37fe700 1 --2- 172.21.15.153:0/541678815 >> v2:172.21.15.164:3300/0 conn(0x7f37b415e280 0x7f37b40cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b3fff700 1 --2- 172.21.15.153:0/541678815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37b415dea0 0x7f37b40d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b8d8f700 1 -- 172.21.15.153:0/541678815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37b415dea0 msgr2=0x7f37b40d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b8d8f700 1 --2- 172.21.15.153:0/541678815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37b415dea0 0x7f37b40d1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b8d8f700 1 -- 172.21.15.153:0/541678815 >> v2:172.21.15.164:3300/0 conn(0x7f37b415e280 msgr2=0x7f37b40cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b8d8f700 1 --2- 172.21.15.153:0/541678815 >> v2:172.21.15.164:3300/0 conn(0x7f37b415e280 0x7f37b40cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b8d8f700 1 -- 172.21.15.153:0/541678815 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40cfeb0 con 0x7f37b40cf250 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b3fff700 1 --2- 172.21.15.153:0/541678815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37b415dea0 0x7f37b40d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b8d8f700 1 --2- 172.21.15.153:0/541678815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b40cf250 0x7f37b406b8e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f37b40cf750 tx=0x7f37ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ba5ae94c6526a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b2ffd700 1 -- 172.21.15.153:0/541678815 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00e070 con 0x7f37b40cf250 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b2ffd700 1 -- 172.21.15.153:0/541678815 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac00b910 con 0x7f37b40cf250 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.333+0000 7f37b2ffd700 1 -- 172.21.15.153:0/541678815 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00bcc0 con 0x7f37b40cf250 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.334+0000 7f37ba7f2700 1 -- 172.21.15.153:0/541678815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b40cf250 msgr2=0x7f37b406b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.334+0000 7f37ba7f2700 1 --2- 172.21.15.153:0/541678815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b40cf250 0x7f37b406b8e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f37b40cf750 tx=0x7f37ac00b330 comp rx=0 tx=0).stop 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.334+0000 7f37ba7f2700 1 -- 172.21.15.153:0/541678815 shutdown_connections 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.334+0000 7f37ba7f2700 1 --2- 172.21.15.153:0/541678815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b40cf250 0x7f37b406b8e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.334+0000 7f37ba7f2700 1 --2- 172.21.15.153:0/541678815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37b415dea0 0x7f37b40d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.334+0000 7f37ba7f2700 1 --2- 172.21.15.153:0/541678815 >> v2:172.21.15.164:3300/0 conn(0x7f37b415e280 0x7f37b40cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.334+0000 7f37ba7f2700 1 -- 172.21.15.153:0/541678815 >> 172.21.15.153:0/541678815 conn(0x7f37b4073130 msgr2=0x7f37b409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:44.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.334+0000 7f37ba7f2700 1 -- 172.21.15.153:0/541678815 shutdown_connections 2023-11-24T08:05:44.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.334+0000 7f37ba7f2700 1 -- 172.21.15.153:0/541678815 wait complete. 2023-11-24T08:05:44.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.335+0000 7f37ba7f2700 1 Processor -- start 2023-11-24T08:05:44.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.335+0000 7f37ba7f2700 1 -- start start 2023-11-24T08:05:44.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37ba7f2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b40cf250 0x7f37b40cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37ba7f2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37b415dea0 0x7f37b40c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37ba7f2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37b41f3250 0x7f37b406fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37ba7f2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c84c0 con 0x7f37b40cf250 2023-11-24T08:05:44.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37ba7f2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4150bd0 con 0x7f37b41f3250 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37ba7f2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b41f7db0 con 0x7f37b415dea0 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b40cf250 0x7f37b40cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b40cf250 0x7f37b40cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38300/0 (socket says 172.21.15.153:38300) 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b3fff700 1 -- 172.21.15.153:0/3771565804 learned_addr learned my addr 172.21.15.153:0/3771565804 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b8d8f700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37b41f3250 0x7f37b406fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b37fe700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37b415dea0 0x7f37b40c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b3fff700 1 -- 172.21.15.153:0/3771565804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37b415dea0 msgr2=0x7f37b40c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b3fff700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37b415dea0 0x7f37b40c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b3fff700 1 -- 172.21.15.153:0/3771565804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37b41f3250 msgr2=0x7f37b406fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b3fff700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37b41f3250 0x7f37b406fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b3fff700 1 -- 172.21.15.153:0/3771565804 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac009b30 con 0x7f37b40cf250 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b3fff700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b40cf250 0x7f37b40cc050 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f37a800e840 tx=0x7f37a800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b0ff9700 1 -- 172.21.15.153:0/3771565804 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8013610 con 0x7f37b40cf250 2023-11-24T08:05:44.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b0ff9700 1 -- 172.21.15.153:0/3771565804 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a8013770 con 0x7f37b40cf250 2023-11-24T08:05:44.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37ba7f2700 1 -- 172.21.15.153:0/3771565804 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b4151520 con 0x7f37b40cf250 2023-11-24T08:05:44.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.336+0000 7f37b0ff9700 1 -- 172.21.15.153:0/3771565804 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8013b20 con 0x7f37b40cf250 2023-11-24T08:05:44.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.337+0000 7f37ba7f2700 1 -- 172.21.15.153:0/3771565804 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b41f72d0 con 0x7f37b40cf250 2023-11-24T08:05:44.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.337+0000 7f37ba7f2700 1 -- 172.21.15.153:0/3771565804 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b4067f60 con 0x7f37b40cf250 2023-11-24T08:05:44.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.338+0000 7f37b0ff9700 1 -- 172.21.15.153:0/3771565804 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f37a8013c80 con 0x7f37b40cf250 2023-11-24T08:05:44.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.338+0000 7f37b0ff9700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37a006b080 0x7f37a006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.339+0000 7f37b37fe700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37a006b080 0x7f37a006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.339+0000 7f37b0ff9700 1 -- 172.21.15.153:0/3771565804 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37a8089590 con 0x7f37b40cf250 2023-11-24T08:05:44.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.339+0000 7f37b37fe700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37a006b080 0x7f37a006d540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009ac0 tx=0x7f37a4009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.343+0000 7f37b0ff9700 1 -- 172.21.15.153:0/3771565804 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37a80542b0 con 0x7f37b40cf250 2023-11-24T08:05:44.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.535+0000 7f37ba7f2700 1 -- 172.21.15.153:0/3771565804 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37b40b7bf0 con 0x7f37b40cf250 2023-11-24T08:05:44.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.537+0000 7f37b0ff9700 1 -- 172.21.15.153:0/3771565804 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16562 (secure 0 0 0) 0x7f37a80578d0 con 0x7f37b40cf250 2023-11-24T08:05:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:44.539 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":42,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:43.573834+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:41.978248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:42.535670+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:44.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 -- 172.21.15.153:0/3771565804 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37a006b080 msgr2=0x7f37a006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37a006b080 0x7f37a006d540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009ac0 tx=0x7f37a4009210 comp rx=0 tx=0).stop 2023-11-24T08:05:44.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 -- 172.21.15.153:0/3771565804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b40cf250 msgr2=0x7f37b40cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b40cf250 0x7f37b40cc050 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f37a800e840 tx=0x7f37a800eb50 comp rx=0 tx=0).stop 2023-11-24T08:05:44.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 -- 172.21.15.153:0/3771565804 shutdown_connections 2023-11-24T08:05:44.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37b41f3250 0x7f37b406fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37a006b080 0x7f37a006d540 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b40cf250 0x7f37b40cc050 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 --2- 172.21.15.153:0/3771565804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37b415dea0 0x7f37b40c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 -- 172.21.15.153:0/3771565804 >> 172.21.15.153:0/3771565804 conn(0x7f37b4073130 msgr2=0x7f37b406f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:44.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 -- 172.21.15.153:0/3771565804 shutdown_connections 2023-11-24T08:05:44.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.539+0000 7f37ba7f2700 1 -- 172.21.15.153:0/3771565804 wait complete. 2023-11-24T08:05:44.554 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:44.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.673+0000 7fcce33a2700 1 Processor -- start 2023-11-24T08:05:44.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.674+0000 7fcce33a2700 1 -- start start 2023-11-24T08:05:44.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.674+0000 7fcce33a2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fccdc15bdd0 0x7fccdc1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.674+0000 7fcce33a2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fccdc0b3370 0x7fccdc0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.674+0000 7fcce33a2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccdc0d1c70 0x7fccdc0d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.674+0000 7fcce33a2700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc0b2f50 con 0x7fccdc0b3370 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.674+0000 7fcce33a2700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc0d2660 con 0x7fccdc15bdd0 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.674+0000 7fcce33a2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0b2030 con 0x7fccdc0d1c70 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fcce093d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fccdc0b3370 0x7fccdc0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fcce093d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fccdc0b3370 0x7fccdc0b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38308/0 (socket says 172.21.15.153:38308) 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fcce093d700 1 -- 172.21.15.153:0/3129264950 learned_addr learned my addr 172.21.15.153:0/3129264950 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fcce113e700 1 --2- 172.21.15.153:0/3129264950 >> v2:172.21.15.164:3300/0 conn(0x7fccdc15bdd0 0x7fccdc1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fcce193f700 1 --2- 172.21.15.153:0/3129264950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccdc0d1c70 0x7fccdc0d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fcce093d700 1 -- 172.21.15.153:0/3129264950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccdc0d1c70 msgr2=0x7fccdc0d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fcce093d700 1 --2- 172.21.15.153:0/3129264950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccdc0d1c70 0x7fccdc0d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fcce093d700 1 -- 172.21.15.153:0/3129264950 >> v2:172.21.15.164:3300/0 conn(0x7fccdc15bdd0 msgr2=0x7fccdc1604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fcce093d700 1 --2- 172.21.15.153:0/3129264950 >> v2:172.21.15.164:3300/0 conn(0x7fccdc15bdd0 0x7fccdc1604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fcce093d700 1 -- 172.21.15.153:0/3129264950 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0b22d0 con 0x7fccdc0b3370 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fcce093d700 1 --2- 172.21.15.153:0/3129264950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccdc0b3370 0x7fccdc0b1af0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fccdc06ec10 tx=0x7fccd8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657617cac251305a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fccd3fff700 1 -- 172.21.15.153:0/3129264950 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800b870 con 0x7fccdc0b3370 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fccd3fff700 1 -- 172.21.15.153:0/3129264950 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd800b9d0 con 0x7fccdc0b3370 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.675+0000 7fccd3fff700 1 -- 172.21.15.153:0/3129264950 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800bd60 con 0x7fccdc0b3370 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.676+0000 7fcce33a2700 1 -- 172.21.15.153:0/3129264950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccdc0b3370 msgr2=0x7fccdc0b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.676+0000 7fcce33a2700 1 --2- 172.21.15.153:0/3129264950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccdc0b3370 0x7fccdc0b1af0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fccdc06ec10 tx=0x7fccd8009bd0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.676+0000 7fcce33a2700 1 -- 172.21.15.153:0/3129264950 shutdown_connections 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.676+0000 7fcce33a2700 1 --2- 172.21.15.153:0/3129264950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccdc0d1c70 0x7fccdc0d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.676+0000 7fcce33a2700 1 --2- 172.21.15.153:0/3129264950 >> v2:172.21.15.164:3300/0 conn(0x7fccdc15bdd0 0x7fccdc1604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.676+0000 7fcce33a2700 1 --2- 172.21.15.153:0/3129264950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccdc0b3370 0x7fccdc0b1af0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.676+0000 7fcce33a2700 1 -- 172.21.15.153:0/3129264950 >> 172.21.15.153:0/3129264950 conn(0x7fccdc0731a0 msgr2=0x7fccdc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:44.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.676+0000 7fcce33a2700 1 -- 172.21.15.153:0/3129264950 shutdown_connections 2023-11-24T08:05:44.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.676+0000 7fcce33a2700 1 -- 172.21.15.153:0/3129264950 wait complete. 2023-11-24T08:05:44.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.677+0000 7fcce33a2700 1 Processor -- start 2023-11-24T08:05:44.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.677+0000 7fcce33a2700 1 -- start start 2023-11-24T08:05:44.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce33a2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccdc0b3370 0x7fccdc157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce33a2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fccdc0d1c70 0x7fccdc0cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce33a2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccdc15bdd0 0x7fccdc0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce33a2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc1f3300 con 0x7fccdc0b3370 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce33a2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0b6920 con 0x7fccdc0d1c70 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce33a2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0b7510 con 0x7fccdc15bdd0 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce113e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccdc0b3370 0x7fccdc157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce113e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccdc0b3370 0x7fccdc157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38314/0 (socket says 172.21.15.153:38314) 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce113e700 1 -- 172.21.15.153:0/954115636 learned_addr learned my addr 172.21.15.153:0/954115636 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce193f700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccdc15bdd0 0x7fccdc0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce093d700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fccdc0d1c70 0x7fccdc0cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce113e700 1 -- 172.21.15.153:0/954115636 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccdc15bdd0 msgr2=0x7fccdc0cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce113e700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccdc15bdd0 0x7fccdc0cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce113e700 1 -- 172.21.15.153:0/954115636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fccdc0d1c70 msgr2=0x7fccdc0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce113e700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fccdc0d1c70 0x7fccdc0cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce113e700 1 -- 172.21.15.153:0/954115636 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd8009550 con 0x7fccdc0b3370 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce113e700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccdc0b3370 0x7fccdc157140 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00d800 tx=0x7fcccc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fccd1ffb700 1 -- 172.21.15.153:0/954115636 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0125f0 con 0x7fccdc0b3370 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fccd1ffb700 1 -- 172.21.15.153:0/954115636 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc012750 con 0x7fccdc0b3370 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fcce33a2700 1 -- 172.21.15.153:0/954115636 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc157680 con 0x7fccdc0b3370 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.678+0000 7fccd1ffb700 1 -- 172.21.15.153:0/954115636 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc012b00 con 0x7fccdc0b3370 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.679+0000 7fcce33a2700 1 -- 172.21.15.153:0/954115636 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc1f2c40 con 0x7fccdc0b3370 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.679+0000 7fcce33a2700 1 -- 172.21.15.153:0/954115636 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc1f3570 con 0x7fccdc0b3370 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.680+0000 7fccd1ffb700 1 -- 172.21.15.153:0/954115636 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fcccc012c60 con 0x7fccdc0b3370 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.681+0000 7fccd1ffb700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fccc006b080 0x7fccc006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.681+0000 7fccd1ffb700 1 -- 172.21.15.153:0/954115636 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcccc08a770 con 0x7fccdc0b3370 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.681+0000 7fcce093d700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fccc006b080 0x7fccc006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.681+0000 7fcce093d700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fccc006b080 0x7fccc006d540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0b37e0 tx=0x7fccd8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.685+0000 7fccd1ffb700 1 -- 172.21.15.153:0/954115636 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcccc055610 con 0x7fccdc0b3370 2023-11-24T08:05:44.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.877+0000 7fcce33a2700 1 -- 172.21.15.153:0/954115636 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccdc067f60 con 0x7fccdc0b3370 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.878+0000 7fccd1ffb700 1 -- 172.21.15.153:0/954115636 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16562 (secure 0 0 0) 0x7fcccc058c30 con 0x7fccdc0b3370 2023-11-24T08:05:44.881 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:44.881 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":42,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:43.573834+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:41.978248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:42.535670+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:44.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.880+0000 7fcce33a2700 1 -- 172.21.15.153:0/954115636 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fccc006b080 msgr2=0x7fccc006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.880+0000 7fcce33a2700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fccc006b080 0x7fccc006d540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0b37e0 tx=0x7fccd8008030 comp rx=0 tx=0).stop 2023-11-24T08:05:44.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.880+0000 7fcce33a2700 1 -- 172.21.15.153:0/954115636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccdc0b3370 msgr2=0x7fccdc157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.880+0000 7fcce33a2700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccdc0b3370 0x7fccdc157140 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00d800 tx=0x7fcccc00dbc0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.881+0000 7fcce33a2700 1 -- 172.21.15.153:0/954115636 shutdown_connections 2023-11-24T08:05:44.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.881+0000 7fcce33a2700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccdc15bdd0 0x7fccdc0cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.881+0000 7fcce33a2700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fccc006b080 0x7fccc006d540 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.881+0000 7fcce33a2700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccdc0b3370 0x7fccdc157140 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.881+0000 7fcce33a2700 1 --2- 172.21.15.153:0/954115636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fccdc0d1c70 0x7fccdc0cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.881+0000 7fcce33a2700 1 -- 172.21.15.153:0/954115636 >> 172.21.15.153:0/954115636 conn(0x7fccdc0731a0 msgr2=0x7fccdc0703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:44.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.881+0000 7fcce33a2700 1 -- 172.21.15.153:0/954115636 shutdown_connections 2023-11-24T08:05:44.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:44.881+0000 7fcce33a2700 1 -- 172.21.15.153:0/954115636 wait complete. 2023-11-24T08:05:44.895 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:05:45.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.018+0000 7fd6c9eba700 1 Processor -- start 2023-11-24T08:05:45.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.018+0000 7fd6c9eba700 1 -- start start 2023-11-24T08:05:45.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.018+0000 7fd6c9eba700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd6c4145720 0x7fd6c406bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:45.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.018+0000 7fd6c9eba700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c40b5730 0x7fd6c40b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:45.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.018+0000 7fd6c9eba700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c40b60d0 con 0x7fd6c415f8f0 2023-11-24T08:05:45.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.018+0000 7fd6c9eba700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c406b750 con 0x7fd6c4145720 2023-11-24T08:05:45.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.018+0000 7fd6c9eba700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4160870 con 0x7fd6c40b5730 2023-11-24T08:05:45.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c37fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd6c4145720 0x7fd6c406bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:45.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c3fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd6c415f8f0 0x7fd6c415fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44430/0 (socket says 172.21.15.153:44430) 2023-11-24T08:05:45.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c3fff700 1 -- 172.21.15.153:0/4066467724 learned_addr learned my addr 172.21.15.153:0/4066467724 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:45.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c2ffd700 1 --2- 172.21.15.153:0/4066467724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c40b5730 0x7fd6c40b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:45.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c37fe700 1 -- 172.21.15.153:0/4066467724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c40b5730 msgr2=0x7fd6c40b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:45.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c37fe700 1 --2- 172.21.15.153:0/4066467724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c40b5730 0x7fd6c40b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:45.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c37fe700 1 -- 172.21.15.153:0/4066467724 >> v1:172.21.15.153:6789/0 conn(0x7fd6c415f8f0 legacy=0x7fd6c415fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:45.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c37fe700 1 -- 172.21.15.153:0/4066467724 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4160590 con 0x7fd6c4145720 2023-11-24T08:05:45.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c2ffd700 1 --2- 172.21.15.153:0/4066467724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c40b5730 0x7fd6c40b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:45.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c27fc700 1 -- 172.21.15.153:0/4066467724 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464699546 0 0) 0x7fd6c40b60d0 con 0x7fd6c415f8f0 2023-11-24T08:05:45.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c37fe700 1 --2- 172.21.15.153:0/4066467724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c4145720 0x7fd6c406bbe0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009840 tx=0x7fd6b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c833e5e6eda9079f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:45.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c27fc700 1 -- 172.21.15.153:0/4066467724 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4011830 con 0x7fd6c4145720 2023-11-24T08:05:45.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c27fc700 1 -- 172.21.15.153:0/4066467724 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b4011990 con 0x7fd6c4145720 2023-11-24T08:05:45.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.019+0000 7fd6c27fc700 1 -- 172.21.15.153:0/4066467724 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4011d20 con 0x7fd6c4145720 2023-11-24T08:05:45.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.020+0000 7fd6c9eba700 1 -- 172.21.15.153:0/4066467724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c4145720 msgr2=0x7fd6c406bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:45.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.020+0000 7fd6c9eba700 1 --2- 172.21.15.153:0/4066467724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c4145720 0x7fd6c406bbe0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009840 tx=0x7fd6b4009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:45.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.020+0000 7fd6c9eba700 1 -- 172.21.15.153:0/4066467724 shutdown_connections 2023-11-24T08:05:45.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.020+0000 7fd6c9eba700 1 --2- 172.21.15.153:0/4066467724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c4145720 0x7fd6c406bbe0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:45.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.020+0000 7fd6c9eba700 1 --2- 172.21.15.153:0/4066467724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c40b5730 0x7fd6c40b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:45.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.020+0000 7fd6c9eba700 1 -- 172.21.15.153:0/4066467724 >> 172.21.15.153:0/4066467724 conn(0x7fd6c40d0be0 msgr2=0x7fd6c40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:45.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.020+0000 7fd6c9eba700 1 -- 172.21.15.153:0/4066467724 shutdown_connections 2023-11-24T08:05:45.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.020+0000 7fd6c9eba700 1 -- 172.21.15.153:0/4066467724 wait complete. 2023-11-24T08:05:45.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.021+0000 7fd6c9eba700 1 Processor -- start 2023-11-24T08:05:45.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.021+0000 7fd6c9eba700 1 -- start start 2023-11-24T08:05:45.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c9eba700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b5730 0x7fd6c406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:45.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c9eba700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c4145720 0x7fd6c415dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:45.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c9eba700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c415f8f0 0x7fd6c406e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:45.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c9eba700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4137bb0 con 0x7fd6c40b5730 2023-11-24T08:05:45.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c9eba700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4136f30 con 0x7fd6c415f8f0 2023-11-24T08:05:45.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c9eba700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4137210 con 0x7fd6c4145720 2023-11-24T08:05:45.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b5730 0x7fd6c406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:45.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b5730 0x7fd6c406d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38328/0 (socket says 172.21.15.153:38328) 2023-11-24T08:05:45.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c37fe700 1 -- 172.21.15.153:0/3171972750 learned_addr learned my addr 172.21.15.153:0/3171972750 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:45.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c2ffd700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c4145720 0x7fd6c415dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:45.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c3fff700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c415f8f0 0x7fd6c406e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:45.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c37fe700 1 -- 172.21.15.153:0/3171972750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c4145720 msgr2=0x7fd6c415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:45.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c37fe700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c4145720 0x7fd6c415dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:45.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c37fe700 1 -- 172.21.15.153:0/3171972750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c415f8f0 msgr2=0x7fd6c406e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:45.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c37fe700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c415f8f0 0x7fd6c406e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:45.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c37fe700 1 -- 172.21.15.153:0/3171972750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40094a0 con 0x7fd6c40b5730 2023-11-24T08:05:45.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.022+0000 7fd6c3fff700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c415f8f0 0x7fd6c406e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:45.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.023+0000 7fd6c37fe700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b5730 0x7fd6c406d8d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40090b0 tx=0x7fd6b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:45.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.023+0000 7fd6bbfff700 1 -- 172.21.15.153:0/3171972750 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40036a0 con 0x7fd6c40b5730 2023-11-24T08:05:45.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.023+0000 7fd6bbfff700 1 -- 172.21.15.153:0/3171972750 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b401f070 con 0x7fd6c40b5730 2023-11-24T08:05:45.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.023+0000 7fd6c9eba700 1 -- 172.21.15.153:0/3171972750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c41374f0 con 0x7fd6c40b5730 2023-11-24T08:05:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.023+0000 7fd6bbfff700 1 -- 172.21.15.153:0/3171972750 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4003a60 con 0x7fd6c40b5730 2023-11-24T08:05:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.023+0000 7fd6c9eba700 1 -- 172.21.15.153:0/3171972750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c415e2e0 con 0x7fd6c40b5730 2023-11-24T08:05:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.024+0000 7fd6c9eba700 1 -- 172.21.15.153:0/3171972750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c415e4a0 con 0x7fd6c40b5730 2023-11-24T08:05:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.024+0000 7fd6bbfff700 1 -- 172.21.15.153:0/3171972750 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd6b4003bc0 con 0x7fd6c40b5730 2023-11-24T08:05:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.025+0000 7fd6bbfff700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd6a406b080 0x7fd6a406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.025+0000 7fd6bbfff700 1 -- 172.21.15.153:0/3171972750 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6b4021070 con 0x7fd6c40b5730 2023-11-24T08:05:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.025+0000 7fd6c2ffd700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd6a406b080 0x7fd6a406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.025+0000 7fd6c2ffd700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd6a406b080 0x7fd6a406d540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4140d80 tx=0x7fd6ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:45.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.029+0000 7fd6bbfff700 1 -- 172.21.15.153:0/3171972750 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6b4056170 con 0x7fd6c40b5730 2023-11-24T08:05:45.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:45.270+0000 7fd6c9eba700 1 -- 172.21.15.153:0/3171972750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd6c4068fb0 con 0x7fd6c40b5730 2023-11-24T08:05:46.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.209+0000 7fd6bbfff700 1 -- 172.21.15.153:0/3171972750 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd6b4024380 con 0x7fd6c40b5730 2023-11-24T08:05:46.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.212+0000 7fd6c9eba700 1 -- 172.21.15.153:0/3171972750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd6a406b080 msgr2=0x7fd6a406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:46.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.212+0000 7fd6c9eba700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd6a406b080 0x7fd6a406d540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4140d80 tx=0x7fd6ac008040 comp rx=0 tx=0).stop 2023-11-24T08:05:46.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.212+0000 7fd6c9eba700 1 -- 172.21.15.153:0/3171972750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b5730 msgr2=0x7fd6c406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:46.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.212+0000 7fd6c9eba700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b5730 0x7fd6c406d8d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40090b0 tx=0x7fd6b4004750 comp rx=0 tx=0).stop 2023-11-24T08:05:46.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.212+0000 7fd6c9eba700 1 -- 172.21.15.153:0/3171972750 shutdown_connections 2023-11-24T08:05:46.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.212+0000 7fd6c9eba700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c415f8f0 0x7fd6c406e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:46.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.212+0000 7fd6c9eba700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd6a406b080 0x7fd6a406d540 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:46.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.212+0000 7fd6c9eba700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b5730 0x7fd6c406d8d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:46.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.212+0000 7fd6c9eba700 1 --2- 172.21.15.153:0/3171972750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c4145720 0x7fd6c415dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:46.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.212+0000 7fd6c9eba700 1 -- 172.21.15.153:0/3171972750 >> 172.21.15.153:0/3171972750 conn(0x7fd6c40d0be0 msgr2=0x7fd6c40af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:46.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.213+0000 7fd6c9eba700 1 -- 172.21.15.153:0/3171972750 shutdown_connections 2023-11-24T08:05:46.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.213+0000 7fd6c9eba700 1 -- 172.21.15.153:0/3171972750 wait complete. 2023-11-24T08:05:46.229 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:05:46.230 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:05:46.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.358+0000 7f61b7191700 1 Processor -- start 2023-11-24T08:05:46.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.358+0000 7f61b7191700 1 -- start start 2023-11-24T08:05:46.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b7191700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b0073f90 0x7f61b006f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:46.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b7191700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f61b015e1b0 0x7f61b00b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:46.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b7191700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b006fa50 con 0x7f61b0074370 2023-11-24T08:05:46.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b7191700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b015e770 con 0x7f61b015e1b0 2023-11-24T08:05:46.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b7191700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00b5630 con 0x7f61b0073f90 2023-11-24T08:05:46.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b4f2d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b0073f90 0x7f61b006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b4f2d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b0073f90 0x7f61b006f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:50406/0 (socket says 172.21.15.153:50406) 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b4f2d700 1 -- 172.21.15.153:0/1618358854 learned_addr learned my addr 172.21.15.153:0/1618358854 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61affff700 1 --2- 172.21.15.153:0/1618358854 >> v2:172.21.15.164:3300/0 conn(0x7f61b015e1b0 0x7f61b00b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b4f2d700 1 -- 172.21.15.153:0/1618358854 >> v2:172.21.15.164:3300/0 conn(0x7f61b015e1b0 msgr2=0x7f61b00b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b4f2d700 1 --2- 172.21.15.153:0/1618358854 >> v2:172.21.15.164:3300/0 conn(0x7f61b015e1b0 0x7f61b00b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b4f2d700 1 -- 172.21.15.153:0/1618358854 >> v1:172.21.15.164:6789/0 conn(0x7f61b0074370 legacy=0x7f61b006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61b4f2d700 1 -- 172.21.15.153:0/1618358854 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b00b41a0 con 0x7f61b0073f90 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61af7fe700 1 -- 172.21.15.153:0/1618358854 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745267949 0 0) 0x7f61a8001490 con 0x7f61b0074370 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.359+0000 7f61affff700 1 --2- 172.21.15.153:0/1618358854 >> v2:172.21.15.164:3300/0 conn(0x7f61b015e1b0 0x7f61b00b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61b4f2d700 1 --2- 172.21.15.153:0/1618358854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b0073f90 0x7f61b006f380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f61a40098f0 tx=0x7f61a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=365a246ed6b41023 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61af7fe700 1 -- 172.21.15.153:0/1618358854 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4011830 con 0x7f61b0073f90 2023-11-24T08:05:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61af7fe700 1 -- 172.21.15.153:0/1618358854 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a4011990 con 0x7f61b0073f90 2023-11-24T08:05:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61af7fe700 1 -- 172.21.15.153:0/1618358854 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4011d20 con 0x7f61b0073f90 2023-11-24T08:05:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61b7191700 1 -- 172.21.15.153:0/1618358854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b0073f90 msgr2=0x7f61b006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61b7191700 1 --2- 172.21.15.153:0/1618358854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b0073f90 0x7f61b006f380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f61a40098f0 tx=0x7f61a4009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61b7191700 1 -- 172.21.15.153:0/1618358854 shutdown_connections 2023-11-24T08:05:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61b7191700 1 --2- 172.21.15.153:0/1618358854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b0073f90 0x7f61b006f380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61b7191700 1 --2- 172.21.15.153:0/1618358854 >> v2:172.21.15.164:3300/0 conn(0x7f61b015e1b0 0x7f61b00b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61b7191700 1 -- 172.21.15.153:0/1618358854 >> 172.21.15.153:0/1618358854 conn(0x7f61b00d0c40 msgr2=0x7f61b00d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61b7191700 1 -- 172.21.15.153:0/1618358854 shutdown_connections 2023-11-24T08:05:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.360+0000 7f61b7191700 1 -- 172.21.15.153:0/1618358854 wait complete. 2023-11-24T08:05:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.362+0000 7f61b7191700 1 Processor -- start 2023-11-24T08:05:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.362+0000 7f61b7191700 1 -- start start 2023-11-24T08:05:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b7191700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61b0073f90 0x7f61b0145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b7191700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61b0074370 0x7f61b0156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b7191700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b015e1b0 0x7f61b0141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b7191700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0158680 con 0x7f61b0073f90 2023-11-24T08:05:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b7191700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0158960 con 0x7f61b0074370 2023-11-24T08:05:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b7191700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0158c40 con 0x7f61b015e1b0 2023-11-24T08:05:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b4f2d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61b0073f90 0x7f61b0145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b4f2d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61b0073f90 0x7f61b0145250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38342/0 (socket says 172.21.15.153:38342) 2023-11-24T08:05:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b4f2d700 1 -- 172.21.15.153:0/2852637354 learned_addr learned my addr 172.21.15.153:0/2852637354 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b572e700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b015e1b0 0x7f61b0141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b4f2d700 1 -- 172.21.15.153:0/2852637354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b015e1b0 msgr2=0x7f61b0141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b4f2d700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b015e1b0 0x7f61b0141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b4f2d700 1 -- 172.21.15.153:0/2852637354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61b0074370 msgr2=0x7f61b0156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b4f2d700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61b0074370 0x7f61b0156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.363+0000 7f61b4f2d700 1 -- 172.21.15.153:0/2852637354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0094a0 con 0x7f61b0073f90 2023-11-24T08:05:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.364+0000 7f61b4f2d700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61b0073f90 0x7f61b0145250 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009c40 tx=0x7f61a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.364+0000 7f61ad7fa700 1 -- 172.21.15.153:0/2852637354 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40036a0 con 0x7f61b0073f90 2023-11-24T08:05:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.364+0000 7f61ad7fa700 1 -- 172.21.15.153:0/2852637354 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a401f070 con 0x7f61b0073f90 2023-11-24T08:05:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.364+0000 7f61b7191700 1 -- 172.21.15.153:0/2852637354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a4009550 con 0x7f61b0073f90 2023-11-24T08:05:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.364+0000 7f61ad7fa700 1 -- 172.21.15.153:0/2852637354 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4003a40 con 0x7f61b0073f90 2023-11-24T08:05:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.364+0000 7f61b7191700 1 -- 172.21.15.153:0/2852637354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b0156770 con 0x7f61b0073f90 2023-11-24T08:05:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.365+0000 7f61b7191700 1 -- 172.21.15.153:0/2852637354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b0068fb0 con 0x7f61b0073f90 2023-11-24T08:05:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.365+0000 7f61ad7fa700 1 -- 172.21.15.153:0/2852637354 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f61a4003ba0 con 0x7f61b0073f90 2023-11-24T08:05:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.366+0000 7f61ad7fa700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f619406b080 0x7f619406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.366+0000 7f61ad7fa700 1 -- 172.21.15.153:0/2852637354 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61a4021070 con 0x7f61b0073f90 2023-11-24T08:05:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.366+0000 7f61affff700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f619406b080 0x7f619406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.366+0000 7f61affff700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f619406b080 0x7f619406d540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f619c006f10 tx=0x7f619c006e60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.370+0000 7f61ad7fa700 1 -- 172.21.15.153:0/2852637354 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61a40560d0 con 0x7f61b0073f90 2023-11-24T08:05:46.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:46.604+0000 7f61b7191700 1 -- 172.21.15.153:0/2852637354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f61b01587c0 con 0x7f61b0073f90 2023-11-24T08:05:47.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.212+0000 7f61ad7fa700 1 -- 172.21.15.153:0/2852637354 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f61b01587c0 con 0x7f61b0073f90 2023-11-24T08:05:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 -- 172.21.15.153:0/2852637354 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f619406b080 msgr2=0x7f619406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f619406b080 0x7f619406d540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f619c006f10 tx=0x7f619c006e60 comp rx=0 tx=0).stop 2023-11-24T08:05:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 -- 172.21.15.153:0/2852637354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61b0073f90 msgr2=0x7f61b0145250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61b0073f90 0x7f61b0145250 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009c40 tx=0x7f61a4004750 comp rx=0 tx=0).stop 2023-11-24T08:05:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 -- 172.21.15.153:0/2852637354 shutdown_connections 2023-11-24T08:05:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61b015e1b0 0x7f61b0141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f619406b080 0x7f619406d540 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61b0073f90 0x7f61b0145250 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 --2- 172.21.15.153:0/2852637354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61b0074370 0x7f61b0156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 -- 172.21.15.153:0/2852637354 >> 172.21.15.153:0/2852637354 conn(0x7f61b00d0c40 msgr2=0x7f61b00b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:47.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 -- 172.21.15.153:0/2852637354 shutdown_connections 2023-11-24T08:05:47.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.215+0000 7f61b7191700 1 -- 172.21.15.153:0/2852637354 wait complete. 2023-11-24T08:05:47.231 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:05:47.231 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:47.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.354+0000 7f5c35d20700 1 Processor -- start 2023-11-24T08:05:47.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.354+0000 7f5c35d20700 1 -- start start 2023-11-24T08:05:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.355+0000 7f5c35d20700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5c300b3370 0x7f5c301604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.355+0000 7f5c35d20700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300d1c70 0x7f5c300d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.355+0000 7f5c35d20700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c300b22d0 con 0x7f5c3015bdd0 2023-11-24T08:05:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.355+0000 7f5c35d20700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c300b2f50 con 0x7f5c300b3370 2023-11-24T08:05:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.355+0000 7f5c35d20700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300d2640 con 0x7f5c300d1c70 2023-11-24T08:05:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.355+0000 7f5c2f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5c3015bdd0 0x7f5c300b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44454/0 (socket says 172.21.15.153:44454) 2023-11-24T08:05:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.355+0000 7f5c2f7fe700 1 -- 172.21.15.153:0/2134851514 learned_addr learned my addr 172.21.15.153:0/2134851514 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.355+0000 7f5c2ffff700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300d1c70 0x7f5c300d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.355+0000 7f5c2effd700 1 --2- 172.21.15.153:0/2134851514 >> v2:172.21.15.164:3300/0 conn(0x7f5c300b3370 0x7f5c301604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.355+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54511273 0 0) 0x7f5c300b22d0 con 0x7f5c3015bdd0 2023-11-24T08:05:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c1c0035b0 con 0x7f5c3015bdd0 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 378458089 0 0) 0x7f5c1c0035b0 con 0x7f5c3015bdd0 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300d1c70 msgr2=0x7f5c300d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300d1c70 0x7f5c300d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 >> v2:172.21.15.164:3300/0 conn(0x7f5c300b3370 msgr2=0x7f5c301604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 --2- 172.21.15.153:0/2134851514 >> v2:172.21.15.164:3300/0 conn(0x7f5c300b3370 0x7f5c301604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300b25b0 con 0x7f5c3015bdd0 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f5c18001670 con 0x7f5c3015bdd0 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 >> v1:172.21.15.153:6789/0 conn(0x7f5c3015bdd0 legacy=0x7f5c300b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300d1c70 0x7f5c1c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c1c003f80 0x7f5c1c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c1c004d90 0x7f5c1c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300b2f50 con 0x7f5c1c004d90 2023-11-24T08:05:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300d2640 con 0x7f5c1c003f80 2023-11-24T08:05:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c00ba10 con 0x7f5c300d1c70 2023-11-24T08:05:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2ffff700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c1c004d90 0x7f5c1c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2effd700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c1c003f80 0x7f5c1c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2f7fe700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300d1c70 0x7f5c1c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2ffff700 1 -- 172.21.15.153:0/2134851514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300d1c70 msgr2=0x7f5c1c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2ffff700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300d1c70 0x7f5c1c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2ffff700 1 -- 172.21.15.153:0/2134851514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c1c003f80 msgr2=0x7f5c1c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2ffff700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c1c003f80 0x7f5c1c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2ffff700 1 -- 172.21.15.153:0/2134851514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c0035b0 con 0x7f5c1c004d90 2023-11-24T08:05:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.356+0000 7f5c2ffff700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c1c004d90 0x7f5c1c005210 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009fc0 tx=0x7f5c1c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d677d97754b697 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.357+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2800ebd0 con 0x7f5c1c004d90 2023-11-24T08:05:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.357+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2800f040 con 0x7f5c1c004d90 2023-11-24T08:05:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.357+0000 7f5c2e7fc700 1 -- 172.21.15.153:0/2134851514 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28014480 con 0x7f5c1c004d90 2023-11-24T08:05:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.357+0000 7f5c35d20700 1 -- 172.21.15.153:0/2134851514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c1c004d90 msgr2=0x7f5c1c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.357+0000 7f5c35d20700 1 --2- 172.21.15.153:0/2134851514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c1c004d90 0x7f5c1c005210 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009fc0 tx=0x7f5c1c005880 comp rx=0 tx=0).stop 2023-11-24T08:05:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.357+0000 7f5c2ffff700 1 -- 172.21.15.153:0/2134851514 reap_dead start 2023-11-24T08:05:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.357+0000 7f5c35d20700 1 -- 172.21.15.153:0/2134851514 shutdown_connections 2023-11-24T08:05:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.357+0000 7f5c35d20700 1 -- 172.21.15.153:0/2134851514 >> 172.21.15.153:0/2134851514 conn(0x7f5c300731a0 msgr2=0x7f5c3009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.357+0000 7f5c35d20700 1 -- 172.21.15.153:0/2134851514 shutdown_connections 2023-11-24T08:05:47.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.357+0000 7f5c35d20700 1 -- 172.21.15.153:0/2134851514 wait complete. 2023-11-24T08:05:47.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.358+0000 7f5c35d20700 1 Processor -- start 2023-11-24T08:05:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.359+0000 7f5c35d20700 1 -- start start 2023-11-24T08:05:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.359+0000 7f5c35d20700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c300b5230 0x7f5c300c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.359+0000 7f5c35d20700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c300cb0f0 0x7f5c300b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.359+0000 7f5c35d20700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300cdf30 0x7f5c300ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.359+0000 7f5c35d20700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300cdb10 con 0x7f5c300cb0f0 2023-11-24T08:05:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.359+0000 7f5c35d20700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300cbb40 con 0x7f5c300b5230 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.359+0000 7f5c35d20700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300ca2f0 con 0x7f5c300cdf30 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.359+0000 7f5c2effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c300cb0f0 0x7f5c300b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.359+0000 7f5c2effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c300cb0f0 0x7f5c300b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38364/0 (socket says 172.21.15.153:38364) 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.359+0000 7f5c2effd700 1 -- 172.21.15.153:0/1065259220 learned_addr learned my addr 172.21.15.153:0/1065259220 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c2f7fe700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c300b5230 0x7f5c300c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c2ffff700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300cdf30 0x7f5c300ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c2effd700 1 -- 172.21.15.153:0/1065259220 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300cdf30 msgr2=0x7f5c300ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c2effd700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300cdf30 0x7f5c300ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c2effd700 1 -- 172.21.15.153:0/1065259220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c300b5230 msgr2=0x7f5c300c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c2effd700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c300b5230 0x7f5c300c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c2effd700 1 -- 172.21.15.153:0/1065259220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300b5b50 con 0x7f5c300cb0f0 2023-11-24T08:05:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c2ffff700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300cdf30 0x7f5c300ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c2effd700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c300cb0f0 0x7f5c300b5610 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5c20011ad0 tx=0x7f5c20011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c27fff700 1 -- 172.21.15.153:0/1065259220 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000f9a0 con 0x7f5c300cb0f0 2023-11-24T08:05:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c27fff700 1 -- 172.21.15.153:0/1065259220 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2000fb20 con 0x7f5c300cb0f0 2023-11-24T08:05:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c35d20700 1 -- 172.21.15.153:0/1065259220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3015c4b0 con 0x7f5c300cb0f0 2023-11-24T08:05:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c27fff700 1 -- 172.21.15.153:0/1065259220 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000fed0 con 0x7f5c300cb0f0 2023-11-24T08:05:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.360+0000 7f5c35d20700 1 -- 172.21.15.153:0/1065259220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c300cb860 con 0x7f5c300cb0f0 2023-11-24T08:05:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.361+0000 7f5c35d20700 1 -- 172.21.15.153:0/1065259220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c30067f60 con 0x7f5c300cb0f0 2023-11-24T08:05:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.362+0000 7f5c27fff700 1 -- 172.21.15.153:0/1065259220 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5c20014440 con 0x7f5c300cb0f0 2023-11-24T08:05:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.362+0000 7f5c27fff700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5c1006b080 0x7f5c1006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.363+0000 7f5c27fff700 1 -- 172.21.15.153:0/1065259220 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c2008a2e0 con 0x7f5c300cb0f0 2023-11-24T08:05:47.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.363+0000 7f5c2f7fe700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5c1006b080 0x7f5c1006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.363+0000 7f5c2f7fe700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5c1006b080 0x7f5c1006d540 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5c180048d0 tx=0x7f5c18009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:47.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.366+0000 7f5c27fff700 1 -- 172.21.15.153:0/1065259220 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c20055340 con 0x7f5c300cb0f0 2023-11-24T08:05:47.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.600+0000 7f5c35d20700 1 -- 172.21.15.153:0/1065259220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c300b7c60 con 0x7f5c300cb0f0 2023-11-24T08:05:47.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.600+0000 7f5c27fff700 1 -- 172.21.15.153:0/1065259220 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f5c20058960 con 0x7f5c300cb0f0 2023-11-24T08:05:47.602 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:47.602 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:47.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 -- 172.21.15.153:0/1065259220 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5c1006b080 msgr2=0x7f5c1006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5c1006b080 0x7f5c1006d540 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5c180048d0 tx=0x7f5c18009040 comp rx=0 tx=0).stop 2023-11-24T08:05:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 -- 172.21.15.153:0/1065259220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c300cb0f0 msgr2=0x7f5c300b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c300cb0f0 0x7f5c300b5610 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5c20011ad0 tx=0x7f5c20011e90 comp rx=0 tx=0).stop 2023-11-24T08:05:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 -- 172.21.15.153:0/1065259220 shutdown_connections 2023-11-24T08:05:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c300cdf30 0x7f5c300ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c300b5230 0x7f5c300c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5c1006b080 0x7f5c1006d540 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 --2- 172.21.15.153:0/1065259220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c300cb0f0 0x7f5c300b5610 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 -- 172.21.15.153:0/1065259220 >> 172.21.15.153:0/1065259220 conn(0x7f5c300731a0 msgr2=0x7f5c30159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 -- 172.21.15.153:0/1065259220 shutdown_connections 2023-11-24T08:05:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.603+0000 7f5c35d20700 1 -- 172.21.15.153:0/1065259220 wait complete. 2023-11-24T08:05:47.606 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 26 2023-11-24T08:05:47.617 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:47.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.736+0000 7f1afe63c700 1 Processor -- start 2023-11-24T08:05:47.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.736+0000 7f1afe63c700 1 -- start start 2023-11-24T08:05:47.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afe63c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1af815e080 0x7f1af80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afe63c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1af806c710 0x7f1af80afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afe63c700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af80ae430 con 0x7f1af80af4d0 2023-11-24T08:05:47.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afe63c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af80af0b0 con 0x7f1af806c710 2023-11-24T08:05:47.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afe63c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80b05a0 con 0x7f1af815e080 2023-11-24T08:05:47.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afcbd9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1af806c710 0x7f1af80afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afcbd9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1af806c710 0x7f1af80afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38374/0 (socket says 172.21.15.153:38374) 2023-11-24T08:05:47.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afcbd9700 1 -- 172.21.15.153:0/3903073185 learned_addr learned my addr 172.21.15.153:0/3903073185 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:47.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1af7fff700 1 --2- 172.21.15.153:0/3903073185 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1af815e080 0x7f1af80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afcbd9700 1 -- 172.21.15.153:0/3903073185 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1af815e080 msgr2=0x7f1af80b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:47.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afcbd9700 1 --2- 172.21.15.153:0/3903073185 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1af815e080 0x7f1af80b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afcbd9700 1 -- 172.21.15.153:0/3903073185 >> v1:172.21.15.164:6789/0 conn(0x7f1af80af4d0 legacy=0x7f1af806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afcbd9700 1 -- 172.21.15.153:0/3903073185 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af80ae710 con 0x7f1af806c710 2023-11-24T08:05:47.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1af7fff700 1 --2- 172.21.15.153:0/3903073185 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1af815e080 0x7f1af80b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:47.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.737+0000 7f1afcbd9700 1 --2- 172.21.15.153:0/3903073185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1af806c710 0x7f1af80afb90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009e80 tx=0x7f1af000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0a929844132a78 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:47.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.738+0000 7f1af6ffd700 1 -- 172.21.15.153:0/3903073185 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af000e070 con 0x7f1af806c710 2023-11-24T08:05:47.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.738+0000 7f1af6ffd700 1 -- 172.21.15.153:0/3903073185 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af000b980 con 0x7f1af806c710 2023-11-24T08:05:47.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.738+0000 7f1af6ffd700 1 -- 172.21.15.153:0/3903073185 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af000bd30 con 0x7f1af806c710 2023-11-24T08:05:47.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.738+0000 7f1afe63c700 1 -- 172.21.15.153:0/3903073185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1af806c710 msgr2=0x7f1af80afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.738+0000 7f1afe63c700 1 --2- 172.21.15.153:0/3903073185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1af806c710 0x7f1af80afb90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009e80 tx=0x7f1af000b330 comp rx=0 tx=0).stop 2023-11-24T08:05:47.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.738+0000 7f1afe63c700 1 -- 172.21.15.153:0/3903073185 shutdown_connections 2023-11-24T08:05:47.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.738+0000 7f1afe63c700 1 --2- 172.21.15.153:0/3903073185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1af806c710 0x7f1af80afb90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.738+0000 7f1afe63c700 1 --2- 172.21.15.153:0/3903073185 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1af815e080 0x7f1af80b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.738+0000 7f1afe63c700 1 -- 172.21.15.153:0/3903073185 >> 172.21.15.153:0/3903073185 conn(0x7f1af8071b90 msgr2=0x7f1af8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:47.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.738+0000 7f1afe63c700 1 -- 172.21.15.153:0/3903073185 shutdown_connections 2023-11-24T08:05:47.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.738+0000 7f1afe63c700 1 -- 172.21.15.153:0/3903073185 wait complete. 2023-11-24T08:05:47.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.740+0000 7f1afe63c700 1 Processor -- start 2023-11-24T08:05:47.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.740+0000 7f1afe63c700 1 -- start start 2023-11-24T08:05:47.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.740+0000 7f1afe63c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1af806c710 0x7f1af8153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.740+0000 7f1afe63c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1af80af4d0 0x7f1af8159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.740+0000 7f1afe63c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1af815e080 0x7f1af806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.740+0000 7f1afe63c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af8153c80 con 0x7f1af806c710 2023-11-24T08:05:47.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.740+0000 7f1afe63c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af81f4750 con 0x7f1af80af4d0 2023-11-24T08:05:47.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.740+0000 7f1afe63c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af81598c0 con 0x7f1af815e080 2023-11-24T08:05:47.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.740+0000 7f1af7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1af806c710 0x7f1af8153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.740+0000 7f1af7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1af806c710 0x7f1af8153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38376/0 (socket says 172.21.15.153:38376) 2023-11-24T08:05:47.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1af7fff700 1 -- 172.21.15.153:0/707653558 learned_addr learned my addr 172.21.15.153:0/707653558 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:47.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1af7fff700 1 -- 172.21.15.153:0/707653558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1af815e080 msgr2=0x7f1af806e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1afcbd9700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1af815e080 0x7f1af806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1af77fe700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1af80af4d0 0x7f1af8159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1af7fff700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1af815e080 0x7f1af806e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1af7fff700 1 -- 172.21.15.153:0/707653558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1af80af4d0 msgr2=0x7f1af8159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1af7fff700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1af80af4d0 0x7f1af8159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1af7fff700 1 -- 172.21.15.153:0/707653558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af0009b30 con 0x7f1af806c710 2023-11-24T08:05:47.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1af7fff700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1af806c710 0x7f1af8153740 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800e810 tx=0x7f1ae800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:47.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1af4ff9700 1 -- 172.21.15.153:0/707653558 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae800c020 con 0x7f1af806c710 2023-11-24T08:05:47.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1af4ff9700 1 -- 172.21.15.153:0/707653558 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae8004250 con 0x7f1af806c710 2023-11-24T08:05:47.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1afe63c700 1 -- 172.21.15.153:0/707653558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af81f3b40 con 0x7f1af806c710 2023-11-24T08:05:47.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1af4ff9700 1 -- 172.21.15.153:0/707653558 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae80036a0 con 0x7f1af806c710 2023-11-24T08:05:47.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.741+0000 7f1afe63c700 1 -- 172.21.15.153:0/707653558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af81f4100 con 0x7f1af806c710 2023-11-24T08:05:47.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.742+0000 7f1afe63c700 1 -- 172.21.15.153:0/707653558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af80753f0 con 0x7f1af806c710 2023-11-24T08:05:47.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.743+0000 7f1af4ff9700 1 -- 172.21.15.153:0/707653558 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1ae8003800 con 0x7f1af806c710 2023-11-24T08:05:47.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.743+0000 7f1af4ff9700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1ae406b080 0x7f1ae406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:47.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.743+0000 7f1af4ff9700 1 -- 172.21.15.153:0/707653558 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ae80893f0 con 0x7f1af806c710 2023-11-24T08:05:47.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.743+0000 7f1af77fe700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1ae406b080 0x7f1ae406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:47.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.743+0000 7f1af77fe700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1ae406b080 0x7f1ae406d540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1af81f1350 tx=0x7f1aec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:47.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.747+0000 7f1af4ff9700 1 -- 172.21.15.153:0/707653558 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ae80541a0 con 0x7f1af806c710 2023-11-24T08:05:47.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.938+0000 7f1afe63c700 1 -- 172.21.15.153:0/707653558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1af8067f60 con 0x7f1af806c710 2023-11-24T08:05:47.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.940+0000 7f1af4ff9700 1 -- 172.21.15.153:0/707653558 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16549 (secure 0 0 0) 0x7f1ae80577c0 con 0x7f1af806c710 2023-11-24T08:05:47.942 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:47.942 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":43,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:45.143974+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:41.978248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:42.535670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:47.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 -- 172.21.15.153:0/707653558 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1ae406b080 msgr2=0x7f1ae406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1ae406b080 0x7f1ae406d540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1af81f1350 tx=0x7f1aec009040 comp rx=0 tx=0).stop 2023-11-24T08:05:47.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 -- 172.21.15.153:0/707653558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1af806c710 msgr2=0x7f1af8153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:47.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1af806c710 0x7f1af8153740 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800e810 tx=0x7f1ae800ebd0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 -- 172.21.15.153:0/707653558 shutdown_connections 2023-11-24T08:05:47.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1af815e080 0x7f1af806e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1ae406b080 0x7f1ae406d540 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1af806c710 0x7f1af8153740 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 --2- 172.21.15.153:0/707653558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1af80af4d0 0x7f1af8159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:47.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 -- 172.21.15.153:0/707653558 >> 172.21.15.153:0/707653558 conn(0x7f1af8071b90 msgr2=0x7f1af806bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:47.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 -- 172.21.15.153:0/707653558 shutdown_connections 2023-11-24T08:05:47.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:47.942+0000 7f1afe63c700 1 -- 172.21.15.153:0/707653558 wait complete. 2023-11-24T08:05:47.956 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:05:47.956 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:48.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.075+0000 7f26c982f700 1 Processor -- start 2023-11-24T08:05:48.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.075+0000 7f26c982f700 1 -- start start 2023-11-24T08:05:48.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.076+0000 7f26c982f700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f26c415a3b0 0x7f26c40b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.076+0000 7f26c982f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26c40cf360 0x7f26c40b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.076+0000 7f26c982f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c415a790 con 0x7f26c40b3da0 2023-11-24T08:05:48.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.076+0000 7f26c982f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c415eec0 con 0x7f26c40cf360 2023-11-24T08:05:48.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.076+0000 7f26c982f700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c40cf8b0 con 0x7f26c415a3b0 2023-11-24T08:05:48.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.076+0000 7f26c27fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26c40cf360 0x7f26c40b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c27fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26c40cf360 0x7f26c40b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38384/0 (socket says 172.21.15.153:38384) 2023-11-24T08:05:48.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c27fc700 1 -- 172.21.15.153:0/3274247943 learned_addr learned my addr 172.21.15.153:0/3274247943 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:48.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c2ffd700 1 --2- 172.21.15.153:0/3274247943 >> v2:172.21.15.164:3300/0 conn(0x7f26c415a3b0 0x7f26c40b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c27fc700 1 -- 172.21.15.153:0/3274247943 >> v2:172.21.15.164:3300/0 conn(0x7f26c415a3b0 msgr2=0x7f26c40b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:48.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c27fc700 1 --2- 172.21.15.153:0/3274247943 >> v2:172.21.15.164:3300/0 conn(0x7f26c415a3b0 0x7f26c40b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c27fc700 1 -- 172.21.15.153:0/3274247943 >> v1:172.21.15.164:6789/0 conn(0x7f26c40b3da0 legacy=0x7f26c406dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:48.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c27fc700 1 -- 172.21.15.153:0/3274247943 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40b4c40 con 0x7f26c40cf360 2023-11-24T08:05:48.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c2ffd700 1 --2- 172.21.15.153:0/3274247943 >> v2:172.21.15.164:3300/0 conn(0x7f26c415a3b0 0x7f26c40b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:48.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c27fc700 1 --2- 172.21.15.153:0/3274247943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26c40cf360 0x7f26c40b3860 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f26c404fca0 tx=0x7f26b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1be15a44628d46 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:48.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c1ffb700 1 -- 172.21.15.153:0/3274247943 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4004230 con 0x7f26c40cf360 2023-11-24T08:05:48.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c1ffb700 1 -- 172.21.15.153:0/3274247943 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b4004390 con 0x7f26c40cf360 2023-11-24T08:05:48.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.077+0000 7f26c1ffb700 1 -- 172.21.15.153:0/3274247943 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40036a0 con 0x7f26c40cf360 2023-11-24T08:05:48.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.078+0000 7f26c982f700 1 -- 172.21.15.153:0/3274247943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26c40cf360 msgr2=0x7f26c40b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.078+0000 7f26c982f700 1 --2- 172.21.15.153:0/3274247943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26c40cf360 0x7f26c40b3860 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f26c404fca0 tx=0x7f26b4009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:48.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.078+0000 7f26c982f700 1 -- 172.21.15.153:0/3274247943 shutdown_connections 2023-11-24T08:05:48.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.078+0000 7f26c982f700 1 --2- 172.21.15.153:0/3274247943 >> v2:172.21.15.164:3300/0 conn(0x7f26c415a3b0 0x7f26c40b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.078+0000 7f26c982f700 1 --2- 172.21.15.153:0/3274247943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26c40cf360 0x7f26c40b3860 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.078+0000 7f26c982f700 1 -- 172.21.15.153:0/3274247943 >> 172.21.15.153:0/3274247943 conn(0x7f26c40b1740 msgr2=0x7f26c40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:48.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.078+0000 7f26c982f700 1 -- 172.21.15.153:0/3274247943 shutdown_connections 2023-11-24T08:05:48.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.078+0000 7f26c982f700 1 -- 172.21.15.153:0/3274247943 wait complete. 2023-11-24T08:05:48.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.079+0000 7f26c982f700 1 Processor -- start 2023-11-24T08:05:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.079+0000 7f26c982f700 1 -- start start 2023-11-24T08:05:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c982f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40b3da0 0x7f26c415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c982f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26c40cf360 0x7f26c4148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c982f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26c415a3b0 0x7f26c415a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c982f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c4145730 con 0x7f26c40cf360 2023-11-24T08:05:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c982f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c415c9e0 con 0x7f26c40b3da0 2023-11-24T08:05:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c982f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c4144ed0 con 0x7f26c415a3b0 2023-11-24T08:05:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c27fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26c40cf360 0x7f26c4148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c27fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26c40cf360 0x7f26c4148800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38390/0 (socket says 172.21.15.153:38390) 2023-11-24T08:05:48.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c27fc700 1 -- 172.21.15.153:0/2424623382 learned_addr learned my addr 172.21.15.153:0/2424623382 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:48.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c37fe700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26c415a3b0 0x7f26c415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c2ffd700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40b3da0 0x7f26c415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c27fc700 1 -- 172.21.15.153:0/2424623382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26c415a3b0 msgr2=0x7f26c415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c27fc700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26c415a3b0 0x7f26c415a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c27fc700 1 -- 172.21.15.153:0/2424623382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40b3da0 msgr2=0x7f26c415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c27fc700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40b3da0 0x7f26c415c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c27fc700 1 -- 172.21.15.153:0/2424623382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b4009550 con 0x7f26c40cf360 2023-11-24T08:05:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c2ffd700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40b3da0 0x7f26c415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26c27fc700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26c40cf360 0x7f26c4148800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009870 tx=0x7f26b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.080+0000 7f26abfff700 1 -- 172.21.15.153:0/2424623382 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4003d80 con 0x7f26c40cf360 2023-11-24T08:05:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.081+0000 7f26abfff700 1 -- 172.21.15.153:0/2424623382 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b401f070 con 0x7f26c40cf360 2023-11-24T08:05:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.081+0000 7f26c982f700 1 -- 172.21.15.153:0/2424623382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c4145170 con 0x7f26c40cf360 2023-11-24T08:05:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.081+0000 7f26abfff700 1 -- 172.21.15.153:0/2424623382 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4011870 con 0x7f26c40cf360 2023-11-24T08:05:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.081+0000 7f26c982f700 1 -- 172.21.15.153:0/2424623382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c4145f60 con 0x7f26c40cf360 2023-11-24T08:05:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.082+0000 7f26c982f700 1 -- 172.21.15.153:0/2424623382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c415cb20 con 0x7f26c40cf360 2023-11-24T08:05:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.082+0000 7f26abfff700 1 -- 172.21.15.153:0/2424623382 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f26b4021030 con 0x7f26c40cf360 2023-11-24T08:05:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.082+0000 7f26abfff700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b0b0 0x7f26b006d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.082+0000 7f26abfff700 1 -- 172.21.15.153:0/2424623382 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26b408aea0 con 0x7f26c40cf360 2023-11-24T08:05:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.082+0000 7f26c2ffd700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b0b0 0x7f26b006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.083+0000 7f26c2ffd700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b0b0 0x7f26b006d570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f26b8006fd0 tx=0x7f26b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:48.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.087+0000 7f26abfff700 1 -- 172.21.15.153:0/2424623382 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26b4055d60 con 0x7f26c40cf360 2023-11-24T08:05:48.200 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:48.203 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:48.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.280+0000 7f26c982f700 1 -- 172.21.15.153:0/2424623382 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26c40711e0 con 0x7f26b006b0b0 2023-11-24T08:05:48.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.289+0000 7f26abfff700 1 -- 172.21.15.153:0/2424623382 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288808 (secure 0 0 0) 0x7f26b800c050 con 0x7f26b006b0b0 2023-11-24T08:05:48.297 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:48.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.292+0000 7f26c982f700 1 -- 172.21.15.153:0/2424623382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b0b0 msgr2=0x7f26b006d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.292+0000 7f26c982f700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b0b0 0x7f26b006d570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f26b8006fd0 tx=0x7f26b8008040 comp rx=0 tx=0).stop 2023-11-24T08:05:48.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.292+0000 7f26c982f700 1 -- 172.21.15.153:0/2424623382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26c40cf360 msgr2=0x7f26c4148800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.292+0000 7f26c982f700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26c40cf360 0x7f26c4148800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009870 tx=0x7f26b4004750 comp rx=0 tx=0).stop 2023-11-24T08:05:48.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.292+0000 7f26c982f700 1 -- 172.21.15.153:0/2424623382 shutdown_connections 2023-11-24T08:05:48.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.292+0000 7f26c982f700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26c415a3b0 0x7f26c415a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.292+0000 7f26c982f700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40b3da0 0x7f26c415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.292+0000 7f26c982f700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b0b0 0x7f26b006d570 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.292+0000 7f26c982f700 1 --2- 172.21.15.153:0/2424623382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26c40cf360 0x7f26c4148800 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.292+0000 7f26c982f700 1 -- 172.21.15.153:0/2424623382 >> 172.21.15.153:0/2424623382 conn(0x7f26c40b1740 msgr2=0x7f26c4157b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:48.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.293+0000 7f26c982f700 1 -- 172.21.15.153:0/2424623382 shutdown_connections 2023-11-24T08:05:48.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.293+0000 7f26c982f700 1 -- 172.21.15.153:0/2424623382 wait complete. 2023-11-24T08:05:48.302 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:05:48.307 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-11-24T08:05:48.060734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221244,"kb_used_data":5048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753476,"statfs":{"total":773094113280,"available":772867559424,"internally_reserved":0,"allocated":5169152,"data_stored":2754371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.891074"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.163859+0000","last_change":"2023-11-24T08:05:44.160185+0000","last_active":"2023-11-24T08:05:44.163859+0000","last_peered":"2023-11-24T08:05:44.163859+0000","last_clean":"2023-11-24T08:05:44.163859+0000","last_became_active":"2023-11-24T08:05:44.159897+0000","last_became_peered":"2023-11-24T08:05:44.159897+0000","last_unstale":"2023-11-24T08:05:44.163859+0000","last_undegraded":"2023-11-24T08:05:44.163859+0000","last_fullsized":"2023-11-24T08:05:44.163859+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:16:52.821767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.167087+0000","last_change":"2023-11-24T08:05:44.162201+0000","last_active":"2023-11-24T08:05:44.167087+0000","last_peered":"2023-11-24T08:05:44.167087+0000","last_clean":"2023-11-24T08:05:44.167087+0000","last_became_active":"2023-11-24T08:05:44.161759+0000","last_became_peered":"2023-11-24T08:05:44.161759+0000","last_unstale":"2023-11-24T08:05:44.167087+0000","last_undegraded":"2023-11-24T08:05:44.167087+0000","last_fullsized":"2023-11-24T08:05:44.167087+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:16:52.821767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169150+0000","last_change":"2023-11-24T08:05:44.164352+0000","last_active":"2023-11-24T08:05:44.169150+0000","last_peered":"2023-11-24T08:05:44.169150+0000","last_clean":"2023-11-24T08:05:44.169150+0000","last_became_active":"2023-11-24T08:05:44.164060+0000","last_became_peered":"2023-11-24T08:05:44.164060+0000","last_unstale":"2023-11-24T08:05:44.169150+0000","last_undegraded":"2023-11-24T08:05:44.169150+0000","last_fullsized":"2023-11-24T08:05:44.169150+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:53.301615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168249+0000","last_change":"2023-11-24T08:05:44.163955+0000","last_active":"2023-11-24T08:05:44.168249+0000","last_peered":"2023-11-24T08:05:44.168249+0000","last_clean":"2023-11-24T08:05:44.168249+0000","last_became_active":"2023-11-24T08:05:44.163670+0000","last_became_peered":"2023-11-24T08:05:44.163670+0000","last_unstale":"2023-11-24T08:05:44.168249+0000","last_undegraded":"2023-11-24T08:05:44.168249+0000","last_fullsized":"2023-11-24T08:05:44.168249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:57.160571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166952+0000","last_change":"2023-11-24T08:05:44.163777+0000","last_active":"2023-11-24T08:05:44.166952+0000","last_peered":"2023-11-24T08:05:44.166952+0000","last_clean":"2023-11-24T08:05:44.166952+0000","last_became_active":"2023-11-24T08:05:44.163487+0000","last_became_peered":"2023-11-24T08:05:44.163487+0000","last_unstale":"2023-11-24T08:05:44.166952+0000","last_undegraded":"2023-11-24T08:05:44.166952+0000","last_fullsized":"2023-11-24T08:05:44.166952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:25.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.160451+0000","last_change":"2023-11-24T08:05:44.156835+0000","last_active":"2023-11-24T08:05:44.160451+0000","last_peered":"2023-11-24T08:05:44.160451+0000","last_clean":"2023-11-24T08:05:44.160451+0000","last_became_active":"2023-11-24T08:05:44.156562+0000","last_became_peered":"2023-11-24T08:05:44.156562+0000","last_unstale":"2023-11-24T08:05:44.160451+0000","last_undegraded":"2023-11-24T08:05:44.160451+0000","last_fullsized":"2023-11-24T08:05:44.160451+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:46:08.448281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169151+0000","last_change":"2023-11-24T08:05:44.164363+0000","last_active":"2023-11-24T08:05:44.169151+0000","last_peered":"2023-11-24T08:05:44.169151+0000","last_clean":"2023-11-24T08:05:44.169151+0000","last_became_active":"2023-11-24T08:05:44.164082+0000","last_became_peered":"2023-11-24T08:05:44.164082+0000","last_unstale":"2023-11-24T08:05:44.169151+0000","last_undegraded":"2023-11-24T08:05:44.169151+0000","last_fullsized":"2023-11-24T08:05:44.169151+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:35:43.201615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168908+0000","last_change":"2023-11-24T08:05:44.164684+0000","last_active":"2023-11-24T08:05:44.168908+0000","last_peered":"2023-11-24T08:05:44.168908+0000","last_clean":"2023-11-24T08:05:44.168908+0000","last_became_active":"2023-11-24T08:05:44.164293+0000","last_became_peered":"2023-11-24T08:05:44.164293+0000","last_unstale":"2023-11-24T08:05:44.168908+0000","last_undegraded":"2023-11-24T08:05:44.168908+0000","last_fullsized":"2023-11-24T08:05:44.168908+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:48:42.755278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168337+0000","last_change":"2023-11-24T08:05:44.163854+0000","last_active":"2023-11-24T08:05:44.168337+0000","last_peered":"2023-11-24T08:05:44.168337+0000","last_clean":"2023-11-24T08:05:44.168337+0000","last_became_active":"2023-11-24T08:05:44.163621+0000","last_became_peered":"2023-11-24T08:05:44.163621+0000","last_unstale":"2023-11-24T08:05:44.168337+0000","last_undegraded":"2023-11-24T08:05:44.168337+0000","last_fullsized":"2023-11-24T08:05:44.168337+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:09:32.902925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169079+0000","last_change":"2023-11-24T08:05:44.165912+0000","last_active":"2023-11-24T08:05:44.169079+0000","last_peered":"2023-11-24T08:05:44.169079+0000","last_clean":"2023-11-24T08:05:44.169079+0000","last_became_active":"2023-11-24T08:05:44.165586+0000","last_became_peered":"2023-11-24T08:05:44.165586+0000","last_unstale":"2023-11-24T08:05:44.169079+0000","last_undegraded":"2023-11-24T08:05:44.169079+0000","last_fullsized":"2023-11-24T08:05:44.169079+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:24:47.258524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168888+0000","last_change":"2023-11-24T08:05:44.164714+0000","last_active":"2023-11-24T08:05:44.168888+0000","last_peered":"2023-11-24T08:05:44.168888+0000","last_clean":"2023-11-24T08:05:44.168888+0000","last_became_active":"2023-11-24T08:05:44.163989+0000","last_became_peered":"2023-11-24T08:05:44.163989+0000","last_unstale":"2023-11-24T08:05:44.168888+0000","last_undegraded":"2023-11-24T08:05:44.168888+0000","last_fullsized":"2023-11-24T08:05:44.168888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:13.703528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.171788+0000","last_change":"2023-11-24T08:05:44.167128+0000","last_active":"2023-11-24T08:05:44.171788+0000","last_peered":"2023-11-24T08:05:44.171788+0000","last_clean":"2023-11-24T08:05:44.171788+0000","last_became_active":"2023-11-24T08:05:44.166834+0000","last_became_peered":"2023-11-24T08:05:44.166834+0000","last_unstale":"2023-11-24T08:05:44.171788+0000","last_undegraded":"2023-11-24T08:05:44.171788+0000","last_fullsized":"2023-11-24T08:05:44.171788+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:26:12.033988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170155+0000","last_change":"2023-11-24T08:05:44.163003+0000","last_active":"2023-11-24T08:05:44.170155+0000","last_peered":"2023-11-24T08:05:44.170155+0000","last_clean":"2023-11-24T08:05:44.170155+0000","last_became_active":"2023-11-24T08:05:44.162604+0000","last_became_peered":"2023-11-24T08:05:44.162604+0000","last_unstale":"2023-11-24T08:05:44.170155+0000","last_undegraded":"2023-11-24T08:05:44.170155+0000","last_fullsized":"2023-11-24T08:05:44.170155+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:14.842942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168318+0000","last_change":"2023-11-24T08:05:44.164468+0000","last_active":"2023-11-24T08:05:44.168318+0000","last_peered":"2023-11-24T08:05:44.168318+0000","last_clean":"2023-11-24T08:05:44.168318+0000","last_became_active":"2023-11-24T08:05:44.164069+0000","last_became_peered":"2023-11-24T08:05:44.164069+0000","last_unstale":"2023-11-24T08:05:44.168318+0000","last_undegraded":"2023-11-24T08:05:44.168318+0000","last_fullsized":"2023-11-24T08:05:44.168318+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:11.513164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162023+0000","last_change":"2023-11-24T08:05:44.160246+0000","last_active":"2023-11-24T08:05:44.162023+0000","last_peered":"2023-11-24T08:05:44.162023+0000","last_clean":"2023-11-24T08:05:44.162023+0000","last_became_active":"2023-11-24T08:05:44.159989+0000","last_became_peered":"2023-11-24T08:05:44.159989+0000","last_unstale":"2023-11-24T08:05:44.162023+0000","last_undegraded":"2023-11-24T08:05:44.162023+0000","last_fullsized":"2023-11-24T08:05:44.162023+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:12.556630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169303+0000","last_change":"2023-11-24T08:05:44.165840+0000","last_active":"2023-11-24T08:05:44.169303+0000","last_peered":"2023-11-24T08:05:44.169303+0000","last_clean":"2023-11-24T08:05:44.169303+0000","last_became_active":"2023-11-24T08:05:44.165582+0000","last_became_peered":"2023-11-24T08:05:44.165582+0000","last_unstale":"2023-11-24T08:05:44.169303+0000","last_undegraded":"2023-11-24T08:05:44.169303+0000","last_fullsized":"2023-11-24T08:05:44.169303+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:23.956996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162306+0000","last_change":"2023-11-24T08:05:44.160483+0000","last_active":"2023-11-24T08:05:44.162306+0000","last_peered":"2023-11-24T08:05:44.162306+0000","last_clean":"2023-11-24T08:05:44.162306+0000","last_became_active":"2023-11-24T08:05:44.160064+0000","last_became_peered":"2023-11-24T08:05:44.160064+0000","last_unstale":"2023-11-24T08:05:44.162306+0000","last_undegraded":"2023-11-24T08:05:44.162306+0000","last_fullsized":"2023-11-24T08:05:44.162306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:34.038812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169222+0000","last_change":"2023-11-24T08:05:44.165988+0000","last_active":"2023-11-24T08:05:44.169222+0000","last_peered":"2023-11-24T08:05:44.169222+0000","last_clean":"2023-11-24T08:05:44.169222+0000","last_became_active":"2023-11-24T08:05:44.165655+0000","last_became_peered":"2023-11-24T08:05:44.165655+0000","last_unstale":"2023-11-24T08:05:44.169222+0000","last_undegraded":"2023-11-24T08:05:44.169222+0000","last_fullsized":"2023-11-24T08:05:44.169222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:24:47.258524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169032+0000","last_change":"2023-11-24T08:05:44.163723+0000","last_active":"2023-11-24T08:05:44.169032+0000","last_peered":"2023-11-24T08:05:44.169032+0000","last_clean":"2023-11-24T08:05:44.169032+0000","last_became_active":"2023-11-24T08:05:44.163421+0000","last_became_peered":"2023-11-24T08:05:44.163421+0000","last_unstale":"2023-11-24T08:05:44.169032+0000","last_undegraded":"2023-11-24T08:05:44.169032+0000","last_fullsized":"2023-11-24T08:05:44.169032+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:13.703528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170196+0000","last_change":"2023-11-24T08:05:44.163857+0000","last_active":"2023-11-24T08:05:44.170196+0000","last_peered":"2023-11-24T08:05:44.170196+0000","last_clean":"2023-11-24T08:05:44.170196+0000","last_became_active":"2023-11-24T08:05:44.163634+0000","last_became_peered":"2023-11-24T08:05:44.163634+0000","last_unstale":"2023-11-24T08:05:44.170196+0000","last_undegraded":"2023-11-24T08:05:44.170196+0000","last_fullsized":"2023-11-24T08:05:44.170196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:21.773652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.161916+0000","last_change":"2023-11-24T08:05:44.158653+0000","last_active":"2023-11-24T08:05:44.161916+0000","last_peered":"2023-11-24T08:05:44.161916+0000","last_clean":"2023-11-24T08:05:44.161916+0000","last_became_active":"2023-11-24T08:05:44.158391+0000","last_became_peered":"2023-11-24T08:05:44.158391+0000","last_unstale":"2023-11-24T08:05:44.161916+0000","last_undegraded":"2023-11-24T08:05:44.161916+0000","last_fullsized":"2023-11-24T08:05:44.161916+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:00:10.333165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.167437+0000","last_change":"2023-11-24T08:05:44.162692+0000","last_active":"2023-11-24T08:05:44.167437+0000","last_peered":"2023-11-24T08:05:44.167437+0000","last_clean":"2023-11-24T08:05:44.167437+0000","last_became_active":"2023-11-24T08:05:44.162430+0000","last_became_peered":"2023-11-24T08:05:44.162430+0000","last_unstale":"2023-11-24T08:05:44.167437+0000","last_undegraded":"2023-11-24T08:05:44.167437+0000","last_fullsized":"2023-11-24T08:05:44.167437+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:32:53.597950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.161982+0000","last_change":"2023-11-24T08:05:44.155850+0000","last_active":"2023-11-24T08:05:44.161982+0000","last_peered":"2023-11-24T08:05:44.161982+0000","last_clean":"2023-11-24T08:05:44.161982+0000","last_became_active":"2023-11-24T08:05:44.155495+0000","last_became_peered":"2023-11-24T08:05:44.155495+0000","last_unstale":"2023-11-24T08:05:44.161982+0000","last_undegraded":"2023-11-24T08:05:44.161982+0000","last_fullsized":"2023-11-24T08:05:44.161982+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:47.528724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.161932+0000","last_change":"2023-11-24T08:05:44.155119+0000","last_active":"2023-11-24T08:05:44.161932+0000","last_peered":"2023-11-24T08:05:44.161932+0000","last_clean":"2023-11-24T08:05:44.161932+0000","last_became_active":"2023-11-24T08:05:44.154831+0000","last_became_peered":"2023-11-24T08:05:44.154831+0000","last_unstale":"2023-11-24T08:05:44.161932+0000","last_undegraded":"2023-11-24T08:05:44.161932+0000","last_fullsized":"2023-11-24T08:05:44.161932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:33:35.161075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169099+0000","last_change":"2023-11-24T08:05:44.164802+0000","last_active":"2023-11-24T08:05:44.169099+0000","last_peered":"2023-11-24T08:05:44.169099+0000","last_clean":"2023-11-24T08:05:44.169099+0000","last_became_active":"2023-11-24T08:05:44.164504+0000","last_became_peered":"2023-11-24T08:05:44.164504+0000","last_unstale":"2023-11-24T08:05:44.169099+0000","last_undegraded":"2023-11-24T08:05:44.169099+0000","last_fullsized":"2023-11-24T08:05:44.169099+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:46.873896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170171+0000","last_change":"2023-11-24T08:05:44.163160+0000","last_active":"2023-11-24T08:05:44.170171+0000","last_peered":"2023-11-24T08:05:44.170171+0000","last_clean":"2023-11-24T08:05:44.170171+0000","last_became_active":"2023-11-24T08:05:44.162891+0000","last_became_peered":"2023-11-24T08:05:44.162891+0000","last_unstale":"2023-11-24T08:05:44.170171+0000","last_undegraded":"2023-11-24T08:05:44.170171+0000","last_fullsized":"2023-11-24T08:05:44.170171+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:47.528724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162355+0000","last_change":"2023-11-24T08:05:44.160860+0000","last_active":"2023-11-24T08:05:44.162355+0000","last_peered":"2023-11-24T08:05:44.162355+0000","last_clean":"2023-11-24T08:05:44.162355+0000","last_became_active":"2023-11-24T08:05:44.159259+0000","last_became_peered":"2023-11-24T08:05:44.159259+0000","last_unstale":"2023-11-24T08:05:44.162355+0000","last_undegraded":"2023-11-24T08:05:44.162355+0000","last_fullsized":"2023-11-24T08:05:44.162355+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:11.513164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.171800+0000","last_change":"2023-11-24T08:05:44.167212+0000","last_active":"2023-11-24T08:05:44.171800+0000","last_peered":"2023-11-24T08:05:44.171800+0000","last_clean":"2023-11-24T08:05:44.171800+0000","last_became_active":"2023-11-24T08:05:44.166900+0000","last_became_peered":"2023-11-24T08:05:44.166900+0000","last_unstale":"2023-11-24T08:05:44.171800+0000","last_undegraded":"2023-11-24T08:05:44.171800+0000","last_fullsized":"2023-11-24T08:05:44.171800+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:56.526467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166432+0000","last_change":"2023-11-24T08:05:44.162624+0000","last_active":"2023-11-24T08:05:44.166432+0000","last_peered":"2023-11-24T08:05:44.166432+0000","last_clean":"2023-11-24T08:05:44.166432+0000","last_became_active":"2023-11-24T08:05:44.162338+0000","last_became_peered":"2023-11-24T08:05:44.162338+0000","last_unstale":"2023-11-24T08:05:44.166432+0000","last_undegraded":"2023-11-24T08:05:44.166432+0000","last_fullsized":"2023-11-24T08:05:44.166432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:39.060847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162372+0000","last_change":"2023-11-24T08:05:44.160304+0000","last_active":"2023-11-24T08:05:44.162372+0000","last_peered":"2023-11-24T08:05:44.162372+0000","last_clean":"2023-11-24T08:05:44.162372+0000","last_became_active":"2023-11-24T08:05:44.160034+0000","last_became_peered":"2023-11-24T08:05:44.160034+0000","last_unstale":"2023-11-24T08:05:44.162372+0000","last_undegraded":"2023-11-24T08:05:44.162372+0000","last_fullsized":"2023-11-24T08:05:44.162372+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:07.101986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.160523+0000","last_change":"2023-11-24T08:05:44.158138+0000","last_active":"2023-11-24T08:05:44.160523+0000","last_peered":"2023-11-24T08:05:44.160523+0000","last_clean":"2023-11-24T08:05:44.160523+0000","last_became_active":"2023-11-24T08:05:44.157877+0000","last_became_peered":"2023-11-24T08:05:44.157877+0000","last_unstale":"2023-11-24T08:05:44.160523+0000","last_undegraded":"2023-11-24T08:05:44.160523+0000","last_fullsized":"2023-11-24T08:05:44.160523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:25:48.891700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170224+0000","last_change":"2023-11-24T08:05:44.164535+0000","last_active":"2023-11-24T08:05:44.170224+0000","last_peered":"2023-11-24T08:05:44.170224+0000","last_clean":"2023-11-24T08:05:44.170224+0000","last_became_active":"2023-11-24T08:05:44.164262+0000","last_became_peered":"2023-11-24T08:05:44.164262+0000","last_unstale":"2023-11-24T08:05:44.170224+0000","last_undegraded":"2023-11-24T08:05:44.170224+0000","last_fullsized":"2023-11-24T08:05:44.170224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:20.919636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168229+0000","last_change":"2023-11-24T08:05:44.159423+0000","last_active":"2023-11-24T08:05:44.168229+0000","last_peered":"2023-11-24T08:05:44.168229+0000","last_clean":"2023-11-24T08:05:44.168229+0000","last_became_active":"2023-11-24T08:05:44.159172+0000","last_became_peered":"2023-11-24T08:05:44.159172+0000","last_unstale":"2023-11-24T08:05:44.168229+0000","last_undegraded":"2023-11-24T08:05:44.168229+0000","last_fullsized":"2023-11-24T08:05:44.168229+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:34.038812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.204608+0000","last_change":"2023-11-24T08:05:43.191409+0000","last_active":"2023-11-24T08:05:44.204608+0000","last_peered":"2023-11-24T08:05:44.204608+0000","last_clean":"2023-11-24T08:05:44.204608+0000","last_became_active":"2023-11-24T08:05:43.191101+0000","last_became_peered":"2023-11-24T08:05:43.191101+0000","last_unstale":"2023-11-24T08:05:44.204608+0000","last_undegraded":"2023-11-24T08:05:44.204608+0000","last_fullsized":"2023-11-24T08:05:44.204608+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:33:04.621385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.164685+0000","last_change":"2023-11-24T08:05:44.159996+0000","last_active":"2023-11-24T08:05:44.164685+0000","last_peered":"2023-11-24T08:05:44.164685+0000","last_clean":"2023-11-24T08:05:44.164685+0000","last_became_active":"2023-11-24T08:05:44.159664+0000","last_became_peered":"2023-11-24T08:05:44.159664+0000","last_unstale":"2023-11-24T08:05:44.164685+0000","last_undegraded":"2023-11-24T08:05:44.164685+0000","last_fullsized":"2023-11-24T08:05:44.164685+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:56.975875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.204270+0000","last_change":"2023-11-24T08:05:43.190501+0000","last_active":"2023-11-24T08:05:44.204270+0000","last_peered":"2023-11-24T08:05:44.204270+0000","last_clean":"2023-11-24T08:05:44.204270+0000","last_became_active":"2023-11-24T08:05:43.189833+0000","last_became_peered":"2023-11-24T08:05:43.189833+0000","last_unstale":"2023-11-24T08:05:44.204270+0000","last_undegraded":"2023-11-24T08:05:44.204270+0000","last_fullsized":"2023-11-24T08:05:44.204270+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:09:31.898610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.159415+0000","last_change":"2023-11-24T08:05:44.156577+0000","last_active":"2023-11-24T08:05:44.159415+0000","last_peered":"2023-11-24T08:05:44.159415+0000","last_clean":"2023-11-24T08:05:44.159415+0000","last_became_active":"2023-11-24T08:05:44.156282+0000","last_became_peered":"2023-11-24T08:05:44.156282+0000","last_unstale":"2023-11-24T08:05:44.159415+0000","last_undegraded":"2023-11-24T08:05:44.159415+0000","last_fullsized":"2023-11-24T08:05:44.159415+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:56.899822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.199729+0000","last_change":"2023-11-24T08:05:43.191397+0000","last_active":"2023-11-24T08:05:44.199729+0000","last_peered":"2023-11-24T08:05:44.199729+0000","last_clean":"2023-11-24T08:05:44.199729+0000","last_became_active":"2023-11-24T08:05:43.191160+0000","last_became_peered":"2023-11-24T08:05:43.191160+0000","last_unstale":"2023-11-24T08:05:44.199729+0000","last_undegraded":"2023-11-24T08:05:44.199729+0000","last_fullsized":"2023-11-24T08:05:44.199729+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:48:41.750963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162440+0000","last_change":"2023-11-24T08:05:44.158584+0000","last_active":"2023-11-24T08:05:44.162440+0000","last_peered":"2023-11-24T08:05:44.162440+0000","last_clean":"2023-11-24T08:05:44.162440+0000","last_became_active":"2023-11-24T08:05:44.158312+0000","last_became_peered":"2023-11-24T08:05:44.158312+0000","last_unstale":"2023-11-24T08:05:44.162440+0000","last_undegraded":"2023-11-24T08:05:44.162440+0000","last_fullsized":"2023-11-24T08:05:44.162440+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:24:47.258524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.199894+0000","last_change":"2023-11-24T08:05:43.188917+0000","last_active":"2023-11-24T08:05:44.199894+0000","last_peered":"2023-11-24T08:05:44.199894+0000","last_clean":"2023-11-24T08:05:44.199894+0000","last_became_active":"2023-11-24T08:05:43.188587+0000","last_became_peered":"2023-11-24T08:05:43.188587+0000","last_unstale":"2023-11-24T08:05:44.199894+0000","last_undegraded":"2023-11-24T08:05:44.199894+0000","last_fullsized":"2023-11-24T08:05:44.199894+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:55.895507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162117+0000","last_change":"2023-11-24T08:05:44.158323+0000","last_active":"2023-11-24T08:05:44.162117+0000","last_peered":"2023-11-24T08:05:44.162117+0000","last_clean":"2023-11-24T08:05:44.162117+0000","last_became_active":"2023-11-24T08:05:44.158072+0000","last_became_peered":"2023-11-24T08:05:44.158072+0000","last_unstale":"2023-11-24T08:05:44.162117+0000","last_undegraded":"2023-11-24T08:05:44.162117+0000","last_fullsized":"2023-11-24T08:05:44.162117+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:59:14.832437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.201854+0000","last_change":"2023-11-24T08:05:43.187994+0000","last_active":"2023-11-24T08:05:44.201854+0000","last_peered":"2023-11-24T08:05:44.201854+0000","last_clean":"2023-11-24T08:05:44.201854+0000","last_became_active":"2023-11-24T08:05:43.187705+0000","last_became_peered":"2023-11-24T08:05:43.187705+0000","last_unstale":"2023-11-24T08:05:44.201854+0000","last_undegraded":"2023-11-24T08:05:44.201854+0000","last_fullsized":"2023-11-24T08:05:44.201854+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:21:48.136678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168391+0000","last_change":"2023-11-24T08:05:44.163626+0000","last_active":"2023-11-24T08:05:44.168391+0000","last_peered":"2023-11-24T08:05:44.168391+0000","last_clean":"2023-11-24T08:05:44.168391+0000","last_became_active":"2023-11-24T08:05:44.163371+0000","last_became_peered":"2023-11-24T08:05:44.163371+0000","last_unstale":"2023-11-24T08:05:44.168391+0000","last_undegraded":"2023-11-24T08:05:44.168391+0000","last_fullsized":"2023-11-24T08:05:44.168391+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:07.101986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.204158+0000","last_change":"2023-11-24T08:05:43.191026+0000","last_active":"2023-11-24T08:05:44.204158+0000","last_peered":"2023-11-24T08:05:44.204158+0000","last_clean":"2023-11-24T08:05:44.204158+0000","last_became_active":"2023-11-24T08:05:43.187423+0000","last_became_peered":"2023-11-24T08:05:43.187423+0000","last_unstale":"2023-11-24T08:05:44.204158+0000","last_undegraded":"2023-11-24T08:05:44.204158+0000","last_fullsized":"2023-11-24T08:05:44.204158+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:54.034699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169104+0000","last_change":"2023-11-24T08:05:44.166150+0000","last_active":"2023-11-24T08:05:44.169104+0000","last_peered":"2023-11-24T08:05:44.169104+0000","last_clean":"2023-11-24T08:05:44.169104+0000","last_became_active":"2023-11-24T08:05:44.165119+0000","last_became_peered":"2023-11-24T08:05:44.165119+0000","last_unstale":"2023-11-24T08:05:44.169104+0000","last_undegraded":"2023-11-24T08:05:44.169104+0000","last_fullsized":"2023-11-24T08:05:44.169104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:25.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.147406+0000","last_change":"2023-11-24T08:05:43.192333+0000","last_active":"2023-11-24T08:05:44.147406+0000","last_peered":"2023-11-24T08:05:44.147406+0000","last_clean":"2023-11-24T08:05:44.147406+0000","last_became_active":"2023-11-24T08:05:43.192069+0000","last_became_peered":"2023-11-24T08:05:43.192069+0000","last_unstale":"2023-11-24T08:05:44.147406+0000","last_undegraded":"2023-11-24T08:05:44.147406+0000","last_fullsized":"2023-11-24T08:05:44.147406+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:19.947740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.163937+0000","last_change":"2023-11-24T08:05:44.158096+0000","last_active":"2023-11-24T08:05:44.163937+0000","last_peered":"2023-11-24T08:05:44.163937+0000","last_clean":"2023-11-24T08:05:44.163937+0000","last_became_active":"2023-11-24T08:05:44.157760+0000","last_became_peered":"2023-11-24T08:05:44.157760+0000","last_unstale":"2023-11-24T08:05:44.163937+0000","last_undegraded":"2023-11-24T08:05:44.163937+0000","last_fullsized":"2023-11-24T08:05:44.163937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:52.994050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.159524+0000","last_change":"2023-11-24T08:05:43.189580+0000","last_active":"2023-11-24T08:05:44.159524+0000","last_peered":"2023-11-24T08:05:44.159524+0000","last_clean":"2023-11-24T08:05:44.159524+0000","last_became_active":"2023-11-24T08:05:43.189212+0000","last_became_peered":"2023-11-24T08:05:43.189212+0000","last_unstale":"2023-11-24T08:05:44.159524+0000","last_undegraded":"2023-11-24T08:05:44.159524+0000","last_fullsized":"2023-11-24T08:05:44.159524+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:32.425237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169195+0000","last_change":"2023-11-24T08:05:44.165169+0000","last_active":"2023-11-24T08:05:44.169195+0000","last_peered":"2023-11-24T08:05:44.169195+0000","last_clean":"2023-11-24T08:05:44.169195+0000","last_became_active":"2023-11-24T08:05:44.164875+0000","last_became_peered":"2023-11-24T08:05:44.164875+0000","last_unstale":"2023-11-24T08:05:44.169195+0000","last_undegraded":"2023-11-24T08:05:44.169195+0000","last_fullsized":"2023-11-24T08:05:44.169195+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:48:42.755278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.153004+0000","last_change":"2023-11-24T08:05:43.189894+0000","last_active":"2023-11-24T08:05:44.153004+0000","last_peered":"2023-11-24T08:05:44.153004+0000","last_clean":"2023-11-24T08:05:44.153004+0000","last_became_active":"2023-11-24T08:05:43.189534+0000","last_became_peered":"2023-11-24T08:05:43.189534+0000","last_unstale":"2023-11-24T08:05:44.153004+0000","last_undegraded":"2023-11-24T08:05:44.153004+0000","last_fullsized":"2023-11-24T08:05:44.153004+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:09:55.503706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162953+0000","last_change":"2023-11-24T08:05:44.158814+0000","last_active":"2023-11-24T08:05:44.162953+0000","last_peered":"2023-11-24T08:05:44.162953+0000","last_clean":"2023-11-24T08:05:44.162953+0000","last_became_active":"2023-11-24T08:05:44.158528+0000","last_became_peered":"2023-11-24T08:05:44.158528+0000","last_unstale":"2023-11-24T08:05:44.162953+0000","last_undegraded":"2023-11-24T08:05:44.162953+0000","last_fullsized":"2023-11-24T08:05:44.162953+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:56.526467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.158964+0000","last_change":"2023-11-24T08:05:43.187276+0000","last_active":"2023-11-24T08:05:44.158964+0000","last_peered":"2023-11-24T08:05:44.158964+0000","last_clean":"2023-11-24T08:05:44.158964+0000","last_became_active":"2023-11-24T08:05:43.187019+0000","last_became_peered":"2023-11-24T08:05:43.187019+0000","last_unstale":"2023-11-24T08:05:44.158964+0000","last_undegraded":"2023-11-24T08:05:44.158964+0000","last_fullsized":"2023-11-24T08:05:44.158964+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:17:08.649119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.172704+0000","last_change":"2023-11-24T08:05:44.168095+0000","last_active":"2023-11-24T08:05:44.172704+0000","last_peered":"2023-11-24T08:05:44.172704+0000","last_clean":"2023-11-24T08:05:44.172704+0000","last_became_active":"2023-11-24T08:05:44.167786+0000","last_became_peered":"2023-11-24T08:05:44.167786+0000","last_unstale":"2023-11-24T08:05:44.172704+0000","last_undegraded":"2023-11-24T08:05:44.172704+0000","last_fullsized":"2023-11-24T08:05:44.172704+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:47:18.606681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.202046+0000","last_change":"2023-11-24T08:05:43.190583+0000","last_active":"2023-11-24T08:05:44.202046+0000","last_peered":"2023-11-24T08:05:44.202046+0000","last_clean":"2023-11-24T08:05:44.202046+0000","last_became_active":"2023-11-24T08:05:43.190249+0000","last_became_peered":"2023-11-24T08:05:43.190249+0000","last_unstale":"2023-11-24T08:05:44.202046+0000","last_undegraded":"2023-11-24T08:05:44.202046+0000","last_fullsized":"2023-11-24T08:05:44.202046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:24.307268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169290+0000","last_change":"2023-11-24T08:05:44.164955+0000","last_active":"2023-11-24T08:05:44.169290+0000","last_peered":"2023-11-24T08:05:44.169290+0000","last_clean":"2023-11-24T08:05:44.169290+0000","last_became_active":"2023-11-24T08:05:44.164167+0000","last_became_peered":"2023-11-24T08:05:44.164167+0000","last_unstale":"2023-11-24T08:05:44.169290+0000","last_undegraded":"2023-11-24T08:05:44.169290+0000","last_fullsized":"2023-11-24T08:05:44.169290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:12.556630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.207412+0000","last_change":"2023-11-24T08:05:43.186261+0000","last_active":"2023-11-24T08:05:44.207412+0000","last_peered":"2023-11-24T08:05:44.207412+0000","last_clean":"2023-11-24T08:05:44.207412+0000","last_became_active":"2023-11-24T08:05:43.186008+0000","last_became_peered":"2023-11-24T08:05:43.186008+0000","last_unstale":"2023-11-24T08:05:44.207412+0000","last_undegraded":"2023-11-24T08:05:44.207412+0000","last_fullsized":"2023-11-24T08:05:44.207412+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:11:05.829812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166552+0000","last_change":"2023-11-24T08:05:44.163096+0000","last_active":"2023-11-24T08:05:44.166552+0000","last_peered":"2023-11-24T08:05:44.166552+0000","last_clean":"2023-11-24T08:05:44.166552+0000","last_became_active":"2023-11-24T08:05:44.162713+0000","last_became_peered":"2023-11-24T08:05:44.162713+0000","last_unstale":"2023-11-24T08:05:44.166552+0000","last_undegraded":"2023-11-24T08:05:44.166552+0000","last_fullsized":"2023-11-24T08:05:44.166552+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:32:53.597950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.201001+0000","last_change":"2023-11-24T08:05:43.189501+0000","last_active":"2023-11-24T08:05:44.201001+0000","last_peered":"2023-11-24T08:05:44.201001+0000","last_clean":"2023-11-24T08:05:44.201001+0000","last_became_active":"2023-11-24T08:05:43.189253+0000","last_became_peered":"2023-11-24T08:05:43.189253+0000","last_unstale":"2023-11-24T08:05:44.201001+0000","last_undegraded":"2023-11-24T08:05:44.201001+0000","last_fullsized":"2023-11-24T08:05:44.201001+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:13:28.554155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166950+0000","last_change":"2023-11-24T08:05:44.161335+0000","last_active":"2023-11-24T08:05:44.166950+0000","last_peered":"2023-11-24T08:05:44.166950+0000","last_clean":"2023-11-24T08:05:44.166950+0000","last_became_active":"2023-11-24T08:05:44.161078+0000","last_became_peered":"2023-11-24T08:05:44.161078+0000","last_unstale":"2023-11-24T08:05:44.166950+0000","last_undegraded":"2023-11-24T08:05:44.166950+0000","last_fullsized":"2023-11-24T08:05:44.166950+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:59:14.832437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.149929+0000","last_change":"2023-11-24T08:05:43.187101+0000","last_active":"2023-11-24T08:05:44.149929+0000","last_peered":"2023-11-24T08:05:44.149929+0000","last_clean":"2023-11-24T08:05:44.149929+0000","last_became_active":"2023-11-24T08:05:43.186568+0000","last_became_peered":"2023-11-24T08:05:43.186568+0000","last_unstale":"2023-11-24T08:05:44.149929+0000","last_undegraded":"2023-11-24T08:05:44.149929+0000","last_fullsized":"2023-11-24T08:05:44.149929+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:32.425237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.172716+0000","last_change":"2023-11-24T08:05:44.168110+0000","last_active":"2023-11-24T08:05:44.172716+0000","last_peered":"2023-11-24T08:05:44.172716+0000","last_clean":"2023-11-24T08:05:44.172716+0000","last_became_active":"2023-11-24T08:05:44.167757+0000","last_became_peered":"2023-11-24T08:05:44.167757+0000","last_unstale":"2023-11-24T08:05:44.172716+0000","last_undegraded":"2023-11-24T08:05:44.172716+0000","last_fullsized":"2023-11-24T08:05:44.172716+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:25.311582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.151862+0000","last_change":"2023-11-24T08:05:43.189867+0000","last_active":"2023-11-24T08:05:44.151862+0000","last_peered":"2023-11-24T08:05:44.151862+0000","last_clean":"2023-11-24T08:05:44.151862+0000","last_became_active":"2023-11-24T08:05:43.188768+0000","last_became_peered":"2023-11-24T08:05:43.188768+0000","last_unstale":"2023-11-24T08:05:44.151862+0000","last_undegraded":"2023-11-24T08:05:44.151862+0000","last_fullsized":"2023-11-24T08:05:44.151862+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:04:47.722739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166540+0000","last_change":"2023-11-24T08:05:44.162827+0000","last_active":"2023-11-24T08:05:44.166540+0000","last_peered":"2023-11-24T08:05:44.166540+0000","last_clean":"2023-11-24T08:05:44.166540+0000","last_became_active":"2023-11-24T08:05:44.162558+0000","last_became_peered":"2023-11-24T08:05:44.162558+0000","last_unstale":"2023-11-24T08:05:44.166540+0000","last_undegraded":"2023-11-24T08:05:44.166540+0000","last_fullsized":"2023-11-24T08:05:44.166540+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:20.952054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.209832+0000","last_change":"2023-11-24T08:05:43.188794+0000","last_active":"2023-11-24T08:05:44.209832+0000","last_peered":"2023-11-24T08:05:44.209832+0000","last_clean":"2023-11-24T08:05:44.209832+0000","last_became_active":"2023-11-24T08:05:43.188515+0000","last_became_peered":"2023-11-24T08:05:43.188515+0000","last_unstale":"2023-11-24T08:05:44.209832+0000","last_undegraded":"2023-11-24T08:05:44.209832+0000","last_fullsized":"2023-11-24T08:05:44.209832+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:52.297300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170127+0000","last_change":"2023-11-24T08:05:44.162674+0000","last_active":"2023-11-24T08:05:44.170127+0000","last_peered":"2023-11-24T08:05:44.170127+0000","last_clean":"2023-11-24T08:05:44.170127+0000","last_became_active":"2023-11-24T08:05:44.162399+0000","last_became_peered":"2023-11-24T08:05:44.162399+0000","last_unstale":"2023-11-24T08:05:44.170127+0000","last_undegraded":"2023-11-24T08:05:44.170127+0000","last_fullsized":"2023-11-24T08:05:44.170127+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:33:35.161075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.200772+0000","last_change":"2023-11-24T08:05:43.187158+0000","last_active":"2023-11-24T08:05:44.200772+0000","last_peered":"2023-11-24T08:05:44.200772+0000","last_clean":"2023-11-24T08:05:44.200772+0000","last_became_active":"2023-11-24T08:05:43.186876+0000","last_became_peered":"2023-11-24T08:05:43.186876+0000","last_unstale":"2023-11-24T08:05:44.200772+0000","last_undegraded":"2023-11-24T08:05:44.200772+0000","last_fullsized":"2023-11-24T08:05:44.200772+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:45.869581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.167415+0000","last_change":"2023-11-24T08:05:44.162502+0000","last_active":"2023-11-24T08:05:44.167415+0000","last_peered":"2023-11-24T08:05:44.167415+0000","last_clean":"2023-11-24T08:05:44.167415+0000","last_became_active":"2023-11-24T08:05:44.162227+0000","last_became_peered":"2023-11-24T08:05:44.162227+0000","last_unstale":"2023-11-24T08:05:44.167415+0000","last_undegraded":"2023-11-24T08:05:44.167415+0000","last_fullsized":"2023-11-24T08:05:44.167415+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:34.038812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.204364+0000","last_change":"2023-11-24T08:05:43.192858+0000","last_active":"2023-11-24T08:05:44.204364+0000","last_peered":"2023-11-24T08:05:44.204364+0000","last_clean":"2023-11-24T08:05:44.204364+0000","last_became_active":"2023-11-24T08:05:43.192455+0000","last_became_peered":"2023-11-24T08:05:43.192455+0000","last_unstale":"2023-11-24T08:05:44.204364+0000","last_undegraded":"2023-11-24T08:05:44.204364+0000","last_fullsized":"2023-11-24T08:05:44.204364+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:00.649091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.164014+0000","last_change":"2023-11-24T08:05:44.157984+0000","last_active":"2023-11-24T08:05:44.164014+0000","last_peered":"2023-11-24T08:05:44.164014+0000","last_clean":"2023-11-24T08:05:44.164014+0000","last_became_active":"2023-11-24T08:05:44.157590+0000","last_became_peered":"2023-11-24T08:05:44.157590+0000","last_unstale":"2023-11-24T08:05:44.164014+0000","last_undegraded":"2023-11-24T08:05:44.164014+0000","last_fullsized":"2023-11-24T08:05:44.164014+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:26.639462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.199554+0000","last_change":"2023-11-24T08:05:43.193520+0000","last_active":"2023-11-24T08:05:44.199554+0000","last_peered":"2023-11-24T08:05:44.199554+0000","last_clean":"2023-11-24T08:05:44.199554+0000","last_became_active":"2023-11-24T08:05:43.193209+0000","last_became_peered":"2023-11-24T08:05:43.193209+0000","last_unstale":"2023-11-24T08:05:44.199554+0000","last_undegraded":"2023-11-24T08:05:44.199554+0000","last_fullsized":"2023-11-24T08:05:44.199554+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:11.552316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169051+0000","last_change":"2023-11-24T08:05:44.164584+0000","last_active":"2023-11-24T08:05:44.169051+0000","last_peered":"2023-11-24T08:05:44.169051+0000","last_clean":"2023-11-24T08:05:44.169051+0000","last_became_active":"2023-11-24T08:05:44.164319+0000","last_became_peered":"2023-11-24T08:05:44.164319+0000","last_unstale":"2023-11-24T08:05:44.169051+0000","last_undegraded":"2023-11-24T08:05:44.169051+0000","last_fullsized":"2023-11-24T08:05:44.169051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:06.798490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.152036+0000","last_change":"2023-11-24T08:05:43.190695+0000","last_active":"2023-11-24T08:05:44.152036+0000","last_peered":"2023-11-24T08:05:44.152036+0000","last_clean":"2023-11-24T08:05:44.152036+0000","last_became_active":"2023-11-24T08:05:43.190416+0000","last_became_peered":"2023-11-24T08:05:43.190416+0000","last_unstale":"2023-11-24T08:05:44.152036+0000","last_undegraded":"2023-11-24T08:05:44.152036+0000","last_fullsized":"2023-11-24T08:05:44.152036+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:46:50.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168306+0000","last_change":"2023-11-24T08:05:44.164988+0000","last_active":"2023-11-24T08:05:44.168306+0000","last_peered":"2023-11-24T08:05:44.168306+0000","last_clean":"2023-11-24T08:05:44.168306+0000","last_became_active":"2023-11-24T08:05:44.164725+0000","last_became_peered":"2023-11-24T08:05:44.164725+0000","last_unstale":"2023-11-24T08:05:44.168306+0000","last_undegraded":"2023-11-24T08:05:44.168306+0000","last_fullsized":"2023-11-24T08:05:44.168306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:16:08.781848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.201886+0000","last_change":"2023-11-24T08:05:43.187584+0000","last_active":"2023-11-24T08:05:44.201886+0000","last_peered":"2023-11-24T08:05:44.201886+0000","last_clean":"2023-11-24T08:05:44.201886+0000","last_became_active":"2023-11-24T08:05:43.187246+0000","last_became_peered":"2023-11-24T08:05:43.187246+0000","last_unstale":"2023-11-24T08:05:44.201886+0000","last_undegraded":"2023-11-24T08:05:44.201886+0000","last_fullsized":"2023-11-24T08:05:44.201886+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:46.216648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162075+0000","last_change":"2023-11-24T08:05:44.150264+0000","last_active":"2023-11-24T08:05:44.162075+0000","last_peered":"2023-11-24T08:05:44.162075+0000","last_clean":"2023-11-24T08:05:44.162075+0000","last_became_active":"2023-11-24T08:05:44.149993+0000","last_became_peered":"2023-11-24T08:05:44.149993+0000","last_unstale":"2023-11-24T08:05:44.162075+0000","last_undegraded":"2023-11-24T08:05:44.162075+0000","last_fullsized":"2023-11-24T08:05:44.162075+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:07.101986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.147671+0000","last_change":"2023-11-24T08:05:43.190451+0000","last_active":"2023-11-24T08:05:44.147671+0000","last_peered":"2023-11-24T08:05:44.147671+0000","last_clean":"2023-11-24T08:05:44.147671+0000","last_became_active":"2023-11-24T08:05:43.190163+0000","last_became_peered":"2023-11-24T08:05:43.190163+0000","last_unstale":"2023-11-24T08:05:44.147671+0000","last_undegraded":"2023-11-24T08:05:44.147671+0000","last_fullsized":"2023-11-24T08:05:44.147671+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:24.307268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170374+0000","last_change":"2023-11-24T08:05:44.167753+0000","last_active":"2023-11-24T08:05:44.170374+0000","last_peered":"2023-11-24T08:05:44.170374+0000","last_clean":"2023-11-24T08:05:44.170374+0000","last_became_active":"2023-11-24T08:05:44.167517+0000","last_became_peered":"2023-11-24T08:05:44.167517+0000","last_unstale":"2023-11-24T08:05:44.170374+0000","last_undegraded":"2023-11-24T08:05:44.170374+0000","last_fullsized":"2023-11-24T08:05:44.170374+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:23.956996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.155333+0000","last_change":"2023-11-24T08:05:43.186296+0000","last_active":"2023-11-24T08:05:44.155333+0000","last_peered":"2023-11-24T08:05:44.155333+0000","last_clean":"2023-11-24T08:05:44.155333+0000","last_became_active":"2023-11-24T08:05:43.186003+0000","last_became_peered":"2023-11-24T08:05:43.186003+0000","last_unstale":"2023-11-24T08:05:44.155333+0000","last_undegraded":"2023-11-24T08:05:44.155333+0000","last_fullsized":"2023-11-24T08:05:44.155333+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:00.649091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169005+0000","last_change":"2023-11-24T08:05:44.164936+0000","last_active":"2023-11-24T08:05:44.169005+0000","last_peered":"2023-11-24T08:05:44.169005+0000","last_clean":"2023-11-24T08:05:44.169005+0000","last_became_active":"2023-11-24T08:05:44.164284+0000","last_became_peered":"2023-11-24T08:05:44.164284+0000","last_unstale":"2023-11-24T08:05:44.169005+0000","last_undegraded":"2023-11-24T08:05:44.169005+0000","last_fullsized":"2023-11-24T08:05:44.169005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:52.994050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.150484+0000","last_change":"2023-11-24T08:05:43.187451+0000","last_active":"2023-11-24T08:05:44.150484+0000","last_peered":"2023-11-24T08:05:44.150484+0000","last_clean":"2023-11-24T08:05:44.150484+0000","last_became_active":"2023-11-24T08:05:43.187182+0000","last_became_peered":"2023-11-24T08:05:43.187182+0000","last_unstale":"2023-11-24T08:05:44.150484+0000","last_undegraded":"2023-11-24T08:05:44.150484+0000","last_fullsized":"2023-11-24T08:05:44.150484+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:24.221762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168997+0000","last_change":"2023-11-24T08:05:44.163701+0000","last_active":"2023-11-24T08:05:44.168997+0000","last_peered":"2023-11-24T08:05:44.168997+0000","last_clean":"2023-11-24T08:05:44.168997+0000","last_became_active":"2023-11-24T08:05:44.163393+0000","last_became_peered":"2023-11-24T08:05:44.163393+0000","last_unstale":"2023-11-24T08:05:44.168997+0000","last_undegraded":"2023-11-24T08:05:44.168997+0000","last_fullsized":"2023-11-24T08:05:44.168997+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:11:06.834126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.151626+0000","last_change":"2023-11-24T08:05:43.186124+0000","last_active":"2023-11-24T08:05:44.151626+0000","last_peered":"2023-11-24T08:05:44.151626+0000","last_clean":"2023-11-24T08:05:44.151626+0000","last_became_active":"2023-11-24T08:05:43.185713+0000","last_became_peered":"2023-11-24T08:05:43.185713+0000","last_unstale":"2023-11-24T08:05:44.151626+0000","last_undegraded":"2023-11-24T08:05:44.151626+0000","last_fullsized":"2023-11-24T08:05:44.151626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:13:17.872700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168027+0000","last_change":"2023-11-24T08:05:44.163037+0000","last_active":"2023-11-24T08:05:44.168027+0000","last_peered":"2023-11-24T08:05:44.168027+0000","last_clean":"2023-11-24T08:05:44.168027+0000","last_became_active":"2023-11-24T08:05:44.162771+0000","last_became_peered":"2023-11-24T08:05:44.162771+0000","last_unstale":"2023-11-24T08:05:44.168027+0000","last_undegraded":"2023-11-24T08:05:44.168027+0000","last_fullsized":"2023-11-24T08:05:44.168027+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:55.039014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.153694+0000","last_change":"2023-11-24T08:05:43.190866+0000","last_active":"2023-11-24T08:05:44.153694+0000","last_peered":"2023-11-24T08:05:44.153694+0000","last_clean":"2023-11-24T08:05:44.153694+0000","last_became_active":"2023-11-24T08:05:43.190560+0000","last_became_peered":"2023-11-24T08:05:43.190560+0000","last_unstale":"2023-11-24T08:05:44.153694+0000","last_undegraded":"2023-11-24T08:05:44.153694+0000","last_fullsized":"2023-11-24T08:05:44.153694+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:16:07.777534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169270+0000","last_change":"2023-11-24T08:05:44.164774+0000","last_active":"2023-11-24T08:05:44.169270+0000","last_peered":"2023-11-24T08:05:44.169270+0000","last_clean":"2023-11-24T08:05:44.169270+0000","last_became_active":"2023-11-24T08:05:44.164581+0000","last_became_peered":"2023-11-24T08:05:44.164581+0000","last_unstale":"2023-11-24T08:05:44.169270+0000","last_undegraded":"2023-11-24T08:05:44.169270+0000","last_fullsized":"2023-11-24T08:05:44.169270+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:25:48.891700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.146128+0000","last_change":"2023-11-24T08:05:43.191219+0000","last_active":"2023-11-24T08:05:44.146128+0000","last_peered":"2023-11-24T08:05:44.146128+0000","last_clean":"2023-11-24T08:05:44.146128+0000","last_became_active":"2023-11-24T08:05:43.190957+0000","last_became_peered":"2023-11-24T08:05:43.190957+0000","last_unstale":"2023-11-24T08:05:44.146128+0000","last_undegraded":"2023-11-24T08:05:44.146128+0000","last_fullsized":"2023-11-24T08:05:44.146128+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:10.508850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.167056+0000","last_change":"2023-11-24T08:05:44.163275+0000","last_active":"2023-11-24T08:05:44.167056+0000","last_peered":"2023-11-24T08:05:44.167056+0000","last_clean":"2023-11-24T08:05:44.167056+0000","last_became_active":"2023-11-24T08:05:44.163006+0000","last_became_peered":"2023-11-24T08:05:44.163006+0000","last_unstale":"2023-11-24T08:05:44.167056+0000","last_undegraded":"2023-11-24T08:05:44.167056+0000","last_fullsized":"2023-11-24T08:05:44.167056+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:56.526467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.151435+0000","last_change":"2023-11-24T08:05:43.190883+0000","last_active":"2023-11-24T08:05:44.151435+0000","last_peered":"2023-11-24T08:05:44.151435+0000","last_clean":"2023-11-24T08:05:44.151435+0000","last_became_active":"2023-11-24T08:05:43.190264+0000","last_became_peered":"2023-11-24T08:05:43.190264+0000","last_unstale":"2023-11-24T08:05:44.151435+0000","last_undegraded":"2023-11-24T08:05:44.151435+0000","last_fullsized":"2023-11-24T08:05:44.151435+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:26:11.029673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168186+0000","last_change":"2023-11-24T08:05:44.165071+0000","last_active":"2023-11-24T08:05:44.168186+0000","last_peered":"2023-11-24T08:05:44.168186+0000","last_clean":"2023-11-24T08:05:44.168186+0000","last_became_active":"2023-11-24T08:05:44.164657+0000","last_became_peered":"2023-11-24T08:05:44.164657+0000","last_unstale":"2023-11-24T08:05:44.168186+0000","last_undegraded":"2023-11-24T08:05:44.168186+0000","last_fullsized":"2023-11-24T08:05:44.168186+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:39:33.962459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.151718+0000","last_change":"2023-11-24T08:05:43.185293+0000","last_active":"2023-11-24T08:05:44.151718+0000","last_peered":"2023-11-24T08:05:44.151718+0000","last_clean":"2023-11-24T08:05:44.151718+0000","last_became_active":"2023-11-24T08:05:43.184939+0000","last_became_peered":"2023-11-24T08:05:43.184939+0000","last_unstale":"2023-11-24T08:05:44.151718+0000","last_undegraded":"2023-11-24T08:05:44.151718+0000","last_fullsized":"2023-11-24T08:05:44.151718+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:56.156256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166397+0000","last_change":"2023-11-24T08:05:44.161064+0000","last_active":"2023-11-24T08:05:44.166397+0000","last_peered":"2023-11-24T08:05:44.166397+0000","last_clean":"2023-11-24T08:05:44.166397+0000","last_became_active":"2023-11-24T08:05:44.160772+0000","last_became_peered":"2023-11-24T08:05:44.160772+0000","last_unstale":"2023-11-24T08:05:44.166397+0000","last_undegraded":"2023-11-24T08:05:44.166397+0000","last_fullsized":"2023-11-24T08:05:44.166397+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:35:43.201615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.146114+0000","last_change":"2023-11-24T08:05:43.190849+0000","last_active":"2023-11-24T08:05:44.146114+0000","last_peered":"2023-11-24T08:05:44.146114+0000","last_clean":"2023-11-24T08:05:44.146114+0000","last_became_active":"2023-11-24T08:05:43.190538+0000","last_became_peered":"2023-11-24T08:05:43.190538+0000","last_unstale":"2023-11-24T08:05:44.146114+0000","last_undegraded":"2023-11-24T08:05:44.146114+0000","last_fullsized":"2023-11-24T08:05:44.146114+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:59:13.828123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162334+0000","last_change":"2023-11-24T08:05:44.160619+0000","last_active":"2023-11-24T08:05:44.162334+0000","last_peered":"2023-11-24T08:05:44.162334+0000","last_clean":"2023-11-24T08:05:44.162334+0000","last_became_active":"2023-11-24T08:05:44.159416+0000","last_became_peered":"2023-11-24T08:05:44.159416+0000","last_unstale":"2023-11-24T08:05:44.162334+0000","last_undegraded":"2023-11-24T08:05:44.162334+0000","last_fullsized":"2023-11-24T08:05:44.162334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:17:09.653433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.159362+0000","last_change":"2023-11-24T08:05:43.187333+0000","last_active":"2023-11-24T08:05:44.159362+0000","last_peered":"2023-11-24T08:05:44.159362+0000","last_clean":"2023-11-24T08:05:44.159362+0000","last_became_active":"2023-11-24T08:05:43.187055+0000","last_became_peered":"2023-11-24T08:05:43.187055+0000","last_unstale":"2023-11-24T08:05:44.159362+0000","last_undegraded":"2023-11-24T08:05:44.159362+0000","last_fullsized":"2023-11-24T08:05:44.159362+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:09:55.503706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166928+0000","last_change":"2023-11-24T08:05:44.161285+0000","last_active":"2023-11-24T08:05:44.166928+0000","last_peered":"2023-11-24T08:05:44.166928+0000","last_clean":"2023-11-24T08:05:44.166928+0000","last_became_active":"2023-11-24T08:05:44.161035+0000","last_became_peered":"2023-11-24T08:05:44.161035+0000","last_unstale":"2023-11-24T08:05:44.166928+0000","last_undegraded":"2023-11-24T08:05:44.166928+0000","last_fullsized":"2023-11-24T08:05:44.166928+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:06.798490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.200776+0000","last_change":"2023-11-24T08:05:43.186403+0000","last_active":"2023-11-24T08:05:44.200776+0000","last_peered":"2023-11-24T08:05:44.200776+0000","last_clean":"2023-11-24T08:05:44.200776+0000","last_became_active":"2023-11-24T08:05:43.186150+0000","last_became_peered":"2023-11-24T08:05:43.186150+0000","last_unstale":"2023-11-24T08:05:44.200776+0000","last_undegraded":"2023-11-24T08:05:44.200776+0000","last_fullsized":"2023-11-24T08:05:44.200776+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:25:47.887386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-24T08:05:43.174305+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:05:43.174305+0000","last_peered":"2023-11-24T08:05:43.174305+0000","last_clean":"2023-11-24T08:05:43.174305+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:05:43.174305+0000","last_undegraded":"2023-11-24T08:05:43.174305+0000","last_fullsized":"2023-11-24T08:05:43.174305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1089536,"data_stored":786767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.628}]},{"osd":3,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":196981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":10.285,"5min":10.285,"15min":10.285},"last":0.377}]},{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":196379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.32300000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.38200000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.624},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":785692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.32700000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.249},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.308},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.443}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.8109999999999999,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":9.9100000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4,"5min":4,"15min":4},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":507904,"data_stored":197943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.26600000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":5.673,"5min":5.673,"15min":5.673},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.432},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":4.4400000000000004,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":0.441}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":5.726,"5min":5.726,"15min":5.726},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.40300000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.7880000000000003,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.52500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":196309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.219},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.26600000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.28599999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.33000000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":197921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.378}]},{"osd":1,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.437}]},{"osd":3,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":1.101},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.34699999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40799999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.48499999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.499}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":196379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68700000000000006}]},{"osd":1,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.436},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.501},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:48.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:48.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.469+0000 7f545e64f700 1 Processor -- start 2023-11-24T08:05:48.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.469+0000 7f545e64f700 1 -- start start 2023-11-24T08:05:48.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.470+0000 7f545e64f700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5458158670 0x7f54580622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.470+0000 7f545e64f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54580cfff0 con 0x7f54580c9fc0 2023-11-24T08:05:48.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.470+0000 7f545e64f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54580cfd10 con 0x7f5458158a50 2023-11-24T08:05:48.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.470+0000 7f545e64f700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5458161f50 con 0x7f5458158670 2023-11-24T08:05:48.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.470+0000 7f545cbec700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f54580c9fc0 0x7f54580ce1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44504/0 (socket says 172.21.15.153:44504) 2023-11-24T08:05:48.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.470+0000 7f545cbec700 1 -- 172.21.15.153:0/2973152048 learned_addr learned my addr 172.21.15.153:0/2973152048 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:48.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.470+0000 7f5457fff700 1 --2- 172.21.15.153:0/2973152048 >> v2:172.21.15.164:3300/0 conn(0x7f5458158670 0x7f54580622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.470+0000 7f5456ffd700 1 -- 172.21.15.153:0/2973152048 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941970053 0 0) 0x7f54580cfff0 con 0x7f54580c9fc0 2023-11-24T08:05:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.470+0000 7f5456ffd700 1 -- 172.21.15.153:0/2973152048 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54400035b0 con 0x7f54580c9fc0 2023-11-24T08:05:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.471+0000 7f5456ffd700 1 -- 172.21.15.153:0/2973152048 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992727923 0 0) 0x7f54580cfd10 con 0x7f5458158a50 2023-11-24T08:05:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.471+0000 7f5456ffd700 1 -- 172.21.15.153:0/2973152048 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54580cfff0 con 0x7f5458158a50 2023-11-24T08:05:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.471+0000 7f5456ffd700 1 -- 172.21.15.153:0/2973152048 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2803747133 0 0) 0x7f54400035b0 con 0x7f54580c9fc0 2023-11-24T08:05:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.471+0000 7f5457fff700 1 -- 172.21.15.153:0/2973152048 >> v1:172.21.15.164:6789/0 conn(0x7f5458158a50 legacy=0x7f54580c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.471+0000 7f5457fff700 1 -- 172.21.15.153:0/2973152048 >> v1:172.21.15.153:6789/0 conn(0x7f54580c9fc0 legacy=0x7f54580ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.471+0000 7f5457fff700 1 -- 172.21.15.153:0/2973152048 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458162230 con 0x7f5458158670 2023-11-24T08:05:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.471+0000 7f5457fff700 1 --2- 172.21.15.153:0/2973152048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5458158670 0x7f54580622a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f544c009840 tx=0x7f544c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12f8ea6cdbe9df9f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.471+0000 7f5456ffd700 1 -- 172.21.15.153:0/2973152048 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500019f0 con 0x7f5458158670 2023-11-24T08:05:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.471+0000 7f5456ffd700 1 -- 172.21.15.153:0/2973152048 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c004030 con 0x7f5458158670 2023-11-24T08:05:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.471+0000 7f5456ffd700 1 -- 172.21.15.153:0/2973152048 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c0043a0 con 0x7f5458158670 2023-11-24T08:05:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.472+0000 7f545e64f700 1 -- 172.21.15.153:0/2973152048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5458158670 msgr2=0x7f54580622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.472+0000 7f545e64f700 1 --2- 172.21.15.153:0/2973152048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5458158670 0x7f54580622a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f544c009840 tx=0x7f544c009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.472+0000 7f545e64f700 1 -- 172.21.15.153:0/2973152048 shutdown_connections 2023-11-24T08:05:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.472+0000 7f545e64f700 1 --2- 172.21.15.153:0/2973152048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5458158670 0x7f54580622a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.472+0000 7f545e64f700 1 -- 172.21.15.153:0/2973152048 >> 172.21.15.153:0/2973152048 conn(0x7f54580b57b0 msgr2=0x7f54580b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:48.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.472+0000 7f545e64f700 1 -- 172.21.15.153:0/2973152048 shutdown_connections 2023-11-24T08:05:48.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.472+0000 7f545e64f700 1 -- 172.21.15.153:0/2973152048 wait complete. 2023-11-24T08:05:48.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.473+0000 7f545e64f700 1 Processor -- start 2023-11-24T08:05:48.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.473+0000 7f545e64f700 1 -- start start 2023-11-24T08:05:48.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545e64f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54580c9fc0 0x7f54581472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545e64f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5458158a50 0x7f54580cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545e64f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5458149b90 0x7f545814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545e64f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545814a560 con 0x7f5458149b90 2023-11-24T08:05:48.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545e64f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5458147830 con 0x7f54580c9fc0 2023-11-24T08:05:48.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545e64f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5458147b40 con 0x7f5458158a50 2023-11-24T08:05:48.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545cbec700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5458149b90 0x7f545814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545cbec700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5458149b90 0x7f545814a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38406/0 (socket says 172.21.15.153:38406) 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545cbec700 1 -- 172.21.15.153:0/1485244286 learned_addr learned my addr 172.21.15.153:0/1485244286 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f5457fff700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54580c9fc0 0x7f54581472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f54577fe700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5458158a50 0x7f54580cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545cbec700 1 -- 172.21.15.153:0/1485244286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5458158a50 msgr2=0x7f54580cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545cbec700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5458158a50 0x7f54580cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545cbec700 1 -- 172.21.15.153:0/1485244286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54580c9fc0 msgr2=0x7f54581472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545cbec700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54580c9fc0 0x7f54581472f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545cbec700 1 -- 172.21.15.153:0/1485244286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c0094a0 con 0x7f5458149b90 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545cbec700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5458149b90 0x7f545814a020 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5450001560 tx=0x7f545000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f5454ff9700 1 -- 172.21.15.153:0/1485244286 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545000ad80 con 0x7f5458149b90 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f5454ff9700 1 -- 172.21.15.153:0/1485244286 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54500070d0 con 0x7f5458149b90 2023-11-24T08:05:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545e64f700 1 -- 172.21.15.153:0/1485244286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5458147e20 con 0x7f5458149b90 2023-11-24T08:05:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f5454ff9700 1 -- 172.21.15.153:0/1485244286 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450007480 con 0x7f5458149b90 2023-11-24T08:05:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.474+0000 7f545e64f700 1 -- 172.21.15.153:0/1485244286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54581483e0 con 0x7f5458149b90 2023-11-24T08:05:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.475+0000 7f545e64f700 1 -- 172.21.15.153:0/1485244286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5458067f60 con 0x7f5458149b90 2023-11-24T08:05:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.476+0000 7f5454ff9700 1 -- 172.21.15.153:0/1485244286 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f54500075e0 con 0x7f5458149b90 2023-11-24T08:05:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.476+0000 7f5454ff9700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f544406b080 0x7f544406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.476+0000 7f5454ff9700 1 -- 172.21.15.153:0/1485244286 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54500898d0 con 0x7f5458149b90 2023-11-24T08:05:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.476+0000 7f5457fff700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f544406b080 0x7f544406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.477+0000 7f5457fff700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f544406b080 0x7f544406d540 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f54580d1340 tx=0x7f544c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:48.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.481+0000 7f5454ff9700 1 -- 172.21.15.153:0/1485244286 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5450054700 con 0x7f5458149b90 2023-11-24T08:05:48.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.669+0000 7f545e64f700 1 -- 172.21.15.153:0/1485244286 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54580cf8a0 con 0x7f544406b080 2023-11-24T08:05:48.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.677+0000 7f5454ff9700 1 -- 172.21.15.153:0/1485244286 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288808 (secure 0 0 0) 0x7f544c004320 con 0x7f544406b080 2023-11-24T08:05:48.682 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:48.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 -- 172.21.15.153:0/1485244286 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f544406b080 msgr2=0x7f544406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f544406b080 0x7f544406d540 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f54580d1340 tx=0x7f544c008030 comp rx=0 tx=0).stop 2023-11-24T08:05:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 -- 172.21.15.153:0/1485244286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5458149b90 msgr2=0x7f545814a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5458149b90 0x7f545814a020 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5450001560 tx=0x7f545000a340 comp rx=0 tx=0).stop 2023-11-24T08:05:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 -- 172.21.15.153:0/1485244286 shutdown_connections 2023-11-24T08:05:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f544406b080 0x7f544406d540 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5458149b90 0x7f545814a020 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54580c9fc0 0x7f54581472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 --2- 172.21.15.153:0/1485244286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5458158a50 0x7f54580cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 -- 172.21.15.153:0/1485244286 >> 172.21.15.153:0/1485244286 conn(0x7f54580b57b0 msgr2=0x7f54580b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 -- 172.21.15.153:0/1485244286 shutdown_connections 2023-11-24T08:05:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.681+0000 7f545e64f700 1 -- 172.21.15.153:0/1485244286 wait complete. 2023-11-24T08:05:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:05:48.695 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-11-24T08:05:48.060734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221244,"kb_used_data":5048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753476,"statfs":{"total":773094113280,"available":772867559424,"internally_reserved":0,"allocated":5169152,"data_stored":2754371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.891074"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.163859+0000","last_change":"2023-11-24T08:05:44.160185+0000","last_active":"2023-11-24T08:05:44.163859+0000","last_peered":"2023-11-24T08:05:44.163859+0000","last_clean":"2023-11-24T08:05:44.163859+0000","last_became_active":"2023-11-24T08:05:44.159897+0000","last_became_peered":"2023-11-24T08:05:44.159897+0000","last_unstale":"2023-11-24T08:05:44.163859+0000","last_undegraded":"2023-11-24T08:05:44.163859+0000","last_fullsized":"2023-11-24T08:05:44.163859+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:16:52.821767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.167087+0000","last_change":"2023-11-24T08:05:44.162201+0000","last_active":"2023-11-24T08:05:44.167087+0000","last_peered":"2023-11-24T08:05:44.167087+0000","last_clean":"2023-11-24T08:05:44.167087+0000","last_became_active":"2023-11-24T08:05:44.161759+0000","last_became_peered":"2023-11-24T08:05:44.161759+0000","last_unstale":"2023-11-24T08:05:44.167087+0000","last_undegraded":"2023-11-24T08:05:44.167087+0000","last_fullsized":"2023-11-24T08:05:44.167087+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:16:52.821767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169150+0000","last_change":"2023-11-24T08:05:44.164352+0000","last_active":"2023-11-24T08:05:44.169150+0000","last_peered":"2023-11-24T08:05:44.169150+0000","last_clean":"2023-11-24T08:05:44.169150+0000","last_became_active":"2023-11-24T08:05:44.164060+0000","last_became_peered":"2023-11-24T08:05:44.164060+0000","last_unstale":"2023-11-24T08:05:44.169150+0000","last_undegraded":"2023-11-24T08:05:44.169150+0000","last_fullsized":"2023-11-24T08:05:44.169150+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:53.301615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168249+0000","last_change":"2023-11-24T08:05:44.163955+0000","last_active":"2023-11-24T08:05:44.168249+0000","last_peered":"2023-11-24T08:05:44.168249+0000","last_clean":"2023-11-24T08:05:44.168249+0000","last_became_active":"2023-11-24T08:05:44.163670+0000","last_became_peered":"2023-11-24T08:05:44.163670+0000","last_unstale":"2023-11-24T08:05:44.168249+0000","last_undegraded":"2023-11-24T08:05:44.168249+0000","last_fullsized":"2023-11-24T08:05:44.168249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:57.160571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166952+0000","last_change":"2023-11-24T08:05:44.163777+0000","last_active":"2023-11-24T08:05:44.166952+0000","last_peered":"2023-11-24T08:05:44.166952+0000","last_clean":"2023-11-24T08:05:44.166952+0000","last_became_active":"2023-11-24T08:05:44.163487+0000","last_became_peered":"2023-11-24T08:05:44.163487+0000","last_unstale":"2023-11-24T08:05:44.166952+0000","last_undegraded":"2023-11-24T08:05:44.166952+0000","last_fullsized":"2023-11-24T08:05:44.166952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:25.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.160451+0000","last_change":"2023-11-24T08:05:44.156835+0000","last_active":"2023-11-24T08:05:44.160451+0000","last_peered":"2023-11-24T08:05:44.160451+0000","last_clean":"2023-11-24T08:05:44.160451+0000","last_became_active":"2023-11-24T08:05:44.156562+0000","last_became_peered":"2023-11-24T08:05:44.156562+0000","last_unstale":"2023-11-24T08:05:44.160451+0000","last_undegraded":"2023-11-24T08:05:44.160451+0000","last_fullsized":"2023-11-24T08:05:44.160451+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:46:08.448281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169151+0000","last_change":"2023-11-24T08:05:44.164363+0000","last_active":"2023-11-24T08:05:44.169151+0000","last_peered":"2023-11-24T08:05:44.169151+0000","last_clean":"2023-11-24T08:05:44.169151+0000","last_became_active":"2023-11-24T08:05:44.164082+0000","last_became_peered":"2023-11-24T08:05:44.164082+0000","last_unstale":"2023-11-24T08:05:44.169151+0000","last_undegraded":"2023-11-24T08:05:44.169151+0000","last_fullsized":"2023-11-24T08:05:44.169151+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:35:43.201615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168908+0000","last_change":"2023-11-24T08:05:44.164684+0000","last_active":"2023-11-24T08:05:44.168908+0000","last_peered":"2023-11-24T08:05:44.168908+0000","last_clean":"2023-11-24T08:05:44.168908+0000","last_became_active":"2023-11-24T08:05:44.164293+0000","last_became_peered":"2023-11-24T08:05:44.164293+0000","last_unstale":"2023-11-24T08:05:44.168908+0000","last_undegraded":"2023-11-24T08:05:44.168908+0000","last_fullsized":"2023-11-24T08:05:44.168908+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:48:42.755278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168337+0000","last_change":"2023-11-24T08:05:44.163854+0000","last_active":"2023-11-24T08:05:44.168337+0000","last_peered":"2023-11-24T08:05:44.168337+0000","last_clean":"2023-11-24T08:05:44.168337+0000","last_became_active":"2023-11-24T08:05:44.163621+0000","last_became_peered":"2023-11-24T08:05:44.163621+0000","last_unstale":"2023-11-24T08:05:44.168337+0000","last_undegraded":"2023-11-24T08:05:44.168337+0000","last_fullsized":"2023-11-24T08:05:44.168337+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:09:32.902925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169079+0000","last_change":"2023-11-24T08:05:44.165912+0000","last_active":"2023-11-24T08:05:44.169079+0000","last_peered":"2023-11-24T08:05:44.169079+0000","last_clean":"2023-11-24T08:05:44.169079+0000","last_became_active":"2023-11-24T08:05:44.165586+0000","last_became_peered":"2023-11-24T08:05:44.165586+0000","last_unstale":"2023-11-24T08:05:44.169079+0000","last_undegraded":"2023-11-24T08:05:44.169079+0000","last_fullsized":"2023-11-24T08:05:44.169079+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:24:47.258524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168888+0000","last_change":"2023-11-24T08:05:44.164714+0000","last_active":"2023-11-24T08:05:44.168888+0000","last_peered":"2023-11-24T08:05:44.168888+0000","last_clean":"2023-11-24T08:05:44.168888+0000","last_became_active":"2023-11-24T08:05:44.163989+0000","last_became_peered":"2023-11-24T08:05:44.163989+0000","last_unstale":"2023-11-24T08:05:44.168888+0000","last_undegraded":"2023-11-24T08:05:44.168888+0000","last_fullsized":"2023-11-24T08:05:44.168888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:13.703528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.171788+0000","last_change":"2023-11-24T08:05:44.167128+0000","last_active":"2023-11-24T08:05:44.171788+0000","last_peered":"2023-11-24T08:05:44.171788+0000","last_clean":"2023-11-24T08:05:44.171788+0000","last_became_active":"2023-11-24T08:05:44.166834+0000","last_became_peered":"2023-11-24T08:05:44.166834+0000","last_unstale":"2023-11-24T08:05:44.171788+0000","last_undegraded":"2023-11-24T08:05:44.171788+0000","last_fullsized":"2023-11-24T08:05:44.171788+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:26:12.033988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170155+0000","last_change":"2023-11-24T08:05:44.163003+0000","last_active":"2023-11-24T08:05:44.170155+0000","last_peered":"2023-11-24T08:05:44.170155+0000","last_clean":"2023-11-24T08:05:44.170155+0000","last_became_active":"2023-11-24T08:05:44.162604+0000","last_became_peered":"2023-11-24T08:05:44.162604+0000","last_unstale":"2023-11-24T08:05:44.170155+0000","last_undegraded":"2023-11-24T08:05:44.170155+0000","last_fullsized":"2023-11-24T08:05:44.170155+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:14.842942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168318+0000","last_change":"2023-11-24T08:05:44.164468+0000","last_active":"2023-11-24T08:05:44.168318+0000","last_peered":"2023-11-24T08:05:44.168318+0000","last_clean":"2023-11-24T08:05:44.168318+0000","last_became_active":"2023-11-24T08:05:44.164069+0000","last_became_peered":"2023-11-24T08:05:44.164069+0000","last_unstale":"2023-11-24T08:05:44.168318+0000","last_undegraded":"2023-11-24T08:05:44.168318+0000","last_fullsized":"2023-11-24T08:05:44.168318+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:11.513164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162023+0000","last_change":"2023-11-24T08:05:44.160246+0000","last_active":"2023-11-24T08:05:44.162023+0000","last_peered":"2023-11-24T08:05:44.162023+0000","last_clean":"2023-11-24T08:05:44.162023+0000","last_became_active":"2023-11-24T08:05:44.159989+0000","last_became_peered":"2023-11-24T08:05:44.159989+0000","last_unstale":"2023-11-24T08:05:44.162023+0000","last_undegraded":"2023-11-24T08:05:44.162023+0000","last_fullsized":"2023-11-24T08:05:44.162023+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:12.556630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169303+0000","last_change":"2023-11-24T08:05:44.165840+0000","last_active":"2023-11-24T08:05:44.169303+0000","last_peered":"2023-11-24T08:05:44.169303+0000","last_clean":"2023-11-24T08:05:44.169303+0000","last_became_active":"2023-11-24T08:05:44.165582+0000","last_became_peered":"2023-11-24T08:05:44.165582+0000","last_unstale":"2023-11-24T08:05:44.169303+0000","last_undegraded":"2023-11-24T08:05:44.169303+0000","last_fullsized":"2023-11-24T08:05:44.169303+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:23.956996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162306+0000","last_change":"2023-11-24T08:05:44.160483+0000","last_active":"2023-11-24T08:05:44.162306+0000","last_peered":"2023-11-24T08:05:44.162306+0000","last_clean":"2023-11-24T08:05:44.162306+0000","last_became_active":"2023-11-24T08:05:44.160064+0000","last_became_peered":"2023-11-24T08:05:44.160064+0000","last_unstale":"2023-11-24T08:05:44.162306+0000","last_undegraded":"2023-11-24T08:05:44.162306+0000","last_fullsized":"2023-11-24T08:05:44.162306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:34.038812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169222+0000","last_change":"2023-11-24T08:05:44.165988+0000","last_active":"2023-11-24T08:05:44.169222+0000","last_peered":"2023-11-24T08:05:44.169222+0000","last_clean":"2023-11-24T08:05:44.169222+0000","last_became_active":"2023-11-24T08:05:44.165655+0000","last_became_peered":"2023-11-24T08:05:44.165655+0000","last_unstale":"2023-11-24T08:05:44.169222+0000","last_undegraded":"2023-11-24T08:05:44.169222+0000","last_fullsized":"2023-11-24T08:05:44.169222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:24:47.258524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169032+0000","last_change":"2023-11-24T08:05:44.163723+0000","last_active":"2023-11-24T08:05:44.169032+0000","last_peered":"2023-11-24T08:05:44.169032+0000","last_clean":"2023-11-24T08:05:44.169032+0000","last_became_active":"2023-11-24T08:05:44.163421+0000","last_became_peered":"2023-11-24T08:05:44.163421+0000","last_unstale":"2023-11-24T08:05:44.169032+0000","last_undegraded":"2023-11-24T08:05:44.169032+0000","last_fullsized":"2023-11-24T08:05:44.169032+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:13.703528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170196+0000","last_change":"2023-11-24T08:05:44.163857+0000","last_active":"2023-11-24T08:05:44.170196+0000","last_peered":"2023-11-24T08:05:44.170196+0000","last_clean":"2023-11-24T08:05:44.170196+0000","last_became_active":"2023-11-24T08:05:44.163634+0000","last_became_peered":"2023-11-24T08:05:44.163634+0000","last_unstale":"2023-11-24T08:05:44.170196+0000","last_undegraded":"2023-11-24T08:05:44.170196+0000","last_fullsized":"2023-11-24T08:05:44.170196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:21.773652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.161916+0000","last_change":"2023-11-24T08:05:44.158653+0000","last_active":"2023-11-24T08:05:44.161916+0000","last_peered":"2023-11-24T08:05:44.161916+0000","last_clean":"2023-11-24T08:05:44.161916+0000","last_became_active":"2023-11-24T08:05:44.158391+0000","last_became_peered":"2023-11-24T08:05:44.158391+0000","last_unstale":"2023-11-24T08:05:44.161916+0000","last_undegraded":"2023-11-24T08:05:44.161916+0000","last_fullsized":"2023-11-24T08:05:44.161916+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:00:10.333165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.167437+0000","last_change":"2023-11-24T08:05:44.162692+0000","last_active":"2023-11-24T08:05:44.167437+0000","last_peered":"2023-11-24T08:05:44.167437+0000","last_clean":"2023-11-24T08:05:44.167437+0000","last_became_active":"2023-11-24T08:05:44.162430+0000","last_became_peered":"2023-11-24T08:05:44.162430+0000","last_unstale":"2023-11-24T08:05:44.167437+0000","last_undegraded":"2023-11-24T08:05:44.167437+0000","last_fullsized":"2023-11-24T08:05:44.167437+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:32:53.597950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.161982+0000","last_change":"2023-11-24T08:05:44.155850+0000","last_active":"2023-11-24T08:05:44.161982+0000","last_peered":"2023-11-24T08:05:44.161982+0000","last_clean":"2023-11-24T08:05:44.161982+0000","last_became_active":"2023-11-24T08:05:44.155495+0000","last_became_peered":"2023-11-24T08:05:44.155495+0000","last_unstale":"2023-11-24T08:05:44.161982+0000","last_undegraded":"2023-11-24T08:05:44.161982+0000","last_fullsized":"2023-11-24T08:05:44.161982+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:47.528724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.161932+0000","last_change":"2023-11-24T08:05:44.155119+0000","last_active":"2023-11-24T08:05:44.161932+0000","last_peered":"2023-11-24T08:05:44.161932+0000","last_clean":"2023-11-24T08:05:44.161932+0000","last_became_active":"2023-11-24T08:05:44.154831+0000","last_became_peered":"2023-11-24T08:05:44.154831+0000","last_unstale":"2023-11-24T08:05:44.161932+0000","last_undegraded":"2023-11-24T08:05:44.161932+0000","last_fullsized":"2023-11-24T08:05:44.161932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:33:35.161075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169099+0000","last_change":"2023-11-24T08:05:44.164802+0000","last_active":"2023-11-24T08:05:44.169099+0000","last_peered":"2023-11-24T08:05:44.169099+0000","last_clean":"2023-11-24T08:05:44.169099+0000","last_became_active":"2023-11-24T08:05:44.164504+0000","last_became_peered":"2023-11-24T08:05:44.164504+0000","last_unstale":"2023-11-24T08:05:44.169099+0000","last_undegraded":"2023-11-24T08:05:44.169099+0000","last_fullsized":"2023-11-24T08:05:44.169099+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:46.873896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170171+0000","last_change":"2023-11-24T08:05:44.163160+0000","last_active":"2023-11-24T08:05:44.170171+0000","last_peered":"2023-11-24T08:05:44.170171+0000","last_clean":"2023-11-24T08:05:44.170171+0000","last_became_active":"2023-11-24T08:05:44.162891+0000","last_became_peered":"2023-11-24T08:05:44.162891+0000","last_unstale":"2023-11-24T08:05:44.170171+0000","last_undegraded":"2023-11-24T08:05:44.170171+0000","last_fullsized":"2023-11-24T08:05:44.170171+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:47.528724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162355+0000","last_change":"2023-11-24T08:05:44.160860+0000","last_active":"2023-11-24T08:05:44.162355+0000","last_peered":"2023-11-24T08:05:44.162355+0000","last_clean":"2023-11-24T08:05:44.162355+0000","last_became_active":"2023-11-24T08:05:44.159259+0000","last_became_peered":"2023-11-24T08:05:44.159259+0000","last_unstale":"2023-11-24T08:05:44.162355+0000","last_undegraded":"2023-11-24T08:05:44.162355+0000","last_fullsized":"2023-11-24T08:05:44.162355+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:11.513164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.171800+0000","last_change":"2023-11-24T08:05:44.167212+0000","last_active":"2023-11-24T08:05:44.171800+0000","last_peered":"2023-11-24T08:05:44.171800+0000","last_clean":"2023-11-24T08:05:44.171800+0000","last_became_active":"2023-11-24T08:05:44.166900+0000","last_became_peered":"2023-11-24T08:05:44.166900+0000","last_unstale":"2023-11-24T08:05:44.171800+0000","last_undegraded":"2023-11-24T08:05:44.171800+0000","last_fullsized":"2023-11-24T08:05:44.171800+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:56.526467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166432+0000","last_change":"2023-11-24T08:05:44.162624+0000","last_active":"2023-11-24T08:05:44.166432+0000","last_peered":"2023-11-24T08:05:44.166432+0000","last_clean":"2023-11-24T08:05:44.166432+0000","last_became_active":"2023-11-24T08:05:44.162338+0000","last_became_peered":"2023-11-24T08:05:44.162338+0000","last_unstale":"2023-11-24T08:05:44.166432+0000","last_undegraded":"2023-11-24T08:05:44.166432+0000","last_fullsized":"2023-11-24T08:05:44.166432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:39.060847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162372+0000","last_change":"2023-11-24T08:05:44.160304+0000","last_active":"2023-11-24T08:05:44.162372+0000","last_peered":"2023-11-24T08:05:44.162372+0000","last_clean":"2023-11-24T08:05:44.162372+0000","last_became_active":"2023-11-24T08:05:44.160034+0000","last_became_peered":"2023-11-24T08:05:44.160034+0000","last_unstale":"2023-11-24T08:05:44.162372+0000","last_undegraded":"2023-11-24T08:05:44.162372+0000","last_fullsized":"2023-11-24T08:05:44.162372+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:07.101986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.160523+0000","last_change":"2023-11-24T08:05:44.158138+0000","last_active":"2023-11-24T08:05:44.160523+0000","last_peered":"2023-11-24T08:05:44.160523+0000","last_clean":"2023-11-24T08:05:44.160523+0000","last_became_active":"2023-11-24T08:05:44.157877+0000","last_became_peered":"2023-11-24T08:05:44.157877+0000","last_unstale":"2023-11-24T08:05:44.160523+0000","last_undegraded":"2023-11-24T08:05:44.160523+0000","last_fullsized":"2023-11-24T08:05:44.160523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:25:48.891700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170224+0000","last_change":"2023-11-24T08:05:44.164535+0000","last_active":"2023-11-24T08:05:44.170224+0000","last_peered":"2023-11-24T08:05:44.170224+0000","last_clean":"2023-11-24T08:05:44.170224+0000","last_became_active":"2023-11-24T08:05:44.164262+0000","last_became_peered":"2023-11-24T08:05:44.164262+0000","last_unstale":"2023-11-24T08:05:44.170224+0000","last_undegraded":"2023-11-24T08:05:44.170224+0000","last_fullsized":"2023-11-24T08:05:44.170224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:20.919636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168229+0000","last_change":"2023-11-24T08:05:44.159423+0000","last_active":"2023-11-24T08:05:44.168229+0000","last_peered":"2023-11-24T08:05:44.168229+0000","last_clean":"2023-11-24T08:05:44.168229+0000","last_became_active":"2023-11-24T08:05:44.159172+0000","last_became_peered":"2023-11-24T08:05:44.159172+0000","last_unstale":"2023-11-24T08:05:44.168229+0000","last_undegraded":"2023-11-24T08:05:44.168229+0000","last_fullsized":"2023-11-24T08:05:44.168229+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:34.038812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.204608+0000","last_change":"2023-11-24T08:05:43.191409+0000","last_active":"2023-11-24T08:05:44.204608+0000","last_peered":"2023-11-24T08:05:44.204608+0000","last_clean":"2023-11-24T08:05:44.204608+0000","last_became_active":"2023-11-24T08:05:43.191101+0000","last_became_peered":"2023-11-24T08:05:43.191101+0000","last_unstale":"2023-11-24T08:05:44.204608+0000","last_undegraded":"2023-11-24T08:05:44.204608+0000","last_fullsized":"2023-11-24T08:05:44.204608+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:33:04.621385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.164685+0000","last_change":"2023-11-24T08:05:44.159996+0000","last_active":"2023-11-24T08:05:44.164685+0000","last_peered":"2023-11-24T08:05:44.164685+0000","last_clean":"2023-11-24T08:05:44.164685+0000","last_became_active":"2023-11-24T08:05:44.159664+0000","last_became_peered":"2023-11-24T08:05:44.159664+0000","last_unstale":"2023-11-24T08:05:44.164685+0000","last_undegraded":"2023-11-24T08:05:44.164685+0000","last_fullsized":"2023-11-24T08:05:44.164685+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:56.975875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.204270+0000","last_change":"2023-11-24T08:05:43.190501+0000","last_active":"2023-11-24T08:05:44.204270+0000","last_peered":"2023-11-24T08:05:44.204270+0000","last_clean":"2023-11-24T08:05:44.204270+0000","last_became_active":"2023-11-24T08:05:43.189833+0000","last_became_peered":"2023-11-24T08:05:43.189833+0000","last_unstale":"2023-11-24T08:05:44.204270+0000","last_undegraded":"2023-11-24T08:05:44.204270+0000","last_fullsized":"2023-11-24T08:05:44.204270+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:09:31.898610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.159415+0000","last_change":"2023-11-24T08:05:44.156577+0000","last_active":"2023-11-24T08:05:44.159415+0000","last_peered":"2023-11-24T08:05:44.159415+0000","last_clean":"2023-11-24T08:05:44.159415+0000","last_became_active":"2023-11-24T08:05:44.156282+0000","last_became_peered":"2023-11-24T08:05:44.156282+0000","last_unstale":"2023-11-24T08:05:44.159415+0000","last_undegraded":"2023-11-24T08:05:44.159415+0000","last_fullsized":"2023-11-24T08:05:44.159415+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:56.899822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.199729+0000","last_change":"2023-11-24T08:05:43.191397+0000","last_active":"2023-11-24T08:05:44.199729+0000","last_peered":"2023-11-24T08:05:44.199729+0000","last_clean":"2023-11-24T08:05:44.199729+0000","last_became_active":"2023-11-24T08:05:43.191160+0000","last_became_peered":"2023-11-24T08:05:43.191160+0000","last_unstale":"2023-11-24T08:05:44.199729+0000","last_undegraded":"2023-11-24T08:05:44.199729+0000","last_fullsized":"2023-11-24T08:05:44.199729+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:48:41.750963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162440+0000","last_change":"2023-11-24T08:05:44.158584+0000","last_active":"2023-11-24T08:05:44.162440+0000","last_peered":"2023-11-24T08:05:44.162440+0000","last_clean":"2023-11-24T08:05:44.162440+0000","last_became_active":"2023-11-24T08:05:44.158312+0000","last_became_peered":"2023-11-24T08:05:44.158312+0000","last_unstale":"2023-11-24T08:05:44.162440+0000","last_undegraded":"2023-11-24T08:05:44.162440+0000","last_fullsized":"2023-11-24T08:05:44.162440+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:24:47.258524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.199894+0000","last_change":"2023-11-24T08:05:43.188917+0000","last_active":"2023-11-24T08:05:44.199894+0000","last_peered":"2023-11-24T08:05:44.199894+0000","last_clean":"2023-11-24T08:05:44.199894+0000","last_became_active":"2023-11-24T08:05:43.188587+0000","last_became_peered":"2023-11-24T08:05:43.188587+0000","last_unstale":"2023-11-24T08:05:44.199894+0000","last_undegraded":"2023-11-24T08:05:44.199894+0000","last_fullsized":"2023-11-24T08:05:44.199894+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:55.895507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162117+0000","last_change":"2023-11-24T08:05:44.158323+0000","last_active":"2023-11-24T08:05:44.162117+0000","last_peered":"2023-11-24T08:05:44.162117+0000","last_clean":"2023-11-24T08:05:44.162117+0000","last_became_active":"2023-11-24T08:05:44.158072+0000","last_became_peered":"2023-11-24T08:05:44.158072+0000","last_unstale":"2023-11-24T08:05:44.162117+0000","last_undegraded":"2023-11-24T08:05:44.162117+0000","last_fullsized":"2023-11-24T08:05:44.162117+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:59:14.832437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.201854+0000","last_change":"2023-11-24T08:05:43.187994+0000","last_active":"2023-11-24T08:05:44.201854+0000","last_peered":"2023-11-24T08:05:44.201854+0000","last_clean":"2023-11-24T08:05:44.201854+0000","last_became_active":"2023-11-24T08:05:43.187705+0000","last_became_peered":"2023-11-24T08:05:43.187705+0000","last_unstale":"2023-11-24T08:05:44.201854+0000","last_undegraded":"2023-11-24T08:05:44.201854+0000","last_fullsized":"2023-11-24T08:05:44.201854+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:21:48.136678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168391+0000","last_change":"2023-11-24T08:05:44.163626+0000","last_active":"2023-11-24T08:05:44.168391+0000","last_peered":"2023-11-24T08:05:44.168391+0000","last_clean":"2023-11-24T08:05:44.168391+0000","last_became_active":"2023-11-24T08:05:44.163371+0000","last_became_peered":"2023-11-24T08:05:44.163371+0000","last_unstale":"2023-11-24T08:05:44.168391+0000","last_undegraded":"2023-11-24T08:05:44.168391+0000","last_fullsized":"2023-11-24T08:05:44.168391+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:07.101986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.204158+0000","last_change":"2023-11-24T08:05:43.191026+0000","last_active":"2023-11-24T08:05:44.204158+0000","last_peered":"2023-11-24T08:05:44.204158+0000","last_clean":"2023-11-24T08:05:44.204158+0000","last_became_active":"2023-11-24T08:05:43.187423+0000","last_became_peered":"2023-11-24T08:05:43.187423+0000","last_unstale":"2023-11-24T08:05:44.204158+0000","last_undegraded":"2023-11-24T08:05:44.204158+0000","last_fullsized":"2023-11-24T08:05:44.204158+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:54.034699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169104+0000","last_change":"2023-11-24T08:05:44.166150+0000","last_active":"2023-11-24T08:05:44.169104+0000","last_peered":"2023-11-24T08:05:44.169104+0000","last_clean":"2023-11-24T08:05:44.169104+0000","last_became_active":"2023-11-24T08:05:44.165119+0000","last_became_peered":"2023-11-24T08:05:44.165119+0000","last_unstale":"2023-11-24T08:05:44.169104+0000","last_undegraded":"2023-11-24T08:05:44.169104+0000","last_fullsized":"2023-11-24T08:05:44.169104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:25.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.147406+0000","last_change":"2023-11-24T08:05:43.192333+0000","last_active":"2023-11-24T08:05:44.147406+0000","last_peered":"2023-11-24T08:05:44.147406+0000","last_clean":"2023-11-24T08:05:44.147406+0000","last_became_active":"2023-11-24T08:05:43.192069+0000","last_became_peered":"2023-11-24T08:05:43.192069+0000","last_unstale":"2023-11-24T08:05:44.147406+0000","last_undegraded":"2023-11-24T08:05:44.147406+0000","last_fullsized":"2023-11-24T08:05:44.147406+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:19.947740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.163937+0000","last_change":"2023-11-24T08:05:44.158096+0000","last_active":"2023-11-24T08:05:44.163937+0000","last_peered":"2023-11-24T08:05:44.163937+0000","last_clean":"2023-11-24T08:05:44.163937+0000","last_became_active":"2023-11-24T08:05:44.157760+0000","last_became_peered":"2023-11-24T08:05:44.157760+0000","last_unstale":"2023-11-24T08:05:44.163937+0000","last_undegraded":"2023-11-24T08:05:44.163937+0000","last_fullsized":"2023-11-24T08:05:44.163937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:52.994050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.159524+0000","last_change":"2023-11-24T08:05:43.189580+0000","last_active":"2023-11-24T08:05:44.159524+0000","last_peered":"2023-11-24T08:05:44.159524+0000","last_clean":"2023-11-24T08:05:44.159524+0000","last_became_active":"2023-11-24T08:05:43.189212+0000","last_became_peered":"2023-11-24T08:05:43.189212+0000","last_unstale":"2023-11-24T08:05:44.159524+0000","last_undegraded":"2023-11-24T08:05:44.159524+0000","last_fullsized":"2023-11-24T08:05:44.159524+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:32.425237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169195+0000","last_change":"2023-11-24T08:05:44.165169+0000","last_active":"2023-11-24T08:05:44.169195+0000","last_peered":"2023-11-24T08:05:44.169195+0000","last_clean":"2023-11-24T08:05:44.169195+0000","last_became_active":"2023-11-24T08:05:44.164875+0000","last_became_peered":"2023-11-24T08:05:44.164875+0000","last_unstale":"2023-11-24T08:05:44.169195+0000","last_undegraded":"2023-11-24T08:05:44.169195+0000","last_fullsized":"2023-11-24T08:05:44.169195+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:48:42.755278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.153004+0000","last_change":"2023-11-24T08:05:43.189894+0000","last_active":"2023-11-24T08:05:44.153004+0000","last_peered":"2023-11-24T08:05:44.153004+0000","last_clean":"2023-11-24T08:05:44.153004+0000","last_became_active":"2023-11-24T08:05:43.189534+0000","last_became_peered":"2023-11-24T08:05:43.189534+0000","last_unstale":"2023-11-24T08:05:44.153004+0000","last_undegraded":"2023-11-24T08:05:44.153004+0000","last_fullsized":"2023-11-24T08:05:44.153004+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:09:55.503706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162953+0000","last_change":"2023-11-24T08:05:44.158814+0000","last_active":"2023-11-24T08:05:44.162953+0000","last_peered":"2023-11-24T08:05:44.162953+0000","last_clean":"2023-11-24T08:05:44.162953+0000","last_became_active":"2023-11-24T08:05:44.158528+0000","last_became_peered":"2023-11-24T08:05:44.158528+0000","last_unstale":"2023-11-24T08:05:44.162953+0000","last_undegraded":"2023-11-24T08:05:44.162953+0000","last_fullsized":"2023-11-24T08:05:44.162953+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:56.526467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.158964+0000","last_change":"2023-11-24T08:05:43.187276+0000","last_active":"2023-11-24T08:05:44.158964+0000","last_peered":"2023-11-24T08:05:44.158964+0000","last_clean":"2023-11-24T08:05:44.158964+0000","last_became_active":"2023-11-24T08:05:43.187019+0000","last_became_peered":"2023-11-24T08:05:43.187019+0000","last_unstale":"2023-11-24T08:05:44.158964+0000","last_undegraded":"2023-11-24T08:05:44.158964+0000","last_fullsized":"2023-11-24T08:05:44.158964+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:17:08.649119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.172704+0000","last_change":"2023-11-24T08:05:44.168095+0000","last_active":"2023-11-24T08:05:44.172704+0000","last_peered":"2023-11-24T08:05:44.172704+0000","last_clean":"2023-11-24T08:05:44.172704+0000","last_became_active":"2023-11-24T08:05:44.167786+0000","last_became_peered":"2023-11-24T08:05:44.167786+0000","last_unstale":"2023-11-24T08:05:44.172704+0000","last_undegraded":"2023-11-24T08:05:44.172704+0000","last_fullsized":"2023-11-24T08:05:44.172704+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:47:18.606681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.202046+0000","last_change":"2023-11-24T08:05:43.190583+0000","last_active":"2023-11-24T08:05:44.202046+0000","last_peered":"2023-11-24T08:05:44.202046+0000","last_clean":"2023-11-24T08:05:44.202046+0000","last_became_active":"2023-11-24T08:05:43.190249+0000","last_became_peered":"2023-11-24T08:05:43.190249+0000","last_unstale":"2023-11-24T08:05:44.202046+0000","last_undegraded":"2023-11-24T08:05:44.202046+0000","last_fullsized":"2023-11-24T08:05:44.202046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:24.307268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169290+0000","last_change":"2023-11-24T08:05:44.164955+0000","last_active":"2023-11-24T08:05:44.169290+0000","last_peered":"2023-11-24T08:05:44.169290+0000","last_clean":"2023-11-24T08:05:44.169290+0000","last_became_active":"2023-11-24T08:05:44.164167+0000","last_became_peered":"2023-11-24T08:05:44.164167+0000","last_unstale":"2023-11-24T08:05:44.169290+0000","last_undegraded":"2023-11-24T08:05:44.169290+0000","last_fullsized":"2023-11-24T08:05:44.169290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:12.556630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.207412+0000","last_change":"2023-11-24T08:05:43.186261+0000","last_active":"2023-11-24T08:05:44.207412+0000","last_peered":"2023-11-24T08:05:44.207412+0000","last_clean":"2023-11-24T08:05:44.207412+0000","last_became_active":"2023-11-24T08:05:43.186008+0000","last_became_peered":"2023-11-24T08:05:43.186008+0000","last_unstale":"2023-11-24T08:05:44.207412+0000","last_undegraded":"2023-11-24T08:05:44.207412+0000","last_fullsized":"2023-11-24T08:05:44.207412+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:11:05.829812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166552+0000","last_change":"2023-11-24T08:05:44.163096+0000","last_active":"2023-11-24T08:05:44.166552+0000","last_peered":"2023-11-24T08:05:44.166552+0000","last_clean":"2023-11-24T08:05:44.166552+0000","last_became_active":"2023-11-24T08:05:44.162713+0000","last_became_peered":"2023-11-24T08:05:44.162713+0000","last_unstale":"2023-11-24T08:05:44.166552+0000","last_undegraded":"2023-11-24T08:05:44.166552+0000","last_fullsized":"2023-11-24T08:05:44.166552+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:32:53.597950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.201001+0000","last_change":"2023-11-24T08:05:43.189501+0000","last_active":"2023-11-24T08:05:44.201001+0000","last_peered":"2023-11-24T08:05:44.201001+0000","last_clean":"2023-11-24T08:05:44.201001+0000","last_became_active":"2023-11-24T08:05:43.189253+0000","last_became_peered":"2023-11-24T08:05:43.189253+0000","last_unstale":"2023-11-24T08:05:44.201001+0000","last_undegraded":"2023-11-24T08:05:44.201001+0000","last_fullsized":"2023-11-24T08:05:44.201001+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:13:28.554155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166950+0000","last_change":"2023-11-24T08:05:44.161335+0000","last_active":"2023-11-24T08:05:44.166950+0000","last_peered":"2023-11-24T08:05:44.166950+0000","last_clean":"2023-11-24T08:05:44.166950+0000","last_became_active":"2023-11-24T08:05:44.161078+0000","last_became_peered":"2023-11-24T08:05:44.161078+0000","last_unstale":"2023-11-24T08:05:44.166950+0000","last_undegraded":"2023-11-24T08:05:44.166950+0000","last_fullsized":"2023-11-24T08:05:44.166950+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:59:14.832437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.149929+0000","last_change":"2023-11-24T08:05:43.187101+0000","last_active":"2023-11-24T08:05:44.149929+0000","last_peered":"2023-11-24T08:05:44.149929+0000","last_clean":"2023-11-24T08:05:44.149929+0000","last_became_active":"2023-11-24T08:05:43.186568+0000","last_became_peered":"2023-11-24T08:05:43.186568+0000","last_unstale":"2023-11-24T08:05:44.149929+0000","last_undegraded":"2023-11-24T08:05:44.149929+0000","last_fullsized":"2023-11-24T08:05:44.149929+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:32.425237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.172716+0000","last_change":"2023-11-24T08:05:44.168110+0000","last_active":"2023-11-24T08:05:44.172716+0000","last_peered":"2023-11-24T08:05:44.172716+0000","last_clean":"2023-11-24T08:05:44.172716+0000","last_became_active":"2023-11-24T08:05:44.167757+0000","last_became_peered":"2023-11-24T08:05:44.167757+0000","last_unstale":"2023-11-24T08:05:44.172716+0000","last_undegraded":"2023-11-24T08:05:44.172716+0000","last_fullsized":"2023-11-24T08:05:44.172716+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:25.311582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.151862+0000","last_change":"2023-11-24T08:05:43.189867+0000","last_active":"2023-11-24T08:05:44.151862+0000","last_peered":"2023-11-24T08:05:44.151862+0000","last_clean":"2023-11-24T08:05:44.151862+0000","last_became_active":"2023-11-24T08:05:43.188768+0000","last_became_peered":"2023-11-24T08:05:43.188768+0000","last_unstale":"2023-11-24T08:05:44.151862+0000","last_undegraded":"2023-11-24T08:05:44.151862+0000","last_fullsized":"2023-11-24T08:05:44.151862+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:04:47.722739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166540+0000","last_change":"2023-11-24T08:05:44.162827+0000","last_active":"2023-11-24T08:05:44.166540+0000","last_peered":"2023-11-24T08:05:44.166540+0000","last_clean":"2023-11-24T08:05:44.166540+0000","last_became_active":"2023-11-24T08:05:44.162558+0000","last_became_peered":"2023-11-24T08:05:44.162558+0000","last_unstale":"2023-11-24T08:05:44.166540+0000","last_undegraded":"2023-11-24T08:05:44.166540+0000","last_fullsized":"2023-11-24T08:05:44.166540+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:20.952054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.209832+0000","last_change":"2023-11-24T08:05:43.188794+0000","last_active":"2023-11-24T08:05:44.209832+0000","last_peered":"2023-11-24T08:05:44.209832+0000","last_clean":"2023-11-24T08:05:44.209832+0000","last_became_active":"2023-11-24T08:05:43.188515+0000","last_became_peered":"2023-11-24T08:05:43.188515+0000","last_unstale":"2023-11-24T08:05:44.209832+0000","last_undegraded":"2023-11-24T08:05:44.209832+0000","last_fullsized":"2023-11-24T08:05:44.209832+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:52.297300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170127+0000","last_change":"2023-11-24T08:05:44.162674+0000","last_active":"2023-11-24T08:05:44.170127+0000","last_peered":"2023-11-24T08:05:44.170127+0000","last_clean":"2023-11-24T08:05:44.170127+0000","last_became_active":"2023-11-24T08:05:44.162399+0000","last_became_peered":"2023-11-24T08:05:44.162399+0000","last_unstale":"2023-11-24T08:05:44.170127+0000","last_undegraded":"2023-11-24T08:05:44.170127+0000","last_fullsized":"2023-11-24T08:05:44.170127+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:33:35.161075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.200772+0000","last_change":"2023-11-24T08:05:43.187158+0000","last_active":"2023-11-24T08:05:44.200772+0000","last_peered":"2023-11-24T08:05:44.200772+0000","last_clean":"2023-11-24T08:05:44.200772+0000","last_became_active":"2023-11-24T08:05:43.186876+0000","last_became_peered":"2023-11-24T08:05:43.186876+0000","last_unstale":"2023-11-24T08:05:44.200772+0000","last_undegraded":"2023-11-24T08:05:44.200772+0000","last_fullsized":"2023-11-24T08:05:44.200772+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:45.869581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.167415+0000","last_change":"2023-11-24T08:05:44.162502+0000","last_active":"2023-11-24T08:05:44.167415+0000","last_peered":"2023-11-24T08:05:44.167415+0000","last_clean":"2023-11-24T08:05:44.167415+0000","last_became_active":"2023-11-24T08:05:44.162227+0000","last_became_peered":"2023-11-24T08:05:44.162227+0000","last_unstale":"2023-11-24T08:05:44.167415+0000","last_undegraded":"2023-11-24T08:05:44.167415+0000","last_fullsized":"2023-11-24T08:05:44.167415+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:34.038812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.204364+0000","last_change":"2023-11-24T08:05:43.192858+0000","last_active":"2023-11-24T08:05:44.204364+0000","last_peered":"2023-11-24T08:05:44.204364+0000","last_clean":"2023-11-24T08:05:44.204364+0000","last_became_active":"2023-11-24T08:05:43.192455+0000","last_became_peered":"2023-11-24T08:05:43.192455+0000","last_unstale":"2023-11-24T08:05:44.204364+0000","last_undegraded":"2023-11-24T08:05:44.204364+0000","last_fullsized":"2023-11-24T08:05:44.204364+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:00.649091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.164014+0000","last_change":"2023-11-24T08:05:44.157984+0000","last_active":"2023-11-24T08:05:44.164014+0000","last_peered":"2023-11-24T08:05:44.164014+0000","last_clean":"2023-11-24T08:05:44.164014+0000","last_became_active":"2023-11-24T08:05:44.157590+0000","last_became_peered":"2023-11-24T08:05:44.157590+0000","last_unstale":"2023-11-24T08:05:44.164014+0000","last_undegraded":"2023-11-24T08:05:44.164014+0000","last_fullsized":"2023-11-24T08:05:44.164014+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:26.639462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.199554+0000","last_change":"2023-11-24T08:05:43.193520+0000","last_active":"2023-11-24T08:05:44.199554+0000","last_peered":"2023-11-24T08:05:44.199554+0000","last_clean":"2023-11-24T08:05:44.199554+0000","last_became_active":"2023-11-24T08:05:43.193209+0000","last_became_peered":"2023-11-24T08:05:43.193209+0000","last_unstale":"2023-11-24T08:05:44.199554+0000","last_undegraded":"2023-11-24T08:05:44.199554+0000","last_fullsized":"2023-11-24T08:05:44.199554+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:11.552316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169051+0000","last_change":"2023-11-24T08:05:44.164584+0000","last_active":"2023-11-24T08:05:44.169051+0000","last_peered":"2023-11-24T08:05:44.169051+0000","last_clean":"2023-11-24T08:05:44.169051+0000","last_became_active":"2023-11-24T08:05:44.164319+0000","last_became_peered":"2023-11-24T08:05:44.164319+0000","last_unstale":"2023-11-24T08:05:44.169051+0000","last_undegraded":"2023-11-24T08:05:44.169051+0000","last_fullsized":"2023-11-24T08:05:44.169051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:06.798490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.152036+0000","last_change":"2023-11-24T08:05:43.190695+0000","last_active":"2023-11-24T08:05:44.152036+0000","last_peered":"2023-11-24T08:05:44.152036+0000","last_clean":"2023-11-24T08:05:44.152036+0000","last_became_active":"2023-11-24T08:05:43.190416+0000","last_became_peered":"2023-11-24T08:05:43.190416+0000","last_unstale":"2023-11-24T08:05:44.152036+0000","last_undegraded":"2023-11-24T08:05:44.152036+0000","last_fullsized":"2023-11-24T08:05:44.152036+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:46:50.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168306+0000","last_change":"2023-11-24T08:05:44.164988+0000","last_active":"2023-11-24T08:05:44.168306+0000","last_peered":"2023-11-24T08:05:44.168306+0000","last_clean":"2023-11-24T08:05:44.168306+0000","last_became_active":"2023-11-24T08:05:44.164725+0000","last_became_peered":"2023-11-24T08:05:44.164725+0000","last_unstale":"2023-11-24T08:05:44.168306+0000","last_undegraded":"2023-11-24T08:05:44.168306+0000","last_fullsized":"2023-11-24T08:05:44.168306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:16:08.781848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.201886+0000","last_change":"2023-11-24T08:05:43.187584+0000","last_active":"2023-11-24T08:05:44.201886+0000","last_peered":"2023-11-24T08:05:44.201886+0000","last_clean":"2023-11-24T08:05:44.201886+0000","last_became_active":"2023-11-24T08:05:43.187246+0000","last_became_peered":"2023-11-24T08:05:43.187246+0000","last_unstale":"2023-11-24T08:05:44.201886+0000","last_undegraded":"2023-11-24T08:05:44.201886+0000","last_fullsized":"2023-11-24T08:05:44.201886+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:46.216648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162075+0000","last_change":"2023-11-24T08:05:44.150264+0000","last_active":"2023-11-24T08:05:44.162075+0000","last_peered":"2023-11-24T08:05:44.162075+0000","last_clean":"2023-11-24T08:05:44.162075+0000","last_became_active":"2023-11-24T08:05:44.149993+0000","last_became_peered":"2023-11-24T08:05:44.149993+0000","last_unstale":"2023-11-24T08:05:44.162075+0000","last_undegraded":"2023-11-24T08:05:44.162075+0000","last_fullsized":"2023-11-24T08:05:44.162075+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:07.101986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.147671+0000","last_change":"2023-11-24T08:05:43.190451+0000","last_active":"2023-11-24T08:05:44.147671+0000","last_peered":"2023-11-24T08:05:44.147671+0000","last_clean":"2023-11-24T08:05:44.147671+0000","last_became_active":"2023-11-24T08:05:43.190163+0000","last_became_peered":"2023-11-24T08:05:43.190163+0000","last_unstale":"2023-11-24T08:05:44.147671+0000","last_undegraded":"2023-11-24T08:05:44.147671+0000","last_fullsized":"2023-11-24T08:05:44.147671+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:24.307268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.170374+0000","last_change":"2023-11-24T08:05:44.167753+0000","last_active":"2023-11-24T08:05:44.170374+0000","last_peered":"2023-11-24T08:05:44.170374+0000","last_clean":"2023-11-24T08:05:44.170374+0000","last_became_active":"2023-11-24T08:05:44.167517+0000","last_became_peered":"2023-11-24T08:05:44.167517+0000","last_unstale":"2023-11-24T08:05:44.170374+0000","last_undegraded":"2023-11-24T08:05:44.170374+0000","last_fullsized":"2023-11-24T08:05:44.170374+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:23.956996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.155333+0000","last_change":"2023-11-24T08:05:43.186296+0000","last_active":"2023-11-24T08:05:44.155333+0000","last_peered":"2023-11-24T08:05:44.155333+0000","last_clean":"2023-11-24T08:05:44.155333+0000","last_became_active":"2023-11-24T08:05:43.186003+0000","last_became_peered":"2023-11-24T08:05:43.186003+0000","last_unstale":"2023-11-24T08:05:44.155333+0000","last_undegraded":"2023-11-24T08:05:44.155333+0000","last_fullsized":"2023-11-24T08:05:44.155333+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:00.649091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169005+0000","last_change":"2023-11-24T08:05:44.164936+0000","last_active":"2023-11-24T08:05:44.169005+0000","last_peered":"2023-11-24T08:05:44.169005+0000","last_clean":"2023-11-24T08:05:44.169005+0000","last_became_active":"2023-11-24T08:05:44.164284+0000","last_became_peered":"2023-11-24T08:05:44.164284+0000","last_unstale":"2023-11-24T08:05:44.169005+0000","last_undegraded":"2023-11-24T08:05:44.169005+0000","last_fullsized":"2023-11-24T08:05:44.169005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:52.994050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.150484+0000","last_change":"2023-11-24T08:05:43.187451+0000","last_active":"2023-11-24T08:05:44.150484+0000","last_peered":"2023-11-24T08:05:44.150484+0000","last_clean":"2023-11-24T08:05:44.150484+0000","last_became_active":"2023-11-24T08:05:43.187182+0000","last_became_peered":"2023-11-24T08:05:43.187182+0000","last_unstale":"2023-11-24T08:05:44.150484+0000","last_undegraded":"2023-11-24T08:05:44.150484+0000","last_fullsized":"2023-11-24T08:05:44.150484+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:24.221762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168997+0000","last_change":"2023-11-24T08:05:44.163701+0000","last_active":"2023-11-24T08:05:44.168997+0000","last_peered":"2023-11-24T08:05:44.168997+0000","last_clean":"2023-11-24T08:05:44.168997+0000","last_became_active":"2023-11-24T08:05:44.163393+0000","last_became_peered":"2023-11-24T08:05:44.163393+0000","last_unstale":"2023-11-24T08:05:44.168997+0000","last_undegraded":"2023-11-24T08:05:44.168997+0000","last_fullsized":"2023-11-24T08:05:44.168997+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:11:06.834126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.151626+0000","last_change":"2023-11-24T08:05:43.186124+0000","last_active":"2023-11-24T08:05:44.151626+0000","last_peered":"2023-11-24T08:05:44.151626+0000","last_clean":"2023-11-24T08:05:44.151626+0000","last_became_active":"2023-11-24T08:05:43.185713+0000","last_became_peered":"2023-11-24T08:05:43.185713+0000","last_unstale":"2023-11-24T08:05:44.151626+0000","last_undegraded":"2023-11-24T08:05:44.151626+0000","last_fullsized":"2023-11-24T08:05:44.151626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:13:17.872700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168027+0000","last_change":"2023-11-24T08:05:44.163037+0000","last_active":"2023-11-24T08:05:44.168027+0000","last_peered":"2023-11-24T08:05:44.168027+0000","last_clean":"2023-11-24T08:05:44.168027+0000","last_became_active":"2023-11-24T08:05:44.162771+0000","last_became_peered":"2023-11-24T08:05:44.162771+0000","last_unstale":"2023-11-24T08:05:44.168027+0000","last_undegraded":"2023-11-24T08:05:44.168027+0000","last_fullsized":"2023-11-24T08:05:44.168027+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:55.039014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.153694+0000","last_change":"2023-11-24T08:05:43.190866+0000","last_active":"2023-11-24T08:05:44.153694+0000","last_peered":"2023-11-24T08:05:44.153694+0000","last_clean":"2023-11-24T08:05:44.153694+0000","last_became_active":"2023-11-24T08:05:43.190560+0000","last_became_peered":"2023-11-24T08:05:43.190560+0000","last_unstale":"2023-11-24T08:05:44.153694+0000","last_undegraded":"2023-11-24T08:05:44.153694+0000","last_fullsized":"2023-11-24T08:05:44.153694+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:16:07.777534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.169270+0000","last_change":"2023-11-24T08:05:44.164774+0000","last_active":"2023-11-24T08:05:44.169270+0000","last_peered":"2023-11-24T08:05:44.169270+0000","last_clean":"2023-11-24T08:05:44.169270+0000","last_became_active":"2023-11-24T08:05:44.164581+0000","last_became_peered":"2023-11-24T08:05:44.164581+0000","last_unstale":"2023-11-24T08:05:44.169270+0000","last_undegraded":"2023-11-24T08:05:44.169270+0000","last_fullsized":"2023-11-24T08:05:44.169270+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:25:48.891700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.146128+0000","last_change":"2023-11-24T08:05:43.191219+0000","last_active":"2023-11-24T08:05:44.146128+0000","last_peered":"2023-11-24T08:05:44.146128+0000","last_clean":"2023-11-24T08:05:44.146128+0000","last_became_active":"2023-11-24T08:05:43.190957+0000","last_became_peered":"2023-11-24T08:05:43.190957+0000","last_unstale":"2023-11-24T08:05:44.146128+0000","last_undegraded":"2023-11-24T08:05:44.146128+0000","last_fullsized":"2023-11-24T08:05:44.146128+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:10.508850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.167056+0000","last_change":"2023-11-24T08:05:44.163275+0000","last_active":"2023-11-24T08:05:44.167056+0000","last_peered":"2023-11-24T08:05:44.167056+0000","last_clean":"2023-11-24T08:05:44.167056+0000","last_became_active":"2023-11-24T08:05:44.163006+0000","last_became_peered":"2023-11-24T08:05:44.163006+0000","last_unstale":"2023-11-24T08:05:44.167056+0000","last_undegraded":"2023-11-24T08:05:44.167056+0000","last_fullsized":"2023-11-24T08:05:44.167056+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:56.526467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.151435+0000","last_change":"2023-11-24T08:05:43.190883+0000","last_active":"2023-11-24T08:05:44.151435+0000","last_peered":"2023-11-24T08:05:44.151435+0000","last_clean":"2023-11-24T08:05:44.151435+0000","last_became_active":"2023-11-24T08:05:43.190264+0000","last_became_peered":"2023-11-24T08:05:43.190264+0000","last_unstale":"2023-11-24T08:05:44.151435+0000","last_undegraded":"2023-11-24T08:05:44.151435+0000","last_fullsized":"2023-11-24T08:05:44.151435+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:26:11.029673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.168186+0000","last_change":"2023-11-24T08:05:44.165071+0000","last_active":"2023-11-24T08:05:44.168186+0000","last_peered":"2023-11-24T08:05:44.168186+0000","last_clean":"2023-11-24T08:05:44.168186+0000","last_became_active":"2023-11-24T08:05:44.164657+0000","last_became_peered":"2023-11-24T08:05:44.164657+0000","last_unstale":"2023-11-24T08:05:44.168186+0000","last_undegraded":"2023-11-24T08:05:44.168186+0000","last_fullsized":"2023-11-24T08:05:44.168186+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:39:33.962459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.151718+0000","last_change":"2023-11-24T08:05:43.185293+0000","last_active":"2023-11-24T08:05:44.151718+0000","last_peered":"2023-11-24T08:05:44.151718+0000","last_clean":"2023-11-24T08:05:44.151718+0000","last_became_active":"2023-11-24T08:05:43.184939+0000","last_became_peered":"2023-11-24T08:05:43.184939+0000","last_unstale":"2023-11-24T08:05:44.151718+0000","last_undegraded":"2023-11-24T08:05:44.151718+0000","last_fullsized":"2023-11-24T08:05:44.151718+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:56.156256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166397+0000","last_change":"2023-11-24T08:05:44.161064+0000","last_active":"2023-11-24T08:05:44.166397+0000","last_peered":"2023-11-24T08:05:44.166397+0000","last_clean":"2023-11-24T08:05:44.166397+0000","last_became_active":"2023-11-24T08:05:44.160772+0000","last_became_peered":"2023-11-24T08:05:44.160772+0000","last_unstale":"2023-11-24T08:05:44.166397+0000","last_undegraded":"2023-11-24T08:05:44.166397+0000","last_fullsized":"2023-11-24T08:05:44.166397+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:35:43.201615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.146114+0000","last_change":"2023-11-24T08:05:43.190849+0000","last_active":"2023-11-24T08:05:44.146114+0000","last_peered":"2023-11-24T08:05:44.146114+0000","last_clean":"2023-11-24T08:05:44.146114+0000","last_became_active":"2023-11-24T08:05:43.190538+0000","last_became_peered":"2023-11-24T08:05:43.190538+0000","last_unstale":"2023-11-24T08:05:44.146114+0000","last_undegraded":"2023-11-24T08:05:44.146114+0000","last_fullsized":"2023-11-24T08:05:44.146114+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:59:13.828123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.162334+0000","last_change":"2023-11-24T08:05:44.160619+0000","last_active":"2023-11-24T08:05:44.162334+0000","last_peered":"2023-11-24T08:05:44.162334+0000","last_clean":"2023-11-24T08:05:44.162334+0000","last_became_active":"2023-11-24T08:05:44.159416+0000","last_became_peered":"2023-11-24T08:05:44.159416+0000","last_unstale":"2023-11-24T08:05:44.162334+0000","last_undegraded":"2023-11-24T08:05:44.162334+0000","last_fullsized":"2023-11-24T08:05:44.162334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:17:09.653433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.159362+0000","last_change":"2023-11-24T08:05:43.187333+0000","last_active":"2023-11-24T08:05:44.159362+0000","last_peered":"2023-11-24T08:05:44.159362+0000","last_clean":"2023-11-24T08:05:44.159362+0000","last_became_active":"2023-11-24T08:05:43.187055+0000","last_became_peered":"2023-11-24T08:05:43.187055+0000","last_unstale":"2023-11-24T08:05:44.159362+0000","last_undegraded":"2023-11-24T08:05:44.159362+0000","last_fullsized":"2023-11-24T08:05:44.159362+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:09:55.503706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.166928+0000","last_change":"2023-11-24T08:05:44.161285+0000","last_active":"2023-11-24T08:05:44.166928+0000","last_peered":"2023-11-24T08:05:44.166928+0000","last_clean":"2023-11-24T08:05:44.166928+0000","last_became_active":"2023-11-24T08:05:44.161035+0000","last_became_peered":"2023-11-24T08:05:44.161035+0000","last_unstale":"2023-11-24T08:05:44.166928+0000","last_undegraded":"2023-11-24T08:05:44.166928+0000","last_fullsized":"2023-11-24T08:05:44.166928+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:43.169196+0000","last_clean_scrub_stamp":"2023-11-24T08:05:43.169196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:06.798490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-24T08:05:44.200776+0000","last_change":"2023-11-24T08:05:43.186403+0000","last_active":"2023-11-24T08:05:44.200776+0000","last_peered":"2023-11-24T08:05:44.200776+0000","last_clean":"2023-11-24T08:05:44.200776+0000","last_became_active":"2023-11-24T08:05:43.186150+0000","last_became_peered":"2023-11-24T08:05:43.186150+0000","last_unstale":"2023-11-24T08:05:44.200776+0000","last_undegraded":"2023-11-24T08:05:44.200776+0000","last_fullsized":"2023-11-24T08:05:44.200776+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:42.164882+0000","last_clean_scrub_stamp":"2023-11-24T08:05:42.164882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:25:47.887386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-24T08:05:43.174305+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:05:43.174305+0000","last_peered":"2023-11-24T08:05:43.174305+0000","last_clean":"2023-11-24T08:05:43.174305+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:05:43.174305+0000","last_undegraded":"2023-11-24T08:05:43.174305+0000","last_fullsized":"2023-11-24T08:05:43.174305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1089536,"data_stored":786767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.628}]},{"osd":3,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":196981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":10.285,"5min":10.285,"15min":10.285},"last":0.377}]},{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":196379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.32300000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.38200000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.624},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":785692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.32700000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.249},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.308},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.443}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":9.8109999999999999,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":9.9100000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4,"5min":4,"15min":4},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":507904,"data_stored":197943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.26600000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":5.673,"5min":5.673,"15min":5.673},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.432},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":4.4400000000000004,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":0.441}]},{"osd":6,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":5.726,"5min":5.726,"15min":5.726},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.40300000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.7880000000000003,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.52500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":196309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.219},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.26600000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.28599999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.33000000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":197921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.378}]},{"osd":1,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.437}]},{"osd":3,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":1.101},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.34699999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40799999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.48499999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.499}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":196379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68700000000000006}]},{"osd":1,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.436},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.501},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:48.699 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:05:48.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T08:05:48.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.861+0000 7f5515620700 1 Processor -- start 2023-11-24T08:05:48.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.861+0000 7f5515620700 1 -- start start 2023-11-24T08:05:48.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.862+0000 7f5515620700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5510144760 0x7f55100b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.862+0000 7f5515620700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f55100b4cd0 0x7f551006db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.862+0000 7f5515620700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55100b4300 con 0x7f551006e0d0 2023-11-24T08:05:48.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.862+0000 7f5515620700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5510144b40 con 0x7f55100b4cd0 2023-11-24T08:05:48.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.862+0000 7f5515620700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551015ec80 con 0x7f5510144760 2023-11-24T08:05:48.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.862+0000 7f550e7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f55100b4cd0 0x7f551006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.862+0000 7f550f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f551006e0d0 0x7f551006c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44518/0 (socket says 172.21.15.153:44518) 2023-11-24T08:05:48.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.862+0000 7f550f7fe700 1 -- 172.21.15.153:0/1570627206 learned_addr learned my addr 172.21.15.153:0/1570627206 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:48.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.863+0000 7f550effd700 1 --2- 172.21.15.153:0/1570627206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5510144760 0x7f55100b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.863+0000 7f550e7fc700 1 -- 172.21.15.153:0/1570627206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5510144760 msgr2=0x7f55100b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:48.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.863+0000 7f550e7fc700 1 --2- 172.21.15.153:0/1570627206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5510144760 0x7f55100b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.863+0000 7f550e7fc700 1 -- 172.21.15.153:0/1570627206 >> v1:172.21.15.153:6789/0 conn(0x7f551006e0d0 legacy=0x7f551006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.863+0000 7f550e7fc700 1 -- 172.21.15.153:0/1570627206 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551006e6e0 con 0x7f55100b4cd0 2023-11-24T08:05:48.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.863+0000 7f550dffb700 1 -- 172.21.15.153:0/1570627206 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167489915 0 0) 0x7f55100b4300 con 0x7f551006e0d0 2023-11-24T08:05:48.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.863+0000 7f550e7fc700 1 --2- 172.21.15.153:0/1570627206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55100b4cd0 0x7f551006db90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5504009840 tx=0x7f5504009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115f8eaf6ba360b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:48.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.863+0000 7f550dffb700 1 -- 172.21.15.153:0/1570627206 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504011830 con 0x7f55100b4cd0 2023-11-24T08:05:48.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.863+0000 7f550dffb700 1 -- 172.21.15.153:0/1570627206 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5504011990 con 0x7f55100b4cd0 2023-11-24T08:05:48.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.863+0000 7f550dffb700 1 -- 172.21.15.153:0/1570627206 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504011d20 con 0x7f55100b4cd0 2023-11-24T08:05:48.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.864+0000 7f5515620700 1 -- 172.21.15.153:0/1570627206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55100b4cd0 msgr2=0x7f551006db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.864+0000 7f5515620700 1 --2- 172.21.15.153:0/1570627206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55100b4cd0 0x7f551006db90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5504009840 tx=0x7f5504009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:48.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.864+0000 7f5515620700 1 -- 172.21.15.153:0/1570627206 shutdown_connections 2023-11-24T08:05:48.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.864+0000 7f5515620700 1 --2- 172.21.15.153:0/1570627206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5510144760 0x7f55100b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.864+0000 7f5515620700 1 --2- 172.21.15.153:0/1570627206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55100b4cd0 0x7f551006db90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.864+0000 7f5515620700 1 -- 172.21.15.153:0/1570627206 >> 172.21.15.153:0/1570627206 conn(0x7f5510071a70 msgr2=0x7f5510071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:48.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.864+0000 7f5515620700 1 -- 172.21.15.153:0/1570627206 shutdown_connections 2023-11-24T08:05:48.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.864+0000 7f5515620700 1 -- 172.21.15.153:0/1570627206 wait complete. 2023-11-24T08:05:48.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.865+0000 7f5515620700 1 Processor -- start 2023-11-24T08:05:48.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.865+0000 7f5515620700 1 -- start start 2023-11-24T08:05:48.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f5515620700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551006e0d0 0x7f55100ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f5515620700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55100b4cd0 0x7f551014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f5515620700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5510144760 0x7f551013c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f5515620700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55100ca6c0 con 0x7f5510144760 2023-11-24T08:05:48.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f5515620700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551015d150 con 0x7f551006e0d0 2023-11-24T08:05:48.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f5515620700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5510150500 con 0x7f55100b4cd0 2023-11-24T08:05:48.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5510144760 0x7f551013c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5510144760 0x7f551013c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38420/0 (socket says 172.21.15.153:38420) 2023-11-24T08:05:48.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550f7fe700 1 -- 172.21.15.153:0/3707107144 learned_addr learned my addr 172.21.15.153:0/3707107144 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:48.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550effd700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551006e0d0 0x7f55100ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550e7fc700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55100b4cd0 0x7f551014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550f7fe700 1 -- 172.21.15.153:0/3707107144 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55100b4cd0 msgr2=0x7f551014ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550f7fe700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55100b4cd0 0x7f551014ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550f7fe700 1 -- 172.21.15.153:0/3707107144 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551006e0d0 msgr2=0x7f55100ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:48.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550f7fe700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551006e0d0 0x7f55100ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550f7fe700 1 -- 172.21.15.153:0/3707107144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55040094a0 con 0x7f5510144760 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550e7fc700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55100b4cd0 0x7f551014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f550f7fe700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5510144760 0x7f551013c900 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f550800cca0 tx=0x7f550800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f54f77fe700 1 -- 172.21.15.153:0/3707107144 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550800ac20 con 0x7f5510144760 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.866+0000 7f54f77fe700 1 -- 172.21.15.153:0/3707107144 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550800ad80 con 0x7f5510144760 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.867+0000 7f5515620700 1 -- 172.21.15.153:0/3707107144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551013ce40 con 0x7f5510144760 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.867+0000 7f54f77fe700 1 -- 172.21.15.153:0/3707107144 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508007310 con 0x7f5510144760 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.867+0000 7f5515620700 1 -- 172.21.15.153:0/3707107144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551015b960 con 0x7f5510144760 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.867+0000 7f5515620700 1 -- 172.21.15.153:0/3707107144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5510068fb0 con 0x7f5510144760 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.868+0000 7f54f77fe700 1 -- 172.21.15.153:0/3707107144 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5508007470 con 0x7f5510144760 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.868+0000 7f54f77fe700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54fc06b080 0x7f54fc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.868+0000 7f54f77fe700 1 -- 172.21.15.153:0/3707107144 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5508089710 con 0x7f5510144760 2023-11-24T08:05:48.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.868+0000 7f550effd700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54fc06b080 0x7f54fc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:48.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.869+0000 7f550effd700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54fc06b080 0x7f54fc06d540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5500007a30 tx=0x7f5500008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:48.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:48.873+0000 7f54f77fe700 1 -- 172.21.15.153:0/3707107144 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f55080545d0 con 0x7f5510144760 2023-11-24T08:05:49.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.142+0000 7f5515620700 1 -- 172.21.15.153:0/3707107144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f55100b3c80 con 0x7f5510144760 2023-11-24T08:05:49.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.149+0000 7f54f77fe700 1 -- 172.21.15.153:0/3707107144 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f55080180e0 con 0x7f5510144760 2023-11-24T08:05:49.151 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2023-11-24T08:05:49.151 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDIWGBlu28wOBAATnuO3XTplxrcn9JD3ta5XQ== 2023-11-24T08:05:49.151 INFO:teuthology.orchestra.run.smithi153.stdout: caps mds = "allow" 2023-11-24T08:05:49.151 INFO:teuthology.orchestra.run.smithi153.stdout: caps mon = "allow r" 2023-11-24T08:05:49.151 INFO:teuthology.orchestra.run.smithi153.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T08:05:49.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 -- 172.21.15.153:0/3707107144 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54fc06b080 msgr2=0x7f54fc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:49.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54fc06b080 0x7f54fc06d540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5500007a30 tx=0x7f5500008040 comp rx=0 tx=0).stop 2023-11-24T08:05:49.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 -- 172.21.15.153:0/3707107144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5510144760 msgr2=0x7f551013c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:49.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5510144760 0x7f551013c900 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f550800cca0 tx=0x7f550800a060 comp rx=0 tx=0).stop 2023-11-24T08:05:49.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 -- 172.21.15.153:0/3707107144 shutdown_connections 2023-11-24T08:05:49.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54fc06b080 0x7f54fc06d540 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5510144760 0x7f551013c900 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f551006e0d0 0x7f55100ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 --2- 172.21.15.153:0/3707107144 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55100b4cd0 0x7f551014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 -- 172.21.15.153:0/3707107144 >> 172.21.15.153:0/3707107144 conn(0x7f5510071a70 msgr2=0x7f5510071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:49.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 -- 172.21.15.153:0/3707107144 shutdown_connections 2023-11-24T08:05:49.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.152+0000 7f5515620700 1 -- 172.21.15.153:0/3707107144 wait complete. 2023-11-24T08:05:49.155 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-11-24T08:05:49.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:49.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.286+0000 7fc861a91700 1 Processor -- start 2023-11-24T08:05:49.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.286+0000 7fc861a91700 1 -- start start 2023-11-24T08:05:49.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc861a91700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c06c710 0x7fc85c165b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:49.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc861a91700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c0af950 con 0x7fc85c0adf00 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc861a91700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c0afc30 con 0x7fc85c1446a0 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc861a91700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c144a80 con 0x7fc85c06c710 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85affd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc85c0adf00 0x7fc85c06c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44528/0 (socket says 172.21.15.153:44528) 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85affd700 1 -- 172.21.15.153:0/4182006214 learned_addr learned my addr 172.21.15.153:0/4182006214 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693361705 0 0) 0x7fc85c0af950 con 0x7fc85c0adf00 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85bfff700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c06c710 0x7fc85c165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8440035b0 con 0x7fc85c0adf00 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1016140918 0 0) 0x7fc8440035b0 con 0x7fc85c0adf00 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c06c710 msgr2=0x7fc85c165b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c06c710 0x7fc85c165b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 >> v1:172.21.15.164:6789/0 conn(0x7fc85c1446a0 legacy=0x7fc85c0b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c0aff10 con 0x7fc85c0adf00 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fc850001670 con 0x7fc85c0adf00 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 >> v1:172.21.15.153:6789/0 conn(0x7fc85c0adf00 legacy=0x7fc85c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c06c710 0x7fc844003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 0x7fc844004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc844004d90 0x7fc844005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c144a80 con 0x7fc844003fb0 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84400baf0 con 0x7fc844004d90 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84400dec0 con 0x7fc85c06c710 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.287+0000 7fc85affd700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 0x7fc844004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85b7fe700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c06c710 0x7fc844003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85bfff700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc844004d90 0x7fc844005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85affd700 1 -- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c06c710 msgr2=0x7fc844003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85affd700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c06c710 0x7fc844003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85affd700 1 -- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc844004d90 msgr2=0x7fc844005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85affd700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc844004d90 0x7fc844005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85affd700 1 -- 172.21.15.153:0/4182006214 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8440035b0 con 0x7fc844003fb0 2023-11-24T08:05:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85b7fe700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c06c710 0x7fc844003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85affd700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 0x7fc844004850 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc85c06f1d0 tx=0x7fc844005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f35c44448fa8d70 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85000cdd0 con 0x7fc844003fb0 2023-11-24T08:05:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc850005960 con 0x7fc844003fb0 2023-11-24T08:05:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85a7fc700 1 -- 172.21.15.153:0/4182006214 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850005cf0 con 0x7fc844003fb0 2023-11-24T08:05:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc861a91700 1 -- 172.21.15.153:0/4182006214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 msgr2=0x7fc844004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc861a91700 1 --2- 172.21.15.153:0/4182006214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 0x7fc844004850 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc85c06f1d0 tx=0x7fc844005880 comp rx=0 tx=0).stop 2023-11-24T08:05:49.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc85bfff700 1 -- 172.21.15.153:0/4182006214 reap_dead start 2023-11-24T08:05:49.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.288+0000 7fc861a91700 1 -- 172.21.15.153:0/4182006214 shutdown_connections 2023-11-24T08:05:49.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.289+0000 7fc861a91700 1 -- 172.21.15.153:0/4182006214 >> 172.21.15.153:0/4182006214 conn(0x7fc85c071b90 msgr2=0x7fc85c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:49.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.289+0000 7fc861a91700 1 -- 172.21.15.153:0/4182006214 shutdown_connections 2023-11-24T08:05:49.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.289+0000 7fc861a91700 1 -- 172.21.15.153:0/4182006214 wait complete. 2023-11-24T08:05:49.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.290+0000 7fc861a91700 1 Processor -- start 2023-11-24T08:05:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.290+0000 7fc861a91700 1 -- start start 2023-11-24T08:05:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.291+0000 7fc861a91700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 0x7fc85c09aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.291+0000 7fc861a91700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c1f06d0 0x7fc85c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.291+0000 7fc861a91700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc85c09d230 0x7fc85c09d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.291+0000 7fc861a91700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1f1850 con 0x7fc844003fb0 2023-11-24T08:05:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.291+0000 7fc861a91700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c09dc20 con 0x7fc85c09d230 2023-11-24T08:05:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.291+0000 7fc861a91700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c09af40 con 0x7fc85c1f06d0 2023-11-24T08:05:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.291+0000 7fc85b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 0x7fc85c09aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.291+0000 7fc85b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 0x7fc85c09aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38436/0 (socket says 172.21.15.153:38436) 2023-11-24T08:05:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.291+0000 7fc85b7fe700 1 -- 172.21.15.153:0/3187478012 learned_addr learned my addr 172.21.15.153:0/3187478012 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc85affd700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c1f06d0 0x7fc85c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc85b7fe700 1 -- 172.21.15.153:0/3187478012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c1f06d0 msgr2=0x7fc85c0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc85bfff700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc85c09d230 0x7fc85c09d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc85b7fe700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c1f06d0 0x7fc85c0cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc85b7fe700 1 -- 172.21.15.153:0/3187478012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc85c09d230 msgr2=0x7fc85c09d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc85b7fe700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc85c09d230 0x7fc85c09d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc85b7fe700 1 -- 172.21.15.153:0/3187478012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c1f0bd0 con 0x7fc844003fb0 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc85bfff700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc85c09d230 0x7fc85c09d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc85b7fe700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 0x7fc85c09aa00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00e7b0 tx=0x7fc84c00eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc843fff700 1 -- 172.21.15.153:0/3187478012 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0052e0 con 0x7fc844003fb0 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc843fff700 1 -- 172.21.15.153:0/3187478012 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c005440 con 0x7fc844003fb0 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc861a91700 1 -- 172.21.15.153:0/3187478012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c1f0eb0 con 0x7fc844003fb0 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc843fff700 1 -- 172.21.15.153:0/3187478012 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0038c0 con 0x7fc844003fb0 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.292+0000 7fc861a91700 1 -- 172.21.15.153:0/3187478012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c1f1470 con 0x7fc844003fb0 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.293+0000 7fc861a91700 1 -- 172.21.15.153:0/3187478012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c0753f0 con 0x7fc844003fb0 2023-11-24T08:05:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.293+0000 7fc843fff700 1 -- 172.21.15.153:0/3187478012 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc84c003a20 con 0x7fc844003fb0 2023-11-24T08:05:49.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.294+0000 7fc843fff700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc84806b0d0 0x7fc84806d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:49.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.294+0000 7fc843fff700 1 -- 172.21.15.153:0/3187478012 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc84c088f90 con 0x7fc844003fb0 2023-11-24T08:05:49.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.294+0000 7fc85affd700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc84806b0d0 0x7fc84806d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:49.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.294+0000 7fc85affd700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc84806b0d0 0x7fc84806d590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc85c06f1d0 tx=0x7fc850007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:49.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.299+0000 7fc843fff700 1 -- 172.21.15.153:0/3187478012 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc84c053f50 con 0x7fc844003fb0 2023-11-24T08:05:49.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.533+0000 7fc861a91700 1 -- 172.21.15.153:0/3187478012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc85c1f1600 con 0x7fc844003fb0 2023-11-24T08:05:49.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.533+0000 7fc843fff700 1 -- 172.21.15.153:0/3187478012 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fc84c019090 con 0x7fc844003fb0 2023-11-24T08:05:49.535 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:49.535 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:49.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 -- 172.21.15.153:0/3187478012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc84806b0d0 msgr2=0x7fc84806d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:49.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc84806b0d0 0x7fc84806d590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc85c06f1d0 tx=0x7fc850007000 comp rx=0 tx=0).stop 2023-11-24T08:05:49.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 -- 172.21.15.153:0/3187478012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 msgr2=0x7fc85c09aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:49.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 0x7fc85c09aa00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00e7b0 tx=0x7fc84c00eb70 comp rx=0 tx=0).stop 2023-11-24T08:05:49.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 -- 172.21.15.153:0/3187478012 shutdown_connections 2023-11-24T08:05:49.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc85c09d230 0x7fc85c09d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc84806b0d0 0x7fc84806d590 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc844003fb0 0x7fc85c09aa00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 --2- 172.21.15.153:0/3187478012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc85c1f06d0 0x7fc85c0cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:49.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 -- 172.21.15.153:0/3187478012 >> 172.21.15.153:0/3187478012 conn(0x7fc85c071b90 msgr2=0x7fc85c15dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:49.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 -- 172.21.15.153:0/3187478012 shutdown_connections 2023-11-24T08:05:49.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:49.535+0000 7fc861a91700 1 -- 172.21.15.153:0/3187478012 wait complete. 2023-11-24T08:05:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 26 2023-11-24T08:05:49.952 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:05:43.574155+0000', 'modified': '2023-11-24T08:05:46.605461+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5553}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5553': {'gid': 5553, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6837/3585468907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 3585468907}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 3585468907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:05:49.952 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:05:49.952 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-24T08:05:50.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.074+0000 7f9e8955e700 1 Processor -- start 2023-11-24T08:05:50.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.074+0000 7f9e8955e700 1 -- start start 2023-11-24T08:05:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.074+0000 7f9e8955e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9e8415e080 0x7f9e840b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.074+0000 7f9e8955e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e8406c710 0x7f9e840afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.074+0000 7f9e8955e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e840ae430 con 0x7f9e840af4d0 2023-11-24T08:05:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.074+0000 7f9e8955e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e840af0b0 con 0x7f9e8406c710 2023-11-24T08:05:50.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.074+0000 7f9e8955e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e840b05a0 con 0x7f9e8415e080 2023-11-24T08:05:50.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e837fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e8406c710 0x7f9e840afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e837fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e8406c710 0x7f9e840afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38444/0 (socket says 172.21.15.153:38444) 2023-11-24T08:05:50.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e837fe700 1 -- 172.21.15.153:0/2781554494 learned_addr learned my addr 172.21.15.153:0/2781554494 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:50.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/2781554494 >> v2:172.21.15.164:3300/0 conn(0x7f9e8415e080 0x7f9e840b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e837fe700 1 -- 172.21.15.153:0/2781554494 >> v2:172.21.15.164:3300/0 conn(0x7f9e8415e080 msgr2=0x7f9e840b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e837fe700 1 --2- 172.21.15.153:0/2781554494 >> v2:172.21.15.164:3300/0 conn(0x7f9e8415e080 0x7f9e840b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e837fe700 1 -- 172.21.15.153:0/2781554494 >> v1:172.21.15.164:6789/0 conn(0x7f9e840af4d0 legacy=0x7f9e8406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e837fe700 1 -- 172.21.15.153:0/2781554494 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e840ae710 con 0x7f9e8406c710 2023-11-24T08:05:50.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/2781554494 >> v2:172.21.15.164:3300/0 conn(0x7f9e8415e080 0x7f9e840b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:50.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e837fe700 1 --2- 172.21.15.153:0/2781554494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e8406c710 0x7f9e840afb90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9e84072a90 tx=0x7f9e7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd03a2bd7f6155f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e81ffb700 1 -- 172.21.15.153:0/2781554494 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c00e070 con 0x7f9e8406c710 2023-11-24T08:05:50.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e81ffb700 1 -- 172.21.15.153:0/2781554494 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c003a20 con 0x7f9e8406c710 2023-11-24T08:05:50.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.075+0000 7f9e81ffb700 1 -- 172.21.15.153:0/2781554494 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c003dd0 con 0x7f9e8406c710 2023-11-24T08:05:50.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.076+0000 7f9e8955e700 1 -- 172.21.15.153:0/2781554494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e8406c710 msgr2=0x7f9e840afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.076+0000 7f9e8955e700 1 --2- 172.21.15.153:0/2781554494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e8406c710 0x7f9e840afb90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9e84072a90 tx=0x7f9e7c00b330 comp rx=0 tx=0).stop 2023-11-24T08:05:50.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.076+0000 7f9e8955e700 1 -- 172.21.15.153:0/2781554494 shutdown_connections 2023-11-24T08:05:50.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.076+0000 7f9e8955e700 1 --2- 172.21.15.153:0/2781554494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e8406c710 0x7f9e840afb90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.076+0000 7f9e8955e700 1 --2- 172.21.15.153:0/2781554494 >> v2:172.21.15.164:3300/0 conn(0x7f9e8415e080 0x7f9e840b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.076+0000 7f9e8955e700 1 -- 172.21.15.153:0/2781554494 >> 172.21.15.153:0/2781554494 conn(0x7f9e84071b90 msgr2=0x7f9e84071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:50.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.076+0000 7f9e8955e700 1 -- 172.21.15.153:0/2781554494 shutdown_connections 2023-11-24T08:05:50.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.076+0000 7f9e8955e700 1 -- 172.21.15.153:0/2781554494 wait complete. 2023-11-24T08:05:50.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.077+0000 7f9e8955e700 1 Processor -- start 2023-11-24T08:05:50.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.077+0000 7f9e8955e700 1 -- start start 2023-11-24T08:05:50.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e8955e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e8406c710 0x7f9e841f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e8955e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e840af4d0 0x7f9e84159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e8955e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e8415e080 0x7f9e8415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e8955e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84154940 con 0x7f9e8415e080 2023-11-24T08:05:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e8955e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84154c20 con 0x7f9e840af4d0 2023-11-24T08:05:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e8955e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84154f00 con 0x7f9e8406c710 2023-11-24T08:05:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e8415e080 0x7f9e8415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e8415e080 0x7f9e8415a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38446/0 (socket says 172.21.15.153:38446) 2023-11-24T08:05:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e837fe700 1 -- 172.21.15.153:0/3333383108 learned_addr learned my addr 172.21.15.153:0/3333383108 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:50.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e827fc700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e840af4d0 0x7f9e84159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e8406c710 0x7f9e841f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e837fe700 1 -- 172.21.15.153:0/3333383108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e8406c710 msgr2=0x7f9e841f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e837fe700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e8406c710 0x7f9e841f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e837fe700 1 -- 172.21.15.153:0/3333383108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e840af4d0 msgr2=0x7f9e84159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e837fe700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e840af4d0 0x7f9e84159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e837fe700 1 -- 172.21.15.153:0/3333383108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c009b30 con 0x7f9e8415e080 2023-11-24T08:05:50.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e8406c710 0x7f9e841f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:50.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.078+0000 7f9e837fe700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e8415e080 0x7f9e8415a0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c004000 tx=0x7f9e7c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.079+0000 7f9e6b7fe700 1 -- 172.21.15.153:0/3333383108 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c004440 con 0x7f9e8415e080 2023-11-24T08:05:50.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.079+0000 7f9e6b7fe700 1 -- 172.21.15.153:0/3333383108 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c0092e0 con 0x7f9e8415e080 2023-11-24T08:05:50.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.079+0000 7f9e6b7fe700 1 -- 172.21.15.153:0/3333383108 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c004820 con 0x7f9e8415e080 2023-11-24T08:05:50.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.079+0000 7f9e8955e700 1 -- 172.21.15.153:0/3333383108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e841551e0 con 0x7f9e8415e080 2023-11-24T08:05:50.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.079+0000 7f9e8955e700 1 -- 172.21.15.153:0/3333383108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e841f3b80 con 0x7f9e8415e080 2023-11-24T08:05:50.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.080+0000 7f9e6b7fe700 1 -- 172.21.15.153:0/3333383108 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9e7c012430 con 0x7f9e8415e080 2023-11-24T08:05:50.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.080+0000 7f9e6b7fe700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e7006b080 0x7f9e7006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.081+0000 7f9e6b7fe700 1 -- 172.21.15.153:0/3333383108 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e7c08af10 con 0x7f9e8415e080 2023-11-24T08:05:50.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.081+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e7006b080 0x7f9e7006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.081+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e7006b080 0x7f9e7006d540 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9e8415d640 tx=0x7f9e74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.082+0000 7f9e95757b80 1 Processor -- start 2023-11-24T08:05:50.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.083+0000 7f9e95757b80 1 -- start start 2023-11-24T08:05:50.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.083+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d7263a3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.083+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d726372ed0 0x55d7263a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.083+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635a490 0x55d726386e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.083+0000 7f9e95757b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7262d0770 con 0x55d72635a490 2023-11-24T08:05:50.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.083+0000 7f9e95757b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7262b7750 con 0x55d72635d080 2023-11-24T08:05:50.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.083+0000 7f9e95757b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7262b5070 con 0x55d726372ed0 2023-11-24T08:05:50.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635a490 0x55d726386e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635a490 0x55d726386e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38454/0 (socket says 172.21.15.153:38454) 2023-11-24T08:05:50.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e837fe700 1 -- 172.21.15.153:0/906098785 learned_addr learned my addr 172.21.15.153:0/906098785 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:50.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/906098785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d7263a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e827fc700 1 --2- 172.21.15.153:0/906098785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d726372ed0 0x55d7263a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e837fe700 1 -- 172.21.15.153:0/906098785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d726372ed0 msgr2=0x55d7263a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e837fe700 1 --2- 172.21.15.153:0/906098785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d726372ed0 0x55d7263a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e837fe700 1 -- 172.21.15.153:0/906098785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 msgr2=0x55d7263a3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e837fe700 1 --2- 172.21.15.153:0/906098785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d7263a3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e837fe700 1 -- 172.21.15.153:0/906098785 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d72612d5e0 con 0x55d72635a490 2023-11-24T08:05:50.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/906098785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d7263a3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:50.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e837fe700 1 --2- 172.21.15.153:0/906098785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635a490 0x55d726386e70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00b370 tx=0x7f9e7c059320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fb8810b9587168 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e68ff9700 1 -- 172.21.15.153:0/906098785 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c061bf0 con 0x55d72635a490 2023-11-24T08:05:50.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e68ff9700 1 -- 172.21.15.153:0/906098785 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c0711c0 con 0x55d72635a490 2023-11-24T08:05:50.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.084+0000 7f9e68ff9700 1 -- 172.21.15.153:0/906098785 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c059d70 con 0x55d72635a490 2023-11-24T08:05:50.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.085+0000 7f9e95757b80 1 -- 172.21.15.153:0/906098785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635a490 msgr2=0x55d726386e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.085+0000 7f9e95757b80 1 --2- 172.21.15.153:0/906098785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635a490 0x55d726386e70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00b370 tx=0x7f9e7c059320 comp rx=0 tx=0).stop 2023-11-24T08:05:50.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.085+0000 7f9e95757b80 1 -- 172.21.15.153:0/906098785 shutdown_connections 2023-11-24T08:05:50.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.085+0000 7f9e95757b80 1 --2- 172.21.15.153:0/906098785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635a490 0x55d726386e70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.085+0000 7f9e95757b80 1 --2- 172.21.15.153:0/906098785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d7263a3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.085+0000 7f9e95757b80 1 --2- 172.21.15.153:0/906098785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d726372ed0 0x55d7263a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.085+0000 7f9e95757b80 1 -- 172.21.15.153:0/906098785 >> 172.21.15.153:0/906098785 conn(0x55d72628b310 msgr2=0x55d7263a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:50.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.085+0000 7f9e95757b80 1 -- 172.21.15.153:0/906098785 shutdown_connections 2023-11-24T08:05:50.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.085+0000 7f9e95757b80 1 -- 172.21.15.153:0/906098785 wait complete. 2023-11-24T08:05:50.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.086+0000 7f9e95757b80 1 -- start start 2023-11-24T08:05:50.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.086+0000 7f9e95757b80 1 Processor -- start 2023-11-24T08:05:50.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.086+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d726386bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.086+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d72639e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.086+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263647e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.086+0000 7f9e95757b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7262b0960 con 0x55d726372ed0 2023-11-24T08:05:50.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.086+0000 7f9e95757b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d72626a510 con 0x55d72635d080 2023-11-24T08:05:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.086+0000 7f9e95757b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d72626a1b0 con 0x55d72635a490 2023-11-24T08:05:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.086+0000 7f9e95757b80 10 client.0 _ll_register_callbacks cb 0x55d726195a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:05:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263647e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38462/0 (socket says 172.21.15.153:38462) 2023-11-24T08:05:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e837fe700 1 -- 172.21.15.153:0/3095465837 learned_addr learned my addr 172.21.15.153:0/3095465837 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e827fc700 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d72639e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d726386bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e837fe700 1 -- 172.21.15.153:0/3095465837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 msgr2=0x55d726386bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e837fe700 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d726386bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e837fe700 1 -- 172.21.15.153:0/3095465837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 msgr2=0x55d72639e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e837fe700 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d72639e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e837fe700 1 -- 172.21.15.153:0/3095465837 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e841f3b80 con 0x55d726372ed0 2023-11-24T08:05:50.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d726386bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:50.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e837fe700 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263647e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0595f0 tx=0x7f9e7c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9609c17e5e2da4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e61ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-11-24T08:05:50.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e61ffb700 1 -- 172.21.15.153:0/3095465837 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c0890c0 con 0x55d726372ed0 2023-11-24T08:05:50.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e61ffb700 1 -- 172.21.15.153:0/3095465837 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e7c061bf0 con 0x55d726372ed0 2023-11-24T08:05:50.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e95757b80 1 -- 172.21.15.153:0/3095465837 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d72634fa40 con 0x55d726372ed0 2023-11-24T08:05:50.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e61ffb700 1 -- 172.21.15.153:0/3095465837 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e7c061760 con 0x55d726372ed0 2023-11-24T08:05:50.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e95757b80 10 client.5694 fetch_fsmap learned FSMap version 26 2023-11-24T08:05:50.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e95757b80 1 -- 172.21.15.153:0/3095465837 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55d7260d9d90 con 0x55d726372ed0 2023-11-24T08:05:50.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e61ffb700 1 -- 172.21.15.153:0/3095465837 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d72634fa40 con 0x55d726372ed0 2023-11-24T08:05:50.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.087+0000 7f9e61ffb700 1 -- 172.21.15.153:0/3095465837 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9e7c078020 con 0x55d726372ed0 2023-11-24T08:05:50.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.088+0000 7f9e95757b80 10 client.5694 fetch_fsmap finished waiting for FSMap version 26 2023-11-24T08:05:50.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.088+0000 7f9e95757b80 10 client.5694 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-24T08:05:50.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.088+0000 7f9e95757b80 20 client.5694 populate_metadata read hostname 'smithi153' 2023-11-24T08:05:50.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.088+0000 7f9e95757b80 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.153:6834/3585468907,v1:172.21.15.153:6837/3585468907] conn(0x55d72638a1e0 0x55d72638a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.088+0000 7f9e95757b80 4 client.5694 mds_command: new command op to 5553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:05:50.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.088+0000 7f9e95757b80 1 -- 172.21.15.153:0/3095465837 --> [v2:172.21.15.153:6834/3585468907,v1:172.21.15.153:6837/3585468907] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d72632b840 con 0x55d72638a1e0 2023-11-24T08:05:50.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.088+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.153:6834/3585468907,v1:172.21.15.153:6837/3585468907] conn(0x55d72638a1e0 0x55d72638a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.088+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.153:6834/3585468907,v1:172.21.15.153:6837/3585468907] conn(0x55d72638a1e0 0x55d72638a5c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd395a760be1990b server_cookie=2f10f954ca7f4526 in_seq=0 out_seq=0 2023-11-24T08:05:50.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.088+0000 7f9e61ffb700 10 client.5694 ms_handle_connect on v2:172.21.15.153:6834/3585468907 2023-11-24T08:05:50.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e61ffb700 1 -- 172.21.15.153:0/3095465837 <== mds.0 v2:172.21.15.153:6834/3585468907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d72632b840 con 0x55d72638a1e0 2023-11-24T08:05:50.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e61ffb700 10 client.5694 handle_command_reply: tid=0 2023-11-24T08:05:50.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 1 client.5694 shutdown 2023-11-24T08:05:50.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 1 -- 172.21.15.153:0/3095465837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 msgr2=0x55d7263647e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263647e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0595f0 tx=0x7f9e7c01b000 comp rx=0 tx=0).stop 2023-11-24T08:05:50.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 1 -- 172.21.15.153:0/3095465837 shutdown_connections 2023-11-24T08:05:50.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.153:6834/3585468907,v1:172.21.15.153:6837/3585468907] conn(0x55d72638a1e0 0x55d72638a5c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263647e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d726386bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 1 --2- 172.21.15.153:0/3095465837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d72639e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e61ffb700 0 client.5694 ms_handle_reset on v2:172.21.15.153:6834/3585468907 2023-11-24T08:05:50.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 1 -- 172.21.15.153:0/3095465837 >> 172.21.15.153:0/3095465837 conn(0x55d72628b310 msgr2=0x55d7263a5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:50.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 1 -- 172.21.15.153:0/3095465837 shutdown_connections 2023-11-24T08:05:50.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 1 -- 172.21.15.153:0/3095465837 wait complete. 2023-11-24T08:05:50.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.089+0000 7f9e95757b80 20 client.5694 trim_cache size 0 max 16384 2023-11-24T08:05:50.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.107+0000 7f9e95757b80 1 Processor -- start 2023-11-24T08:05:50.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.107+0000 7f9e95757b80 1 -- start start 2023-11-24T08:05:50.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d7263a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635d080 0x55d7263a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d726372ed0 0x55d7263b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e95757b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d72612f8d0 con 0x55d72635d080 2023-11-24T08:05:50.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e95757b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d72639f970 con 0x55d726372ed0 2023-11-24T08:05:50.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e95757b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d726363ca0 con 0x55d72635a490 2023-11-24T08:05:50.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e827fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635d080 0x55d7263a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e827fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635d080 0x55d7263a21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38468/0 (socket says 172.21.15.153:38468) 2023-11-24T08:05:50.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e827fc700 1 -- 172.21.15.153:0/1053833688 learned_addr learned my addr 172.21.15.153:0/1053833688 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:50.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e827fc700 1 -- 172.21.15.153:0/1053833688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 msgr2=0x55d7263a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/1053833688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d7263a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e837fe700 1 --2- 172.21.15.153:0/1053833688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d726372ed0 0x55d7263b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e827fc700 1 --2- 172.21.15.153:0/1053833688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d7263a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e827fc700 1 -- 172.21.15.153:0/1053833688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d726372ed0 msgr2=0x55d7263b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e827fc700 1 --2- 172.21.15.153:0/1053833688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d726372ed0 0x55d7263b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e827fc700 1 -- 172.21.15.153:0/1053833688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7260c2c10 con 0x55d72635d080 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e827fc700 1 --2- 172.21.15.153:0/1053833688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635d080 0x55d7263a21c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9e840af950 tx=0x7f9e780050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd60e7489492ecd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e697fa700 1 -- 172.21.15.153:0/1053833688 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e78006860 con 0x55d72635d080 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e697fa700 1 -- 172.21.15.153:0/1053833688 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e780069c0 con 0x55d72635d080 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.108+0000 7f9e697fa700 1 -- 172.21.15.153:0/1053833688 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e78006d30 con 0x55d72635d080 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.109+0000 7f9e95757b80 1 -- 172.21.15.153:0/1053833688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635d080 msgr2=0x55d7263a21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.109+0000 7f9e95757b80 1 --2- 172.21.15.153:0/1053833688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635d080 0x55d7263a21c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9e840af950 tx=0x7f9e780050f0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.109+0000 7f9e95757b80 1 -- 172.21.15.153:0/1053833688 shutdown_connections 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.109+0000 7f9e95757b80 1 --2- 172.21.15.153:0/1053833688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d726372ed0 0x55d7263b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.109+0000 7f9e95757b80 1 --2- 172.21.15.153:0/1053833688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d7263a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.109+0000 7f9e95757b80 1 --2- 172.21.15.153:0/1053833688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d72635d080 0x55d7263a21c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.109+0000 7f9e95757b80 1 -- 172.21.15.153:0/1053833688 >> 172.21.15.153:0/1053833688 conn(0x55d72628b310 msgr2=0x55d7263646e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.109+0000 7f9e95757b80 1 -- 172.21.15.153:0/1053833688 shutdown_connections 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.109+0000 7f9e95757b80 1 -- 172.21.15.153:0/1053833688 wait complete. 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.110+0000 7f9e95757b80 1 -- start start 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.110+0000 7f9e95757b80 1 Processor -- start 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.110+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d7263b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.110+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d726351970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.110+0000 7f9e95757b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.110+0000 7f9e95757b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7263a0030 con 0x55d726372ed0 2023-11-24T08:05:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.110+0000 7f9e95757b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7263521c0 con 0x55d72635d080 2023-11-24T08:05:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.110+0000 7f9e95757b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d72639d220 con 0x55d72635a490 2023-11-24T08:05:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.110+0000 7f9e95757b80 10 client.0 _ll_register_callbacks cb 0x55d726195a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:05:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263a53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38476/0 (socket says 172.21.15.153:38476) 2023-11-24T08:05:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e837fe700 1 -- 172.21.15.153:0/1777232103 learned_addr learned my addr 172.21.15.153:0/1777232103 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e827fc700 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d726351970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d7263b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e837fe700 1 -- 172.21.15.153:0/1777232103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 msgr2=0x55d7263b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e837fe700 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d7263b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e837fe700 1 -- 172.21.15.153:0/1777232103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 msgr2=0x55d726351970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e837fe700 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d726351970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e837fe700 1 -- 172.21.15.153:0/1777232103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7800f040 con 0x55d726372ed0 2023-11-24T08:05:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d7263b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e837fe700 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263a53f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0616c0 tx=0x7f9e7c055cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97522334c5c4b315 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e61ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-11-24T08:05:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e61ffb700 1 -- 172.21.15.153:0/1777232103 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c061bf0 con 0x55d726372ed0 2023-11-24T08:05:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e61ffb700 1 -- 172.21.15.153:0/1777232103 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e7c089030 con 0x55d726372ed0 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e95757b80 1 -- 172.21.15.153:0/1777232103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9e7c0711c0 con 0x55d726372ed0 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e61ffb700 1 -- 172.21.15.153:0/1777232103 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e7c0558f0 con 0x55d726372ed0 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e95757b80 10 client.5700 fetch_fsmap learned FSMap version 26 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e95757b80 1 -- 172.21.15.153:0/1777232103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55d726100200 con 0x55d726372ed0 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.111+0000 7f9e61ffb700 1 -- 172.21.15.153:0/1777232103 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c0711c0 con 0x55d726372ed0 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e61ffb700 1 -- 172.21.15.153:0/1777232103 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9e7c078020 con 0x55d726372ed0 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 10 client.5700 fetch_fsmap finished waiting for FSMap version 26 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 10 client.5700 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 20 client.5700 populate_metadata read hostname 'smithi153' 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.153:6834/3585468907,v1:172.21.15.153:6837/3585468907] conn(0x55d726385430 0x55d726385810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 4 client.5700 mds_command: new command op to 5553 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:05:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 -- 172.21.15.153:0/1777232103 --> [v2:172.21.15.153:6834/3585468907,v1:172.21.15.153:6837/3585468907] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d726276f80 con 0x55d726385430 2023-11-24T08:05:50.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.153:6834/3585468907,v1:172.21.15.153:6837/3585468907] conn(0x55d726385430 0x55d726385810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e61ffb700 10 client.5700 ms_handle_connect on v2:172.21.15.153:6834/3585468907 2023-11-24T08:05:50.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e82ffd700 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.153:6834/3585468907,v1:172.21.15.153:6837/3585468907] conn(0x55d726385430 0x55d726385810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af40b37ac49437d server_cookie=b3646415ba3ef590 in_seq=0 out_seq=0 2023-11-24T08:05:50.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e61ffb700 1 -- 172.21.15.153:0/1777232103 <== mds.0 v2:172.21.15.153:6834/3585468907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55d726276f80 con 0x55d726385430 2023-11-24T08:05:50.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e61ffb700 10 client.5700 handle_command_reply: tid=0 2023-11-24T08:05:50.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 client.5700 shutdown 2023-11-24T08:05:50.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 -- 172.21.15.153:0/1777232103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 msgr2=0x55d7263a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263a53f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0616c0 tx=0x7f9e7c055cb0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 -- 172.21.15.153:0/1777232103 shutdown_connections 2023-11-24T08:05:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.153:6834/3585468907,v1:172.21.15.153:6837/3585468907] conn(0x55d726385430 0x55d726385810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d726372ed0 0x55d7263a53f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e61ffb700 0 client.5700 ms_handle_reset on v2:172.21.15.153:6834/3585468907 2023-11-24T08:05:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d72635a490 0x55d7263b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 --2- 172.21.15.153:0/1777232103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d72635d080 0x55d726351970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 -- 172.21.15.153:0/1777232103 >> 172.21.15.153:0/1777232103 conn(0x55d72628b310 msgr2=0x55d726357bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 -- 172.21.15.153:0/1777232103 shutdown_connections 2023-11-24T08:05:50.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.112+0000 7f9e95757b80 1 -- 172.21.15.153:0/1777232103 wait complete. 2023-11-24T08:05:50.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e95757b80 20 client.5700 trim_cache size 0 max 16384 2023-11-24T08:05:50.130 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:05:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "a594d4d2-de60-4a04-bb93-76779d526986", 2023-11-24T08:05:50.131 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-11-24T08:05:50.131 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5553, 2023-11-24T08:05:50.131 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-11-24T08:05:50.131 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-11-24T08:05:50.132 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-11-24T08:05:50.132 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 5.9230125410000003, 2023-11-24T08:05:50.132 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 26, 2023-11-24T08:05:50.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 43, 2023-11-24T08:05:50.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 43, 2023-11-24T08:05:50.133 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 10.850739822 2023-11-24T08:05:50.133 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:05:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 -- 172.21.15.153:0/3333383108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e7006b080 msgr2=0x7f9e7006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e7006b080 0x7f9e7006d540 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9e8415d640 tx=0x7f9e74008040 comp rx=0 tx=0).stop 2023-11-24T08:05:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 -- 172.21.15.153:0/3333383108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e8415e080 msgr2=0x7f9e8415a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e8415e080 0x7f9e8415a0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c004000 tx=0x7f9e7c004ad0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 -- 172.21.15.153:0/3333383108 shutdown_connections 2023-11-24T08:05:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9e7006b080 0x7f9e7006d540 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e8415e080 0x7f9e8415a0a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e8406c710 0x7f9e841f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 --2- 172.21.15.153:0/3333383108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e840af4d0 0x7f9e84159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 -- 172.21.15.153:0/3333383108 >> 172.21.15.153:0/3333383108 conn(0x7f9e84071b90 msgr2=0x7f9e84160470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:50.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 -- 172.21.15.153:0/3333383108 shutdown_connections 2023-11-24T08:05:50.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.113+0000 7f9e8955e700 1 -- 172.21.15.153:0/3333383108 wait complete. 2023-11-24T08:05:50.137 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:05:50.170 INFO:tasks.ceph.mds.a.smithi153.stderr:2023-11-24T08:05:50.168+0000 7f2f8c2d7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:05:50.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.259+0000 7f2973d21700 1 Processor -- start 2023-11-24T08:05:50.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.259+0000 7f2973d21700 1 -- start start 2023-11-24T08:05:50.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f2973d21700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f296c15e2a0 0x7f296c06ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f2973d21700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f296c073f90 0x7f296c074420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f2973d21700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f296c06e7f0 con 0x7f296c0ce090 2023-11-24T08:05:50.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f2973d21700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296c074960 con 0x7f296c073f90 2023-11-24T08:05:50.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f2973d21700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c06dec0 con 0x7f296c15e2a0 2023-11-24T08:05:50.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f29722be700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f296c073f90 0x7f296c074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f2971abd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f296c15e2a0 0x7f296c06ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f29712bc700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f296c0ce090 0x7f296c06ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:52266/0 (socket says 172.21.15.153:52266) 2023-11-24T08:05:50.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f29722be700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f296c073f90 0x7f296c074420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:60070/0 (socket says 172.21.15.153:60070) 2023-11-24T08:05:50.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f29712bc700 1 -- 172.21.15.153:0/4242781672 learned_addr learned my addr 172.21.15.153:0/4242781672 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:50.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f29722be700 1 -- 172.21.15.153:0/4242781672 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f296c15e2a0 msgr2=0x7f296c06ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f29722be700 1 --2- 172.21.15.153:0/4242781672 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f296c15e2a0 0x7f296c06ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f29722be700 1 -- 172.21.15.153:0/4242781672 >> v1:172.21.15.164:6789/0 conn(0x7f296c0ce090 legacy=0x7f296c06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f29722be700 1 -- 172.21.15.153:0/4242781672 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c06e1a0 con 0x7f296c073f90 2023-11-24T08:05:50.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.260+0000 7f2970abb700 1 -- 172.21.15.153:0/4242781672 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104901844 0 0) 0x7f296c06e7f0 con 0x7f296c0ce090 2023-11-24T08:05:50.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f29722be700 1 --2- 172.21.15.153:0/4242781672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f296c073f90 0x7f296c074420 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2964009d90 tx=0x7f296400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e47fa7595fb3603 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f2970abb700 1 -- 172.21.15.153:0/4242781672 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400e070 con 0x7f296c073f90 2023-11-24T08:05:50.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f2970abb700 1 -- 172.21.15.153:0/4242781672 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296400bb20 con 0x7f296c073f90 2023-11-24T08:05:50.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f2970abb700 1 -- 172.21.15.153:0/4242781672 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964012430 con 0x7f296c073f90 2023-11-24T08:05:50.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f2973d21700 1 -- 172.21.15.153:0/4242781672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f296c073f90 msgr2=0x7f296c074420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f2973d21700 1 --2- 172.21.15.153:0/4242781672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f296c073f90 0x7f296c074420 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2964009d90 tx=0x7f296400b330 comp rx=0 tx=0).stop 2023-11-24T08:05:50.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f2973d21700 1 -- 172.21.15.153:0/4242781672 shutdown_connections 2023-11-24T08:05:50.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f2973d21700 1 --2- 172.21.15.153:0/4242781672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f296c073f90 0x7f296c074420 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f2973d21700 1 --2- 172.21.15.153:0/4242781672 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f296c15e2a0 0x7f296c06ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f2973d21700 1 -- 172.21.15.153:0/4242781672 >> 172.21.15.153:0/4242781672 conn(0x7f296c0cd570 msgr2=0x7f296c0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:50.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f2973d21700 1 -- 172.21.15.153:0/4242781672 shutdown_connections 2023-11-24T08:05:50.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.261+0000 7f2973d21700 1 -- 172.21.15.153:0/4242781672 wait complete. 2023-11-24T08:05:50.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.263+0000 7f2973d21700 1 Processor -- start 2023-11-24T08:05:50.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.263+0000 7f2973d21700 1 -- start start 2023-11-24T08:05:50.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.263+0000 7f2973d21700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f296c073f90 0x7f296c157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.263+0000 7f2973d21700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f296c0ce090 0x7f296c0c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.263+0000 7f2973d21700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f296c15e2a0 0x7f296c0b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.263+0000 7f2973d21700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0c6f60 con 0x7f296c073f90 2023-11-24T08:05:50.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.263+0000 7f2973d21700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0c6350 con 0x7f296c15e2a0 2023-11-24T08:05:50.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.263+0000 7f2973d21700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0c6630 con 0x7f296c0ce090 2023-11-24T08:05:50.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.263+0000 7f2971abd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f296c073f90 0x7f296c157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.263+0000 7f2971abd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f296c073f90 0x7f296c157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38486/0 (socket says 172.21.15.153:38486) 2023-11-24T08:05:50.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.263+0000 7f2971abd700 1 -- 172.21.15.153:0/17020568 learned_addr learned my addr 172.21.15.153:0/17020568 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:50.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f29722be700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f296c15e2a0 0x7f296c0b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f29712bc700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f296c0ce090 0x7f296c0c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f2971abd700 1 -- 172.21.15.153:0/17020568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f296c0ce090 msgr2=0x7f296c0c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f2971abd700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f296c0ce090 0x7f296c0c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f2971abd700 1 -- 172.21.15.153:0/17020568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f296c15e2a0 msgr2=0x7f296c0b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f2971abd700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f296c15e2a0 0x7f296c0b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f2971abd700 1 -- 172.21.15.153:0/17020568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964009a70 con 0x7f296c073f90 2023-11-24T08:05:50.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f2971abd700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f296c073f90 0x7f296c157da0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f296800e9b0 tx=0x7f296800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f29627fc700 1 -- 172.21.15.153:0/17020568 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968009710 con 0x7f296c073f90 2023-11-24T08:05:50.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f29627fc700 1 -- 172.21.15.153:0/17020568 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296800ee50 con 0x7f296c073f90 2023-11-24T08:05:50.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f2973d21700 1 -- 172.21.15.153:0/17020568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296c0c6910 con 0x7f296c073f90 2023-11-24T08:05:50.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f29627fc700 1 -- 172.21.15.153:0/17020568 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296800ca50 con 0x7f296c073f90 2023-11-24T08:05:50.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.264+0000 7f2973d21700 1 -- 172.21.15.153:0/17020568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296c1582e0 con 0x7f296c073f90 2023-11-24T08:05:50.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.265+0000 7f2973d21700 1 -- 172.21.15.153:0/17020568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296c0c7240 con 0x7f296c073f90 2023-11-24T08:05:50.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.265+0000 7f29627fc700 1 -- 172.21.15.153:0/17020568 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f296800cbb0 con 0x7f296c073f90 2023-11-24T08:05:50.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.266+0000 7f29627fc700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f295006b080 0x7f295006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.266+0000 7f29627fc700 1 -- 172.21.15.153:0/17020568 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29680898a0 con 0x7f296c073f90 2023-11-24T08:05:50.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.266+0000 7f29712bc700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f295006b080 0x7f295006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.266+0000 7f29712bc700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f295006b080 0x7f295006d540 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f296c15cc60 tx=0x7f295c007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.270+0000 7f29627fc700 1 -- 172.21.15.153:0/17020568 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f29680546d0 con 0x7f296c073f90 2023-11-24T08:05:50.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.506+0000 7f2973d21700 1 -- 172.21.15.153:0/17020568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f296c067f60 con 0x7f296c073f90 2023-11-24T08:05:50.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.506+0000 7f29627fc700 1 -- 172.21.15.153:0/17020568 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2968021070 con 0x7f296c073f90 2023-11-24T08:05:50.508 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:05:50.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 -- 172.21.15.153:0/17020568 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f295006b080 msgr2=0x7f295006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f295006b080 0x7f295006d540 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f296c15cc60 tx=0x7f295c007de0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 -- 172.21.15.153:0/17020568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f296c073f90 msgr2=0x7f296c157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f296c073f90 0x7f296c157da0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f296800e9b0 tx=0x7f296800ecc0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 -- 172.21.15.153:0/17020568 shutdown_connections 2023-11-24T08:05:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f296c15e2a0 0x7f296c0b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f295006b080 0x7f295006d540 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f296c073f90 0x7f296c157da0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 --2- 172.21.15.153:0/17020568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f296c0ce090 0x7f296c0c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 -- 172.21.15.153:0/17020568 >> 172.21.15.153:0/17020568 conn(0x7f296c0cd570 msgr2=0x7f296c06eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:50.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 -- 172.21.15.153:0/17020568 shutdown_connections 2023-11-24T08:05:50.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:50.509+0000 7f2973d21700 1 -- 172.21.15.153:0/17020568 wait complete. 2023-11-24T08:05:50.522 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:05:50.522 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:05:50.523 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-11-24T08:05:50.523 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:05:50.523 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:50.523 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:05:50.523 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:05:50.523 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:05:50.523 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:50.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:50.523 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-11-24T08:05:50.580 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:05:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:05:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:05:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-11-24T08:05:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:50.580 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:50.580 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:50.580 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42322sec preferred_lft 42322sec 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e4cb:ff36:bdaf:3e03/64 scope link noprefixroute 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 9e:57:11:a0:a0:4b brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e4cd:e0ff:fe37:cdab/64 scope link 2023-11-24T08:05:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 9e:57:11:a0:a0:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:05:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::9c57:11ff:fea0:a04b/64 scope link 2023-11-24T08:05:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether f6:b2:5a:65:17:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:05:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::f4b2:5aff:fe65:174f/64 scope link 2023-11-24T08:05:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:50.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:50.583 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:05:50.646 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-11-24T08:05:50.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:50.647 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-11-24T08:05:50.706 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-11-24T08:05:50.706 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:05:50.706 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:05:50.706 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:05:50.706 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:05:50.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:50.707 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:05:50.707 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:05:50.707 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:05:50.707 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:05:50.707 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:05:50.707 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:05:50.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:50.812 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-11-24T08:05:50.829 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:05:50.829 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:05:50.829 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:50.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:50.830 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-11-24T08:05:50.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:50.896 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:50.953 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:50.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:50.954 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:51.011 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T08:05:51.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:51.011 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:05:51.096 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:05:51.096 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:05:51.096 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:05:51.104 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:05:51.105 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:05:51.105 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:05:51.105 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:05:51.105 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:05:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:05:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:05:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:05:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:05:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:05:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-11-24T08:05:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-11-24T08:05:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a594d4d2-de60-4a04-bb93-76779d526986" will pass to kernel 2023-11-24T08:05:51.148 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:05:51.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:51.149 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:51.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:51.185 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:05:51.268 INFO:teuthology.orchestra.run.smithi153.stdout:client5706 2023-11-24T08:05:51.268 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:05:51.268 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:51.326 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:05:51.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.485+0000 7f86ec28f700 1 Processor -- start 2023-11-24T08:05:51.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.485+0000 7f86ec28f700 1 -- start start 2023-11-24T08:05:51.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.486+0000 7f86ec28f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f86e4152cc0 0x7f86e406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:51.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.486+0000 7f86ec28f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40d0630 0x7f86e406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:51.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.486+0000 7f86ec28f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e415c4b0 con 0x7f86e40b49a0 2023-11-24T08:05:51.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.486+0000 7f86ec28f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e415c790 con 0x7f86e4152cc0 2023-11-24T08:05:51.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.486+0000 7f86ec28f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e415ca70 con 0x7f86e40d0630 2023-11-24T08:05:51.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.486+0000 7f86ea02b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f86e4152cc0 0x7f86e406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:51.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86ea02b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f86e4152cc0 0x7f86e406c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38498/0 (socket says 172.21.15.153:38498) 2023-11-24T08:05:51.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86ea02b700 1 -- 172.21.15.153:0/1352793886 learned_addr learned my addr 172.21.15.153:0/1352793886 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:51.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86e982a700 1 --1- 172.21.15.153:0/1352793886 >> v1:172.21.15.153:6789/0 conn(0x7f86e40b49a0 0x7f86e40cff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44604/0 (socket says 172.21.15.153:44604) 2023-11-24T08:05:51.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86ea82c700 1 --2- 172.21.15.153:0/1352793886 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40d0630 0x7f86e406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:51.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86ea02b700 1 -- 172.21.15.153:0/1352793886 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40d0630 msgr2=0x7f86e406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:51.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86ea02b700 1 --2- 172.21.15.153:0/1352793886 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40d0630 0x7f86e406c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:51.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86ea02b700 1 -- 172.21.15.153:0/1352793886 >> v1:172.21.15.153:6789/0 conn(0x7f86e40b49a0 legacy=0x7f86e40cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:51.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86ea02b700 1 -- 172.21.15.153:0/1352793886 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e415cd50 con 0x7f86e4152cc0 2023-11-24T08:05:51.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86ea82c700 1 --2- 172.21.15.153:0/1352793886 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40d0630 0x7f86e406c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:51.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86ea02b700 1 --2- 172.21.15.153:0/1352793886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e4152cc0 0x7f86e406c000 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f86d40098f0 tx=0x7f86d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f647039607609a1d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:51.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86e9029700 1 -- 172.21.15.153:0/1352793886 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d400b8a0 con 0x7f86e4152cc0 2023-11-24T08:05:51.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86e9029700 1 -- 172.21.15.153:0/1352793886 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d400ba00 con 0x7f86e4152cc0 2023-11-24T08:05:51.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.487+0000 7f86e9029700 1 -- 172.21.15.153:0/1352793886 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d400bd90 con 0x7f86e4152cc0 2023-11-24T08:05:51.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.488+0000 7f86ec28f700 1 -- 172.21.15.153:0/1352793886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e4152cc0 msgr2=0x7f86e406c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:51.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.488+0000 7f86ec28f700 1 --2- 172.21.15.153:0/1352793886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e4152cc0 0x7f86e406c000 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f86d40098f0 tx=0x7f86d4009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:51.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.488+0000 7f86ec28f700 1 -- 172.21.15.153:0/1352793886 shutdown_connections 2023-11-24T08:05:51.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.488+0000 7f86ec28f700 1 --2- 172.21.15.153:0/1352793886 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40d0630 0x7f86e406c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:51.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.488+0000 7f86ec28f700 1 --2- 172.21.15.153:0/1352793886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e4152cc0 0x7f86e406c000 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:51.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.488+0000 7f86ec28f700 1 -- 172.21.15.153:0/1352793886 >> 172.21.15.153:0/1352793886 conn(0x7f86e4071b90 msgr2=0x7f86e4071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:51.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.488+0000 7f86ec28f700 1 -- 172.21.15.153:0/1352793886 shutdown_connections 2023-11-24T08:05:51.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.488+0000 7f86ec28f700 1 -- 172.21.15.153:0/1352793886 wait complete. 2023-11-24T08:05:51.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.489+0000 7f86ec28f700 1 Processor -- start 2023-11-24T08:05:51.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.489+0000 7f86ec28f700 1 -- start start 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86ec28f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40b49a0 0x7f86e4147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86ec28f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e40d0630 0x7f86e4159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86ec28f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86e4152cc0 0x7f86e40b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86ec28f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4147bd0 con 0x7f86e40d0630 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86ec28f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4156cd0 con 0x7f86e4152cc0 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86ec28f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40cfec0 con 0x7f86e40b49a0 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86e982a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e40d0630 0x7f86e4159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86e982a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e40d0630 0x7f86e4159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38506/0 (socket says 172.21.15.153:38506) 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86e982a700 1 -- 172.21.15.153:0/3828625135 learned_addr learned my addr 172.21.15.153:0/3828625135 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86ea02b700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40b49a0 0x7f86e4147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86ea82c700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86e4152cc0 0x7f86e40b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:51.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86e982a700 1 -- 172.21.15.153:0/3828625135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40b49a0 msgr2=0x7f86e4147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86e982a700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40b49a0 0x7f86e4147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86e982a700 1 -- 172.21.15.153:0/3828625135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86e4152cc0 msgr2=0x7f86e40b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86e982a700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86e4152cc0 0x7f86e40b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86e982a700 1 -- 172.21.15.153:0/3828625135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d4009550 con 0x7f86e40d0630 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86ea02b700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40b49a0 0x7f86e4147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86e982a700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e40d0630 0x7f86e4159070 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f86e000c520 tx=0x7f86e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86daffd700 1 -- 172.21.15.153:0/3828625135 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0005cb0 con 0x7f86e40d0630 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86daffd700 1 -- 172.21.15.153:0/3828625135 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e0005e10 con 0x7f86e40d0630 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86ec28f700 1 -- 172.21.15.153:0/3828625135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e414a5a0 con 0x7f86e40d0630 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86daffd700 1 -- 172.21.15.153:0/3828625135 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e00072d0 con 0x7f86e40d0630 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.490+0000 7f86ec28f700 1 -- 172.21.15.153:0/3828625135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e414ab60 con 0x7f86e40d0630 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.491+0000 7f86ec28f700 1 -- 172.21.15.153:0/3828625135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e4156fb0 con 0x7f86e40d0630 2023-11-24T08:05:51.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.492+0000 7f86daffd700 1 -- 172.21.15.153:0/3828625135 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f86e0007430 con 0x7f86e40d0630 2023-11-24T08:05:51.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.492+0000 7f86daffd700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f86c806b080 0x7f86c806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:51.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.492+0000 7f86ea02b700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f86c806b080 0x7f86c806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:51.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.492+0000 7f86daffd700 1 -- 172.21.15.153:0/3828625135 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86e0088ce0 con 0x7f86e40d0630 2023-11-24T08:05:51.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.493+0000 7f86ea02b700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f86c806b080 0x7f86c806d540 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86d4014040 tx=0x7f86d4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:51.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.497+0000 7f86daffd700 1 -- 172.21.15.153:0/3828625135 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f86e0053bc0 con 0x7f86e40d0630 2023-11-24T08:05:51.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.730+0000 7f86ec28f700 1 -- 172.21.15.153:0/3828625135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f86e40753f0 con 0x7f86e40d0630 2023-11-24T08:05:51.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.730+0000 7f86daffd700 1 -- 172.21.15.153:0/3828625135 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f86e0017020 con 0x7f86e40d0630 2023-11-24T08:05:51.732 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:05:51.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.732+0000 7f86ec28f700 1 -- 172.21.15.153:0/3828625135 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f86c806b080 msgr2=0x7f86c806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.732+0000 7f86ec28f700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f86c806b080 0x7f86c806d540 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86d4014040 tx=0x7f86d4008030 comp rx=0 tx=0).stop 2023-11-24T08:05:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.732+0000 7f86ec28f700 1 -- 172.21.15.153:0/3828625135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e40d0630 msgr2=0x7f86e4159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.732+0000 7f86ec28f700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e40d0630 0x7f86e4159070 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f86e000c520 tx=0x7f86e000c8e0 comp rx=0 tx=0).stop 2023-11-24T08:05:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.732+0000 7f86ec28f700 1 -- 172.21.15.153:0/3828625135 shutdown_connections 2023-11-24T08:05:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.732+0000 7f86ec28f700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86e4152cc0 0x7f86e40b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.732+0000 7f86ec28f700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e40b49a0 0x7f86e4147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.732+0000 7f86ec28f700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f86c806b080 0x7f86c806d540 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.732+0000 7f86ec28f700 1 --2- 172.21.15.153:0/3828625135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e40d0630 0x7f86e4159070 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.733+0000 7f86ec28f700 1 -- 172.21.15.153:0/3828625135 >> 172.21.15.153:0/3828625135 conn(0x7f86e4071b90 msgr2=0x7f86e415a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.733+0000 7f86ec28f700 1 -- 172.21.15.153:0/3828625135 shutdown_connections 2023-11-24T08:05:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:51.733+0000 7f86ec28f700 1 -- 172.21.15.153:0/3828625135 wait complete. 2023-11-24T08:05:51.746 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:05:51.746 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:05:51.746 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-11-24T08:05:51.747 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:05:51.747 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:51.747 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:05:51.747 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:05:51.747 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:05:51.748 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:51.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:51.748 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-11-24T08:05:51.770 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:05:51.770 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:05:51.770 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:05:51.770 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:51.771 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-11-24T08:05:51.771 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:51.771 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:51.771 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:51.771 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:51.771 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:51.771 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:51.772 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:51.772 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:05:51.772 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:51.772 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:05:51.772 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42326sec preferred_lft 42326sec 2023-11-24T08:05:51.773 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c3a:c9d4:b907:ae22/64 scope link noprefixroute 2023-11-24T08:05:51.773 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:51.773 INFO:teuthology.orchestra.run.smithi164.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:05:51.773 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 2a:59:a8:c3:97:84 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:51.773 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:05:51.773 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:51.774 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::743c:f9ff:fe03:c5d2/64 scope link 2023-11-24T08:05:51.774 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:51.774 INFO:teuthology.orchestra.run.smithi164.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:51.774 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 2a:59:a8:c3:97:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:05:51.775 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::2859:a8ff:fec3:9784/64 scope link 2023-11-24T08:05:51.775 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:51.775 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:51.776 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether b6:1c:9d:ac:a8:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:05:51.776 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::b41c:9dff:feac:a8c8/64 scope link 2023-11-24T08:05:51.776 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:51.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:51.776 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:05:51.841 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-11-24T08:05:51.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:51.843 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-11-24T08:05:51.904 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-11-24T08:05:51.904 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:05:51.904 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:05:51.904 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:05:51.904 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:05:51.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:51.905 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:05:51.905 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:05:51.905 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:05:51.905 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:05:51.905 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:05:51.905 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:05:52.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:52.018 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-11-24T08:05:52.036 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:05:52.036 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:05:52.036 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:52.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:52.037 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-11-24T08:05:52.104 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:52.104 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:52.162 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:52.162 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:52.162 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:52.219 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T08:05:52.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:52.219 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:05:52.305 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:05:52.305 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:05:52.306 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:05:52.314 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:05:52.314 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:05:52.315 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:05:52.315 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:05:52.315 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:05:52.356 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:05:52.357 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:05:52.357 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:05:52.357 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:05:52.357 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:05:52.357 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-11-24T08:05:52.357 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-11-24T08:05:52.358 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a594d4d2-de60-4a04-bb93-76779d526986" will pass to kernel 2023-11-24T08:05:52.374 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:05:52.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:52.375 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:52.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:52.401 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:05:52.474 INFO:teuthology.orchestra.run.smithi164.stdout:client5138 2023-11-24T08:05:52.474 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:05:52.474 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:52.534 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T08:05:52.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.666+0000 7fa5bd146700 1 Processor -- start 2023-11-24T08:05:52.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.666+0000 7fa5bd146700 1 -- start start 2023-11-24T08:05:52.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5bd146700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa5b815e260 0x7fa5b806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:52.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5bd146700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b806f810 con 0x7fa5b815de80 2023-11-24T08:05:52.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5bd146700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b806faf0 con 0x7fa5b806f2b0 2023-11-24T08:05:52.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5bd146700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b806b580 con 0x7fa5b815e260 2023-11-24T08:05:52.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5b6d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa5b815de80 0x7fa5b80cfd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44618/0 (socket says 172.21.15.153:44618) 2023-11-24T08:05:52.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5b6d9d700 1 -- 172.21.15.153:0/2411966288 learned_addr learned my addr 172.21.15.153:0/2411966288 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:52.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5b659c700 1 --2- 172.21.15.153:0/2411966288 >> v2:172.21.15.164:3300/0 conn(0x7fa5b815e260 0x7fa5b806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5b5d9b700 1 -- 172.21.15.153:0/2411966288 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997941959 0 0) 0x7fa5b806f810 con 0x7fa5b815de80 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5b5d9b700 1 -- 172.21.15.153:0/2411966288 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a00035b0 con 0x7fa5b815de80 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5b659c700 1 -- 172.21.15.153:0/2411966288 >> v1:172.21.15.164:6789/0 conn(0x7fa5b806f2b0 legacy=0x7fa5b80d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5b5d9b700 1 -- 172.21.15.153:0/2411966288 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906154229 0 0) 0x7fa5b806faf0 con 0x7fa5b806f2b0 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5b659c700 1 -- 172.21.15.153:0/2411966288 >> v1:172.21.15.153:6789/0 conn(0x7fa5b815de80 legacy=0x7fa5b80cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5b659c700 1 -- 172.21.15.153:0/2411966288 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b806fdd0 con 0x7fa5b815e260 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.667+0000 7fa5b659c700 1 --2- 172.21.15.153:0/2411966288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b815e260 0x7fa5b806ed70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009840 tx=0x7fa5ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3ad6d7d2f2b62a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.668+0000 7fa5b5d9b700 1 -- 172.21.15.153:0/2411966288 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac011830 con 0x7fa5b815e260 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.668+0000 7fa5b5d9b700 1 -- 172.21.15.153:0/2411966288 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac011990 con 0x7fa5b815e260 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.668+0000 7fa5b5d9b700 1 -- 172.21.15.153:0/2411966288 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac011d00 con 0x7fa5b815e260 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.668+0000 7fa5bd146700 1 -- 172.21.15.153:0/2411966288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b815e260 msgr2=0x7fa5b806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.668+0000 7fa5bd146700 1 --2- 172.21.15.153:0/2411966288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b815e260 0x7fa5b806ed70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009840 tx=0x7fa5ac009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:52.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.668+0000 7fa5bd146700 1 -- 172.21.15.153:0/2411966288 shutdown_connections 2023-11-24T08:05:52.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.668+0000 7fa5bd146700 1 --2- 172.21.15.153:0/2411966288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b815e260 0x7fa5b806ed70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:52.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.668+0000 7fa5bd146700 1 -- 172.21.15.153:0/2411966288 >> 172.21.15.153:0/2411966288 conn(0x7fa5b809aa00 msgr2=0x7fa5b809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:52.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.668+0000 7fa5bd146700 1 -- 172.21.15.153:0/2411966288 shutdown_connections 2023-11-24T08:05:52.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.668+0000 7fa5bd146700 1 -- 172.21.15.153:0/2411966288 wait complete. 2023-11-24T08:05:52.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.670+0000 7fa5bd146700 1 Processor -- start 2023-11-24T08:05:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.670+0000 7fa5bd146700 1 -- start start 2023-11-24T08:05:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.670+0000 7fa5bd146700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b806f2b0 0x7fa5b8156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.670+0000 7fa5bd146700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5b815de80 0x7fa5b8157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.670+0000 7fa5bd146700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b815e260 0x7fa5b81530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.670+0000 7fa5bd146700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8158430 con 0x7fa5b806f2b0 2023-11-24T08:05:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5bd146700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80c5df0 con 0x7fa5b815e260 2023-11-24T08:05:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5bd146700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8158660 con 0x7fa5b815de80 2023-11-24T08:05:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5b6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b806f2b0 0x7fa5b8156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5b6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b806f2b0 0x7fa5b8156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38518/0 (socket says 172.21.15.153:38518) 2023-11-24T08:05:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5b6d9d700 1 -- 172.21.15.153:0/1838546138 learned_addr learned my addr 172.21.15.153:0/1838546138 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:52.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5b759e700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b815e260 0x7fa5b81530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:52.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5b659c700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5b815de80 0x7fa5b8157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:52.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5b6d9d700 1 -- 172.21.15.153:0/1838546138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5b815de80 msgr2=0x7fa5b8157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:52.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5b6d9d700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5b815de80 0x7fa5b8157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:52.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5b6d9d700 1 -- 172.21.15.153:0/1838546138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b815e260 msgr2=0x7fa5b81530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:52.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5b6d9d700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b815e260 0x7fa5b81530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:52.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5b6d9d700 1 -- 172.21.15.153:0/1838546138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0094a0 con 0x7fa5b806f2b0 2023-11-24T08:05:52.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5b6d9d700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b806f2b0 0x7fa5b8156a10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c420 tx=0x7fa5a800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:52.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa59f7fe700 1 -- 172.21.15.153:0/1838546138 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8005d70 con 0x7fa5b806f2b0 2023-11-24T08:05:52.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa59f7fe700 1 -- 172.21.15.153:0/1838546138 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a800ce30 con 0x7fa5b806f2b0 2023-11-24T08:05:52.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5bd146700 1 -- 172.21.15.153:0/1838546138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b8158940 con 0x7fa5b806f2b0 2023-11-24T08:05:52.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa59f7fe700 1 -- 172.21.15.153:0/1838546138 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80072d0 con 0x7fa5b806f2b0 2023-11-24T08:05:52.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.671+0000 7fa5bd146700 1 -- 172.21.15.153:0/1838546138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b8158f00 con 0x7fa5b806f2b0 2023-11-24T08:05:52.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.672+0000 7fa5bd146700 1 -- 172.21.15.153:0/1838546138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b80b1380 con 0x7fa5b806f2b0 2023-11-24T08:05:52.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.673+0000 7fa59f7fe700 1 -- 172.21.15.153:0/1838546138 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa5a8007430 con 0x7fa5b806f2b0 2023-11-24T08:05:52.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.673+0000 7fa59f7fe700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5a406b080 0x7fa5a406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:52.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.673+0000 7fa59f7fe700 1 -- 172.21.15.153:0/1838546138 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5a8088b00 con 0x7fa5b806f2b0 2023-11-24T08:05:52.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.673+0000 7fa5b659c700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5a406b080 0x7fa5a406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:52.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.674+0000 7fa5b659c700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5a406b080 0x7fa5a406d540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0090b0 tx=0x7fa5ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:52.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.678+0000 7fa59f7fe700 1 -- 172.21.15.153:0/1838546138 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5a80539e0 con 0x7fa5b806f2b0 2023-11-24T08:05:52.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:52.913+0000 7fa5bd146700 1 -- 172.21.15.153:0/1838546138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa5b8067f60 con 0x7fa5b806f2b0 2023-11-24T08:05:53.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.236+0000 7fa59f7fe700 1 -- 172.21.15.153:0/1838546138 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 136+0+0 (secure 0 0 0) 0x7fa5a80170c0 con 0x7fa5b806f2b0 2023-11-24T08:05:53.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 -- 172.21.15.153:0/1838546138 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5a406b080 msgr2=0x7fa5a406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5a406b080 0x7fa5a406d540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0090b0 tx=0x7fa5ac008030 comp rx=0 tx=0).stop 2023-11-24T08:05:53.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 -- 172.21.15.153:0/1838546138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b806f2b0 msgr2=0x7fa5b8156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b806f2b0 0x7fa5b8156a10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c420 tx=0x7fa5a800c730 comp rx=0 tx=0).stop 2023-11-24T08:05:53.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 -- 172.21.15.153:0/1838546138 shutdown_connections 2023-11-24T08:05:53.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5b815e260 0x7fa5b81530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa5a406b080 0x7fa5a406d540 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5b806f2b0 0x7fa5b8156a10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 --2- 172.21.15.153:0/1838546138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5b815de80 0x7fa5b8157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 -- 172.21.15.153:0/1838546138 >> 172.21.15.153:0/1838546138 conn(0x7fa5b809aa00 msgr2=0x7fa5b80cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:53.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 -- 172.21.15.153:0/1838546138 shutdown_connections 2023-11-24T08:05:53.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.239+0000 7fa5bd146700 1 -- 172.21.15.153:0/1838546138 wait complete. 2023-11-24T08:05:53.254 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T08:05:53.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.377+0000 7f3b13db9700 1 Processor -- start 2023-11-24T08:05:53.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.377+0000 7f3b13db9700 1 -- start start 2023-11-24T08:05:53.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.378+0000 7f3b13db9700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3b0c0cfbd0 0x7f3b0c15edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.378+0000 7f3b13db9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c161bf0 con 0x7f3b0c162920 2023-11-24T08:05:53.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.378+0000 7f3b13db9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c15f450 con 0x7f3b0c15bd30 2023-11-24T08:05:53.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.378+0000 7f3b13db9700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c161e40 con 0x7f3b0c0cfbd0 2023-11-24T08:05:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.378+0000 7f3b11354700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3b0c162920 0x7f3b0c15e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44632/0 (socket says 172.21.15.153:44632) 2023-11-24T08:05:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.378+0000 7f3b11354700 1 -- 172.21.15.153:0/1985353359 learned_addr learned my addr 172.21.15.153:0/1985353359 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.378+0000 7f3b12356700 1 --2- 172.21.15.153:0/1985353359 >> v2:172.21.15.164:3300/0 conn(0x7f3b0c0cfbd0 0x7f3b0c15edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.378+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173888898 0 0) 0x7f3b0c161bf0 con 0x7f3b0c162920 2023-11-24T08:05:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.378+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af80035b0 con 0x7f3b0c162920 2023-11-24T08:05:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 123972854 0 0) 0x7f3af80035b0 con 0x7f3b0c162920 2023-11-24T08:05:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 >> v2:172.21.15.164:3300/0 conn(0x7f3b0c0cfbd0 msgr2=0x7f3b0c15edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 --2- 172.21.15.153:0/1985353359 >> v2:172.21.15.164:3300/0 conn(0x7f3b0c0cfbd0 0x7f3b0c15edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 >> v1:172.21.15.164:6789/0 conn(0x7f3b0c15bd30 legacy=0x7f3b0c0cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c162120 con 0x7f3b0c162920 2023-11-24T08:05:53.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f3b08001670 con 0x7f3b0c162920 2023-11-24T08:05:53.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 >> v1:172.21.15.153:6789/0 conn(0x7f3b0c162920 legacy=0x7f3b0c15e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3af8003a00 0x7f3af8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3af8004850 0x7f3af8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3af8005210 0x7f3af800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c161e40 con 0x7f3af8004850 2023-11-24T08:05:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af800c0b0 con 0x7f3af8003a00 2023-11-24T08:05:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af800c270 con 0x7f3af8005210 2023-11-24T08:05:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b11354700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3af8004850 0x7f3af8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b11b55700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3af8003a00 0x7f3af8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b12356700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3af8005210 0x7f3af800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b11354700 1 -- 172.21.15.153:0/1985353359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3af8005210 msgr2=0x7f3af800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b11354700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3af8005210 0x7f3af800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b11354700 1 -- 172.21.15.153:0/1985353359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3af8003a00 msgr2=0x7f3af8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b11354700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3af8003a00 0x7f3af8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b11354700 1 -- 172.21.15.153:0/1985353359 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af80035b0 con 0x7f3af8004850 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b12356700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3af8005210 0x7f3af800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b12356700 1 -- 172.21.15.153:0/1985353359 reap_dead start 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b11354700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3af8004850 0x7f3af8004cd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800c210 tx=0x7f3af8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41353b6e96ce02ed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08007c10 con 0x7f3af8004850 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0800cdb0 con 0x7f3af8004850 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.379+0000 7f3b10b53700 1 -- 172.21.15.153:0/1985353359 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08005ba0 con 0x7f3af8004850 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.380+0000 7f3b13db9700 1 -- 172.21.15.153:0/1985353359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3af8004850 msgr2=0x7f3af8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.380+0000 7f3b13db9700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3af8004850 0x7f3af8004cd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800c210 tx=0x7f3af8005880 comp rx=0 tx=0).stop 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.380+0000 7f3b13db9700 1 -- 172.21.15.153:0/1985353359 shutdown_connections 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.380+0000 7f3b13db9700 1 --2- 172.21.15.153:0/1985353359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3af8004850 0x7f3af8004cd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.380+0000 7f3b13db9700 1 -- 172.21.15.153:0/1985353359 >> 172.21.15.153:0/1985353359 conn(0x7f3b0c072710 msgr2=0x7f3b0c072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.380+0000 7f3b13db9700 1 -- 172.21.15.153:0/1985353359 shutdown_connections 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.380+0000 7f3b13db9700 1 -- 172.21.15.153:0/1985353359 wait complete. 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.381+0000 7f3b13db9700 1 Processor -- start 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.381+0000 7f3b13db9700 1 -- start start 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b13db9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3af8004850 0x7f3b0c161790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b13db9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c153e70 0x7f3b0c160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b13db9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b0c1513a0 0x7f3b0c151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b13db9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c1546f0 con 0x7f3b0c1513a0 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b13db9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0b3090 con 0x7f3af8004850 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b13db9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0b3330 con 0x7f3b0c153e70 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b12356700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b0c1513a0 0x7f3b0c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b12356700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b0c1513a0 0x7f3b0c151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38542/0 (socket says 172.21.15.153:38542) 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b12356700 1 -- 172.21.15.153:0/2644348031 learned_addr learned my addr 172.21.15.153:0/2644348031 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b11354700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c153e70 0x7f3b0c160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b11b55700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3af8004850 0x7f3b0c161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b12356700 1 -- 172.21.15.153:0/2644348031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c153e70 msgr2=0x7f3b0c160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b12356700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c153e70 0x7f3b0c160a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b12356700 1 -- 172.21.15.153:0/2644348031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3af8004850 msgr2=0x7f3b0c161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b12356700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3af8004850 0x7f3b0c161790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b12356700 1 -- 172.21.15.153:0/2644348031 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c0b3610 con 0x7f3b0c1513a0 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.382+0000 7f3b11b55700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3af8004850 0x7f3b0c161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.383+0000 7f3b12356700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b0c1513a0 0x7f3b0c151850 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0d0200 tx=0x7f3b040104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.383+0000 7f3b027fc700 1 -- 172.21.15.153:0/2644348031 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0401b070 con 0x7f3b0c1513a0 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.383+0000 7f3b027fc700 1 -- 172.21.15.153:0/2644348031 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0400f040 con 0x7f3b0c1513a0 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.383+0000 7f3b13db9700 1 -- 172.21.15.153:0/2644348031 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c0b38f0 con 0x7f3b0c1513a0 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.383+0000 7f3b027fc700 1 -- 172.21.15.153:0/2644348031 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400e050 con 0x7f3b0c1513a0 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.383+0000 7f3b13db9700 1 -- 172.21.15.153:0/2644348031 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c160f60 con 0x7f3b0c1513a0 2023-11-24T08:05:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.384+0000 7f3b13db9700 1 -- 172.21.15.153:0/2644348031 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c0ccb20 con 0x7f3b0c1513a0 2023-11-24T08:05:53.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.384+0000 7f3b027fc700 1 -- 172.21.15.153:0/2644348031 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3b04015440 con 0x7f3b0c1513a0 2023-11-24T08:05:53.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.385+0000 7f3b027fc700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3af006b080 0x7f3af006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.385+0000 7f3b11b55700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3af006b080 0x7f3af006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.385+0000 7f3b027fc700 1 -- 172.21.15.153:0/2644348031 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b04089b20 con 0x7f3b0c1513a0 2023-11-24T08:05:53.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.385+0000 7f3b11b55700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3af006b080 0x7f3af006d540 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3afc007fd0 tx=0x7f3afc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:53.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.389+0000 7f3b027fc700 1 -- 172.21.15.153:0/2644348031 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b04054840 con 0x7f3b0c1513a0 2023-11-24T08:05:53.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.607+0000 7f3b13db9700 1 -- 172.21.15.153:0/2644348031 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b0c15dc20 con 0x7f3af006b080 2023-11-24T08:05:53.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.609+0000 7f3b027fc700 1 -- 172.21.15.153:0/2644348031 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3b0c15dc20 con 0x7f3af006b080 2023-11-24T08:05:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-11-24T08:05:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:05:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "cephfs" 2023-11-24T08:05:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:05:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-11-24T08:05:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 -- 172.21.15.153:0/2644348031 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3af006b080 msgr2=0x7f3af006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3af006b080 0x7f3af006d540 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3afc007fd0 tx=0x7f3afc009040 comp rx=0 tx=0).stop 2023-11-24T08:05:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 -- 172.21.15.153:0/2644348031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b0c1513a0 msgr2=0x7f3b0c151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b0c1513a0 0x7f3b0c151850 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0d0200 tx=0x7f3b040104a0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 -- 172.21.15.153:0/2644348031 shutdown_connections 2023-11-24T08:05:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3af006b080 0x7f3af006d540 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b0c1513a0 0x7f3b0c151850 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3af8004850 0x7f3b0c161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 --2- 172.21.15.153:0/2644348031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c153e70 0x7f3b0c160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 -- 172.21.15.153:0/2644348031 >> 172.21.15.153:0/2644348031 conn(0x7f3b0c072710 msgr2=0x7f3b0c15de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 -- 172.21.15.153:0/2644348031 shutdown_connections 2023-11-24T08:05:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.611+0000 7f3b13db9700 1 -- 172.21.15.153:0/2644348031 wait complete. 2023-11-24T08:05:53.625 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:05:53.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.748+0000 7f5618c14700 1 Processor -- start 2023-11-24T08:05:53.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.748+0000 7f5618c14700 1 -- start start 2023-11-24T08:05:53.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f5618c14700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56140cfdf0 0x7f5614073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f5618c14700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f56140744d0 0x7f56140b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f5618c14700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56140b5ee0 con 0x7f561415be70 2023-11-24T08:05:53.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f5618c14700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56140d0270 con 0x7f56140744d0 2023-11-24T08:05:53.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f5618c14700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561406bfc0 con 0x7f56140cfdf0 2023-11-24T08:05:53.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f5612d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f56140744d0 0x7f56140b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f561259c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f561415be70 0x7f56140add40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44650/0 (socket says 172.21.15.153:44650) 2023-11-24T08:05:53.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f561259c700 1 -- 172.21.15.153:0/4085088474 learned_addr learned my addr 172.21.15.153:0/4085088474 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:53.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f5611d9b700 1 --2- 172.21.15.153:0/4085088474 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56140cfdf0 0x7f5614073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f5612d9d700 1 -- 172.21.15.153:0/4085088474 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56140cfdf0 msgr2=0x7f5614073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f5612d9d700 1 --2- 172.21.15.153:0/4085088474 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56140cfdf0 0x7f5614073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f5612d9d700 1 -- 172.21.15.153:0/4085088474 >> v1:172.21.15.153:6789/0 conn(0x7f561415be70 legacy=0x7f56140add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f561159a700 1 -- 172.21.15.153:0/4085088474 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027188093 0 0) 0x7f56140b5ee0 con 0x7f561415be70 2023-11-24T08:05:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.749+0000 7f5612d9d700 1 -- 172.21.15.153:0/4085088474 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561406ba00 con 0x7f56140744d0 2023-11-24T08:05:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f5612d9d700 1 --2- 172.21.15.153:0/4085088474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56140744d0 0x7f56140b3c60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f560c009d90 tx=0x7f560c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89d5948a22f98c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f561159a700 1 -- 172.21.15.153:0/4085088474 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c00e070 con 0x7f56140744d0 2023-11-24T08:05:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f561159a700 1 -- 172.21.15.153:0/4085088474 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c00bbd0 con 0x7f56140744d0 2023-11-24T08:05:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f561159a700 1 -- 172.21.15.153:0/4085088474 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c012430 con 0x7f56140744d0 2023-11-24T08:05:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f5618c14700 1 -- 172.21.15.153:0/4085088474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56140744d0 msgr2=0x7f56140b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f5618c14700 1 --2- 172.21.15.153:0/4085088474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56140744d0 0x7f56140b3c60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f560c009d90 tx=0x7f560c00b330 comp rx=0 tx=0).stop 2023-11-24T08:05:53.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f5618c14700 1 -- 172.21.15.153:0/4085088474 shutdown_connections 2023-11-24T08:05:53.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f5618c14700 1 --2- 172.21.15.153:0/4085088474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56140744d0 0x7f56140b3c60 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f5618c14700 1 --2- 172.21.15.153:0/4085088474 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56140cfdf0 0x7f5614073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f5618c14700 1 -- 172.21.15.153:0/4085088474 >> 172.21.15.153:0/4085088474 conn(0x7f56140d0bf0 msgr2=0x7f56140d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:53.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f5618c14700 1 -- 172.21.15.153:0/4085088474 shutdown_connections 2023-11-24T08:05:53.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.750+0000 7f5618c14700 1 -- 172.21.15.153:0/4085088474 wait complete. 2023-11-24T08:05:53.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.752+0000 7f5618c14700 1 Processor -- start 2023-11-24T08:05:53.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.752+0000 7f5618c14700 1 -- start start 2023-11-24T08:05:53.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.752+0000 7f5618c14700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56140744d0 0x7f5614153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5618c14700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56140cfdf0 0x7f561409ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5618c14700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f561415be70 0x7f56141579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5618c14700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5614154070 con 0x7f56140744d0 2023-11-24T08:05:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5618c14700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561409d420 con 0x7f56140cfdf0 2023-11-24T08:05:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5618c14700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561409d700 con 0x7f561415be70 2023-11-24T08:05:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f561259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56140744d0 0x7f5614153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f561259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56140744d0 0x7f5614153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38552/0 (socket says 172.21.15.153:38552) 2023-11-24T08:05:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f561259c700 1 -- 172.21.15.153:0/29017032 learned_addr learned my addr 172.21.15.153:0/29017032 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:53.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5611d9b700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56140cfdf0 0x7f561409ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5612d9d700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f561415be70 0x7f56141579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f561259c700 1 -- 172.21.15.153:0/29017032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f561415be70 msgr2=0x7f56141579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f561259c700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f561415be70 0x7f56141579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f561259c700 1 -- 172.21.15.153:0/29017032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56140cfdf0 msgr2=0x7f561409ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f561259c700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56140cfdf0 0x7f561409ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f561259c700 1 -- 172.21.15.153:0/29017032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c009a70 con 0x7f56140744d0 2023-11-24T08:05:53.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5611d9b700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56140cfdf0 0x7f561409ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f561259c700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56140744d0 0x7f5614153b30 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f560800c550 tx=0x7f560800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5602ffd700 1 -- 172.21.15.153:0/29017032 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608004c80 con 0x7f56140744d0 2023-11-24T08:05:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5602ffd700 1 -- 172.21.15.153:0/29017032 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5608004e00 con 0x7f56140744d0 2023-11-24T08:05:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5618c14700 1 -- 172.21.15.153:0/29017032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561409d9e0 con 0x7f56140744d0 2023-11-24T08:05:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5602ffd700 1 -- 172.21.15.153:0/29017032 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608007310 con 0x7f56140744d0 2023-11-24T08:05:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.753+0000 7f5618c14700 1 -- 172.21.15.153:0/29017032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561409dfa0 con 0x7f56140744d0 2023-11-24T08:05:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.754+0000 7f5618c14700 1 -- 172.21.15.153:0/29017032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5614068fb0 con 0x7f56140744d0 2023-11-24T08:05:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.755+0000 7f5602ffd700 1 -- 172.21.15.153:0/29017032 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5608007470 con 0x7f56140744d0 2023-11-24T08:05:53.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.755+0000 7f5602ffd700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55f406b0b0 0x7f55f406d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:53.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.755+0000 7f5602ffd700 1 -- 172.21.15.153:0/29017032 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5608089640 con 0x7f56140744d0 2023-11-24T08:05:53.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.755+0000 7f5611d9b700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55f406b0b0 0x7f55f406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:53.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.756+0000 7f5611d9b700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55f406b0b0 0x7f55f406d570 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5614156350 tx=0x7f5604008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:53.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.759+0000 7f5602ffd700 1 -- 172.21.15.153:0/29017032 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5608054460 con 0x7f56140744d0 2023-11-24T08:05:53.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.949+0000 7f5618c14700 1 -- 172.21.15.153:0/29017032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f561415b4e0 con 0x7f56140744d0 2023-11-24T08:05:53.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.949+0000 7f5602ffd700 1 -- 172.21.15.153:0/29017032 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5608057a80 con 0x7f56140744d0 2023-11-24T08:05:53.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 -- 172.21.15.153:0/29017032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55f406b0b0 msgr2=0x7f55f406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55f406b0b0 0x7f55f406d570 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5614156350 tx=0x7f5604008040 comp rx=0 tx=0).stop 2023-11-24T08:05:53.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 -- 172.21.15.153:0/29017032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56140744d0 msgr2=0x7f5614153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:53.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56140744d0 0x7f5614153b30 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f560800c550 tx=0x7f560800c910 comp rx=0 tx=0).stop 2023-11-24T08:05:53.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 -- 172.21.15.153:0/29017032 shutdown_connections 2023-11-24T08:05:53.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f561415be70 0x7f56141579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f55f406b0b0 0x7f55f406d570 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56140744d0 0x7f5614153b30 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 --2- 172.21.15.153:0/29017032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56140cfdf0 0x7f561409ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:53.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 -- 172.21.15.153:0/29017032 >> 172.21.15.153:0/29017032 conn(0x7f56140d0bf0 msgr2=0x7f56140add40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:53.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 -- 172.21.15.153:0/29017032 shutdown_connections 2023-11-24T08:05:53.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:53.951+0000 7f5618c14700 1 -- 172.21.15.153:0/29017032 wait complete. 2023-11-24T08:05:53.965 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:05:53.965 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:53.983 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:05:53.983 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:54.041 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:54.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.200+0000 7fb7e0adb700 1 Processor -- start 2023-11-24T08:05:54.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.200+0000 7fb7e0adb700 1 -- start start 2023-11-24T08:05:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.201+0000 7fb7e0adb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7dc06c710 0x7fb7dc165b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.201+0000 7fb7e0adb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc0af950 con 0x7fb7dc1446a0 2023-11-24T08:05:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.201+0000 7fb7e0adb700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc0afc30 con 0x7fb7dc0adf00 2023-11-24T08:05:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.201+0000 7fb7e0adb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc144a80 con 0x7fb7dc06c710 2023-11-24T08:05:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.201+0000 7fb7da59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb7dc1446a0 0x7fb7dc0b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44664/0 (socket says 172.21.15.153:44664) 2023-11-24T08:05:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7da59c700 1 -- 172.21.15.153:0/3577527777 learned_addr learned my addr 172.21.15.153:0/3577527777 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7dad9d700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7dc06c710 0x7fb7dc165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547146822 0 0) 0x7fb7dc0af950 con 0x7fb7dc1446a0 2023-11-24T08:05:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c40035b0 con 0x7fb7dc1446a0 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4084553754 0 0) 0x7fb7c40035b0 con 0x7fb7dc1446a0 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7dc06c710 msgr2=0x7fb7dc165b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7dc06c710 0x7fb7dc165b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 >> v1:172.21.15.164:6789/0 conn(0x7fb7dc0adf00 legacy=0x7fb7dc06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0aff10 con 0x7fb7dc1446a0 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fb7d0001670 con 0x7fb7dc1446a0 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 >> v1:172.21.15.153:6789/0 conn(0x7fb7dc1446a0 legacy=0x7fb7dc0b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7c4003a30 0x7fb7c4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7dc06c710 0x7fb7c4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7c4004d90 0x7fb7c4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc144a80 con 0x7fb7c4004d90 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c400bac0 con 0x7fb7c4003a30 2023-11-24T08:05:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c400bc80 con 0x7fb7dc06c710 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7dad9d700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7c4004d90 0x7fb7c4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7da59c700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7c4003a30 0x7fb7c4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.202+0000 7fb7d9d9b700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7dc06c710 0x7fb7c4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7dad9d700 1 -- 172.21.15.153:0/3577527777 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7dc06c710 msgr2=0x7fb7c4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7dad9d700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7dc06c710 0x7fb7c4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7dad9d700 1 -- 172.21.15.153:0/3577527777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7c4003a30 msgr2=0x7fb7c4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7dad9d700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7c4003a30 0x7fb7c4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7dad9d700 1 -- 172.21.15.153:0/3577527777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40035b0 con 0x7fb7c4004d90 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7dad9d700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7c4004d90 0x7fb7c4005210 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009f90 tx=0x7fb7c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98152200c6b8cd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400ec30 con 0x7fb7c4004d90 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d400f040 con 0x7fb7c4004d90 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7d959a700 1 -- 172.21.15.153:0/3577527777 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4014480 con 0x7fb7c4004d90 2023-11-24T08:05:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7e0adb700 1 -- 172.21.15.153:0/3577527777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7c4004d90 msgr2=0x7fb7c4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7e0adb700 1 --2- 172.21.15.153:0/3577527777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7c4004d90 0x7fb7c4005210 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009f90 tx=0x7fb7c4005880 comp rx=0 tx=0).stop 2023-11-24T08:05:54.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7dad9d700 1 -- 172.21.15.153:0/3577527777 reap_dead start 2023-11-24T08:05:54.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7e0adb700 1 -- 172.21.15.153:0/3577527777 shutdown_connections 2023-11-24T08:05:54.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7e0adb700 1 -- 172.21.15.153:0/3577527777 >> 172.21.15.153:0/3577527777 conn(0x7fb7dc071b90 msgr2=0x7fb7dc071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:54.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7e0adb700 1 -- 172.21.15.153:0/3577527777 shutdown_connections 2023-11-24T08:05:54.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.203+0000 7fb7e0adb700 1 -- 172.21.15.153:0/3577527777 wait complete. 2023-11-24T08:05:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.205+0000 7fb7e0adb700 1 Processor -- start 2023-11-24T08:05:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.205+0000 7fb7e0adb700 1 -- start start 2023-11-24T08:05:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.205+0000 7fb7e0adb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7c4004d90 0x7fb7dc15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.205+0000 7fb7e0adb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7dc1f59a0 0x7fb7dc13b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7e0adb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7dc13d5b0 0x7fb7dc073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7e0adb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc15abb0 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7e0adb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc09cc10 con 0x7fb7dc13d5b0 2023-11-24T08:05:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7e0adb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc09cef0 con 0x7fb7c4004d90 2023-11-24T08:05:54.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7d9d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7dc1f59a0 0x7fb7dc13b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7d9d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7dc1f59a0 0x7fb7dc13b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38574/0 (socket says 172.21.15.153:38574) 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7d9d9b700 1 -- 172.21.15.153:0/2245651062 learned_addr learned my addr 172.21.15.153:0/2245651062 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7da59c700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7c4004d90 0x7fb7dc15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7dad9d700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7dc13d5b0 0x7fb7dc073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7d9d9b700 1 -- 172.21.15.153:0/2245651062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7c4004d90 msgr2=0x7fb7dc15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7d9d9b700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7c4004d90 0x7fb7dc15a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7d9d9b700 1 -- 172.21.15.153:0/2245651062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7dc13d5b0 msgr2=0x7fb7dc073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7d9d9b700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7dc13d5b0 0x7fb7dc073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7d9d9b700 1 -- 172.21.15.153:0/2245651062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc09d1d0 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7d9d9b700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7dc1f59a0 0x7fb7dc13b980 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00f820 tx=0x7fb7cc00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7caffd700 1 -- 172.21.15.153:0/2245651062 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0052e0 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7caffd700 1 -- 172.21.15.153:0/2245651062 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc005440 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7caffd700 1 -- 172.21.15.153:0/2245651062 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0038c0 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7e0adb700 1 -- 172.21.15.153:0/2245651062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc09d4b0 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.206+0000 7fb7e0adb700 1 -- 172.21.15.153:0/2245651062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc13bec0 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.207+0000 7fb7e0adb700 1 -- 172.21.15.153:0/2245651062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc0753f0 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.208+0000 7fb7caffd700 1 -- 172.21.15.153:0/2245651062 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb7cc003a20 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.208+0000 7fb7caffd700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb7bc06b080 0x7fb7bc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.208+0000 7fb7caffd700 1 -- 172.21.15.153:0/2245651062 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7cc089570 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.208+0000 7fb7da59c700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb7bc06b080 0x7fb7bc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.208+0000 7fb7da59c700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb7bc06b080 0x7fb7bc06d540 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc06eba0 tx=0x7fb7d0000f80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:54.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.213+0000 7fb7caffd700 1 -- 172.21.15.153:0/2245651062 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb7cc0543a0 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.405+0000 7fb7e0adb700 1 -- 172.21.15.153:0/2245651062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7dc067f60 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.406+0000 7fb7caffd700 1 -- 172.21.15.153:0/2245651062 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16549 (secure 0 0 0) 0x7fb7cc0579c0 con 0x7fb7dc1f59a0 2023-11-24T08:05:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:54.408 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":43,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:45.143974+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:41.978248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:42.535670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:54.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 -- 172.21.15.153:0/2245651062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb7bc06b080 msgr2=0x7fb7bc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb7bc06b080 0x7fb7bc06d540 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc06eba0 tx=0x7fb7d0000f80 comp rx=0 tx=0).stop 2023-11-24T08:05:54.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 -- 172.21.15.153:0/2245651062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7dc1f59a0 msgr2=0x7fb7dc13b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7dc1f59a0 0x7fb7dc13b980 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00f820 tx=0x7fb7cc00fb30 comp rx=0 tx=0).stop 2023-11-24T08:05:54.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 -- 172.21.15.153:0/2245651062 shutdown_connections 2023-11-24T08:05:54.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7dc13d5b0 0x7fb7dc073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7c4004d90 0x7fb7dc15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb7bc06b080 0x7fb7bc06d540 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 --2- 172.21.15.153:0/2245651062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7dc1f59a0 0x7fb7dc13b980 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 -- 172.21.15.153:0/2245651062 >> 172.21.15.153:0/2245651062 conn(0x7fb7dc071b90 msgr2=0x7fb7dc06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:54.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 -- 172.21.15.153:0/2245651062 shutdown_connections 2023-11-24T08:05:54.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.408+0000 7fb7e0adb700 1 -- 172.21.15.153:0/2245651062 wait complete. 2023-11-24T08:05:54.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:05:41.978248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:05:42.535670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:54.423 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:54.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.546+0000 7faf0120f700 1 Processor -- start 2023-11-24T08:05:54.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.546+0000 7faf0120f700 1 -- start start 2023-11-24T08:05:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.546+0000 7faf0120f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc1587f0 0x7faefc06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.546+0000 7faf0120f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc06b530 con 0x7faefc15b370 2023-11-24T08:05:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faf0120f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc0ae5e0 con 0x7faefc0b4370 2023-11-24T08:05:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faf0120f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc15be30 con 0x7faefc1587f0 2023-11-24T08:05:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faefa59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7faefc15b370 0x7faefc0b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44684/0 (socket says 172.21.15.153:44684) 2023-11-24T08:05:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faefa59c700 1 -- 172.21.15.153:0/2084793802 learned_addr learned my addr 172.21.15.153:0/2084793802 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902917925 0 0) 0x7faefc06b530 con 0x7faefc15b370 2023-11-24T08:05:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faefad9d700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc1587f0 0x7faefc06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faee40035b0 con 0x7faefc15b370 2023-11-24T08:05:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2665826756 0 0) 0x7faee40035b0 con 0x7faefc15b370 2023-11-24T08:05:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc1587f0 msgr2=0x7faefc06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc1587f0 0x7faefc06aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 >> v1:172.21.15.164:6789/0 conn(0x7faefc0b4370 legacy=0x7faefc0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc15c110 con 0x7faefc15b370 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7faef0001670 con 0x7faefc15b370 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 >> v1:172.21.15.153:6789/0 conn(0x7faefc15b370 legacy=0x7faefc0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc1587f0 0x7faee4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faee4003fb0 0x7faee4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 0x7faee4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc15be30 con 0x7faee4004d90 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee400baf0 con 0x7faee4003fb0 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee400bcb0 con 0x7faefc1587f0 2023-11-24T08:05:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faefad9d700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc1587f0 0x7faee4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faefb59e700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 0x7faee4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.547+0000 7faefa59c700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faee4003fb0 0x7faee4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faefb59e700 1 -- 172.21.15.153:0/2084793802 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc1587f0 msgr2=0x7faee4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faefb59e700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc1587f0 0x7faee4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faefb59e700 1 -- 172.21.15.153:0/2084793802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faee4003fb0 msgr2=0x7faee4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faefb59e700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faee4003fb0 0x7faee4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faefb59e700 1 -- 172.21.15.153:0/2084793802 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40035b0 con 0x7faee4004d90 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faefb59e700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 0x7faee4005210 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7faef400c160 tx=0x7faee4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99826414192031f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4001db0 con 0x7faee4004d90 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef400cca0 con 0x7faee4004d90 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faef9d9b700 1 -- 172.21.15.153:0/2084793802 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4003c40 con 0x7faee4004d90 2023-11-24T08:05:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faf0120f700 1 -- 172.21.15.153:0/2084793802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 msgr2=0x7faee4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faf0120f700 1 --2- 172.21.15.153:0/2084793802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 0x7faee4005210 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7faef400c160 tx=0x7faee4005880 comp rx=0 tx=0).stop 2023-11-24T08:05:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faefb59e700 1 -- 172.21.15.153:0/2084793802 reap_dead start 2023-11-24T08:05:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faf0120f700 1 -- 172.21.15.153:0/2084793802 shutdown_connections 2023-11-24T08:05:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faf0120f700 1 -- 172.21.15.153:0/2084793802 >> 172.21.15.153:0/2084793802 conn(0x7faefc0d0bf0 msgr2=0x7faefc0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faf0120f700 1 -- 172.21.15.153:0/2084793802 shutdown_connections 2023-11-24T08:05:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.548+0000 7faf0120f700 1 -- 172.21.15.153:0/2084793802 wait complete. 2023-11-24T08:05:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.550+0000 7faf0120f700 1 Processor -- start 2023-11-24T08:05:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.550+0000 7faf0120f700 1 -- start start 2023-11-24T08:05:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.551+0000 7faf0120f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 0x7faefc1448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.551+0000 7faf0120f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc09aa00 0x7faefc09d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.551+0000 7faf0120f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faefc09d590 0x7faefc0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.551+0000 7faf0120f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc1451b0 con 0x7faee4004d90 2023-11-24T08:05:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.551+0000 7faf0120f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc1481c0 con 0x7faefc09d590 2023-11-24T08:05:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.551+0000 7faf0120f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc09dc10 con 0x7faefc09aa00 2023-11-24T08:05:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.551+0000 7faefad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 0x7faefc1448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.551+0000 7faefad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 0x7faefc1448d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38590/0 (socket says 172.21.15.153:38590) 2023-11-24T08:05:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.551+0000 7faefad9d700 1 -- 172.21.15.153:0/4111067723 learned_addr learned my addr 172.21.15.153:0/4111067723 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faefa59c700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc09aa00 0x7faefc09d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faefb59e700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faefc09d590 0x7faefc0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faefad9d700 1 -- 172.21.15.153:0/4111067723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc09aa00 msgr2=0x7faefc09d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faefad9d700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc09aa00 0x7faefc09d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faefad9d700 1 -- 172.21.15.153:0/4111067723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faefc09d590 msgr2=0x7faefc0b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faefad9d700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faefc09d590 0x7faefc0b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faefad9d700 1 -- 172.21.15.153:0/4111067723 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc145390 con 0x7faee4004d90 2023-11-24T08:05:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faefad9d700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 0x7faefc1448d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7faeec011ad0 tx=0x7faeec011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faee37fe700 1 -- 172.21.15.153:0/4111067723 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec00fa00 con 0x7faee4004d90 2023-11-24T08:05:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faee37fe700 1 -- 172.21.15.153:0/4111067723 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec00fb60 con 0x7faee4004d90 2023-11-24T08:05:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faee37fe700 1 -- 172.21.15.153:0/4111067723 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec014440 con 0x7faee4004d90 2023-11-24T08:05:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faf0120f700 1 -- 172.21.15.153:0/4111067723 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc145670 con 0x7faee4004d90 2023-11-24T08:05:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.552+0000 7faf0120f700 1 -- 172.21.15.153:0/4111067723 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc145c30 con 0x7faee4004d90 2023-11-24T08:05:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.553+0000 7faf0120f700 1 -- 172.21.15.153:0/4111067723 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc068fb0 con 0x7faee4004d90 2023-11-24T08:05:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.553+0000 7faee37fe700 1 -- 172.21.15.153:0/4111067723 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7faeec0145a0 con 0x7faee4004d90 2023-11-24T08:05:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.554+0000 7faee37fe700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faee806b080 0x7faee806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.554+0000 7faee37fe700 1 -- 172.21.15.153:0/4111067723 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faeec08a120 con 0x7faee4004d90 2023-11-24T08:05:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.554+0000 7faefa59c700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faee806b080 0x7faee806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.554+0000 7faefa59c700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faee806b080 0x7faee806d540 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faefc153f20 tx=0x7faef0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:54.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.558+0000 7faee37fe700 1 -- 172.21.15.153:0/4111067723 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faeec054f70 con 0x7faee4004d90 2023-11-24T08:05:54.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.749+0000 7faf0120f700 1 -- 172.21.15.153:0/4111067723 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faefc15b950 con 0x7faee4004d90 2023-11-24T08:05:54.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.749+0000 7faee37fe700 1 -- 172.21.15.153:0/4111067723 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7faeec058590 con 0x7faee4004d90 2023-11-24T08:05:54.751 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:05:54.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.751+0000 7faf0120f700 1 -- 172.21.15.153:0/4111067723 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faee806b080 msgr2=0x7faee806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.751+0000 7faf0120f700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faee806b080 0x7faee806d540 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faefc153f20 tx=0x7faef0009040 comp rx=0 tx=0).stop 2023-11-24T08:05:54.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.751+0000 7faf0120f700 1 -- 172.21.15.153:0/4111067723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 msgr2=0x7faefc1448d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.751+0000 7faf0120f700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 0x7faefc1448d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7faeec011ad0 tx=0x7faeec011e90 comp rx=0 tx=0).stop 2023-11-24T08:05:54.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.752+0000 7faf0120f700 1 -- 172.21.15.153:0/4111067723 shutdown_connections 2023-11-24T08:05:54.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.752+0000 7faf0120f700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faefc09d590 0x7faefc0b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.752+0000 7faf0120f700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faee806b080 0x7faee806d540 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.752+0000 7faf0120f700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faee4004d90 0x7faefc1448d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.752+0000 7faf0120f700 1 --2- 172.21.15.153:0/4111067723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faefc09aa00 0x7faefc09d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.752+0000 7faf0120f700 1 -- 172.21.15.153:0/4111067723 >> 172.21.15.153:0/4111067723 conn(0x7faefc0d0bf0 msgr2=0x7faefc15c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:54.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.752+0000 7faf0120f700 1 -- 172.21.15.153:0/4111067723 shutdown_connections 2023-11-24T08:05:54.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.752+0000 7faf0120f700 1 -- 172.21.15.153:0/4111067723 wait complete. 2023-11-24T08:05:54.765 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:54.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.888+0000 7fb0e58fd700 1 Processor -- start 2023-11-24T08:05:54.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.888+0000 7fb0e58fd700 1 -- start start 2023-11-24T08:05:54.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0e58fd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb0e015e1d0 0x7fb0e00d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0e58fd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e00b5950 0x7fb0e00b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0e58fd700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e00b62e0 con 0x7fb0e00cf240 2023-11-24T08:05:54.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0e58fd700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e00d1aa0 con 0x7fb0e015e1d0 2023-11-24T08:05:54.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0e58fd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00d2ff0 con 0x7fb0e00b5950 2023-11-24T08:05:54.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0deffd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb0e015e1d0 0x7fb0e00d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0df7fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e00b5950 0x7fb0e00b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0deffd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb0e015e1d0 0x7fb0e00d2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:60184/0 (socket says 172.21.15.153:60184) 2023-11-24T08:05:54.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0de7fc700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fb0e00cf240 0x7fb0e00d3430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:52384/0 (socket says 172.21.15.153:52384) 2023-11-24T08:05:54.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0deffd700 1 -- 172.21.15.153:0/1179640786 learned_addr learned my addr 172.21.15.153:0/1179640786 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:54.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0deffd700 1 -- 172.21.15.153:0/1179640786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e00b5950 msgr2=0x7fb0e00b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:54.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0deffd700 1 --2- 172.21.15.153:0/1179640786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e00b5950 0x7fb0e00b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0deffd700 1 -- 172.21.15.153:0/1179640786 >> v1:172.21.15.164:6789/0 conn(0x7fb0e00cf240 legacy=0x7fb0e00d3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0deffd700 1 -- 172.21.15.153:0/1179640786 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e00d3b40 con 0x7fb0e015e1d0 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.889+0000 7fb0df7fe700 1 --2- 172.21.15.153:0/1179640786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e00b5950 0x7fb0e00b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0deffd700 1 --2- 172.21.15.153:0/1179640786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e015e1d0 0x7fb0e00d2ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00098f0 tx=0x7fb0d0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a1785cd54469b62 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0ddffb700 1 -- 172.21.15.153:0/1179640786 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0011830 con 0x7fb0e015e1d0 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0ddffb700 1 -- 172.21.15.153:0/1179640786 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d0011990 con 0x7fb0e015e1d0 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0ddffb700 1 -- 172.21.15.153:0/1179640786 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0011d20 con 0x7fb0e015e1d0 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0e58fd700 1 -- 172.21.15.153:0/1179640786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e015e1d0 msgr2=0x7fb0e00d2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0e58fd700 1 --2- 172.21.15.153:0/1179640786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e015e1d0 0x7fb0e00d2ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00098f0 tx=0x7fb0d0009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0e58fd700 1 -- 172.21.15.153:0/1179640786 shutdown_connections 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0e58fd700 1 --2- 172.21.15.153:0/1179640786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e00b5950 0x7fb0e00b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0e58fd700 1 --2- 172.21.15.153:0/1179640786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e015e1d0 0x7fb0e00d2ab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0e58fd700 1 -- 172.21.15.153:0/1179640786 >> 172.21.15.153:0/1179640786 conn(0x7fb0e00d0950 msgr2=0x7fb0e00d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:54.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0e58fd700 1 -- 172.21.15.153:0/1179640786 shutdown_connections 2023-11-24T08:05:54.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.890+0000 7fb0e58fd700 1 -- 172.21.15.153:0/1179640786 wait complete. 2023-11-24T08:05:54.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.891+0000 7fb0e58fd700 1 Processor -- start 2023-11-24T08:05:54.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.892+0000 7fb0e58fd700 1 -- start start 2023-11-24T08:05:54.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.892+0000 7fb0e58fd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e00b5950 0x7fb0e00ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.892+0000 7fb0e58fd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e00cf240 0x7fb0e00c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.892+0000 7fb0e58fd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0e015e1d0 0x7fb0e0150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.892+0000 7fb0e58fd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e01e7cb0 con 0x7fb0e015e1d0 2023-11-24T08:05:54.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.892+0000 7fb0e58fd700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00c90a0 con 0x7fb0e00cf240 2023-11-24T08:05:54.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.892+0000 7fb0e58fd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e01604e0 con 0x7fb0e00b5950 2023-11-24T08:05:54.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0df7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0e015e1d0 0x7fb0e0150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0df7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0e015e1d0 0x7fb0e0150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38604/0 (socket says 172.21.15.153:38604) 2023-11-24T08:05:54.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0df7fe700 1 -- 172.21.15.153:0/2656863725 learned_addr learned my addr 172.21.15.153:0/2656863725 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:54.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0de7fc700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e00cf240 0x7fb0e00c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0deffd700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e00b5950 0x7fb0e00ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0df7fe700 1 -- 172.21.15.153:0/2656863725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e00b5950 msgr2=0x7fb0e00ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0df7fe700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e00b5950 0x7fb0e00ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0df7fe700 1 -- 172.21.15.153:0/2656863725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e00cf240 msgr2=0x7fb0e00c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:54.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0df7fe700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e00cf240 0x7fb0e00c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:54.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0df7fe700 1 -- 172.21.15.153:0/2656863725 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d8009a70 con 0x7fb0e015e1d0 2023-11-24T08:05:54.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0df7fe700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0e015e1d0 0x7fb0e0150520 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800efc0 tx=0x7fb0d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:54.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0c7fff700 1 -- 172.21.15.153:0/2656863725 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8009d70 con 0x7fb0e015e1d0 2023-11-24T08:05:54.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0c7fff700 1 -- 172.21.15.153:0/2656863725 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d800f040 con 0x7fb0e015e1d0 2023-11-24T08:05:54.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0e58fd700 1 -- 172.21.15.153:0/2656863725 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d0009550 con 0x7fb0e015e1d0 2023-11-24T08:05:54.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0c7fff700 1 -- 172.21.15.153:0/2656863725 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800ce00 con 0x7fb0e015e1d0 2023-11-24T08:05:54.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.893+0000 7fb0e58fd700 1 -- 172.21.15.153:0/2656863725 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e0161520 con 0x7fb0e015e1d0 2023-11-24T08:05:54.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.894+0000 7fb0e58fd700 1 -- 172.21.15.153:0/2656863725 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e0068fb0 con 0x7fb0e015e1d0 2023-11-24T08:05:54.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.895+0000 7fb0c7fff700 1 -- 172.21.15.153:0/2656863725 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb0d8014480 con 0x7fb0e015e1d0 2023-11-24T08:05:54.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.895+0000 7fb0c7fff700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb0cc06b080 0x7fb0cc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:54.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.895+0000 7fb0c7fff700 1 -- 172.21.15.153:0/2656863725 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0d808a100 con 0x7fb0e015e1d0 2023-11-24T08:05:54.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.895+0000 7fb0deffd700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb0cc06b080 0x7fb0cc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:54.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.895+0000 7fb0deffd700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb0cc06b080 0x7fb0cc06d540 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0014040 tx=0x7fb0d0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:54.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:54.899+0000 7fb0c7fff700 1 -- 172.21.15.153:0/2656863725 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb0d8054eb0 con 0x7fb0e015e1d0 2023-11-24T08:05:55.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.089+0000 7fb0e58fd700 1 -- 172.21.15.153:0/2656863725 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0e00c6f00 con 0x7fb0e015e1d0 2023-11-24T08:05:55.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.089+0000 7fb0c7fff700 1 -- 172.21.15.153:0/2656863725 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0d80584d0 con 0x7fb0e015e1d0 2023-11-24T08:05:55.092 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:05:55.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 -- 172.21.15.153:0/2656863725 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb0cc06b080 msgr2=0x7fb0cc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb0cc06b080 0x7fb0cc06d540 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0014040 tx=0x7fb0d0008030 comp rx=0 tx=0).stop 2023-11-24T08:05:55.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 -- 172.21.15.153:0/2656863725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0e015e1d0 msgr2=0x7fb0e0150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0e015e1d0 0x7fb0e0150520 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800efc0 tx=0x7fb0d800c3a0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 -- 172.21.15.153:0/2656863725 shutdown_connections 2023-11-24T08:05:55.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb0cc06b080 0x7fb0cc06d540 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0e015e1d0 0x7fb0e0150520 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e00b5950 0x7fb0e00ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 --2- 172.21.15.153:0/2656863725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e00cf240 0x7fb0e00c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 -- 172.21.15.153:0/2656863725 >> 172.21.15.153:0/2656863725 conn(0x7fb0e00d0950 msgr2=0x7fb0e00ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 -- 172.21.15.153:0/2656863725 shutdown_connections 2023-11-24T08:05:55.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.092+0000 7fb0e58fd700 1 -- 172.21.15.153:0/2656863725 wait complete. 2023-11-24T08:05:55.106 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.228+0000 7f155ede2700 1 Processor -- start 2023-11-24T08:05:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.228+0000 7f155ede2700 1 -- start start 2023-11-24T08:05:55.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.229+0000 7f155ede2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15580746a0 0x7f15580b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.229+0000 7f155ede2700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15580b3c60 con 0x7f15580afc90 2023-11-24T08:05:55.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.229+0000 7f155ede2700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15580b58c0 con 0x7f155815e160 2023-11-24T08:05:55.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.229+0000 7f155ede2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15580b4500 con 0x7f15580746a0 2023-11-24T08:05:55.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.229+0000 7f155d37f700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f15580afc90 0x7f155806d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44720/0 (socket says 172.21.15.153:44720) 2023-11-24T08:05:55.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.229+0000 7f155d37f700 1 -- 172.21.15.153:0/1039478860 learned_addr learned my addr 172.21.15.153:0/1039478860 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:55.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806917451 0 0) 0x7f15580b3c60 con 0x7f15580afc90 2023-11-24T08:05:55.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15480035b0 con 0x7f15580afc90 2023-11-24T08:05:55.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f1557fff700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15580746a0 0x7f15580b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4158013142 0 0) 0x7f15480035b0 con 0x7f15580afc90 2023-11-24T08:05:55.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15580746a0 msgr2=0x7f15580b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:55.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15580746a0 0x7f15580b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 >> v1:172.21.15.164:6789/0 conn(0x7f155815e160 legacy=0x7f1558073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15580b0140 con 0x7f15580afc90 2023-11-24T08:05:55.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f15500019f0 con 0x7f15580afc90 2023-11-24T08:05:55.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 >> v1:172.21.15.153:6789/0 conn(0x7f15580afc90 legacy=0x7f155806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1548003a30 0x7f1548003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15580746a0 0x7f1548004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548004d90 0x7f1548005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15580b4500 con 0x7f1548003a30 2023-11-24T08:05:55.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154800bba0 con 0x7f1548004d90 2023-11-24T08:05:55.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154800bd30 con 0x7f15580746a0 2023-11-24T08:05:55.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f155cb7e700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1548003a30 0x7f1548003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f1557fff700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15580746a0 0x7f1548004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f155d37f700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548004d90 0x7f1548005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f155cb7e700 1 -- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15580746a0 msgr2=0x7f1548004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:55.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f155cb7e700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15580746a0 0x7f1548004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f155cb7e700 1 -- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548004d90 msgr2=0x7f1548005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:55.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f155cb7e700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548004d90 0x7f1548005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f155cb7e700 1 -- 172.21.15.153:0/1039478860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15480035b0 con 0x7f1548003a30 2023-11-24T08:05:55.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f1557fff700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15580746a0 0x7f1548004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:55.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f155d37f700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548004d90 0x7f1548005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:55.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.230+0000 7f155cb7e700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1548003a30 0x7f1548003e50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f154c0017f0 tx=0x7f1548005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb6bf4286b4bbfd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.231+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c0052d0 con 0x7f1548003a30 2023-11-24T08:05:55.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.231+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c005430 con 0x7f1548003a30 2023-11-24T08:05:55.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.231+0000 7f15577fe700 1 -- 172.21.15.153:0/1039478860 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c0038c0 con 0x7f1548003a30 2023-11-24T08:05:55.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.231+0000 7f155ede2700 1 -- 172.21.15.153:0/1039478860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1548003a30 msgr2=0x7f1548003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.231+0000 7f155ede2700 1 --2- 172.21.15.153:0/1039478860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1548003a30 0x7f1548003e50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f154c0017f0 tx=0x7f1548005880 comp rx=0 tx=0).stop 2023-11-24T08:05:55.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.231+0000 7f155d37f700 1 -- 172.21.15.153:0/1039478860 reap_dead start 2023-11-24T08:05:55.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.231+0000 7f155ede2700 1 -- 172.21.15.153:0/1039478860 shutdown_connections 2023-11-24T08:05:55.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.231+0000 7f155ede2700 1 -- 172.21.15.153:0/1039478860 >> 172.21.15.153:0/1039478860 conn(0x7f15580d0bf0 msgr2=0x7f15580d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.231+0000 7f155ede2700 1 -- 172.21.15.153:0/1039478860 shutdown_connections 2023-11-24T08:05:55.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.231+0000 7f155ede2700 1 -- 172.21.15.153:0/1039478860 wait complete. 2023-11-24T08:05:55.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.232+0000 7f155ede2700 1 Processor -- start 2023-11-24T08:05:55.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.232+0000 7f155ede2700 1 -- start start 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.233+0000 7f155ede2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548003a30 0x7f155815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.233+0000 7f155ede2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1558162000 0x7f15581f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.233+0000 7f155ede2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15581f3d90 0x7f15581f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.233+0000 7f155ede2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155815b550 con 0x7f1558162000 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.233+0000 7f155ede2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15580c7160 con 0x7f1548003a30 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.233+0000 7f155ede2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15581f4220 con 0x7f15581f3d90 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.233+0000 7f1557fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1558162000 0x7f15581f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.233+0000 7f1557fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1558162000 0x7f15581f3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38626/0 (socket says 172.21.15.153:38626) 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.233+0000 7f1557fff700 1 -- 172.21.15.153:0/316107932 learned_addr learned my addr 172.21.15.153:0/316107932 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.233+0000 7f155cb7e700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548003a30 0x7f155815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f155d37f700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15581f3d90 0x7f15581f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f1557fff700 1 -- 172.21.15.153:0/316107932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15581f3d90 msgr2=0x7f15581f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f1557fff700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15581f3d90 0x7f15581f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f1557fff700 1 -- 172.21.15.153:0/316107932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548003a30 msgr2=0x7f155815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f1557fff700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548003a30 0x7f155815b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f1557fff700 1 -- 172.21.15.153:0/316107932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15581f4500 con 0x7f1558162000 2023-11-24T08:05:55.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f1557fff700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1558162000 0x7f15581f3850 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1544010890 tx=0x7f1544010ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f15557fa700 1 -- 172.21.15.153:0/316107932 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544015880 con 0x7f1558162000 2023-11-24T08:05:55.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f15557fa700 1 -- 172.21.15.153:0/316107932 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154400c050 con 0x7f1558162000 2023-11-24T08:05:55.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f15557fa700 1 -- 172.21.15.153:0/316107932 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544015be0 con 0x7f1558162000 2023-11-24T08:05:55.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f155ede2700 1 -- 172.21.15.153:0/316107932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15581f47e0 con 0x7f1558162000 2023-11-24T08:05:55.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.234+0000 7f155ede2700 1 -- 172.21.15.153:0/316107932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15581f4fb0 con 0x7f1558162000 2023-11-24T08:05:55.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.235+0000 7f155ede2700 1 -- 172.21.15.153:0/316107932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15581f51d0 con 0x7f1558162000 2023-11-24T08:05:55.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.236+0000 7f15557fa700 1 -- 172.21.15.153:0/316107932 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1544015d40 con 0x7f1558162000 2023-11-24T08:05:55.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.236+0000 7f15557fa700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f153c06b080 0x7f153c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.236+0000 7f15557fa700 1 -- 172.21.15.153:0/316107932 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1544089f30 con 0x7f1558162000 2023-11-24T08:05:55.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.236+0000 7f155cb7e700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f153c06b080 0x7f153c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.236+0000 7f155cb7e700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f153c06b080 0x7f153c06d540 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f154c000c00 tx=0x7f154c009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.240+0000 7f15557fa700 1 -- 172.21.15.153:0/316107932 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1544054ce0 con 0x7f1558162000 2023-11-24T08:05:55.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.433+0000 7f155ede2700 1 -- 172.21.15.153:0/316107932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1558068fb0 con 0x7f1558162000 2023-11-24T08:05:55.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.433+0000 7f15557fa700 1 -- 172.21.15.153:0/316107932 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1544058300 con 0x7f1558162000 2023-11-24T08:05:55.435 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:05:55.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.435+0000 7f155ede2700 1 -- 172.21.15.153:0/316107932 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f153c06b080 msgr2=0x7f153c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.435+0000 7f155ede2700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f153c06b080 0x7f153c06d540 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f154c000c00 tx=0x7f154c009030 comp rx=0 tx=0).stop 2023-11-24T08:05:55.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.435+0000 7f155ede2700 1 -- 172.21.15.153:0/316107932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1558162000 msgr2=0x7f15581f3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.435+0000 7f155ede2700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1558162000 0x7f15581f3850 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1544010890 tx=0x7f1544010ba0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.436+0000 7f155ede2700 1 -- 172.21.15.153:0/316107932 shutdown_connections 2023-11-24T08:05:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.436+0000 7f155ede2700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15581f3d90 0x7f15581f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.436+0000 7f155ede2700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548003a30 0x7f155815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.436+0000 7f155ede2700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f153c06b080 0x7f153c06d540 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.436+0000 7f155ede2700 1 --2- 172.21.15.153:0/316107932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1558162000 0x7f15581f3850 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.436+0000 7f155ede2700 1 -- 172.21.15.153:0/316107932 >> 172.21.15.153:0/316107932 conn(0x7f15580d0bf0 msgr2=0x7f15580add40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.436+0000 7f155ede2700 1 -- 172.21.15.153:0/316107932 shutdown_connections 2023-11-24T08:05:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.436+0000 7f155ede2700 1 -- 172.21.15.153:0/316107932 wait complete. 2023-11-24T08:05:55.450 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:05:55.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.571+0000 7f7a7f309700 1 Processor -- start 2023-11-24T08:05:55.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.571+0000 7f7a7f309700 1 -- start start 2023-11-24T08:05:55.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a7f309700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7a7815e080 0x7f7a780cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a7f309700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a780d0150 con 0x7f7a780ce4d0 2023-11-24T08:05:55.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a7f309700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a780cee50 con 0x7f7a780d22f0 2023-11-24T08:05:55.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a7f309700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7815e460 con 0x7f7a7815e080 2023-11-24T08:05:55.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a7d0a5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7a7815e080 0x7f7a780cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a7c8a4700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7a780ce4d0 0x7f7a780d1be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44736/0 (socket says 172.21.15.153:44736) 2023-11-24T08:05:55.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a7c8a4700 1 -- 172.21.15.153:0/1205317104 learned_addr learned my addr 172.21.15.153:0/1205317104 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:55.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a6bfff700 1 -- 172.21.15.153:0/1205317104 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106759406 0 0) 0x7f7a780d0150 con 0x7f7a780ce4d0 2023-11-24T08:05:55.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a6bfff700 1 -- 172.21.15.153:0/1205317104 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a640035b0 con 0x7f7a780ce4d0 2023-11-24T08:05:55.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a7d0a5700 1 -- 172.21.15.153:0/1205317104 >> v1:172.21.15.164:6789/0 conn(0x7f7a780d22f0 legacy=0x7f7a780d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a7d0a5700 1 -- 172.21.15.153:0/1205317104 >> v1:172.21.15.153:6789/0 conn(0x7f7a780ce4d0 legacy=0x7f7a780d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a7d0a5700 1 -- 172.21.15.153:0/1205317104 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a780cf130 con 0x7f7a7815e080 2023-11-24T08:05:55.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a7d0a5700 1 --2- 172.21.15.153:0/1205317104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a7815e080 0x7f7a780cc2a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009840 tx=0x7f7a74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b648fef40b9356c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a6bfff700 1 -- 172.21.15.153:0/1205317104 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74011830 con 0x7f7a7815e080 2023-11-24T08:05:55.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a6bfff700 1 -- 172.21.15.153:0/1205317104 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a74011990 con 0x7f7a7815e080 2023-11-24T08:05:55.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.572+0000 7f7a6bfff700 1 -- 172.21.15.153:0/1205317104 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74011d20 con 0x7f7a7815e080 2023-11-24T08:05:55.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.573+0000 7f7a7f309700 1 -- 172.21.15.153:0/1205317104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a7815e080 msgr2=0x7f7a780cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.573+0000 7f7a7f309700 1 --2- 172.21.15.153:0/1205317104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a7815e080 0x7f7a780cc2a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009840 tx=0x7f7a74009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:55.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.573+0000 7f7a7f309700 1 -- 172.21.15.153:0/1205317104 shutdown_connections 2023-11-24T08:05:55.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.573+0000 7f7a7f309700 1 --2- 172.21.15.153:0/1205317104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a7815e080 0x7f7a780cc2a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.573+0000 7f7a7f309700 1 -- 172.21.15.153:0/1205317104 >> 172.21.15.153:0/1205317104 conn(0x7f7a78073130 msgr2=0x7f7a7809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.573+0000 7f7a7f309700 1 -- 172.21.15.153:0/1205317104 shutdown_connections 2023-11-24T08:05:55.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.573+0000 7f7a7f309700 1 -- 172.21.15.153:0/1205317104 wait complete. 2023-11-24T08:05:55.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.574+0000 7f7a7f309700 1 Processor -- start 2023-11-24T08:05:55.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.574+0000 7f7a7f309700 1 -- start start 2023-11-24T08:05:55.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7f309700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a780ce4d0 0x7f7a780c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7f309700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d22f0 0x7f7a781f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7f309700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a7815e080 0x7f7a780b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7f309700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780c71e0 con 0x7f7a780ce4d0 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7f309700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780c7460 con 0x7f7a780d22f0 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7f309700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780c7740 con 0x7f7a7815e080 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7d0a5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a780ce4d0 0x7f7a780c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7d0a5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a780ce4d0 0x7f7a780c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38638/0 (socket says 172.21.15.153:38638) 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7d0a5700 1 -- 172.21.15.153:0/4114173310 learned_addr learned my addr 172.21.15.153:0/4114173310 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7c8a4700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d22f0 0x7f7a781f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7d8a6700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a7815e080 0x7f7a780b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7d0a5700 1 -- 172.21.15.153:0/4114173310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a7815e080 msgr2=0x7f7a780b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7d0a5700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a7815e080 0x7f7a780b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7d0a5700 1 -- 172.21.15.153:0/4114173310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d22f0 msgr2=0x7f7a781f3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7d0a5700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d22f0 0x7f7a781f3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7d0a5700 1 -- 172.21.15.153:0/4114173310 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a740094a0 con 0x7f7a780ce4d0 2023-11-24T08:05:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7c8a4700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d22f0 0x7f7a781f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.575+0000 7f7a7d8a6700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a7815e080 0x7f7a780b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.576+0000 7f7a7d0a5700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a780ce4d0 0x7f7a780c6ca0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009b90 tx=0x7f7a74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.576+0000 7f7a69ffb700 1 -- 172.21.15.153:0/4114173310 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a740038a0 con 0x7f7a780ce4d0 2023-11-24T08:05:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.576+0000 7f7a69ffb700 1 -- 172.21.15.153:0/4114173310 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7401e070 con 0x7f7a780ce4d0 2023-11-24T08:05:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.576+0000 7f7a69ffb700 1 -- 172.21.15.153:0/4114173310 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74003c40 con 0x7f7a780ce4d0 2023-11-24T08:05:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.576+0000 7f7a7f309700 1 -- 172.21.15.153:0/4114173310 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a780c7a20 con 0x7f7a780ce4d0 2023-11-24T08:05:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.576+0000 7f7a7f309700 1 -- 172.21.15.153:0/4114173310 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a780c7fe0 con 0x7f7a780ce4d0 2023-11-24T08:05:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.577+0000 7f7a7f309700 1 -- 172.21.15.153:0/4114173310 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a78067f60 con 0x7f7a780ce4d0 2023-11-24T08:05:55.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.577+0000 7f7a69ffb700 1 -- 172.21.15.153:0/4114173310 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7a7402d450 con 0x7f7a780ce4d0 2023-11-24T08:05:55.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.578+0000 7f7a69ffb700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7a5c06b080 0x7f7a5c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.578+0000 7f7a69ffb700 1 -- 172.21.15.153:0/4114173310 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a7408a930 con 0x7f7a780ce4d0 2023-11-24T08:05:55.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.578+0000 7f7a7c8a4700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7a5c06b080 0x7f7a5c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.578+0000 7f7a7c8a4700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7a5c06b080 0x7f7a5c06d540 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0011e0 tx=0x7f7a6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.582+0000 7f7a69ffb700 1 -- 172.21.15.153:0/4114173310 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7a74055750 con 0x7f7a780ce4d0 2023-11-24T08:05:55.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.789+0000 7f7a7f309700 1 -- 172.21.15.153:0/4114173310 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7a780c8890 con 0x7f7a780ce4d0 2023-11-24T08:05:55.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.789+0000 7f7a69ffb700 1 -- 172.21.15.153:0/4114173310 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7a74015080 con 0x7f7a780ce4d0 2023-11-24T08:05:55.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 -- 172.21.15.153:0/4114173310 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7a5c06b080 msgr2=0x7f7a5c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7a5c06b080 0x7f7a5c06d540 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0011e0 tx=0x7f7a6c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 -- 172.21.15.153:0/4114173310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a780ce4d0 msgr2=0x7f7a780c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a780ce4d0 0x7f7a780c6ca0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009b90 tx=0x7f7a74004750 comp rx=0 tx=0).stop 2023-11-24T08:05:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 -- 172.21.15.153:0/4114173310 shutdown_connections 2023-11-24T08:05:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a7815e080 0x7f7a780b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7a5c06b080 0x7f7a5c06d540 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a780ce4d0 0x7f7a780c6ca0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 --2- 172.21.15.153:0/4114173310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d22f0 0x7f7a781f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 -- 172.21.15.153:0/4114173310 >> 172.21.15.153:0/4114173310 conn(0x7f7a78073130 msgr2=0x7f7a7806fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 -- 172.21.15.153:0/4114173310 shutdown_connections 2023-11-24T08:05:55.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:55.792+0000 7f7a7f309700 1 -- 172.21.15.153:0/4114173310 wait complete. 2023-11-24T08:05:55.795 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2023-11-24T08:05:55.805 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T08:05:55.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:55.806 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:55.845 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:05:55.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:55.845 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:05:55.901 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:05:55.902 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:55.924 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:05:55.924 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:55.985 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:56.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.104+0000 7f089f843700 1 Processor -- start 2023-11-24T08:05:56.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.105+0000 7f089f843700 1 -- start start 2023-11-24T08:05:56.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.105+0000 7f089f843700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08980adf00 0x7f089806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.105+0000 7f089f843700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f089806c540 0x7f08980b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.105+0000 7f089f843700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08980af950 con 0x7f08981446a0 2023-11-24T08:05:56.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.105+0000 7f089f843700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0898144a80 con 0x7f089806c540 2023-11-24T08:05:56.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.105+0000 7f089f843700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089806c9b0 con 0x7f08980adf00 2023-11-24T08:05:56.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.105+0000 7f089dde0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f089806c540 0x7f08980b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f089dde0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f089806c540 0x7f08980b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38650/0 (socket says 172.21.15.153:38650) 2023-11-24T08:05:56.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f089dde0700 1 -- 172.21.15.153:0/1648451006 learned_addr learned my addr 172.21.15.153:0/1648451006 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:56.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f089cdde700 1 --2- 172.21.15.153:0/1648451006 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08980adf00 0x7f089806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f089dde0700 1 -- 172.21.15.153:0/1648451006 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08980adf00 msgr2=0x7f089806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:56.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f089dde0700 1 --2- 172.21.15.153:0/1648451006 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08980adf00 0x7f089806c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f089dde0700 1 -- 172.21.15.153:0/1648451006 >> v1:172.21.15.164:6789/0 conn(0x7f08981446a0 legacy=0x7f08980b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f088ffff700 1 -- 172.21.15.153:0/1648451006 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642927199 0 0) 0x7f08980af950 con 0x7f08981446a0 2023-11-24T08:05:56.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f089dde0700 1 -- 172.21.15.153:0/1648451006 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08980afc30 con 0x7f089806c540 2023-11-24T08:05:56.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f089dde0700 1 --2- 172.21.15.153:0/1648451006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f089806c540 0x7f08980b3d40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0890009e80 tx=0x7f089000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd8f8147dabeb52 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:56.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f088ffff700 1 -- 172.21.15.153:0/1648451006 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089000e070 con 0x7f089806c540 2023-11-24T08:05:56.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f088ffff700 1 -- 172.21.15.153:0/1648451006 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089000b980 con 0x7f089806c540 2023-11-24T08:05:56.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.106+0000 7f088ffff700 1 -- 172.21.15.153:0/1648451006 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089000bd30 con 0x7f089806c540 2023-11-24T08:05:56.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.107+0000 7f089f843700 1 -- 172.21.15.153:0/1648451006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f089806c540 msgr2=0x7f08980b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.107+0000 7f089f843700 1 --2- 172.21.15.153:0/1648451006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f089806c540 0x7f08980b3d40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0890009e80 tx=0x7f089000b330 comp rx=0 tx=0).stop 2023-11-24T08:05:56.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.107+0000 7f089f843700 1 -- 172.21.15.153:0/1648451006 shutdown_connections 2023-11-24T08:05:56.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.107+0000 7f089f843700 1 --2- 172.21.15.153:0/1648451006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f089806c540 0x7f08980b3d40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.107+0000 7f089f843700 1 --2- 172.21.15.153:0/1648451006 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08980adf00 0x7f089806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.107+0000 7f089f843700 1 -- 172.21.15.153:0/1648451006 >> 172.21.15.153:0/1648451006 conn(0x7f0898071b90 msgr2=0x7f0898071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:56.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.107+0000 7f089f843700 1 -- 172.21.15.153:0/1648451006 shutdown_connections 2023-11-24T08:05:56.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.107+0000 7f089f843700 1 -- 172.21.15.153:0/1648451006 wait complete. 2023-11-24T08:05:56.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.108+0000 7f089f843700 1 Processor -- start 2023-11-24T08:05:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.108+0000 7f089f843700 1 -- start start 2023-11-24T08:05:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089f843700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f089806c540 0x7f089815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089f843700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08980adf00 0x7f08981436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089f843700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08981446a0 0x7f08980cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089f843700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089815a8a0 con 0x7f08981446a0 2023-11-24T08:05:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089f843700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08980ce720 con 0x7f089806c540 2023-11-24T08:05:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089f843700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08980cea00 con 0x7f08980adf00 2023-11-24T08:05:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089dde0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08981446a0 0x7f08980cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089dde0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08981446a0 0x7f08980cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38656/0 (socket says 172.21.15.153:38656) 2023-11-24T08:05:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089dde0700 1 -- 172.21.15.153:0/1040289675 learned_addr learned my addr 172.21.15.153:0/1040289675 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089d5df700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f089806c540 0x7f089815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089cdde700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08980adf00 0x7f08981436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089dde0700 1 -- 172.21.15.153:0/1040289675 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08980adf00 msgr2=0x7f08981436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089dde0700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08980adf00 0x7f08981436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089dde0700 1 -- 172.21.15.153:0/1040289675 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f089806c540 msgr2=0x7f089815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089dde0700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f089806c540 0x7f089815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.109+0000 7f089dde0700 1 -- 172.21.15.153:0/1040289675 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890009b30 con 0x7f08981446a0 2023-11-24T08:05:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.110+0000 7f089dde0700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08981446a0 0x7f08980cdc60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f089000b730 tx=0x7f0890004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.110+0000 7f088dffb700 1 -- 172.21.15.153:0/1040289675 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08900099b0 con 0x7f08981446a0 2023-11-24T08:05:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.110+0000 7f088dffb700 1 -- 172.21.15.153:0/1040289675 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08900092e0 con 0x7f08981446a0 2023-11-24T08:05:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.110+0000 7f089f843700 1 -- 172.21.15.153:0/1040289675 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0898142ef0 con 0x7f08981446a0 2023-11-24T08:05:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.110+0000 7f088dffb700 1 -- 172.21.15.153:0/1040289675 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089001c640 con 0x7f08981446a0 2023-11-24T08:05:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.110+0000 7f089f843700 1 -- 172.21.15.153:0/1040289675 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0898143c30 con 0x7f08981446a0 2023-11-24T08:05:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.111+0000 7f089f843700 1 -- 172.21.15.153:0/1040289675 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08980753f0 con 0x7f08981446a0 2023-11-24T08:05:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.111+0000 7f088dffb700 1 -- 172.21.15.153:0/1040289675 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f089001c7a0 con 0x7f08981446a0 2023-11-24T08:05:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.112+0000 7f088dffb700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f087c06b080 0x7f087c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.112+0000 7f088dffb700 1 -- 172.21.15.153:0/1040289675 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f089008b2c0 con 0x7f08981446a0 2023-11-24T08:05:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.112+0000 7f089d5df700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f087c06b080 0x7f087c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.112+0000 7f089d5df700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f087c06b080 0x7f087c06d540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0888000f60 tx=0x7f0888009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:56.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.116+0000 7f088dffb700 1 -- 172.21.15.153:0/1040289675 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0890056070 con 0x7f08981446a0 2023-11-24T08:05:56.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.310+0000 7f089f843700 1 -- 172.21.15.153:0/1040289675 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0898143410 con 0x7f08981446a0 2023-11-24T08:05:56.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.312+0000 7f088dffb700 1 -- 172.21.15.153:0/1040289675 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16549 (secure 0 0 0) 0x7f0898143410 con 0x7f08981446a0 2023-11-24T08:05:56.313 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:56.314 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":43,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:05:45.143974+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:41.978248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:42.535670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:56.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 -- 172.21.15.153:0/1040289675 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f087c06b080 msgr2=0x7f087c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f087c06b080 0x7f087c06d540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0888000f60 tx=0x7f0888009040 comp rx=0 tx=0).stop 2023-11-24T08:05:56.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 -- 172.21.15.153:0/1040289675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08981446a0 msgr2=0x7f08980cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08981446a0 0x7f08980cdc60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f089000b730 tx=0x7f0890004ad0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 -- 172.21.15.153:0/1040289675 shutdown_connections 2023-11-24T08:05:56.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f087c06b080 0x7f087c06d540 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08981446a0 0x7f08980cdc60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f089806c540 0x7f089815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 --2- 172.21.15.153:0/1040289675 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08980adf00 0x7f08981436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 -- 172.21.15.153:0/1040289675 >> 172.21.15.153:0/1040289675 conn(0x7f0898071b90 msgr2=0x7f08980b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:56.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 -- 172.21.15.153:0/1040289675 shutdown_connections 2023-11-24T08:05:56.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.314+0000 7f089f843700 1 -- 172.21.15.153:0/1040289675 wait complete. 2023-11-24T08:05:56.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:05:41.978248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:05:42.535670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:56.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:56.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.451+0000 7fb232eaf700 1 Processor -- start 2023-11-24T08:05:56.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.451+0000 7fb232eaf700 1 -- start start 2023-11-24T08:05:56.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb232eaf700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb22c0746a0 0x7fb22c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb232eaf700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c0b3c60 con 0x7fb22c15e160 2023-11-24T08:05:56.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb232eaf700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c0b58c0 con 0x7fb22c0afc90 2023-11-24T08:05:56.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb232eaf700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22c0b4500 con 0x7fb22c0746a0 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb22bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb22c0746a0 0x7fb22c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb22bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb22c0746a0 0x7fb22c0b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38660/0 (socket says 172.21.15.153:38660) 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb230c4b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb22c15e160 0x7fb22c073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44764/0 (socket says 172.21.15.153:44764) 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb22bfff700 1 -- 172.21.15.153:0/3376607468 learned_addr learned my addr 172.21.15.153:0/3376607468 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb22bfff700 1 -- 172.21.15.153:0/3376607468 >> v1:172.21.15.164:6789/0 conn(0x7fb22c0afc90 legacy=0x7fb22c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb22bfff700 1 -- 172.21.15.153:0/3376607468 >> v1:172.21.15.153:6789/0 conn(0x7fb22c15e160 legacy=0x7fb22c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb22bfff700 1 -- 172.21.15.153:0/3376607468 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c06bdc0 con 0x7fb22c0746a0 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.452+0000 7fb22b7fe700 1 -- 172.21.15.153:0/3376607468 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780823859 0 0) 0x7fb22c0b3c60 con 0x7fb22c15e160 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.453+0000 7fb22bfff700 1 --2- 172.21.15.153:0/3376607468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb22c0746a0 0x7fb22c0b5da0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb2180098f0 tx=0x7fb218009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6ac1ce8e0b1c27 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.453+0000 7fb22b7fe700 1 -- 172.21.15.153:0/3376607468 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218004230 con 0x7fb22c0746a0 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.453+0000 7fb22b7fe700 1 -- 172.21.15.153:0/3376607468 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218004390 con 0x7fb22c0746a0 2023-11-24T08:05:56.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.453+0000 7fb22b7fe700 1 -- 172.21.15.153:0/3376607468 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2180036a0 con 0x7fb22c0746a0 2023-11-24T08:05:56.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.453+0000 7fb232eaf700 1 -- 172.21.15.153:0/3376607468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb22c0746a0 msgr2=0x7fb22c0b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.453+0000 7fb232eaf700 1 --2- 172.21.15.153:0/3376607468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb22c0746a0 0x7fb22c0b5da0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb2180098f0 tx=0x7fb218009c00 comp rx=0 tx=0).stop 2023-11-24T08:05:56.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.453+0000 7fb232eaf700 1 -- 172.21.15.153:0/3376607468 shutdown_connections 2023-11-24T08:05:56.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.453+0000 7fb232eaf700 1 --2- 172.21.15.153:0/3376607468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb22c0746a0 0x7fb22c0b5da0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.453+0000 7fb232eaf700 1 -- 172.21.15.153:0/3376607468 >> 172.21.15.153:0/3376607468 conn(0x7fb22c0d0bf0 msgr2=0x7fb22c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:56.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.453+0000 7fb232eaf700 1 -- 172.21.15.153:0/3376607468 shutdown_connections 2023-11-24T08:05:56.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.453+0000 7fb232eaf700 1 -- 172.21.15.153:0/3376607468 wait complete. 2023-11-24T08:05:56.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.454+0000 7fb232eaf700 1 Processor -- start 2023-11-24T08:05:56.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.455+0000 7fb232eaf700 1 -- start start 2023-11-24T08:05:56.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.455+0000 7fb232eaf700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb22c0746a0 0x7fb22c14c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.455+0000 7fb232eaf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb22c0afc90 0x7fb22c14a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.455+0000 7fb232eaf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb22c15e160 0x7fb22c14ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.455+0000 7fb232eaf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c14c360 con 0x7fb22c0afc90 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.455+0000 7fb232eaf700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c14aab0 con 0x7fb22c15e160 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.455+0000 7fb232eaf700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c14b750 con 0x7fb22c0746a0 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.455+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb22c0afc90 0x7fb22c14a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb22c0afc90 0x7fb22c14a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38668/0 (socket says 172.21.15.153:38668) 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb22bfff700 1 -- 172.21.15.153:0/3114314116 learned_addr learned my addr 172.21.15.153:0/3114314116 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb23144c700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb22c15e160 0x7fb22c14ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb230c4b700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb22c0746a0 0x7fb22c14c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb22bfff700 1 -- 172.21.15.153:0/3114314116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb22c0746a0 msgr2=0x7fb22c14c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb22bfff700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb22c0746a0 0x7fb22c14c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb22bfff700 1 -- 172.21.15.153:0/3114314116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb22c15e160 msgr2=0x7fb22c14ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb22bfff700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb22c15e160 0x7fb22c14ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb22bfff700 1 -- 172.21.15.153:0/3114314116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb218009550 con 0x7fb22c0afc90 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb22bfff700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb22c0afc90 0x7fb22c14a570 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb22c072ed0 tx=0x7fb218004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb2297fa700 1 -- 172.21.15.153:0/3114314116 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218003dc0 con 0x7fb22c0afc90 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb2297fa700 1 -- 172.21.15.153:0/3114314116 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21801f070 con 0x7fb22c0afc90 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb232eaf700 1 -- 172.21.15.153:0/3114314116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c14ba30 con 0x7fb22c0afc90 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb2297fa700 1 -- 172.21.15.153:0/3114314116 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21800b8a0 con 0x7fb22c0afc90 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.456+0000 7fb232eaf700 1 -- 172.21.15.153:0/3114314116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c14bff0 con 0x7fb22c0afc90 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.457+0000 7fb232eaf700 1 -- 172.21.15.153:0/3114314116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c14c180 con 0x7fb22c0afc90 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.458+0000 7fb2297fa700 1 -- 172.21.15.153:0/3114314116 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb218021030 con 0x7fb22c0afc90 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.458+0000 7fb2297fa700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb21006b080 0x7fb21006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.458+0000 7fb2297fa700 1 -- 172.21.15.153:0/3114314116 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb21808b030 con 0x7fb22c0afc90 2023-11-24T08:05:56.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.458+0000 7fb230c4b700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb21006b080 0x7fb21006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.458+0000 7fb230c4b700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb21006b080 0x7fb21006d540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb220000f60 tx=0x7fb220007c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:56.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.462+0000 7fb2297fa700 1 -- 172.21.15.153:0/3114314116 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb218055e70 con 0x7fb22c0afc90 2023-11-24T08:05:56.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.654+0000 7fb232eaf700 1 -- 172.21.15.153:0/3114314116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb22c14c180 con 0x7fb22c0afc90 2023-11-24T08:05:56.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.655+0000 7fb2297fa700 1 -- 172.21.15.153:0/3114314116 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb218059490 con 0x7fb22c0afc90 2023-11-24T08:05:56.657 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:05:56.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.656+0000 7fb232eaf700 1 -- 172.21.15.153:0/3114314116 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb21006b080 msgr2=0x7fb21006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.656+0000 7fb232eaf700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb21006b080 0x7fb21006d540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb220000f60 tx=0x7fb220007c90 comp rx=0 tx=0).stop 2023-11-24T08:05:56.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.656+0000 7fb232eaf700 1 -- 172.21.15.153:0/3114314116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb22c0afc90 msgr2=0x7fb22c14a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.656+0000 7fb232eaf700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb22c0afc90 0x7fb22c14a570 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb22c072ed0 tx=0x7fb218004750 comp rx=0 tx=0).stop 2023-11-24T08:05:56.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.657+0000 7fb232eaf700 1 -- 172.21.15.153:0/3114314116 shutdown_connections 2023-11-24T08:05:56.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.657+0000 7fb232eaf700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb22c15e160 0x7fb22c14ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.657+0000 7fb232eaf700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb22c0746a0 0x7fb22c14c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.657+0000 7fb232eaf700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb21006b080 0x7fb21006d540 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.657+0000 7fb232eaf700 1 --2- 172.21.15.153:0/3114314116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb22c0afc90 0x7fb22c14a570 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.657+0000 7fb232eaf700 1 -- 172.21.15.153:0/3114314116 >> 172.21.15.153:0/3114314116 conn(0x7fb22c0d0bf0 msgr2=0x7fb22c15d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:56.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.657+0000 7fb232eaf700 1 -- 172.21.15.153:0/3114314116 shutdown_connections 2023-11-24T08:05:56.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.657+0000 7fb232eaf700 1 -- 172.21.15.153:0/3114314116 wait complete. 2023-11-24T08:05:56.670 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:56.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.794+0000 7f7f79f2a700 1 Processor -- start 2023-11-24T08:05:56.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.794+0000 7f7f79f2a700 1 -- start start 2023-11-24T08:05:56.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f79f2a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 0x7f7f74141700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f79f2a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f740cf500 0x7f7f7415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f79f2a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7415d560 con 0x7f7f7406c000 2023-11-24T08:05:56.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f79f2a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f74156b00 con 0x7f7f740cf500 2023-11-24T08:05:56.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f79f2a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740cf980 con 0x7f7f7413f110 2023-11-24T08:05:56.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f73fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7f7406c000 0x7f7f74073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44782/0 (socket says 172.21.15.153:44782) 2023-11-24T08:05:56.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f72ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f740cf500 0x7f7f7415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f73fff700 1 -- 172.21.15.153:0/2147512145 learned_addr learned my addr 172.21.15.153:0/2147512145 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:56.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f737fe700 1 --2- 172.21.15.153:0/2147512145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 0x7f7f74141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f72ffd700 1 -- 172.21.15.153:0/2147512145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 msgr2=0x7f7f74141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:56.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f727fc700 1 -- 172.21.15.153:0/2147512145 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379985172 0 0) 0x7f7f7415d560 con 0x7f7f7406c000 2023-11-24T08:05:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f72ffd700 1 --2- 172.21.15.153:0/2147512145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 0x7f7f74141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f72ffd700 1 -- 172.21.15.153:0/2147512145 >> v1:172.21.15.153:6789/0 conn(0x7f7f7406c000 legacy=0x7f7f74073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f72ffd700 1 -- 172.21.15.153:0/2147512145 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f740cfc60 con 0x7f7f740cf500 2023-11-24T08:05:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f737fe700 1 --2- 172.21.15.153:0/2147512145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 0x7f7f74141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f72ffd700 1 --2- 172.21.15.153:0/2147512145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f740cf500 0x7f7f7415d020 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009840 tx=0x7f7f68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9c000df92189d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.795+0000 7f7f727fc700 1 -- 172.21.15.153:0/2147512145 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68011830 con 0x7f7f740cf500 2023-11-24T08:05:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.796+0000 7f7f727fc700 1 -- 172.21.15.153:0/2147512145 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f68011990 con 0x7f7f740cf500 2023-11-24T08:05:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.796+0000 7f7f727fc700 1 -- 172.21.15.153:0/2147512145 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68011d20 con 0x7f7f740cf500 2023-11-24T08:05:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.796+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2147512145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f740cf500 msgr2=0x7f7f7415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.796+0000 7f7f79f2a700 1 --2- 172.21.15.153:0/2147512145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f740cf500 0x7f7f7415d020 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009840 tx=0x7f7f68009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.796+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2147512145 shutdown_connections 2023-11-24T08:05:56.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.796+0000 7f7f79f2a700 1 --2- 172.21.15.153:0/2147512145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 0x7f7f74141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.796+0000 7f7f79f2a700 1 --2- 172.21.15.153:0/2147512145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f740cf500 0x7f7f7415d020 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.796+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2147512145 >> 172.21.15.153:0/2147512145 conn(0x7f7f74071ac0 msgr2=0x7f7f74071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:56.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.796+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2147512145 shutdown_connections 2023-11-24T08:05:56.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.796+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2147512145 wait complete. 2023-11-24T08:05:56.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.797+0000 7f7f79f2a700 1 Processor -- start 2023-11-24T08:05:56.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.797+0000 7f7f79f2a700 1 -- start start 2023-11-24T08:05:56.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.798+0000 7f7f79f2a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f7406c000 0x7f7f740b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.798+0000 7f7f79f2a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f740cf500 0x7f7f740b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.798+0000 7f7f79f2a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 0x7f7f74144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.798+0000 7f7f79f2a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7413d960 con 0x7f7f740cf500 2023-11-24T08:05:56.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.798+0000 7f7f79f2a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74144a30 con 0x7f7f7406c000 2023-11-24T08:05:56.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.798+0000 7f7f79f2a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740b0dd0 con 0x7f7f7413f110 2023-11-24T08:05:56.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.798+0000 7f7f72ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f740cf500 0x7f7f740b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.798+0000 7f7f72ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f740cf500 0x7f7f740b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38682/0 (socket says 172.21.15.153:38682) 2023-11-24T08:05:56.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.798+0000 7f7f72ffd700 1 -- 172.21.15.153:0/2086932420 learned_addr learned my addr 172.21.15.153:0/2086932420 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:56.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.798+0000 7f7f737fe700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f7406c000 0x7f7f740b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.798+0000 7f7f73fff700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 0x7f7f74144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f72ffd700 1 -- 172.21.15.153:0/2086932420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 msgr2=0x7f7f74144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f72ffd700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 0x7f7f74144ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f72ffd700 1 -- 172.21.15.153:0/2086932420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f7406c000 msgr2=0x7f7f740b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f72ffd700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f7406c000 0x7f7f740b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f72ffd700 1 -- 172.21.15.153:0/2086932420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f680094a0 con 0x7f7f740cf500 2023-11-24T08:05:56.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f737fe700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f7406c000 0x7f7f740b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:56.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f73fff700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 0x7f7f74144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:56.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f72ffd700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f740cf500 0x7f7f740b1730 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7f68000c00 tx=0x7f7f68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:56.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f5bfff700 1 -- 172.21.15.153:0/2086932420 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680045f0 con 0x7f7f740cf500 2023-11-24T08:05:56.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2086932420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f74143e20 con 0x7f7f740cf500 2023-11-24T08:05:56.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f5bfff700 1 -- 172.21.15.153:0/2086932420 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6801f070 con 0x7f7f740cf500 2023-11-24T08:05:56.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f5bfff700 1 -- 172.21.15.153:0/2086932420 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68003ae0 con 0x7f7f740cf500 2023-11-24T08:05:56.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.799+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2086932420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f741443e0 con 0x7f7f740cf500 2023-11-24T08:05:56.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.800+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2086932420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f74144be0 con 0x7f7f740cf500 2023-11-24T08:05:56.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.800+0000 7f7f5bfff700 1 -- 172.21.15.153:0/2086932420 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7f68003c40 con 0x7f7f740cf500 2023-11-24T08:05:56.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.800+0000 7f7f5bfff700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f6006b080 0x7f7f6006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:56.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.801+0000 7f7f5bfff700 1 -- 172.21.15.153:0/2086932420 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f68021070 con 0x7f7f740cf500 2023-11-24T08:05:56.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.801+0000 7f7f737fe700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f6006b080 0x7f7f6006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:56.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.801+0000 7f7f737fe700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f6006b080 0x7f7f6006d540 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f64008910 tx=0x7f7f64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:56.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.805+0000 7f7f5bfff700 1 -- 172.21.15.153:0/2086932420 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f74144be0 con 0x7f7f740cf500 2023-11-24T08:05:56.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.992+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2086932420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f74144be0 con 0x7f7f740cf500 2023-11-24T08:05:56.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.992+0000 7f7f5bfff700 1 -- 172.21.15.153:0/2086932420 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f74144be0 con 0x7f7f740cf500 2023-11-24T08:05:56.995 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:05:56.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2086932420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f6006b080 msgr2=0x7f7f6006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f6006b080 0x7f7f6006d540 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f64008910 tx=0x7f7f64008040 comp rx=0 tx=0).stop 2023-11-24T08:05:56.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2086932420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f740cf500 msgr2=0x7f7f740b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f740cf500 0x7f7f740b1730 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7f68000c00 tx=0x7f7f68004750 comp rx=0 tx=0).stop 2023-11-24T08:05:56.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2086932420 shutdown_connections 2023-11-24T08:05:56.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f7413f110 0x7f7f74144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f7406c000 0x7f7f740b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7f6006b080 0x7f7f6006d540 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 --2- 172.21.15.153:0/2086932420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f740cf500 0x7f7f740b1730 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2086932420 >> 172.21.15.153:0/2086932420 conn(0x7f7f74071ac0 msgr2=0x7f7f74073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:57.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2086932420 shutdown_connections 2023-11-24T08:05:57.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:56.995+0000 7f7f79f2a700 1 -- 172.21.15.153:0/2086932420 wait complete. 2023-11-24T08:05:57.009 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:57.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.226+0000 7ff19f1f3700 1 Processor -- start 2023-11-24T08:05:57.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.226+0000 7ff19f1f3700 1 -- start start 2023-11-24T08:05:57.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.227+0000 7ff19f1f3700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff19815ada0 0x7ff19806f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.227+0000 7ff19f1f3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff1980afb40 0x7ff1980cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.227+0000 7ff19f1f3700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980cccd0 con 0x7ff1980cfa80 2023-11-24T08:05:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.227+0000 7ff19f1f3700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1980cd2e0 con 0x7ff1980afb40 2023-11-24T08:05:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.227+0000 7ff19f1f3700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1980cd5c0 con 0x7ff19815ada0 2023-11-24T08:05:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.227+0000 7ff197fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff1980afb40 0x7ff1980cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.227+0000 7ff19d790700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff1980cfa80 0x7ff19806d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44796/0 (socket says 172.21.15.153:44796) 2023-11-24T08:05:57.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.227+0000 7ff19d790700 1 -- 172.21.15.153:0/3945687523 learned_addr learned my addr 172.21.15.153:0/3945687523 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:57.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff19cf8f700 1 --2- 172.21.15.153:0/3945687523 >> v2:172.21.15.164:3300/0 conn(0x7ff19815ada0 0x7ff19806f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff197fff700 1 -- 172.21.15.153:0/3945687523 >> v2:172.21.15.164:3300/0 conn(0x7ff19815ada0 msgr2=0x7ff19806f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:57.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff197fff700 1 --2- 172.21.15.153:0/3945687523 >> v2:172.21.15.164:3300/0 conn(0x7ff19815ada0 0x7ff19806f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff197fff700 1 -- 172.21.15.153:0/3945687523 >> v1:172.21.15.153:6789/0 conn(0x7ff1980cfa80 legacy=0x7ff19806d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff197fff700 1 -- 172.21.15.153:0/3945687523 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19806fd50 con 0x7ff1980afb40 2023-11-24T08:05:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff1977fe700 1 -- 172.21.15.153:0/3945687523 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658824205 0 0) 0x7ff1980cccd0 con 0x7ff1980cfa80 2023-11-24T08:05:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff197fff700 1 --2- 172.21.15.153:0/3945687523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1980afb40 0x7ff1980cf540 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff1980b5610 tx=0x7ff184009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0f236f27856ad6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff1977fe700 1 -- 172.21.15.153:0/3945687523 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184011830 con 0x7ff1980afb40 2023-11-24T08:05:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff1977fe700 1 -- 172.21.15.153:0/3945687523 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff184011990 con 0x7ff1980afb40 2023-11-24T08:05:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff1977fe700 1 -- 172.21.15.153:0/3945687523 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184011d20 con 0x7ff1980afb40 2023-11-24T08:05:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff19f1f3700 1 -- 172.21.15.153:0/3945687523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1980afb40 msgr2=0x7ff1980cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.228+0000 7ff19f1f3700 1 --2- 172.21.15.153:0/3945687523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1980afb40 0x7ff1980cf540 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff1980b5610 tx=0x7ff184009b20 comp rx=0 tx=0).stop 2023-11-24T08:05:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.229+0000 7ff19f1f3700 1 -- 172.21.15.153:0/3945687523 shutdown_connections 2023-11-24T08:05:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.229+0000 7ff19f1f3700 1 --2- 172.21.15.153:0/3945687523 >> v2:172.21.15.164:3300/0 conn(0x7ff19815ada0 0x7ff19806f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.229+0000 7ff19f1f3700 1 --2- 172.21.15.153:0/3945687523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1980afb40 0x7ff1980cf540 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.229+0000 7ff19f1f3700 1 -- 172.21.15.153:0/3945687523 >> 172.21.15.153:0/3945687523 conn(0x7ff1980b2050 msgr2=0x7ff1980b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.229+0000 7ff19f1f3700 1 -- 172.21.15.153:0/3945687523 shutdown_connections 2023-11-24T08:05:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.229+0000 7ff19f1f3700 1 -- 172.21.15.153:0/3945687523 wait complete. 2023-11-24T08:05:57.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.230+0000 7ff19f1f3700 1 Processor -- start 2023-11-24T08:05:57.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.230+0000 7ff19f1f3700 1 -- start start 2023-11-24T08:05:57.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19f1f3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1980afb40 0x7ff19814e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19f1f3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1980cfa80 0x7ff1981598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19f1f3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff19815ada0 0x7ff198159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19f1f3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19814e740 con 0x7ff19815ada0 2023-11-24T08:05:57.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19f1f3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff198156f70 con 0x7ff1980afb40 2023-11-24T08:05:57.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19f1f3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff198156ae0 con 0x7ff1980cfa80 2023-11-24T08:05:57.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19d790700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff19815ada0 0x7ff198159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19d790700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff19815ada0 0x7ff198159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38698/0 (socket says 172.21.15.153:38698) 2023-11-24T08:05:57.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19d790700 1 -- 172.21.15.153:0/406531451 learned_addr learned my addr 172.21.15.153:0/406531451 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:57.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff197fff700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1980cfa80 0x7ff1981598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19cf8f700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1980afb40 0x7ff19814e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19d790700 1 -- 172.21.15.153:0/406531451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1980cfa80 msgr2=0x7ff1981598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19d790700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1980cfa80 0x7ff1981598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19d790700 1 -- 172.21.15.153:0/406531451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1980afb40 msgr2=0x7ff19814e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19d790700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1980afb40 0x7ff19814e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19d790700 1 -- 172.21.15.153:0/406531451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1840094a0 con 0x7ff19815ada0 2023-11-24T08:05:57.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff197fff700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1980cfa80 0x7ff1981598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:57.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19cf8f700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1980afb40 0x7ff19814e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:57.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff19d790700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff19815ada0 0x7ff198159e30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff19000ef30 tx=0x7ff19000c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:57.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.231+0000 7ff1957fa700 1 -- 172.21.15.153:0/406531451 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1900070d0 con 0x7ff19815ada0 2023-11-24T08:05:57.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.232+0000 7ff1957fa700 1 -- 172.21.15.153:0/406531451 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff190007230 con 0x7ff19815ada0 2023-11-24T08:05:57.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.232+0000 7ff19f1f3700 1 -- 172.21.15.153:0/406531451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff198155ed0 con 0x7ff19815ada0 2023-11-24T08:05:57.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.232+0000 7ff1957fa700 1 -- 172.21.15.153:0/406531451 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1900075e0 con 0x7ff19815ada0 2023-11-24T08:05:57.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.232+0000 7ff19f1f3700 1 -- 172.21.15.153:0/406531451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff198156490 con 0x7ff19815ada0 2023-11-24T08:05:57.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.232+0000 7ff19f1f3700 1 -- 172.21.15.153:0/406531451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff198068d90 con 0x7ff19815ada0 2023-11-24T08:05:57.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.233+0000 7ff1957fa700 1 -- 172.21.15.153:0/406531451 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff190007740 con 0x7ff19815ada0 2023-11-24T08:05:57.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.233+0000 7ff1957fa700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff17c06b080 0x7ff17c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.233+0000 7ff1957fa700 1 -- 172.21.15.153:0/406531451 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff19008c7d0 con 0x7ff19815ada0 2023-11-24T08:05:57.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.233+0000 7ff19cf8f700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff17c06b080 0x7ff17c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.234+0000 7ff19cf8f700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff17c06b080 0x7ff17c06d540 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff198154200 tx=0x7ff18c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:57.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.238+0000 7ff1957fa700 1 -- 172.21.15.153:0/406531451 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1900574f0 con 0x7ff19815ada0 2023-11-24T08:05:57.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.428+0000 7ff19f1f3700 1 -- 172.21.15.153:0/406531451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff198068fb0 con 0x7ff19815ada0 2023-11-24T08:05:57.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.428+0000 7ff1957fa700 1 -- 172.21.15.153:0/406531451 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff190015020 con 0x7ff19815ada0 2023-11-24T08:05:57.430 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:05:57.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 -- 172.21.15.153:0/406531451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff17c06b080 msgr2=0x7ff17c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff17c06b080 0x7ff17c06d540 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff198154200 tx=0x7ff18c008040 comp rx=0 tx=0).stop 2023-11-24T08:05:57.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 -- 172.21.15.153:0/406531451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff19815ada0 msgr2=0x7ff198159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff19815ada0 0x7ff198159e30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff19000ef30 tx=0x7ff19000c600 comp rx=0 tx=0).stop 2023-11-24T08:05:57.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 -- 172.21.15.153:0/406531451 shutdown_connections 2023-11-24T08:05:57.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff17c06b080 0x7ff17c06d540 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff19815ada0 0x7ff198159e30 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1980afb40 0x7ff19814e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 --2- 172.21.15.153:0/406531451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1980cfa80 0x7ff1981598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 -- 172.21.15.153:0/406531451 >> 172.21.15.153:0/406531451 conn(0x7ff1980b2050 msgr2=0x7ff19806e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:57.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 -- 172.21.15.153:0/406531451 shutdown_connections 2023-11-24T08:05:57.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.430+0000 7ff19f1f3700 1 -- 172.21.15.153:0/406531451 wait complete. 2023-11-24T08:05:57.444 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:05:57.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.565+0000 7f0d31e26700 1 Processor -- start 2023-11-24T08:05:57.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.565+0000 7f0d31e26700 1 -- start start 2023-11-24T08:05:57.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d31e26700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0d2c0b3370 0x7f0d2c1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d31e26700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0d2c0d1c70 0x7f0d2c0d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d31e26700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2c0b22d0 con 0x7f0d2c15bdd0 2023-11-24T08:05:57.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d31e26700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b2f50 con 0x7f0d2c0d1c70 2023-11-24T08:05:57.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d31e26700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c0d2640 con 0x7f0d2c0b3370 2023-11-24T08:05:57.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0d2c0d1c70 0x7f0d2c0d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2b7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0d2c15bdd0 0x7f0d2c0b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44806/0 (socket says 172.21.15.153:44806) 2023-11-24T08:05:57.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2b7fe700 1 -- 172.21.15.153:0/371203347 learned_addr learned my addr 172.21.15.153:0/371203347 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:57.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2affd700 1 --2- 172.21.15.153:0/371203347 >> v2:172.21.15.164:3300/0 conn(0x7f0d2c0b3370 0x7f0d2c1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2bfff700 1 -- 172.21.15.153:0/371203347 >> v2:172.21.15.164:3300/0 conn(0x7f0d2c0b3370 msgr2=0x7f0d2c1604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2bfff700 1 --2- 172.21.15.153:0/371203347 >> v2:172.21.15.164:3300/0 conn(0x7f0d2c0b3370 0x7f0d2c1604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2bfff700 1 -- 172.21.15.153:0/371203347 >> v1:172.21.15.153:6789/0 conn(0x7f0d2c15bdd0 legacy=0x7f0d2c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2bfff700 1 -- 172.21.15.153:0/371203347 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c0b25b0 con 0x7f0d2c0d1c70 2023-11-24T08:05:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2bfff700 1 --2- 172.21.15.153:0/371203347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c0d1c70 0x7f0d2c0d2100 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c15f910 tx=0x7f0d2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e45691044d8ceb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2a7fc700 1 -- 172.21.15.153:0/371203347 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400e070 con 0x7f0d2c0d1c70 2023-11-24T08:05:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2a7fc700 1 -- 172.21.15.153:0/371203347 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2400bbd0 con 0x7f0d2c0d1c70 2023-11-24T08:05:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.566+0000 7f0d2a7fc700 1 -- 172.21.15.153:0/371203347 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24012430 con 0x7f0d2c0d1c70 2023-11-24T08:05:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.567+0000 7f0d31e26700 1 -- 172.21.15.153:0/371203347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c0d1c70 msgr2=0x7f0d2c0d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.567+0000 7f0d31e26700 1 --2- 172.21.15.153:0/371203347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c0d1c70 0x7f0d2c0d2100 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c15f910 tx=0x7f0d2400b330 comp rx=0 tx=0).stop 2023-11-24T08:05:57.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.567+0000 7f0d31e26700 1 -- 172.21.15.153:0/371203347 shutdown_connections 2023-11-24T08:05:57.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.567+0000 7f0d31e26700 1 --2- 172.21.15.153:0/371203347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c0d1c70 0x7f0d2c0d2100 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.567+0000 7f0d31e26700 1 --2- 172.21.15.153:0/371203347 >> v2:172.21.15.164:3300/0 conn(0x7f0d2c0b3370 0x7f0d2c1604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.567+0000 7f0d31e26700 1 -- 172.21.15.153:0/371203347 >> 172.21.15.153:0/371203347 conn(0x7f0d2c0731a0 msgr2=0x7f0d2c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:57.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.567+0000 7f0d31e26700 1 -- 172.21.15.153:0/371203347 shutdown_connections 2023-11-24T08:05:57.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.567+0000 7f0d31e26700 1 -- 172.21.15.153:0/371203347 wait complete. 2023-11-24T08:05:57.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.568+0000 7f0d31e26700 1 Processor -- start 2023-11-24T08:05:57.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.568+0000 7f0d31e26700 1 -- start start 2023-11-24T08:05:57.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d31e26700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c0b3370 0x7f0d2c14f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d31e26700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d2c0d1c70 0x7f0d2c0b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d31e26700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d2c15bdd0 0x7f0d2c0ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d31e26700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b66d0 con 0x7f0d2c0b3370 2023-11-24T08:05:57.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d31e26700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b69b0 con 0x7f0d2c15bdd0 2023-11-24T08:05:57.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d31e26700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b6c90 con 0x7f0d2c0d1c70 2023-11-24T08:05:57.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c0b3370 0x7f0d2c14f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c0b3370 0x7f0d2c14f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38708/0 (socket says 172.21.15.153:38708) 2023-11-24T08:05:57.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2b7fe700 1 -- 172.21.15.153:0/357714087 learned_addr learned my addr 172.21.15.153:0/357714087 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:57.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2b7fe700 1 -- 172.21.15.153:0/357714087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d2c0d1c70 msgr2=0x7f0d2c0b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2affd700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d2c0d1c70 0x7f0d2c0b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2bfff700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d2c15bdd0 0x7f0d2c0ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2b7fe700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d2c0d1c70 0x7f0d2c0b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2b7fe700 1 -- 172.21.15.153:0/357714087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d2c15bdd0 msgr2=0x7f0d2c0ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2b7fe700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d2c15bdd0 0x7f0d2c0ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2b7fe700 1 -- 172.21.15.153:0/357714087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24009a70 con 0x7f0d2c0b3370 2023-11-24T08:05:57.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2affd700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d2c0d1c70 0x7f0d2c0b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.569+0000 7f0d2bfff700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d2c15bdd0 0x7f0d2c0ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.570+0000 7f0d2b7fe700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c0b3370 0x7f0d2c14f0c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c480 tx=0x7f0d1c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.570+0000 7f0d13fff700 1 -- 172.21.15.153:0/357714087 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c005d70 con 0x7f0d2c0b3370 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.570+0000 7f0d13fff700 1 -- 172.21.15.153:0/357714087 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c0070d0 con 0x7f0d2c0b3370 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.570+0000 7f0d13fff700 1 -- 172.21.15.153:0/357714087 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c007440 con 0x7f0d2c0b3370 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.570+0000 7f0d31e26700 1 -- 172.21.15.153:0/357714087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c0b6f70 con 0x7f0d2c0b3370 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.570+0000 7f0d31e26700 1 -- 172.21.15.153:0/357714087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c14f600 con 0x7f0d2c0b3370 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.571+0000 7f0d31e26700 1 -- 172.21.15.153:0/357714087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c067f60 con 0x7f0d2c0b3370 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.571+0000 7f0d13fff700 1 -- 172.21.15.153:0/357714087 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0d1c0075a0 con 0x7f0d2c0b3370 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.572+0000 7f0d13fff700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0d1806b080 0x7f0d1806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.572+0000 7f0d2affd700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0d1806b080 0x7f0d1806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.572+0000 7f0d13fff700 1 -- 172.21.15.153:0/357714087 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d1c088e20 con 0x7f0d2c0b3370 2023-11-24T08:05:57.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.572+0000 7f0d2affd700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0d1806b080 0x7f0d1806d540 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0cf1e0 tx=0x7f0d20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:57.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.576+0000 7f0d13fff700 1 -- 172.21.15.153:0/357714087 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d1c053c60 con 0x7f0d2c0b3370 2023-11-24T08:05:57.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.783+0000 7f0d31e26700 1 -- 172.21.15.153:0/357714087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0d2c0b7c60 con 0x7f0d2c0b3370 2023-11-24T08:05:57.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.784+0000 7f0d13fff700 1 -- 172.21.15.153:0/357714087 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0d1c017080 con 0x7f0d2c0b3370 2023-11-24T08:05:57.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 -- 172.21.15.153:0/357714087 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0d1806b080 msgr2=0x7f0d1806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0d1806b080 0x7f0d1806d540 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0cf1e0 tx=0x7f0d20008040 comp rx=0 tx=0).stop 2023-11-24T08:05:57.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 -- 172.21.15.153:0/357714087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c0b3370 msgr2=0x7f0d2c14f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c0b3370 0x7f0d2c14f0c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c480 tx=0x7f0d1c00c840 comp rx=0 tx=0).stop 2023-11-24T08:05:57.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 -- 172.21.15.153:0/357714087 shutdown_connections 2023-11-24T08:05:57.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d2c15bdd0 0x7f0d2c0ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0d1806b080 0x7f0d1806d540 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c0b3370 0x7f0d2c14f0c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 --2- 172.21.15.153:0/357714087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d2c0d1c70 0x7f0d2c0b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 -- 172.21.15.153:0/357714087 >> 172.21.15.153:0/357714087 conn(0x7f0d2c0731a0 msgr2=0x7f0d2c0b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:57.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 -- 172.21.15.153:0/357714087 shutdown_connections 2023-11-24T08:05:57.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.786+0000 7f0d31e26700 1 -- 172.21.15.153:0/357714087 wait complete. 2023-11-24T08:05:57.789 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2023-11-24T08:05:57.799 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T08:05:57.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:57.800 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:57.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:05:57.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:57.848 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:05:57.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:57.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.987+0000 7faf327f6700 1 Processor -- start 2023-11-24T08:05:57.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.987+0000 7faf327f6700 1 -- start start 2023-11-24T08:05:57.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.987+0000 7faf327f6700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7faf2c15e080 0x7faf2c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.987+0000 7faf327f6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c06c710 0x7faf2c0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.987+0000 7faf327f6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c0ae430 con 0x7faf2c0af4d0 2023-11-24T08:05:57.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.987+0000 7faf327f6700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c0af0b0 con 0x7faf2c15e080 2023-11-24T08:05:57.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.987+0000 7faf327f6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0b05a0 con 0x7faf2c06c710 2023-11-24T08:05:57.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2b7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7faf2c0af4d0 0x7faf2c06c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44820/0 (socket says 172.21.15.153:44820) 2023-11-24T08:05:57.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2b7fe700 1 -- 172.21.15.153:0/4201997905 learned_addr learned my addr 172.21.15.153:0/4201997905 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2bfff700 1 --2- 172.21.15.153:0/4201997905 >> v2:172.21.15.164:3300/0 conn(0x7faf2c15e080 0x7faf2c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf30d93700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c06c710 0x7faf2c0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155788527 0 0) 0x7faf2c0ae430 con 0x7faf2c0af4d0 2023-11-24T08:05:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf140035b0 con 0x7faf2c0af4d0 2023-11-24T08:05:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2831750667 0 0) 0x7faf140035b0 con 0x7faf2c0af4d0 2023-11-24T08:05:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c06c710 msgr2=0x7faf2c0afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c06c710 0x7faf2c0afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 >> v2:172.21.15.164:3300/0 conn(0x7faf2c15e080 msgr2=0x7faf2c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 --2- 172.21.15.153:0/4201997905 >> v2:172.21.15.164:3300/0 conn(0x7faf2c15e080 0x7faf2c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0ae710 con 0x7faf2c0af4d0 2023-11-24T08:05:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7faf20001670 con 0x7faf2c0af4d0 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 >> v1:172.21.15.153:6789/0 conn(0x7faf2c0af4d0 legacy=0x7faf2c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c06c710 0x7faf14003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf14003fb0 0x7faf14004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf14004d90 0x7faf14005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0af0b0 con 0x7faf14004d90 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0b05a0 con 0x7faf14003fb0 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1400ba10 con 0x7faf2c06c710 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf30d93700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf14004d90 0x7faf14005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2bfff700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c06c710 0x7faf14003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.988+0000 7faf2b7fe700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf14003fb0 0x7faf14004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf30d93700 1 -- 172.21.15.153:0/4201997905 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c06c710 msgr2=0x7faf14003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf30d93700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c06c710 0x7faf14003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf30d93700 1 -- 172.21.15.153:0/4201997905 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf14003fb0 msgr2=0x7faf14004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf30d93700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf14003fb0 0x7faf14004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf30d93700 1 -- 172.21.15.153:0/4201997905 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf140035b0 con 0x7faf14004d90 2023-11-24T08:05:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf30d93700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf14004d90 0x7faf14005210 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7faf24009f90 tx=0x7faf14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8f68fcc4315346 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2400ebd0 con 0x7faf14004d90 2023-11-24T08:05:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2400f040 con 0x7faf14004d90 2023-11-24T08:05:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf2affd700 1 -- 172.21.15.153:0/4201997905 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24014480 con 0x7faf14004d90 2023-11-24T08:05:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf327f6700 1 -- 172.21.15.153:0/4201997905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf14004d90 msgr2=0x7faf14005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf327f6700 1 --2- 172.21.15.153:0/4201997905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf14004d90 0x7faf14005210 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7faf24009f90 tx=0x7faf14005880 comp rx=0 tx=0).stop 2023-11-24T08:05:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf30d93700 1 -- 172.21.15.153:0/4201997905 reap_dead start 2023-11-24T08:05:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf327f6700 1 -- 172.21.15.153:0/4201997905 shutdown_connections 2023-11-24T08:05:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf327f6700 1 -- 172.21.15.153:0/4201997905 >> 172.21.15.153:0/4201997905 conn(0x7faf2c071b90 msgr2=0x7faf2c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf327f6700 1 -- 172.21.15.153:0/4201997905 shutdown_connections 2023-11-24T08:05:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.989+0000 7faf327f6700 1 -- 172.21.15.153:0/4201997905 wait complete. 2023-11-24T08:05:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.991+0000 7faf327f6700 1 Processor -- start 2023-11-24T08:05:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.991+0000 7faf327f6700 1 -- start start 2023-11-24T08:05:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf327f6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c159470 0x7faf2c15f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf327f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2c159850 0x7faf2c1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf327f6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf2c1518f0 0x7faf2c157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf327f6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c151da0 con 0x7faf2c159850 2023-11-24T08:05:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf327f6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c1588c0 con 0x7faf2c1518f0 2023-11-24T08:05:58.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf327f6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0cd750 con 0x7faf2c159470 2023-11-24T08:05:58.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf2b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2c159850 0x7faf2c1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf2b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2c159850 0x7faf2c1513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38728/0 (socket says 172.21.15.153:38728) 2023-11-24T08:05:58.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf2b7fe700 1 -- 172.21.15.153:0/1151695042 learned_addr learned my addr 172.21.15.153:0/1151695042 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf2bfff700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c159470 0x7faf2c15f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf30d93700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf2c1518f0 0x7faf2c157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf2b7fe700 1 -- 172.21.15.153:0/1151695042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c159470 msgr2=0x7faf2c15f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf2b7fe700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c159470 0x7faf2c15f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf2b7fe700 1 -- 172.21.15.153:0/1151695042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf2c1518f0 msgr2=0x7faf2c157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.992+0000 7faf2b7fe700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf2c1518f0 0x7faf2c157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.993+0000 7faf2b7fe700 1 -- 172.21.15.153:0/1151695042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0cda30 con 0x7faf2c159850 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.993+0000 7faf2b7fe700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2c159850 0x7faf2c1513b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7faf200048d0 tx=0x7faf20007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.993+0000 7faf28ff9700 1 -- 172.21.15.153:0/1151695042 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20012560 con 0x7faf2c159850 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.993+0000 7faf28ff9700 1 -- 172.21.15.153:0/1151695042 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf20012700 con 0x7faf2c159850 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.993+0000 7faf327f6700 1 -- 172.21.15.153:0/1151695042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c0cdd10 con 0x7faf2c159850 2023-11-24T08:05:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.993+0000 7faf28ff9700 1 -- 172.21.15.153:0/1151695042 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20012ab0 con 0x7faf2c159850 2023-11-24T08:05:58.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.993+0000 7faf327f6700 1 -- 172.21.15.153:0/1151695042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c15fd60 con 0x7faf2c159850 2023-11-24T08:05:58.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.994+0000 7faf327f6700 1 -- 172.21.15.153:0/1151695042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c0753f0 con 0x7faf2c159850 2023-11-24T08:05:58.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.994+0000 7faf28ff9700 1 -- 172.21.15.153:0/1151695042 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7faf20012c10 con 0x7faf2c159850 2023-11-24T08:05:58.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.995+0000 7faf28ff9700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf1806b080 0x7faf1806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.995+0000 7faf28ff9700 1 -- 172.21.15.153:0/1151695042 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf200898b0 con 0x7faf2c159850 2023-11-24T08:05:58.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.995+0000 7faf2bfff700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf1806b080 0x7faf1806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.995+0000 7faf2bfff700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf1806b080 0x7faf1806d540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009ce0 tx=0x7faf1c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:58.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:57.999+0000 7faf28ff9700 1 -- 172.21.15.153:0/1151695042 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf200546f0 con 0x7faf2c159850 2023-11-24T08:05:58.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.231+0000 7faf327f6700 1 -- 172.21.15.153:0/1151695042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf2c0ce230 con 0x7faf2c159850 2023-11-24T08:05:58.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.231+0000 7faf28ff9700 1 -- 172.21.15.153:0/1151695042 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7faf2c0ce230 con 0x7faf2c159850 2023-11-24T08:05:58.233 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:58.233 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.233+0000 7faf327f6700 1 -- 172.21.15.153:0/1151695042 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf1806b080 msgr2=0x7faf1806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.233+0000 7faf327f6700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf1806b080 0x7faf1806d540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009ce0 tx=0x7faf1c009210 comp rx=0 tx=0).stop 2023-11-24T08:05:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.233+0000 7faf327f6700 1 -- 172.21.15.153:0/1151695042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2c159850 msgr2=0x7faf2c1513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.233+0000 7faf327f6700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2c159850 0x7faf2c1513b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7faf200048d0 tx=0x7faf20007570 comp rx=0 tx=0).stop 2023-11-24T08:05:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.233+0000 7faf327f6700 1 -- 172.21.15.153:0/1151695042 shutdown_connections 2023-11-24T08:05:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.233+0000 7faf327f6700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf2c1518f0 0x7faf2c157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.233+0000 7faf327f6700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf2c159470 0x7faf2c15f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.233+0000 7faf327f6700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf1806b080 0x7faf1806d540 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.233+0000 7faf327f6700 1 --2- 172.21.15.153:0/1151695042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2c159850 0x7faf2c1513b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.233+0000 7faf327f6700 1 -- 172.21.15.153:0/1151695042 >> 172.21.15.153:0/1151695042 conn(0x7faf2c071b90 msgr2=0x7faf2c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.234+0000 7faf327f6700 1 -- 172.21.15.153:0/1151695042 shutdown_connections 2023-11-24T08:05:58.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.234+0000 7faf327f6700 1 -- 172.21.15.153:0/1151695042 wait complete. 2023-11-24T08:05:58.239 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:05:58.248 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:05:58.389 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2023-11-24T08:05:58.389 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-11-24T08:05:58.390 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol7276 2023-11-24T08:05:58.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.512+0000 7fad7d6e5700 1 Processor -- start 2023-11-24T08:05:58.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.512+0000 7fad7d6e5700 1 -- start start 2023-11-24T08:05:58.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.512+0000 7fad7d6e5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fad78071610 0x7fad78071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.512+0000 7fad7d6e5700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fad780b6fb0 0x7fad780b7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad7d6e5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad780d2a60 con 0x7fad7815e090 2023-11-24T08:05:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad7d6e5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad78072000 con 0x7fad78071610 2023-11-24T08:05:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad7d6e5700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad780d2d40 con 0x7fad780b6fb0 2023-11-24T08:05:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad767fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fad78071610 0x7fad78071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad76ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fad7815e090 0x7fad780d1fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44838/0 (socket says 172.21.15.153:44838) 2023-11-24T08:05:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad76ffd700 1 -- 172.21.15.153:0/3734649217 learned_addr learned my addr 172.21.15.153:0/3734649217 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad777fe700 1 --2- 172.21.15.153:0/3734649217 >> v2:172.21.15.164:3300/0 conn(0x7fad780b6fb0 0x7fad780b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad767fc700 1 -- 172.21.15.153:0/3734649217 >> v2:172.21.15.164:3300/0 conn(0x7fad780b6fb0 msgr2=0x7fad780b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad767fc700 1 --2- 172.21.15.153:0/3734649217 >> v2:172.21.15.164:3300/0 conn(0x7fad780b6fb0 0x7fad780b7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad767fc700 1 -- 172.21.15.153:0/3734649217 >> v1:172.21.15.153:6789/0 conn(0x7fad7815e090 legacy=0x7fad780d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad767fc700 1 -- 172.21.15.153:0/3734649217 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780d3020 con 0x7fad78071610 2023-11-24T08:05:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad75ffb700 1 -- 172.21.15.153:0/3734649217 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962872338 0 0) 0x7fad780d2a60 con 0x7fad7815e090 2023-11-24T08:05:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad767fc700 1 --2- 172.21.15.153:0/3734649217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad78071610 0x7fad78071ac0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad780d0020 tx=0x7fad6c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503ca6783ab8df96 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad75ffb700 1 -- 172.21.15.153:0/3734649217 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c011830 con 0x7fad78071610 2023-11-24T08:05:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad75ffb700 1 -- 172.21.15.153:0/3734649217 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c011990 con 0x7fad78071610 2023-11-24T08:05:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.513+0000 7fad75ffb700 1 -- 172.21.15.153:0/3734649217 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c011d20 con 0x7fad78071610 2023-11-24T08:05:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.514+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3734649217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad78071610 msgr2=0x7fad78071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.514+0000 7fad7d6e5700 1 --2- 172.21.15.153:0/3734649217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad78071610 0x7fad78071ac0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad780d0020 tx=0x7fad6c009b20 comp rx=0 tx=0).stop 2023-11-24T08:05:58.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.514+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3734649217 shutdown_connections 2023-11-24T08:05:58.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.514+0000 7fad7d6e5700 1 --2- 172.21.15.153:0/3734649217 >> v2:172.21.15.164:3300/0 conn(0x7fad780b6fb0 0x7fad780b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.514+0000 7fad7d6e5700 1 --2- 172.21.15.153:0/3734649217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad78071610 0x7fad78071ac0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.514+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3734649217 >> 172.21.15.153:0/3734649217 conn(0x7fad7806b410 msgr2=0x7fad7806b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:58.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.514+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3734649217 shutdown_connections 2023-11-24T08:05:58.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.514+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3734649217 wait complete. 2023-11-24T08:05:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.515+0000 7fad7d6e5700 1 Processor -- start 2023-11-24T08:05:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.515+0000 7fad7d6e5700 1 -- start start 2023-11-24T08:05:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad7d6e5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad78071610 0x7fad781f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad7d6e5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad780b6fb0 0x7fad780c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad7d6e5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fad7815e090 0x7fad780c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad7d6e5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad780ccdf0 con 0x7fad780b6fb0 2023-11-24T08:05:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad7d6e5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad780c9280 con 0x7fad78071610 2023-11-24T08:05:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad7d6e5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad780cb060 con 0x7fad7815e090 2023-11-24T08:05:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad767fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad780b6fb0 0x7fad780c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad767fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad780b6fb0 0x7fad780c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38742/0 (socket says 172.21.15.153:38742) 2023-11-24T08:05:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad767fc700 1 -- 172.21.15.153:0/3500178438 learned_addr learned my addr 172.21.15.153:0/3500178438 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad767fc700 1 -- 172.21.15.153:0/3500178438 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fad7815e090 msgr2=0x7fad780c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad767fc700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fad7815e090 0x7fad780c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad76ffd700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad78071610 0x7fad781f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad767fc700 1 -- 172.21.15.153:0/3500178438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad78071610 msgr2=0x7fad781f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad767fc700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad78071610 0x7fad781f3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.516+0000 7fad767fc700 1 -- 172.21.15.153:0/3500178438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0094a0 con 0x7fad780b6fb0 2023-11-24T08:05:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.517+0000 7fad767fc700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad780b6fb0 0x7fad780c8830 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fad6c000c00 tx=0x7fad6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.517+0000 7fad5f7fe700 1 -- 172.21.15.153:0/3500178438 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0038a0 con 0x7fad780b6fb0 2023-11-24T08:05:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.517+0000 7fad5f7fe700 1 -- 172.21.15.153:0/3500178438 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c01f070 con 0x7fad780b6fb0 2023-11-24T08:05:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.517+0000 7fad5f7fe700 1 -- 172.21.15.153:0/3500178438 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c003c40 con 0x7fad780b6fb0 2023-11-24T08:05:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.517+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3500178438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad780cb340 con 0x7fad780b6fb0 2023-11-24T08:05:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.517+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3500178438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad781f36a0 con 0x7fad780b6fb0 2023-11-24T08:05:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.518+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3500178438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad78068fb0 con 0x7fad780b6fb0 2023-11-24T08:05:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.518+0000 7fad5f7fe700 1 -- 172.21.15.153:0/3500178438 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fad6c026480 con 0x7fad780b6fb0 2023-11-24T08:05:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.518+0000 7fad5f7fe700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fad6406b080 0x7fad6406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.519+0000 7fad5f7fe700 1 -- 172.21.15.153:0/3500178438 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad6c021070 con 0x7fad780b6fb0 2023-11-24T08:05:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.519+0000 7fad76ffd700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fad6406b080 0x7fad6406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.519+0000 7fad76ffd700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fad6406b080 0x7fad6406d540 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fad68000f60 tx=0x7fad68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:58.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.523+0000 7fad5f7fe700 1 -- 172.21.15.153:0/3500178438 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad6c0562c0 con 0x7fad780b6fb0 2023-11-24T08:05:58.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.745+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3500178438 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol7276", "target": ["mon-mgr", ""]}) v1 -- 0x7fad781616b0 con 0x7fad6406b080 2023-11-24T08:05:58.752 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:58.750+0000 7f67d8edc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:58.752 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:58.750+0000 7f67d8edc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:58.752 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:58.750+0000 7f67d8edc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:58.752 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:58.750+0000 7f67d8edc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:58.752 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-11-24T08:05:58.750+0000 7f67d8edc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:58.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.779+0000 7fad5f7fe700 1 -- 172.21.15.153:0/3500178438 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fad781616b0 con 0x7fad6406b080 2023-11-24T08:05:58.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3500178438 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fad6406b080 msgr2=0x7fad6406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fad6406b080 0x7fad6406d540 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fad68000f60 tx=0x7fad68009040 comp rx=0 tx=0).stop 2023-11-24T08:05:58.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3500178438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad780b6fb0 msgr2=0x7fad780c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad780b6fb0 0x7fad780c8830 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fad6c000c00 tx=0x7fad6c004750 comp rx=0 tx=0).stop 2023-11-24T08:05:58.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3500178438 shutdown_connections 2023-11-24T08:05:58.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fad7815e090 0x7fad780c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad78071610 0x7fad781f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fad6406b080 0x7fad6406d540 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 --2- 172.21.15.153:0/3500178438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad780b6fb0 0x7fad780c8830 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3500178438 >> 172.21.15.153:0/3500178438 conn(0x7fad7806b410 msgr2=0x7fad7815d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:58.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3500178438 shutdown_connections 2023-11-24T08:05:58.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.782+0000 7fad7d6e5700 1 -- 172.21.15.153:0/3500178438 wait complete. 2023-11-24T08:05:58.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:58.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.914+0000 7f1e866fa700 1 Processor -- start 2023-11-24T08:05:58.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.914+0000 7f1e866fa700 1 -- start start 2023-11-24T08:05:58.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.915+0000 7f1e866fa700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1e8015e080 0x7f1e800b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.915+0000 7f1e866fa700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e800af4d0 0x7f1e800afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.915+0000 7f1e866fa700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e800ae430 con 0x7f1e8006c000 2023-11-24T08:05:58.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.915+0000 7f1e866fa700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e800af0b0 con 0x7f1e800af4d0 2023-11-24T08:05:58.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.915+0000 7f1e866fa700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e800b05a0 con 0x7f1e8015e080 2023-11-24T08:05:58.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.915+0000 7f1e7f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e800af4d0 0x7f1e800afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.915+0000 7f1e84c97700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1e8006c000 0x7f1e80073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44872/0 (socket says 172.21.15.153:44872) 2023-11-24T08:05:58.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e84c97700 1 -- 172.21.15.153:0/2581461162 learned_addr learned my addr 172.21.15.153:0/2581461162 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:05:58.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e7ffff700 1 --2- 172.21.15.153:0/2581461162 >> v2:172.21.15.164:3300/0 conn(0x7f1e8015e080 0x7f1e800b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e7f7fe700 1 -- 172.21.15.153:0/2581461162 >> v2:172.21.15.164:3300/0 conn(0x7f1e8015e080 msgr2=0x7f1e800b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:58.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e7f7fe700 1 --2- 172.21.15.153:0/2581461162 >> v2:172.21.15.164:3300/0 conn(0x7f1e8015e080 0x7f1e800b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e7f7fe700 1 -- 172.21.15.153:0/2581461162 >> v1:172.21.15.153:6789/0 conn(0x7f1e8006c000 legacy=0x7f1e80073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e7f7fe700 1 -- 172.21.15.153:0/2581461162 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800ae710 con 0x7f1e800af4d0 2023-11-24T08:05:58.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e7effd700 1 -- 172.21.15.153:0/2581461162 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019149622 0 0) 0x7f1e800ae430 con 0x7f1e8006c000 2023-11-24T08:05:58.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e7ffff700 1 --2- 172.21.15.153:0/2581461162 >> v2:172.21.15.164:3300/0 conn(0x7f1e8015e080 0x7f1e800b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:58.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e7f7fe700 1 --2- 172.21.15.153:0/2581461162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e800af4d0 0x7f1e800afb90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1e80072a90 tx=0x7f1e74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b767b3fd95178918 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:58.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e7effd700 1 -- 172.21.15.153:0/2581461162 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74011830 con 0x7f1e800af4d0 2023-11-24T08:05:58.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e7effd700 1 -- 172.21.15.153:0/2581461162 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74011990 con 0x7f1e800af4d0 2023-11-24T08:05:58.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.916+0000 7f1e7effd700 1 -- 172.21.15.153:0/2581461162 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74011d20 con 0x7f1e800af4d0 2023-11-24T08:05:58.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.917+0000 7f1e866fa700 1 -- 172.21.15.153:0/2581461162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e800af4d0 msgr2=0x7f1e800afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.917+0000 7f1e866fa700 1 --2- 172.21.15.153:0/2581461162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e800af4d0 0x7f1e800afb90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1e80072a90 tx=0x7f1e74009b50 comp rx=0 tx=0).stop 2023-11-24T08:05:58.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.917+0000 7f1e866fa700 1 -- 172.21.15.153:0/2581461162 shutdown_connections 2023-11-24T08:05:58.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.917+0000 7f1e866fa700 1 --2- 172.21.15.153:0/2581461162 >> v2:172.21.15.164:3300/0 conn(0x7f1e8015e080 0x7f1e800b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.917+0000 7f1e866fa700 1 --2- 172.21.15.153:0/2581461162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e800af4d0 0x7f1e800afb90 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.917+0000 7f1e866fa700 1 -- 172.21.15.153:0/2581461162 >> 172.21.15.153:0/2581461162 conn(0x7f1e80071b90 msgr2=0x7f1e80071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:58.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.917+0000 7f1e866fa700 1 -- 172.21.15.153:0/2581461162 shutdown_connections 2023-11-24T08:05:58.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.917+0000 7f1e866fa700 1 -- 172.21.15.153:0/2581461162 wait complete. 2023-11-24T08:05:58.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.918+0000 7f1e866fa700 1 Processor -- start 2023-11-24T08:05:58.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.918+0000 7f1e866fa700 1 -- start start 2023-11-24T08:05:58.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e866fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8006c000 0x7f1e801497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e866fa700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e800af4d0 0x7f1e800c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e866fa700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8015e080 0x7f1e800c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e866fa700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80159c50 con 0x7f1e8006c000 2023-11-24T08:05:58.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e866fa700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80159f30 con 0x7f1e8015e080 2023-11-24T08:05:58.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e866fa700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8015f4f0 con 0x7f1e800af4d0 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8006c000 0x7f1e801497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8006c000 0x7f1e801497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38770/0 (socket says 172.21.15.153:38770) 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e7ffff700 1 -- 172.21.15.153:0/1530930426 learned_addr learned my addr 172.21.15.153:0/1530930426 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e84c97700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8015e080 0x7f1e800c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e7ffff700 1 -- 172.21.15.153:0/1530930426 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e800af4d0 msgr2=0x7f1e800c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e7ffff700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e800af4d0 0x7f1e800c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e7ffff700 1 -- 172.21.15.153:0/1530930426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8015e080 msgr2=0x7f1e800c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e7ffff700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8015e080 0x7f1e800c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e7ffff700 1 -- 172.21.15.153:0/1530930426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e740094a0 con 0x7f1e8006c000 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e7ffff700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8006c000 0x7f1e801497c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000e810 tx=0x7f1e7000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e7cff9700 1 -- 172.21.15.153:0/1530930426 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7000c020 con 0x7f1e8006c000 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.919+0000 7f1e7cff9700 1 -- 172.21.15.153:0/1530930426 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e70004250 con 0x7f1e8006c000 2023-11-24T08:05:58.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.920+0000 7f1e866fa700 1 -- 172.21.15.153:0/1530930426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8015f7d0 con 0x7f1e8006c000 2023-11-24T08:05:58.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.920+0000 7f1e7cff9700 1 -- 172.21.15.153:0/1530930426 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e700036a0 con 0x7f1e8006c000 2023-11-24T08:05:58.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.920+0000 7f1e866fa700 1 -- 172.21.15.153:0/1530930426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e80149d00 con 0x7f1e8006c000 2023-11-24T08:05:58.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.920+0000 7f1e866fa700 1 -- 172.21.15.153:0/1530930426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e800753f0 con 0x7f1e8006c000 2023-11-24T08:05:58.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.921+0000 7f1e7cff9700 1 -- 172.21.15.153:0/1530930426 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1e70003800 con 0x7f1e8006c000 2023-11-24T08:05:58.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.921+0000 7f1e7cff9700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e6c06b080 0x7f1e6c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:58.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.922+0000 7f1e7f7fe700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e6c06b080 0x7f1e6c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:58.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.922+0000 7f1e7cff9700 1 -- 172.21.15.153:0/1530930426 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e700894f0 con 0x7f1e8006c000 2023-11-24T08:05:58.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.922+0000 7f1e7f7fe700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e6c06b080 0x7f1e6c06d540 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1e80072a90 tx=0x7f1e74010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:58.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:58.926+0000 7f1e7cff9700 1 -- 172.21.15.153:0/1530930426 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e70054210 con 0x7f1e8006c000 2023-11-24T08:05:59.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.160+0000 7f1e866fa700 1 -- 172.21.15.153:0/1530930426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e800d09b0 con 0x7f1e8006c000 2023-11-24T08:05:59.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.160+0000 7f1e7cff9700 1 -- 172.21.15.153:0/1530930426 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f1e70057830 con 0x7f1e8006c000 2023-11-24T08:05:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:59.163 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:59.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.162+0000 7f1e866fa700 1 -- 172.21.15.153:0/1530930426 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e6c06b080 msgr2=0x7f1e6c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:59.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.162+0000 7f1e866fa700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e6c06b080 0x7f1e6c06d540 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1e80072a90 tx=0x7f1e74010000 comp rx=0 tx=0).stop 2023-11-24T08:05:59.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.162+0000 7f1e866fa700 1 -- 172.21.15.153:0/1530930426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8006c000 msgr2=0x7f1e801497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:59.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.162+0000 7f1e866fa700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8006c000 0x7f1e801497c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000e810 tx=0x7f1e7000ebd0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.163+0000 7f1e866fa700 1 -- 172.21.15.153:0/1530930426 shutdown_connections 2023-11-24T08:05:59.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.163+0000 7f1e866fa700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8015e080 0x7f1e800c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.163+0000 7f1e866fa700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e6c06b080 0x7f1e6c06d540 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.163+0000 7f1e866fa700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8006c000 0x7f1e801497c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.163+0000 7f1e866fa700 1 --2- 172.21.15.153:0/1530930426 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e800af4d0 0x7f1e800c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.163+0000 7f1e866fa700 1 -- 172.21.15.153:0/1530930426 >> 172.21.15.153:0/1530930426 conn(0x7f1e80071b90 msgr2=0x7f1e800b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:59.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.163+0000 7f1e866fa700 1 -- 172.21.15.153:0/1530930426 shutdown_connections 2023-11-24T08:05:59.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.163+0000 7f1e866fa700 1 -- 172.21.15.153:0/1530930426 wait complete. 2023-11-24T08:05:59.167 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:05:59.177 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:05:59.320 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.55599032900000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.972301290968389,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:05:59.320 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.97230129096839 }, "state": "open", "uptime": 0.555990329 } ] 2023-11-24T08:05:59.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:59.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.440+0000 7f4744528700 1 Processor -- start 2023-11-24T08:05:59.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.440+0000 7f4744528700 1 -- start start 2023-11-24T08:05:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.441+0000 7f4744528700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c15e080 0x7f473c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.441+0000 7f4744528700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f473c0af4d0 0x7f473c0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.441+0000 7f4744528700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f473c06c000 0x7f473c06c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.441+0000 7f4744528700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c0af0b0 con 0x7f473c06c000 2023-11-24T08:05:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.441+0000 7f4744528700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c06c9f0 con 0x7f473c0af4d0 2023-11-24T08:05:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.441+0000 7f4744528700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0b05a0 con 0x7f473c15e080 2023-11-24T08:05:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.441+0000 7f4742ac5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f473c06c000 0x7f473c06c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.441+0000 7f4742ac5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f473c06c000 0x7f473c06c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38782/0 (socket says 172.21.15.153:38782) 2023-11-24T08:05:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.441+0000 7f4742ac5700 1 -- 172.21.15.153:0/747403971 learned_addr learned my addr 172.21.15.153:0/747403971 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f47422c4700 1 --2- 172.21.15.153:0/747403971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c15e080 0x7f473c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f4741ac3700 1 --2- 172.21.15.153:0/747403971 >> v2:172.21.15.164:3300/0 conn(0x7f473c0af4d0 0x7f473c0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:59.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f4742ac5700 1 -- 172.21.15.153:0/747403971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c15e080 msgr2=0x7f473c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:59.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f4742ac5700 1 --2- 172.21.15.153:0/747403971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c15e080 0x7f473c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f4742ac5700 1 -- 172.21.15.153:0/747403971 >> v2:172.21.15.164:3300/0 conn(0x7f473c0af4d0 msgr2=0x7f473c0afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:59.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f4742ac5700 1 --2- 172.21.15.153:0/747403971 >> v2:172.21.15.164:3300/0 conn(0x7f473c0af4d0 0x7f473c0afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f4742ac5700 1 -- 172.21.15.153:0/747403971 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c0ae430 con 0x7f473c06c000 2023-11-24T08:05:59.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f4742ac5700 1 --2- 172.21.15.153:0/747403971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c06c000 0x7f473c06c4b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f473c06d380 tx=0x7f473400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cf38856fd35d7b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:59.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f47412c2700 1 -- 172.21.15.153:0/747403971 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473400e070 con 0x7f473c06c000 2023-11-24T08:05:59.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f47412c2700 1 -- 172.21.15.153:0/747403971 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473400b980 con 0x7f473c06c000 2023-11-24T08:05:59.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f47412c2700 1 -- 172.21.15.153:0/747403971 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473400bd30 con 0x7f473c06c000 2023-11-24T08:05:59.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.442+0000 7f4744528700 1 -- 172.21.15.153:0/747403971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c06c000 msgr2=0x7f473c06c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:59.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.443+0000 7f4744528700 1 --2- 172.21.15.153:0/747403971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c06c000 0x7f473c06c4b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f473c06d380 tx=0x7f473400b330 comp rx=0 tx=0).stop 2023-11-24T08:05:59.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.443+0000 7f4744528700 1 -- 172.21.15.153:0/747403971 shutdown_connections 2023-11-24T08:05:59.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.443+0000 7f4744528700 1 --2- 172.21.15.153:0/747403971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c06c000 0x7f473c06c4b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.443+0000 7f4744528700 1 --2- 172.21.15.153:0/747403971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c15e080 0x7f473c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.443+0000 7f4744528700 1 --2- 172.21.15.153:0/747403971 >> v2:172.21.15.164:3300/0 conn(0x7f473c0af4d0 0x7f473c0afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.443+0000 7f4744528700 1 -- 172.21.15.153:0/747403971 >> 172.21.15.153:0/747403971 conn(0x7f473c071b90 msgr2=0x7f473c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:59.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.443+0000 7f4744528700 1 -- 172.21.15.153:0/747403971 shutdown_connections 2023-11-24T08:05:59.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.443+0000 7f4744528700 1 -- 172.21.15.153:0/747403971 wait complete. 2023-11-24T08:05:59.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.444+0000 7f4744528700 1 Processor -- start 2023-11-24T08:05:59.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.444+0000 7f4744528700 1 -- start start 2023-11-24T08:05:59.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.444+0000 7f4744528700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c06c000 0x7f473c074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:59.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4744528700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c0af4d0 0x7f473c1f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:59.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4744528700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c15e080 0x7f473c1f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:59.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4744528700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c1f7930 con 0x7f473c06c000 2023-11-24T08:05:59.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4744528700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c1f7c10 con 0x7f473c0af4d0 2023-11-24T08:05:59.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4744528700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c158810 con 0x7f473c15e080 2023-11-24T08:05:59.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f47422c4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c06c000 0x7f473c074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:59.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f47422c4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c06c000 0x7f473c074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38784/0 (socket says 172.21.15.153:38784) 2023-11-24T08:05:59.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f47422c4700 1 -- 172.21.15.153:0/4258937769 learned_addr learned my addr 172.21.15.153:0/4258937769 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:05:59.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4741ac3700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c0af4d0 0x7f473c1f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:59.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4742ac5700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c15e080 0x7f473c1f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:59.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f47422c4700 1 -- 172.21.15.153:0/4258937769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c15e080 msgr2=0x7f473c1f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:59.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f47422c4700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c15e080 0x7f473c1f6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f47422c4700 1 -- 172.21.15.153:0/4258937769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c0af4d0 msgr2=0x7f473c1f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:59.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f47422c4700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c0af4d0 0x7f473c1f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f47422c4700 1 -- 172.21.15.153:0/4258937769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4734009b30 con 0x7f473c06c000 2023-11-24T08:05:59.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4741ac3700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c0af4d0 0x7f473c1f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f47422c4700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c06c000 0x7f473c074200 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f472c00d800 tx=0x7f472c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4732ffd700 1 -- 172.21.15.153:0/4258937769 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c0125f0 con 0x7f473c06c000 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4732ffd700 1 -- 172.21.15.153:0/4258937769 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c012750 con 0x7f473c06c000 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4744528700 1 -- 172.21.15.153:0/4258937769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c158af0 con 0x7f473c06c000 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4732ffd700 1 -- 172.21.15.153:0/4258937769 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c012b00 con 0x7f473c06c000 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.445+0000 7f4744528700 1 -- 172.21.15.153:0/4258937769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c074920 con 0x7f473c06c000 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.446+0000 7f4744528700 1 -- 172.21.15.153:0/4258937769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473c0753f0 con 0x7f473c06c000 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.447+0000 7f4732ffd700 1 -- 172.21.15.153:0/4258937769 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f472c012c60 con 0x7f473c06c000 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.447+0000 7f4732ffd700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f472006b080 0x7f472006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.447+0000 7f4732ffd700 1 -- 172.21.15.153:0/4258937769 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f472c0898a0 con 0x7f473c06c000 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.447+0000 7f4741ac3700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f472006b080 0x7f472006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.447+0000 7f4741ac3700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f472006b080 0x7f472006d540 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f473c0ccb00 tx=0x7f4738008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:59.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.451+0000 7f4732ffd700 1 -- 172.21.15.153:0/4258937769 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f472c0546d0 con 0x7f473c06c000 2023-11-24T08:05:59.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.685+0000 7f4744528700 1 -- 172.21.15.153:0/4258937769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f473c074920 con 0x7f473c06c000 2023-11-24T08:05:59.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.685+0000 7f4732ffd700 1 -- 172.21.15.153:0/4258937769 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f473c074920 con 0x7f473c06c000 2023-11-24T08:05:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:05:59.687 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:59.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 -- 172.21.15.153:0/4258937769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f472006b080 msgr2=0x7f472006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:59.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f472006b080 0x7f472006d540 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f473c0ccb00 tx=0x7f4738008040 comp rx=0 tx=0).stop 2023-11-24T08:05:59.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 -- 172.21.15.153:0/4258937769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c06c000 msgr2=0x7f473c074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:59.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c06c000 0x7f473c074200 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f472c00d800 tx=0x7f472c00db10 comp rx=0 tx=0).stop 2023-11-24T08:05:59.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 -- 172.21.15.153:0/4258937769 shutdown_connections 2023-11-24T08:05:59.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c15e080 0x7f473c1f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f472006b080 0x7f472006d540 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c06c000 0x7f473c074200 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 --2- 172.21.15.153:0/4258937769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c0af4d0 0x7f473c1f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:59.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 -- 172.21.15.153:0/4258937769 >> 172.21.15.153:0/4258937769 conn(0x7f473c071b90 msgr2=0x7f473c15d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:59.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 -- 172.21.15.153:0/4258937769 shutdown_connections 2023-11-24T08:05:59.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:05:59.687+0000 7f4744528700 1 -- 172.21.15.153:0/4258937769 wait complete. 2023-11-24T08:05:59.691 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:05:59.701 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:05:59.842 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":1.077981249,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.945817458301001,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:05:59.843 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.945817458301 }, "state": "open", "uptime": 1.077981249 } ] 2023-11-24T08:05:59.844 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:04.845 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:04.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.978+0000 7fd625eb8700 1 Processor -- start 2023-11-24T08:06:04.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.978+0000 7fd625eb8700 1 -- start start 2023-11-24T08:06:04.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd625eb8700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd6200d0d00 0x7fd6200b7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:04.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd625eb8700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6200d1170 con 0x7fd6200d0870 2023-11-24T08:06:04.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd625eb8700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6200d20b0 con 0x7fd62015e1e0 2023-11-24T08:06:04.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd625eb8700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6200d3150 con 0x7fd6200d0d00 2023-11-24T08:06:04.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61effd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd6200d0870 0x7fd6200b6ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44898/0 (socket says 172.21.15.153:44898) 2023-11-24T08:06:04.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61effd700 1 -- 172.21.15.153:0/2984782559 learned_addr learned my addr 172.21.15.153:0/2984782559 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:06:04.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61ffff700 1 --2- 172.21.15.153:0/2984782559 >> v2:172.21.15.164:3300/0 conn(0x7fd6200d0d00 0x7fd6200b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:04.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441828545 0 0) 0x7fd6200d1170 con 0x7fd6200d0870 2023-11-24T08:06:04.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6080035b0 con 0x7fd6200d0870 2023-11-24T08:06:04.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1200844466 0 0) 0x7fd6080035b0 con 0x7fd6200d0870 2023-11-24T08:06:04.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 >> v2:172.21.15.164:3300/0 conn(0x7fd6200d0d00 msgr2=0x7fd6200b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:04.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 --2- 172.21.15.153:0/2984782559 >> v2:172.21.15.164:3300/0 conn(0x7fd6200d0d00 0x7fd6200b7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 >> v1:172.21.15.164:6789/0 conn(0x7fd62015e1e0 legacy=0x7fd6200d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6200d2390 con 0x7fd6200d0870 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fd614001670 con 0x7fd6200d0870 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 >> v1:172.21.15.153:6789/0 conn(0x7fd6200d0870 legacy=0x7fd6200b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd608003a00 0x7fd608003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd608004850 0x7fd608004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd608005210 0x7fd60800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200d3150 con 0x7fd608004850 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60800c0c0 con 0x7fd608005210 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.980+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60800c280 con 0x7fd608003a00 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61effd700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd608004850 0x7fd608004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61f7fe700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd608003a00 0x7fd608003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61ffff700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd608005210 0x7fd60800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61effd700 1 -- 172.21.15.153:0/2984782559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd608003a00 msgr2=0x7fd608003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61effd700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd608003a00 0x7fd608003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61effd700 1 -- 172.21.15.153:0/2984782559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd608005210 msgr2=0x7fd60800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61effd700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd608005210 0x7fd60800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61effd700 1 -- 172.21.15.153:0/2984782559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080035b0 con 0x7fd608004850 2023-11-24T08:06:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61ffff700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd608005210 0x7fd60800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61ffff700 1 -- 172.21.15.153:0/2984782559 reap_dead start 2023-11-24T08:06:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61effd700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd608004850 0x7fd608004cd0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd61400c240 tx=0x7fd608005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216d8bdcb83ce8d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614007c10 con 0x7fd608004850 2023-11-24T08:06:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61400cde0 con 0x7fd608004850 2023-11-24T08:06:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.981+0000 7fd61e7fc700 1 -- 172.21.15.153:0/2984782559 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614005ba0 con 0x7fd608004850 2023-11-24T08:06:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.982+0000 7fd625eb8700 1 -- 172.21.15.153:0/2984782559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd608004850 msgr2=0x7fd608004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.982+0000 7fd625eb8700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd608004850 0x7fd608004cd0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd61400c240 tx=0x7fd608005880 comp rx=0 tx=0).stop 2023-11-24T08:06:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.982+0000 7fd625eb8700 1 -- 172.21.15.153:0/2984782559 shutdown_connections 2023-11-24T08:06:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.982+0000 7fd625eb8700 1 --2- 172.21.15.153:0/2984782559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd608004850 0x7fd608004cd0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.982+0000 7fd625eb8700 1 -- 172.21.15.153:0/2984782559 >> 172.21.15.153:0/2984782559 conn(0x7fd6200b5b50 msgr2=0x7fd6200b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.982+0000 7fd625eb8700 1 -- 172.21.15.153:0/2984782559 shutdown_connections 2023-11-24T08:06:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.982+0000 7fd625eb8700 1 -- 172.21.15.153:0/2984782559 wait complete. 2023-11-24T08:06:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.983+0000 7fd625eb8700 1 Processor -- start 2023-11-24T08:06:04.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.983+0000 7fd625eb8700 1 -- start start 2023-11-24T08:06:04.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd625eb8700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd608004850 0x7fd62015f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:04.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd625eb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd620160e10 0x7fd6200c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:04.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd625eb8700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6200c7ed0 0x7fd6200ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:04.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd625eb8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200c8350 con 0x7fd620160e10 2023-11-24T08:06:04.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd625eb8700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd620160980 con 0x7fd6200c7ed0 2023-11-24T08:06:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd625eb8700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6201f3d60 con 0x7fd608004850 2023-11-24T08:06:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd620160e10 0x7fd6200c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd620160e10 0x7fd6200c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38804/0 (socket says 172.21.15.153:38804) 2023-11-24T08:06:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61effd700 1 -- 172.21.15.153:0/1854679053 learned_addr learned my addr 172.21.15.153:0/1854679053 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61f7fe700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd608004850 0x7fd62015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61ffff700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6200c7ed0 0x7fd6200ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61effd700 1 -- 172.21.15.153:0/1854679053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd608004850 msgr2=0x7fd62015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61effd700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd608004850 0x7fd62015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61effd700 1 -- 172.21.15.153:0/1854679053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6200c7ed0 msgr2=0x7fd6200ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61effd700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6200c7ed0 0x7fd6200ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61effd700 1 -- 172.21.15.153:0/1854679053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62015fd70 con 0x7fd620160e10 2023-11-24T08:06:04.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61f7fe700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd608004850 0x7fd62015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:04.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd61effd700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd620160e10 0x7fd6200c7990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd60800c090 tx=0x7fd614001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:04.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.984+0000 7fd607fff700 1 -- 172.21.15.153:0/1854679053 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614001640 con 0x7fd620160e10 2023-11-24T08:06:04.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.985+0000 7fd607fff700 1 -- 172.21.15.153:0/1854679053 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6140070d0 con 0x7fd620160e10 2023-11-24T08:06:04.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.985+0000 7fd625eb8700 1 -- 172.21.15.153:0/1854679053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd620160050 con 0x7fd620160e10 2023-11-24T08:06:04.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.985+0000 7fd607fff700 1 -- 172.21.15.153:0/1854679053 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614007440 con 0x7fd620160e10 2023-11-24T08:06:04.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.985+0000 7fd625eb8700 1 -- 172.21.15.153:0/1854679053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd620160610 con 0x7fd620160e10 2023-11-24T08:06:04.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.985+0000 7fd625eb8700 1 -- 172.21.15.153:0/1854679053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6201607d0 con 0x7fd620160e10 2023-11-24T08:06:04.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.986+0000 7fd607fff700 1 -- 172.21.15.153:0/1854679053 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fd6140075a0 con 0x7fd620160e10 2023-11-24T08:06:04.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.986+0000 7fd607fff700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd60c06b140 0x7fd60c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:04.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.986+0000 7fd607fff700 1 -- 172.21.15.153:0/1854679053 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd61408aef0 con 0x7fd620160e10 2023-11-24T08:06:04.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.986+0000 7fd61f7fe700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd60c06b140 0x7fd60c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:04.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.987+0000 7fd61f7fe700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd60c06b140 0x7fd60c06d600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd610003bc0 tx=0x7fd610009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:04.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:04.991+0000 7fd607fff700 1 -- 172.21.15.153:0/1854679053 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd614055db0 con 0x7fd620160e10 2023-11-24T08:06:05.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.227+0000 7fd625eb8700 1 -- 172.21.15.153:0/1854679053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6200d2930 con 0x7fd620160e10 2023-11-24T08:06:05.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.228+0000 7fd607fff700 1 -- 172.21.15.153:0/1854679053 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fd6200d2930 con 0x7fd620160e10 2023-11-24T08:06:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:06:05.230 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:05.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 -- 172.21.15.153:0/1854679053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd60c06b140 msgr2=0x7fd60c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:05.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd60c06b140 0x7fd60c06d600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd610003bc0 tx=0x7fd610009040 comp rx=0 tx=0).stop 2023-11-24T08:06:05.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 -- 172.21.15.153:0/1854679053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd620160e10 msgr2=0x7fd6200c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:05.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd620160e10 0x7fd6200c7990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd60800c090 tx=0x7fd614001a00 comp rx=0 tx=0).stop 2023-11-24T08:06:05.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 -- 172.21.15.153:0/1854679053 shutdown_connections 2023-11-24T08:06:05.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6200c7ed0 0x7fd6200ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:05.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd608004850 0x7fd62015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:05.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd60c06b140 0x7fd60c06d600 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:05.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 --2- 172.21.15.153:0/1854679053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd620160e10 0x7fd6200c7990 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:05.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 -- 172.21.15.153:0/1854679053 >> 172.21.15.153:0/1854679053 conn(0x7fd6200b5b50 msgr2=0x7fd6200b8410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:05.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 -- 172.21.15.153:0/1854679053 shutdown_connections 2023-11-24T08:06:05.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:05.230+0000 7fd625eb8700 1 -- 172.21.15.153:0/1854679053 wait complete. 2023-11-24T08:06:05.234 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:06:05.244 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:06:05.385 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":6.6208848329999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.666553239847012,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:06:05.386 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.666553239847012 }, "state": "open", "uptime": 6.620884833 } ] 2023-11-24T08:06:05.387 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:10.388 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:10.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.521+0000 7f05453e9700 1 Processor -- start 2023-11-24T08:06:10.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.521+0000 7f05453e9700 1 -- start start 2023-11-24T08:06:10.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.522+0000 7f05453e9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f054015bd30 0x7f05400cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:10.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.522+0000 7f05453e9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0540161bf0 con 0x7f054015edf0 2023-11-24T08:06:10.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.522+0000 7f05453e9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054015f450 con 0x7f0540162920 2023-11-24T08:06:10.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.522+0000 7f05453e9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0540161e40 con 0x7f054015bd30 2023-11-24T08:06:10.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.522+0000 7f053f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f054015edf0 0x7f05400afc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44920/0 (socket says 172.21.15.153:44920) 2023-11-24T08:06:10.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.522+0000 7f053f7fe700 1 -- 172.21.15.153:0/2340322670 learned_addr learned my addr 172.21.15.153:0/2340322670 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.522+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111662534 0 0) 0x7f0540161bf0 con 0x7f054015edf0 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.522+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05280035b0 con 0x7f054015edf0 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.522+0000 7f053effd700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f054015bd30 0x7f05400cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1011997773 0 0) 0x7f05280035b0 con 0x7f054015edf0 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f054015bd30 msgr2=0x7f05400cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f054015bd30 0x7f05400cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 >> v1:172.21.15.164:6789/0 conn(0x7f0540162920 legacy=0x7f054015e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540162120 con 0x7f054015edf0 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f05380019f0 con 0x7f054015edf0 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053effd700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f054015bd30 0x7f05400cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 >> v1:172.21.15.153:6789/0 conn(0x7f054015edf0 legacy=0x7f05400afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:10.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f054015bd30 0x7f0528003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 0x7f0528004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0528004d90 0x7f0528005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540161e40 con 0x7f0528004020 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052800bb70 con 0x7f0528004d90 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052800bd30 con 0x7f054015bd30 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053e7fc700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 0x7f0528004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053effd700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f054015bd30 0x7f0528003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053f7fe700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0528004d90 0x7f0528005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053e7fc700 1 -- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f054015bd30 msgr2=0x7f0528003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053e7fc700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f054015bd30 0x7f0528003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053e7fc700 1 -- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0528004d90 msgr2=0x7f0528005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053e7fc700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0528004d90 0x7f0528005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:10.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053e7fc700 1 -- 172.21.15.153:0/2340322670 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280035b0 con 0x7f0528004020 2023-11-24T08:06:10.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053f7fe700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0528004d90 0x7f0528005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:10.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053e7fc700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 0x7f0528004850 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f05300017c0 tx=0x7f0528005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bd34ee26c8c559 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:10.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300052d0 con 0x7f0528004020 2023-11-24T08:06:10.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0530005430 con 0x7f0528004020 2023-11-24T08:06:10.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.523+0000 7f053dffb700 1 -- 172.21.15.153:0/2340322670 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300038c0 con 0x7f0528004020 2023-11-24T08:06:10.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.524+0000 7f05453e9700 1 -- 172.21.15.153:0/2340322670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 msgr2=0x7f0528004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:10.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.524+0000 7f05453e9700 1 --2- 172.21.15.153:0/2340322670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 0x7f0528004850 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f05300017c0 tx=0x7f0528005880 comp rx=0 tx=0).stop 2023-11-24T08:06:10.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.524+0000 7f053f7fe700 1 -- 172.21.15.153:0/2340322670 reap_dead start 2023-11-24T08:06:10.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.524+0000 7f05453e9700 1 -- 172.21.15.153:0/2340322670 shutdown_connections 2023-11-24T08:06:10.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.524+0000 7f05453e9700 1 -- 172.21.15.153:0/2340322670 >> 172.21.15.153:0/2340322670 conn(0x7f0540072710 msgr2=0x7f0540072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:10.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.524+0000 7f05453e9700 1 -- 172.21.15.153:0/2340322670 shutdown_connections 2023-11-24T08:06:10.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.524+0000 7f05453e9700 1 -- 172.21.15.153:0/2340322670 wait complete. 2023-11-24T08:06:10.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.525+0000 7f05453e9700 1 Processor -- start 2023-11-24T08:06:10.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.525+0000 7f05453e9700 1 -- start start 2023-11-24T08:06:10.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f05453e9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 0x7f05400ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:10.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f05453e9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0540160930 0x7f054009d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f05453e9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05400ae650 0x7f05400aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f05453e9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05400af020 con 0x7f0528004020 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f05453e9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05400ae410 con 0x7f0540160930 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f05453e9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05400ad800 con 0x7f05400ae650 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f053effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 0x7f05400ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f053effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 0x7f05400ad170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38824/0 (socket says 172.21.15.153:38824) 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f053effd700 1 -- 172.21.15.153:0/2904188894 learned_addr learned my addr 172.21.15.153:0/2904188894 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f053e7fc700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0540160930 0x7f054009d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f053f7fe700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05400ae650 0x7f05400aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f053effd700 1 -- 172.21.15.153:0/2904188894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05400ae650 msgr2=0x7f05400aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.526+0000 7f053effd700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05400ae650 0x7f05400aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:10.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.527+0000 7f053effd700 1 -- 172.21.15.153:0/2904188894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0540160930 msgr2=0x7f054009d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.527+0000 7f053effd700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0540160930 0x7f054009d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.527+0000 7f053effd700 1 -- 172.21.15.153:0/2904188894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05400adae0 con 0x7f0528004020 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.527+0000 7f053effd700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 0x7f05400ad170 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f05340098b0 tx=0x7f0534009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.527+0000 7f05277fe700 1 -- 172.21.15.153:0/2904188894 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534015880 con 0x7f0528004020 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.527+0000 7f05277fe700 1 -- 172.21.15.153:0/2904188894 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05340159e0 con 0x7f0528004020 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.527+0000 7f05453e9700 1 -- 172.21.15.153:0/2904188894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05400addc0 con 0x7f0528004020 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.527+0000 7f05277fe700 1 -- 172.21.15.153:0/2904188894 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534015d70 con 0x7f0528004020 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.527+0000 7f05453e9700 1 -- 172.21.15.153:0/2904188894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054009ddd0 con 0x7f0528004020 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.528+0000 7f05453e9700 1 -- 172.21.15.153:0/2904188894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05400cdca0 con 0x7f0528004020 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.528+0000 7f05277fe700 1 -- 172.21.15.153:0/2904188894 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f053401e400 con 0x7f0528004020 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.529+0000 7f05277fe700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f052c06b110 0x7f052c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.529+0000 7f053e7fc700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f052c06b110 0x7f052c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.529+0000 7f05277fe700 1 -- 172.21.15.153:0/2904188894 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f053408a070 con 0x7f0528004020 2023-11-24T08:06:10.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.529+0000 7f053e7fc700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f052c06b110 0x7f052c06d5d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0530015040 tx=0x7f0530009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:10.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.533+0000 7f05277fe700 1 -- 172.21.15.153:0/2904188894 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0534054d80 con 0x7f0528004020 2023-11-24T08:06:10.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.767+0000 7f05453e9700 1 -- 172.21.15.153:0/2904188894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05400751e0 con 0x7f0528004020 2023-11-24T08:06:10.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.767+0000 7f05277fe700 1 -- 172.21.15.153:0/2904188894 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f05340583a0 con 0x7f0528004020 2023-11-24T08:06:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:06:10.769 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:10.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.769+0000 7f05453e9700 1 -- 172.21.15.153:0/2904188894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f052c06b110 msgr2=0x7f052c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:10.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.769+0000 7f05453e9700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f052c06b110 0x7f052c06d5d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0530015040 tx=0x7f0530009030 comp rx=0 tx=0).stop 2023-11-24T08:06:10.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.769+0000 7f05453e9700 1 -- 172.21.15.153:0/2904188894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 msgr2=0x7f05400ad170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:10.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.769+0000 7f05453e9700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 0x7f05400ad170 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f05340098b0 tx=0x7f0534009bc0 comp rx=0 tx=0).stop 2023-11-24T08:06:10.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.769+0000 7f05453e9700 1 -- 172.21.15.153:0/2904188894 shutdown_connections 2023-11-24T08:06:10.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.769+0000 7f05453e9700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05400ae650 0x7f05400aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:10.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.769+0000 7f05453e9700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f052c06b110 0x7f052c06d5d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:10.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.769+0000 7f05453e9700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0528004020 0x7f05400ad170 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:10.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.769+0000 7f05453e9700 1 --2- 172.21.15.153:0/2904188894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0540160930 0x7f054009d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:10.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.769+0000 7f05453e9700 1 -- 172.21.15.153:0/2904188894 >> 172.21.15.153:0/2904188894 conn(0x7f0540072710 msgr2=0x7f05400cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:10.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.769+0000 7f05453e9700 1 -- 172.21.15.153:0/2904188894 shutdown_connections 2023-11-24T08:06:10.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:10.770+0000 7f05453e9700 1 -- 172.21.15.153:0/2904188894 wait complete. 2023-11-24T08:06:10.772 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:06:10.784 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:06:10.925 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":12.160788467,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.390990973611025,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:06:10.925 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.390990973611025 }, "state": "open", "uptime": 12.160788467 } ] 2023-11-24T08:06:10.926 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:15.926 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:16.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.059+0000 7fc0a47c9700 1 Processor -- start 2023-11-24T08:06:16.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.059+0000 7fc0a47c9700 1 -- start start 2023-11-24T08:06:16.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.060+0000 7fc0a47c9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc09c1446a0 0x7fc09c0b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:16.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.060+0000 7fc0a47c9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c0af950 con 0x7fc09c0adf00 2023-11-24T08:06:16.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.060+0000 7fc0a47c9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c0afc30 con 0x7fc09c06c710 2023-11-24T08:06:16.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.060+0000 7fc0a47c9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09c144a80 con 0x7fc09c1446a0 2023-11-24T08:06:16.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.060+0000 7fc0a2565700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc09c1446a0 0x7fc09c0b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:16.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.060+0000 7fc0a1d64700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc09c0adf00 0x7fc09c06c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44938/0 (socket says 172.21.15.153:44938) 2023-11-24T08:06:16.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.060+0000 7fc0a1d64700 1 -- 172.21.15.153:0/3747142291 learned_addr learned my addr 172.21.15.153:0/3747142291 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:06:16.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.061+0000 7fc0a2565700 1 -- 172.21.15.153:0/3747142291 >> v1:172.21.15.164:6789/0 conn(0x7fc09c06c710 legacy=0x7fc09c0b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:16.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.061+0000 7fc0a1563700 1 -- 172.21.15.153:0/3747142291 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069905885 0 0) 0x7fc09c0af950 con 0x7fc09c0adf00 2023-11-24T08:06:16.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.061+0000 7fc0a2565700 1 -- 172.21.15.153:0/3747142291 >> v1:172.21.15.153:6789/0 conn(0x7fc09c0adf00 legacy=0x7fc09c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:16.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.061+0000 7fc0a2565700 1 -- 172.21.15.153:0/3747142291 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c0aff10 con 0x7fc09c1446a0 2023-11-24T08:06:16.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.061+0000 7fc0a2565700 1 --2- 172.21.15.153:0/3747142291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc09c1446a0 0x7fc09c0b5ae0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009840 tx=0x7fc08c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f34607432b296e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.061+0000 7fc0a1563700 1 -- 172.21.15.153:0/3747142291 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c011830 con 0x7fc09c1446a0 2023-11-24T08:06:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.061+0000 7fc0a1563700 1 -- 172.21.15.153:0/3747142291 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c011990 con 0x7fc09c1446a0 2023-11-24T08:06:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.061+0000 7fc0a1563700 1 -- 172.21.15.153:0/3747142291 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c011d20 con 0x7fc09c1446a0 2023-11-24T08:06:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.062+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3747142291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc09c1446a0 msgr2=0x7fc09c0b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.062+0000 7fc0a47c9700 1 --2- 172.21.15.153:0/3747142291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc09c1446a0 0x7fc09c0b5ae0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009840 tx=0x7fc08c009b50 comp rx=0 tx=0).stop 2023-11-24T08:06:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.062+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3747142291 shutdown_connections 2023-11-24T08:06:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.062+0000 7fc0a47c9700 1 --2- 172.21.15.153:0/3747142291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc09c1446a0 0x7fc09c0b5ae0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.062+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3747142291 >> 172.21.15.153:0/3747142291 conn(0x7fc09c071b90 msgr2=0x7fc09c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:16.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.062+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3747142291 shutdown_connections 2023-11-24T08:06:16.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.062+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3747142291 wait complete. 2023-11-24T08:06:16.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.063+0000 7fc0a47c9700 1 Processor -- start 2023-11-24T08:06:16.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.063+0000 7fc0a47c9700 1 -- start start 2023-11-24T08:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a47c9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc09c06c710 0x7fc09c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a47c9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc09c0adf00 0x7fc09c143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a47c9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09c1446a0 0x7fc09c09bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a47c9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c09b9d0 con 0x7fc09c06c710 2023-11-24T08:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a47c9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c15ac20 con 0x7fc09c0adf00 2023-11-24T08:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a47c9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c143c80 con 0x7fc09c1446a0 2023-11-24T08:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a2565700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc09c06c710 0x7fc09c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a2565700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc09c06c710 0x7fc09c15a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38838/0 (socket says 172.21.15.153:38838) 2023-11-24T08:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a2565700 1 -- 172.21.15.153:0/3795913837 learned_addr learned my addr 172.21.15.153:0/3795913837 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a1d64700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc09c0adf00 0x7fc09c143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a2d66700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09c1446a0 0x7fc09c09bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a2565700 1 -- 172.21.15.153:0/3795913837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09c1446a0 msgr2=0x7fc09c09bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a2565700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09c1446a0 0x7fc09c09bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a2565700 1 -- 172.21.15.153:0/3795913837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc09c0adf00 msgr2=0x7fc09c143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a2565700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc09c0adf00 0x7fc09c143740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a2565700 1 -- 172.21.15.153:0/3795913837 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c0094a0 con 0x7fc09c06c710 2023-11-24T08:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a2565700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc09c06c710 0x7fc09c15a6e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc08c014040 tx=0x7fc08c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc092ffd700 1 -- 172.21.15.153:0/3795913837 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c01a930 con 0x7fc09c06c710 2023-11-24T08:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc092ffd700 1 -- 172.21.15.153:0/3795913837 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c01aa90 con 0x7fc09c06c710 2023-11-24T08:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3795913837 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c09c330 con 0x7fc09c06c710 2023-11-24T08:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc092ffd700 1 -- 172.21.15.153:0/3795913837 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c01ae40 con 0x7fc09c06c710 2023-11-24T08:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.064+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3795913837 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c09b030 con 0x7fc09c06c710 2023-11-24T08:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.065+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3795913837 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c0753f0 con 0x7fc09c06c710 2023-11-24T08:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.066+0000 7fc092ffd700 1 -- 172.21.15.153:0/3795913837 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fc08c022070 con 0x7fc09c06c710 2023-11-24T08:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.066+0000 7fc092ffd700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc08006b110 0x7fc08006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.066+0000 7fc092ffd700 1 -- 172.21.15.153:0/3795913837 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc08c08abb0 con 0x7fc09c06c710 2023-11-24T08:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.066+0000 7fc0a1d64700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc08006b110 0x7fc08006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.067+0000 7fc0a1d64700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc08006b110 0x7fc08006d5d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc09c09d3f0 tx=0x7fc098007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:16.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.071+0000 7fc092ffd700 1 -- 172.21.15.153:0/3795913837 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc08c055a70 con 0x7fc09c06c710 2023-11-24T08:06:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.310+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3795913837 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc09c09bb10 con 0x7fc09c06c710 2023-11-24T08:06:16.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.310+0000 7fc092ffd700 1 -- 172.21.15.153:0/3795913837 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fc08c029020 con 0x7fc09c06c710 2023-11-24T08:06:16.312 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:06:16.312 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.312+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3795913837 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc08006b110 msgr2=0x7fc08006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.312+0000 7fc0a47c9700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc08006b110 0x7fc08006d5d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc09c09d3f0 tx=0x7fc098007c20 comp rx=0 tx=0).stop 2023-11-24T08:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.312+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3795913837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc09c06c710 msgr2=0x7fc09c15a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.312+0000 7fc0a47c9700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc09c06c710 0x7fc09c15a6e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc08c014040 tx=0x7fc08c004750 comp rx=0 tx=0).stop 2023-11-24T08:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.313+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3795913837 shutdown_connections 2023-11-24T08:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.313+0000 7fc0a47c9700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09c1446a0 0x7fc09c09bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.313+0000 7fc0a47c9700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc08006b110 0x7fc08006d5d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.313+0000 7fc0a47c9700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc09c06c710 0x7fc09c15a6e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.313+0000 7fc0a47c9700 1 --2- 172.21.15.153:0/3795913837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc09c0adf00 0x7fc09c143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.313+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3795913837 >> 172.21.15.153:0/3795913837 conn(0x7fc09c071b90 msgr2=0x7fc09c071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.313+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3795913837 shutdown_connections 2023-11-24T08:06:16.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:16.313+0000 7fc0a47c9700 1 -- 172.21.15.153:0/3795913837 wait complete. 2023-11-24T08:06:16.316 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:06:16.326 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:06:16.467 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":17.703692054000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.118787015350421,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:06:16.468 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.11878701535042 }, "state": "open", "uptime": 17.703692054 } ] 2023-11-24T08:06:16.468 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:18.265 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:19.898 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:21.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:21.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.602+0000 7f4f00127700 1 Processor -- start 2023-11-24T08:06:21.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.602+0000 7f4f00127700 1 -- start start 2023-11-24T08:06:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4f00127700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4ef80afc10 0x7f4ef815e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4f00127700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4ef80746a0 0x7f4ef8162120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4f00127700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef80af090 con 0x7f4ef806fa40 2023-11-24T08:06:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4f00127700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef806dda0 con 0x7f4ef80746a0 2023-11-24T08:06:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4f00127700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef806e060 con 0x7f4ef80afc10 2023-11-24T08:06:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4efe6c4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4ef80746a0 0x7f4ef8162120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4efe6c4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4ef80746a0 0x7f4ef8162120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38850/0 (socket says 172.21.15.153:38850) 2023-11-24T08:06:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4efe6c4700 1 -- 172.21.15.153:0/3992039772 learned_addr learned my addr 172.21.15.153:0/3992039772 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4efdec3700 1 --2- 172.21.15.153:0/3992039772 >> v2:172.21.15.164:3300/0 conn(0x7f4ef80afc10 0x7f4ef815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4efe6c4700 1 -- 172.21.15.153:0/3992039772 >> v2:172.21.15.164:3300/0 conn(0x7f4ef80afc10 msgr2=0x7f4ef815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4efe6c4700 1 --2- 172.21.15.153:0/3992039772 >> v2:172.21.15.164:3300/0 conn(0x7f4ef80afc10 0x7f4ef815e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4efe6c4700 1 -- 172.21.15.153:0/3992039772 >> v1:172.21.15.164:6789/0 conn(0x7f4ef806fa40 legacy=0x7f4ef8073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4efe6c4700 1 -- 172.21.15.153:0/3992039772 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef806ec70 con 0x7f4ef80746a0 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.603+0000 7f4efe6c4700 1 --2- 172.21.15.153:0/3992039772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef80746a0 0x7f4ef8162120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8074b20 tx=0x7f4ef000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0c375e85deb272 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.604+0000 7f4efcec1700 1 -- 172.21.15.153:0/3992039772 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000e070 con 0x7f4ef80746a0 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.604+0000 7f4efcec1700 1 -- 172.21.15.153:0/3992039772 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef000b910 con 0x7f4ef80746a0 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.604+0000 7f4efcec1700 1 -- 172.21.15.153:0/3992039772 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000bcc0 con 0x7f4ef80746a0 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.604+0000 7f4f00127700 1 -- 172.21.15.153:0/3992039772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef80746a0 msgr2=0x7f4ef8162120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.604+0000 7f4f00127700 1 --2- 172.21.15.153:0/3992039772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef80746a0 0x7f4ef8162120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8074b20 tx=0x7f4ef000b330 comp rx=0 tx=0).stop 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.604+0000 7f4f00127700 1 -- 172.21.15.153:0/3992039772 shutdown_connections 2023-11-24T08:06:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.604+0000 7f4f00127700 1 --2- 172.21.15.153:0/3992039772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef80746a0 0x7f4ef8162120 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.604+0000 7f4f00127700 1 --2- 172.21.15.153:0/3992039772 >> v2:172.21.15.164:3300/0 conn(0x7f4ef80afc10 0x7f4ef815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.604+0000 7f4f00127700 1 -- 172.21.15.153:0/3992039772 >> 172.21.15.153:0/3992039772 conn(0x7f4ef806aff0 msgr2=0x7f4ef806b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.604+0000 7f4f00127700 1 -- 172.21.15.153:0/3992039772 shutdown_connections 2023-11-24T08:06:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.604+0000 7f4f00127700 1 -- 172.21.15.153:0/3992039772 wait complete. 2023-11-24T08:06:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.605+0000 7f4f00127700 1 Processor -- start 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.605+0000 7f4f00127700 1 -- start start 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.606+0000 7f4f00127700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef806fa40 0x7f4ef8159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.606+0000 7f4f00127700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ef80746a0 0x7f4ef814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.606+0000 7f4f00127700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ef80afc10 0x7f4ef80add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.606+0000 7f4f00127700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef815b3b0 con 0x7f4ef806fa40 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.606+0000 7f4f00127700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef815a720 con 0x7f4ef80746a0 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.606+0000 7f4f00127700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef815aa00 con 0x7f4ef80afc10 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.606+0000 7f4efdec3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef806fa40 0x7f4ef8159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.606+0000 7f4efdec3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef806fa40 0x7f4ef8159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38852/0 (socket says 172.21.15.153:38852) 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.606+0000 7f4efdec3700 1 -- 172.21.15.153:0/603519043 learned_addr learned my addr 172.21.15.153:0/603519043 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.606+0000 7f4efd6c2700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ef80746a0 0x7f4ef814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.606+0000 7f4efe6c4700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ef80afc10 0x7f4ef80add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4efdec3700 1 -- 172.21.15.153:0/603519043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ef80afc10 msgr2=0x7f4ef80add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4efdec3700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ef80afc10 0x7f4ef80add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4efdec3700 1 -- 172.21.15.153:0/603519043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ef80746a0 msgr2=0x7f4ef814adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4efdec3700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ef80746a0 0x7f4ef814adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4efdec3700 1 -- 172.21.15.153:0/603519043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0009b30 con 0x7f4ef806fa40 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4efe6c4700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ef80afc10 0x7f4ef80add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4efdec3700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef806fa40 0x7f4ef8159ed0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400e870 tx=0x7f4ef400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4eee7fc700 1 -- 172.21.15.153:0/603519043 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4009590 con 0x7f4ef806fa40 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4eee7fc700 1 -- 172.21.15.153:0/603519043 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef4013680 con 0x7f4ef806fa40 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4eee7fc700 1 -- 172.21.15.153:0/603519043 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40139f0 con 0x7f4ef806fa40 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4f00127700 1 -- 172.21.15.153:0/603519043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef815ace0 con 0x7f4ef806fa40 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.607+0000 7f4f00127700 1 -- 172.21.15.153:0/603519043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef815a410 con 0x7f4ef806fa40 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.608+0000 7f4f00127700 1 -- 172.21.15.153:0/603519043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef815b200 con 0x7f4ef806fa40 2023-11-24T08:06:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.608+0000 7f4eee7fc700 1 -- 172.21.15.153:0/603519043 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f4ef4013b50 con 0x7f4ef806fa40 2023-11-24T08:06:21.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.609+0000 7f4eee7fc700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4edc06b110 0x7f4edc06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:21.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.609+0000 7f4eee7fc700 1 -- 172.21.15.153:0/603519043 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4ef40899e0 con 0x7f4ef806fa40 2023-11-24T08:06:21.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.609+0000 7f4efd6c2700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4edc06b110 0x7f4edc06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:21.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.609+0000 7f4efd6c2700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4edc06b110 0x7f4edc06d5d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80744d0 tx=0x7f4ee8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:21.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.613+0000 7f4eee7fc700 1 -- 172.21.15.153:0/603519043 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ef4054650 con 0x7f4ef806fa40 2023-11-24T08:06:21.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.848+0000 7f4f00127700 1 -- 172.21.15.153:0/603519043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ef8068f10 con 0x7f4ef806fa40 2023-11-24T08:06:21.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.848+0000 7f4eee7fc700 1 -- 172.21.15.153:0/603519043 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f4ef4021090 con 0x7f4ef806fa40 2023-11-24T08:06:21.851 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:06:21.851 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:21.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.850+0000 7f4f00127700 1 -- 172.21.15.153:0/603519043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4edc06b110 msgr2=0x7f4edc06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:21.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.850+0000 7f4f00127700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4edc06b110 0x7f4edc06d5d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80744d0 tx=0x7f4ee8009040 comp rx=0 tx=0).stop 2023-11-24T08:06:21.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.851+0000 7f4f00127700 1 -- 172.21.15.153:0/603519043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef806fa40 msgr2=0x7f4ef8159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:21.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.851+0000 7f4f00127700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef806fa40 0x7f4ef8159ed0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400e870 tx=0x7f4ef400eb80 comp rx=0 tx=0).stop 2023-11-24T08:06:21.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.851+0000 7f4f00127700 1 -- 172.21.15.153:0/603519043 shutdown_connections 2023-11-24T08:06:21.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.851+0000 7f4f00127700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ef80afc10 0x7f4ef80add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:21.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.851+0000 7f4f00127700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4edc06b110 0x7f4edc06d5d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:21.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.851+0000 7f4f00127700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef806fa40 0x7f4ef8159ed0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:21.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.851+0000 7f4f00127700 1 --2- 172.21.15.153:0/603519043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ef80746a0 0x7f4ef814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:21.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.851+0000 7f4f00127700 1 -- 172.21.15.153:0/603519043 >> 172.21.15.153:0/603519043 conn(0x7f4ef806aff0 msgr2=0x7f4ef80b4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:21.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.851+0000 7f4f00127700 1 -- 172.21.15.153:0/603519043 shutdown_connections 2023-11-24T08:06:21.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:21.851+0000 7f4f00127700 1 -- 172.21.15.153:0/603519043 wait complete. 2023-11-24T08:06:21.855 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:06:21.865 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:06:22.005 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":23.240595742,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.850335938407696,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:06:22.006 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.850335938407696 }, "state": "open", "uptime": 23.240595742 } ] 2023-11-24T08:06:22.006 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:27.007 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:27.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.140+0000 7fd1597eb700 1 Processor -- start 2023-11-24T08:06:27.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.140+0000 7fd1597eb700 1 -- start start 2023-11-24T08:06:27.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.140+0000 7fd1597eb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd15415a3b0 0x7fd1540b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.140+0000 7fd1597eb700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd1540cf360 0x7fd1540b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.140+0000 7fd1597eb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1540b3da0 0x7fd15406dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.140+0000 7fd1597eb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1540cf8b0 con 0x7fd1540b3da0 2023-11-24T08:06:27.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.140+0000 7fd1597eb700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15415a790 con 0x7fd1540cf360 2023-11-24T08:06:27.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.140+0000 7fd1597eb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540b4c40 con 0x7fd15415a3b0 2023-11-24T08:06:27.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd1537fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1540b3da0 0x7fd15406dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd1537fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1540b3da0 0x7fd15406dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38864/0 (socket says 172.21.15.153:38864) 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd1537fe700 1 -- 172.21.15.153:0/469133646 learned_addr learned my addr 172.21.15.153:0/469133646 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd1527fc700 1 --2- 172.21.15.153:0/469133646 >> v2:172.21.15.164:3300/0 conn(0x7fd1540cf360 0x7fd1540b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd152ffd700 1 --2- 172.21.15.153:0/469133646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd15415a3b0 0x7fd1540b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd1537fe700 1 -- 172.21.15.153:0/469133646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd15415a3b0 msgr2=0x7fd1540b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd1537fe700 1 --2- 172.21.15.153:0/469133646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd15415a3b0 0x7fd1540b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd1537fe700 1 -- 172.21.15.153:0/469133646 >> v2:172.21.15.164:3300/0 conn(0x7fd1540cf360 msgr2=0x7fd1540b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd1537fe700 1 --2- 172.21.15.153:0/469133646 >> v2:172.21.15.164:3300/0 conn(0x7fd1540cf360 0x7fd1540b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd1537fe700 1 -- 172.21.15.153:0/469133646 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd154070c60 con 0x7fd1540b3da0 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd1537fe700 1 --2- 172.21.15.153:0/469133646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1540b3da0 0x7fd15406dd60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd1540d0a90 tx=0x7fd14c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c781976efc002b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd151ffb700 1 -- 172.21.15.153:0/469133646 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c00e070 con 0x7fd1540b3da0 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd151ffb700 1 -- 172.21.15.153:0/469133646 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c00b9c0 con 0x7fd1540b3da0 2023-11-24T08:06:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.141+0000 7fd151ffb700 1 -- 172.21.15.153:0/469133646 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c00bd70 con 0x7fd1540b3da0 2023-11-24T08:06:27.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.142+0000 7fd1597eb700 1 -- 172.21.15.153:0/469133646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1540b3da0 msgr2=0x7fd15406dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:27.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.142+0000 7fd1597eb700 1 --2- 172.21.15.153:0/469133646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1540b3da0 0x7fd15406dd60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd1540d0a90 tx=0x7fd14c00b330 comp rx=0 tx=0).stop 2023-11-24T08:06:27.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.142+0000 7fd1597eb700 1 -- 172.21.15.153:0/469133646 shutdown_connections 2023-11-24T08:06:27.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.142+0000 7fd1597eb700 1 --2- 172.21.15.153:0/469133646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1540b3da0 0x7fd15406dd60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.142+0000 7fd1597eb700 1 --2- 172.21.15.153:0/469133646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd15415a3b0 0x7fd1540b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.142+0000 7fd1597eb700 1 --2- 172.21.15.153:0/469133646 >> v2:172.21.15.164:3300/0 conn(0x7fd1540cf360 0x7fd1540b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.142+0000 7fd1597eb700 1 -- 172.21.15.153:0/469133646 >> 172.21.15.153:0/469133646 conn(0x7fd1540b1740 msgr2=0x7fd1540b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:27.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.142+0000 7fd1597eb700 1 -- 172.21.15.153:0/469133646 shutdown_connections 2023-11-24T08:06:27.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.142+0000 7fd1597eb700 1 -- 172.21.15.153:0/469133646 wait complete. 2023-11-24T08:06:27.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.143+0000 7fd1597eb700 1 Processor -- start 2023-11-24T08:06:27.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.143+0000 7fd1597eb700 1 -- start start 2023-11-24T08:06:27.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd1597eb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1540b3da0 0x7fd15414f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd1597eb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1540cf360 0x7fd15414fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd1597eb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15415a3b0 0x7fd154158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd1597eb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd154150020 con 0x7fd1540b3da0 2023-11-24T08:06:27.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd1597eb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1541502a0 con 0x7fd15415a3b0 2023-11-24T08:06:27.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd1597eb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd154150580 con 0x7fd1540cf360 2023-11-24T08:06:27.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd152ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1540b3da0 0x7fd15414f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd152ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1540b3da0 0x7fd15414f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38866/0 (socket says 172.21.15.153:38866) 2023-11-24T08:06:27.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd152ffd700 1 -- 172.21.15.153:0/404464637 learned_addr learned my addr 172.21.15.153:0/404464637 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:27.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd1537fe700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15415a3b0 0x7fd154158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd1527fc700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1540cf360 0x7fd15414fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd152ffd700 1 -- 172.21.15.153:0/404464637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1540cf360 msgr2=0x7fd15414fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:27.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd152ffd700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1540cf360 0x7fd15414fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd152ffd700 1 -- 172.21.15.153:0/404464637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15415a3b0 msgr2=0x7fd154158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:27.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd152ffd700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15415a3b0 0x7fd154158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd152ffd700 1 -- 172.21.15.153:0/404464637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c009b30 con 0x7fd1540b3da0 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd1537fe700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15415a3b0 0x7fd154158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.144+0000 7fd1527fc700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1540cf360 0x7fd15414fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.145+0000 7fd152ffd700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1540b3da0 0x7fd15414f220 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c7f0 tx=0x7fd14800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.145+0000 7fd13b7fe700 1 -- 172.21.15.153:0/404464637 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148011800 con 0x7fd1540b3da0 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.145+0000 7fd13b7fe700 1 -- 172.21.15.153:0/404464637 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148011960 con 0x7fd1540b3da0 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.145+0000 7fd1597eb700 1 -- 172.21.15.153:0/404464637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd154150860 con 0x7fd1540b3da0 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.145+0000 7fd13b7fe700 1 -- 172.21.15.153:0/404464637 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148011cf0 con 0x7fd1540b3da0 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.145+0000 7fd1597eb700 1 -- 172.21.15.153:0/404464637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd154150b40 con 0x7fd1540b3da0 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.146+0000 7fd1597eb700 1 -- 172.21.15.153:0/404464637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd154072ab0 con 0x7fd1540b3da0 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.146+0000 7fd13b7fe700 1 -- 172.21.15.153:0/404464637 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fd148018360 con 0x7fd1540b3da0 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.146+0000 7fd13b7fe700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14006b110 0x7fd14006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.147+0000 7fd13b7fe700 1 -- 172.21.15.153:0/404464637 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd148089b90 con 0x7fd1540b3da0 2023-11-24T08:06:27.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.147+0000 7fd1527fc700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14006b110 0x7fd14006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.147+0000 7fd1527fc700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14006b110 0x7fd14006d5d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd15415e7e0 tx=0x7fd144008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:27.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.151+0000 7fd13b7fe700 1 -- 172.21.15.153:0/404464637 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1480547a0 con 0x7fd1540b3da0 2023-11-24T08:06:27.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.384+0000 7fd1597eb700 1 -- 172.21.15.153:0/404464637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd15414d9b0 con 0x7fd1540b3da0 2023-11-24T08:06:27.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.385+0000 7fd13b7fe700 1 -- 172.21.15.153:0/404464637 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fd148057dc0 con 0x7fd1540b3da0 2023-11-24T08:06:27.387 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:06:27.387 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:27.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 -- 172.21.15.153:0/404464637 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14006b110 msgr2=0x7fd14006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:27.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14006b110 0x7fd14006d5d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd15415e7e0 tx=0x7fd144008040 comp rx=0 tx=0).stop 2023-11-24T08:06:27.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 -- 172.21.15.153:0/404464637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1540b3da0 msgr2=0x7fd15414f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:27.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1540b3da0 0x7fd15414f220 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c7f0 tx=0x7fd14800cbb0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 -- 172.21.15.153:0/404464637 shutdown_connections 2023-11-24T08:06:27.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15415a3b0 0x7fd154158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14006b110 0x7fd14006d5d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1540b3da0 0x7fd15414f220 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 --2- 172.21.15.153:0/404464637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1540cf360 0x7fd15414fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 -- 172.21.15.153:0/404464637 >> 172.21.15.153:0/404464637 conn(0x7fd1540b1740 msgr2=0x7fd1540b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:27.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 -- 172.21.15.153:0/404464637 shutdown_connections 2023-11-24T08:06:27.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:27.387+0000 7fd1597eb700 1 -- 172.21.15.153:0/404464637 wait complete. 2023-11-24T08:06:27.390 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:06:27.401 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:06:27.542 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":10,"uptime":28.777499433999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.585297272255499,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:06:27.542 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.5852972722555 }, "state": "open", "uptime": 28.777499434 } ] 2023-11-24T08:06:27.543 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:32.543 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:32.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.676+0000 7ff2d8d33700 1 Processor -- start 2023-11-24T08:06:32.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.676+0000 7ff2d8d33700 1 -- start start 2023-11-24T08:06:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d8d33700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff2d4152cc0 0x7ff2d406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d8d33700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d415c4b0 con 0x7ff2d40b49a0 2023-11-24T08:06:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d8d33700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d415c790 con 0x7ff2d40d0630 2023-11-24T08:06:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d8d33700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d415ca70 con 0x7ff2d4152cc0 2023-11-24T08:06:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d1d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff2d40b49a0 0x7ff2d40cff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44980/0 (socket says 172.21.15.153:44980) 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d1d9b700 1 -- 172.21.15.153:0/172602837 learned_addr learned my addr 172.21.15.153:0/172602837 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d259c700 1 --2- 172.21.15.153:0/172602837 >> v2:172.21.15.164:3300/0 conn(0x7ff2d4152cc0 0x7ff2d406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d159a700 1 -- 172.21.15.153:0/172602837 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305275837 0 0) 0x7ff2d415c4b0 con 0x7ff2d40b49a0 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d159a700 1 -- 172.21.15.153:0/172602837 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2bc0035b0 con 0x7ff2d40b49a0 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d159a700 1 -- 172.21.15.153:0/172602837 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530962085 0 0) 0x7ff2d415c790 con 0x7ff2d40d0630 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d159a700 1 -- 172.21.15.153:0/172602837 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d415c4b0 con 0x7ff2d40d0630 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d259c700 1 -- 172.21.15.153:0/172602837 >> v1:172.21.15.164:6789/0 conn(0x7ff2d40d0630 legacy=0x7ff2d415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.677+0000 7ff2d259c700 1 -- 172.21.15.153:0/172602837 >> v1:172.21.15.153:6789/0 conn(0x7ff2d40b49a0 legacy=0x7ff2d40cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.678+0000 7ff2d259c700 1 -- 172.21.15.153:0/172602837 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d415cd50 con 0x7ff2d4152cc0 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.678+0000 7ff2d259c700 1 --2- 172.21.15.153:0/172602837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d4152cc0 0x7ff2d406c000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009840 tx=0x7ff2c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a35f3cb8f5bf4a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.678+0000 7ff2d159a700 1 -- 172.21.15.153:0/172602837 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4011830 con 0x7ff2d4152cc0 2023-11-24T08:06:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.678+0000 7ff2d159a700 1 -- 172.21.15.153:0/172602837 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c4011990 con 0x7ff2d4152cc0 2023-11-24T08:06:32.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.678+0000 7ff2d159a700 1 -- 172.21.15.153:0/172602837 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4011d20 con 0x7ff2d4152cc0 2023-11-24T08:06:32.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.678+0000 7ff2d8d33700 1 -- 172.21.15.153:0/172602837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d4152cc0 msgr2=0x7ff2d406c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:32.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.678+0000 7ff2d8d33700 1 --2- 172.21.15.153:0/172602837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d4152cc0 0x7ff2d406c000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009840 tx=0x7ff2c4009b50 comp rx=0 tx=0).stop 2023-11-24T08:06:32.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.678+0000 7ff2d8d33700 1 -- 172.21.15.153:0/172602837 shutdown_connections 2023-11-24T08:06:32.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.678+0000 7ff2d8d33700 1 --2- 172.21.15.153:0/172602837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d4152cc0 0x7ff2d406c000 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:32.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.678+0000 7ff2d8d33700 1 -- 172.21.15.153:0/172602837 >> 172.21.15.153:0/172602837 conn(0x7ff2d4071b90 msgr2=0x7ff2d4071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:32.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.679+0000 7ff2d8d33700 1 -- 172.21.15.153:0/172602837 shutdown_connections 2023-11-24T08:06:32.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.679+0000 7ff2d8d33700 1 -- 172.21.15.153:0/172602837 wait complete. 2023-11-24T08:06:32.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.680+0000 7ff2d8d33700 1 Processor -- start 2023-11-24T08:06:32.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.680+0000 7ff2d8d33700 1 -- start start 2023-11-24T08:06:32.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d8d33700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40b49a0 0x7ff2d41403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:32.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d8d33700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2d40d0630 0x7ff2d4153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:32.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d8d33700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d4152cc0 0x7ff2d41538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d8d33700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4140930 con 0x7ff2d40b49a0 2023-11-24T08:06:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d8d33700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d415f3d0 con 0x7ff2d4152cc0 2023-11-24T08:06:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d8d33700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4153ef0 con 0x7ff2d40d0630 2023-11-24T08:06:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40b49a0 0x7ff2d41403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40b49a0 0x7ff2d41403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38880/0 (socket says 172.21.15.153:38880) 2023-11-24T08:06:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d259c700 1 -- 172.21.15.153:0/2232719933 learned_addr learned my addr 172.21.15.153:0/2232719933 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d1d9b700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2d40d0630 0x7ff2d4153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d2d9d700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d4152cc0 0x7ff2d41538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d259c700 1 -- 172.21.15.153:0/2232719933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2d40d0630 msgr2=0x7ff2d4153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d259c700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2d40d0630 0x7ff2d4153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d259c700 1 -- 172.21.15.153:0/2232719933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d4152cc0 msgr2=0x7ff2d41538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d259c700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d4152cc0 0x7ff2d41538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d259c700 1 -- 172.21.15.153:0/2232719933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c40094a0 con 0x7ff2d40b49a0 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d1d9b700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2d40d0630 0x7ff2d4153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d2d9d700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d4152cc0 0x7ff2d41538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2d259c700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40b49a0 0x7ff2d41403f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009b90 tx=0x7ff2c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.681+0000 7ff2c2ffd700 1 -- 172.21.15.153:0/2232719933 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40036a0 con 0x7ff2d40b49a0 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.682+0000 7ff2c2ffd700 1 -- 172.21.15.153:0/2232719933 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c401e070 con 0x7ff2d40b49a0 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.682+0000 7ff2d8d33700 1 -- 172.21.15.153:0/2232719933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d41541d0 con 0x7ff2d40b49a0 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.682+0000 7ff2c2ffd700 1 -- 172.21.15.153:0/2232719933 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4003a60 con 0x7ff2d40b49a0 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.682+0000 7ff2d8d33700 1 -- 172.21.15.153:0/2232719933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d4154790 con 0x7ff2d40b49a0 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.682+0000 7ff2d8d33700 1 -- 172.21.15.153:0/2232719933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d40753f0 con 0x7ff2d40b49a0 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.683+0000 7ff2c2ffd700 1 -- 172.21.15.153:0/2232719933 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7ff2c4003bc0 con 0x7ff2d40b49a0 2023-11-24T08:06:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.683+0000 7ff2c2ffd700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff2b406b110 0x7ff2b406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.683+0000 7ff2c2ffd700 1 -- 172.21.15.153:0/2232719933 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff2c408a920 con 0x7ff2d40b49a0 2023-11-24T08:06:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.683+0000 7ff2d1d9b700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff2b406b110 0x7ff2b406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.684+0000 7ff2d1d9b700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff2b406b110 0x7ff2b406d5d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40b3ae0 tx=0x7ff2c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:32.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.688+0000 7ff2c2ffd700 1 -- 172.21.15.153:0/2232719933 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2c40556c0 con 0x7ff2d40b49a0 2023-11-24T08:06:32.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.922+0000 7ff2d8d33700 1 -- 172.21.15.153:0/2232719933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2d4157760 con 0x7ff2d40b49a0 2023-11-24T08:06:32.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.923+0000 7ff2c2ffd700 1 -- 172.21.15.153:0/2232719933 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7ff2c4015090 con 0x7ff2d40b49a0 2023-11-24T08:06:32.925 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:06:32.925 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:32.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.925+0000 7ff2d8d33700 1 -- 172.21.15.153:0/2232719933 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff2b406b110 msgr2=0x7ff2b406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:32.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.925+0000 7ff2d8d33700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff2b406b110 0x7ff2b406d5d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40b3ae0 tx=0x7ff2c8009040 comp rx=0 tx=0).stop 2023-11-24T08:06:32.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.925+0000 7ff2d8d33700 1 -- 172.21.15.153:0/2232719933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40b49a0 msgr2=0x7ff2d41403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:32.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.925+0000 7ff2d8d33700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40b49a0 0x7ff2d41403f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009b90 tx=0x7ff2c4004750 comp rx=0 tx=0).stop 2023-11-24T08:06:32.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.925+0000 7ff2d8d33700 1 -- 172.21.15.153:0/2232719933 shutdown_connections 2023-11-24T08:06:32.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.925+0000 7ff2d8d33700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d4152cc0 0x7ff2d41538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:32.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.925+0000 7ff2d8d33700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff2b406b110 0x7ff2b406d5d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:32.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.925+0000 7ff2d8d33700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40b49a0 0x7ff2d41403f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:32.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.925+0000 7ff2d8d33700 1 --2- 172.21.15.153:0/2232719933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2d40d0630 0x7ff2d4153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:32.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.925+0000 7ff2d8d33700 1 -- 172.21.15.153:0/2232719933 >> 172.21.15.153:0/2232719933 conn(0x7ff2d4071b90 msgr2=0x7ff2d40b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:32.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.925+0000 7ff2d8d33700 1 -- 172.21.15.153:0/2232719933 shutdown_connections 2023-11-24T08:06:32.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:32.926+0000 7ff2d8d33700 1 -- 172.21.15.153:0/2232719933 wait complete. 2023-11-24T08:06:32.929 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:06:32.940 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:06:33.084 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":10,"uptime":34.319403100000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.323392855112573,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:06:33.085 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.323392855112573 }, "state": "open", "uptime": 34.3194031 } ] 2023-11-24T08:06:33.085 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:38.089 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:38.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.221+0000 7f5073283700 1 Processor -- start 2023-11-24T08:06:38.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.222+0000 7f5073283700 1 -- start start 2023-11-24T08:06:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5073283700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f506c158670 0x7f506c0622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5073283700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f506c0c9fc0 0x7f506c0ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5073283700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c0cfff0 con 0x7f506c158a50 2023-11-24T08:06:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5073283700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c0cfd10 con 0x7f506c0c9fc0 2023-11-24T08:06:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5073283700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c161f50 con 0x7f506c158670 2023-11-24T08:06:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5071820700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f506c0c9fc0 0x7f506c0ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f507081e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f506c158a50 0x7f506c0c98b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44992/0 (socket says 172.21.15.153:44992) 2023-11-24T08:06:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f507081e700 1 -- 172.21.15.153:0/3690738770 learned_addr learned my addr 172.21.15.153:0/3690738770 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:06:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5071820700 1 --2- 172.21.15.153:0/3690738770 >> v2:172.21.15.153:3300/0 conn(0x7f506c0c9fc0 0x7f506c0ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38892/0 (socket says 172.21.15.153:38892) 2023-11-24T08:06:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f507101f700 1 --2- 172.21.15.153:0/3690738770 >> v2:172.21.15.164:3300/0 conn(0x7f506c158670 0x7f506c0622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5071820700 1 -- 172.21.15.153:0/3690738770 >> v2:172.21.15.164:3300/0 conn(0x7f506c158670 msgr2=0x7f506c0622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:38.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5071820700 1 --2- 172.21.15.153:0/3690738770 >> v2:172.21.15.164:3300/0 conn(0x7f506c158670 0x7f506c0622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5071820700 1 -- 172.21.15.153:0/3690738770 >> v1:172.21.15.153:6789/0 conn(0x7f506c158a50 legacy=0x7f506c0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5071820700 1 -- 172.21.15.153:0/3690738770 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c162230 con 0x7f506c0c9fc0 2023-11-24T08:06:38.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5063fff700 1 -- 172.21.15.153:0/3690738770 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236503112 0 0) 0x7f506c0cfff0 con 0x7f506c158a50 2023-11-24T08:06:38.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5071820700 1 --2- 172.21.15.153:0/3690738770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f506c0c9fc0 0x7f506c0ce1a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f506c09e5c0 tx=0x7f506400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45fe3d275503e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5063fff700 1 -- 172.21.15.153:0/3690738770 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506400e070 con 0x7f506c0c9fc0 2023-11-24T08:06:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5063fff700 1 -- 172.21.15.153:0/3690738770 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506400bbd0 con 0x7f506c0c9fc0 2023-11-24T08:06:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.223+0000 7f5063fff700 1 -- 172.21.15.153:0/3690738770 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064012430 con 0x7f506c0c9fc0 2023-11-24T08:06:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.224+0000 7f5073283700 1 -- 172.21.15.153:0/3690738770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f506c0c9fc0 msgr2=0x7f506c0ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.224+0000 7f5073283700 1 --2- 172.21.15.153:0/3690738770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f506c0c9fc0 0x7f506c0ce1a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f506c09e5c0 tx=0x7f506400b330 comp rx=0 tx=0).stop 2023-11-24T08:06:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.224+0000 7f5073283700 1 -- 172.21.15.153:0/3690738770 shutdown_connections 2023-11-24T08:06:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.224+0000 7f5073283700 1 --2- 172.21.15.153:0/3690738770 >> v2:172.21.15.164:3300/0 conn(0x7f506c158670 0x7f506c0622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.224+0000 7f5073283700 1 --2- 172.21.15.153:0/3690738770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f506c0c9fc0 0x7f506c0ce1a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.224+0000 7f5073283700 1 -- 172.21.15.153:0/3690738770 >> 172.21.15.153:0/3690738770 conn(0x7f506c0b57b0 msgr2=0x7f506c0b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.224+0000 7f5073283700 1 -- 172.21.15.153:0/3690738770 shutdown_connections 2023-11-24T08:06:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.224+0000 7f5073283700 1 -- 172.21.15.153:0/3690738770 wait complete. 2023-11-24T08:06:38.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.225+0000 7f5073283700 1 Processor -- start 2023-11-24T08:06:38.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.225+0000 7f5073283700 1 -- start start 2023-11-24T08:06:38.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f5073283700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f506c0c9fc0 0x7f506c155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f5073283700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f506c158670 0x7f506c0ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f5073283700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f506c158a50 0x7f506c0ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f5073283700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0aec10 con 0x7f506c158670 2023-11-24T08:06:38.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f5073283700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c150380 con 0x7f506c0c9fc0 2023-11-24T08:06:38.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f5073283700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c154b50 con 0x7f506c158a50 2023-11-24T08:06:38.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f507081e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f506c158670 0x7f506c0ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f507081e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f506c158670 0x7f506c0ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38896/0 (socket says 172.21.15.153:38896) 2023-11-24T08:06:38.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f507081e700 1 -- 172.21.15.153:0/379534820 learned_addr learned my addr 172.21.15.153:0/379534820 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f507101f700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f506c0c9fc0 0x7f506c155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f5071820700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f506c158a50 0x7f506c0ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f507081e700 1 -- 172.21.15.153:0/379534820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f506c158a50 msgr2=0x7f506c0ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f507081e700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f506c158a50 0x7f506c0ae6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f507081e700 1 -- 172.21.15.153:0/379534820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f506c0c9fc0 msgr2=0x7f506c155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f507081e700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f506c0c9fc0 0x7f506c155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.226+0000 7f507081e700 1 -- 172.21.15.153:0/379534820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009a70 con 0x7f506c158670 2023-11-24T08:06:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.227+0000 7f507081e700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f506c158670 0x7f506c0ae190 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f506800c460 tx=0x7f506800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.227+0000 7f5061ffb700 1 -- 172.21.15.153:0/379534820 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068004c80 con 0x7f506c158670 2023-11-24T08:06:38.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.227+0000 7f5061ffb700 1 -- 172.21.15.153:0/379534820 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068004e00 con 0x7f506c158670 2023-11-24T08:06:38.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.227+0000 7f5073283700 1 -- 172.21.15.153:0/379534820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c154e30 con 0x7f506c158670 2023-11-24T08:06:38.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.227+0000 7f5061ffb700 1 -- 172.21.15.153:0/379534820 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068007310 con 0x7f506c158670 2023-11-24T08:06:38.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.227+0000 7f5073283700 1 -- 172.21.15.153:0/379534820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c1553f0 con 0x7f506c158670 2023-11-24T08:06:38.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.228+0000 7f5073283700 1 -- 172.21.15.153:0/379534820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c067f60 con 0x7f506c158670 2023-11-24T08:06:38.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.228+0000 7f5061ffb700 1 -- 172.21.15.153:0/379534820 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f5068007470 con 0x7f506c158670 2023-11-24T08:06:38.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.229+0000 7f5061ffb700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f505006b110 0x7f505006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.229+0000 7f5061ffb700 1 -- 172.21.15.153:0/379534820 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f50680896f0 con 0x7f506c158670 2023-11-24T08:06:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.229+0000 7f507101f700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f505006b110 0x7f505006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.229+0000 7f507101f700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f505006b110 0x7f505006d5d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f505c009930 tx=0x7f505c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.233+0000 7f5061ffb700 1 -- 172.21.15.153:0/379534820 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5068054490 con 0x7f506c158670 2023-11-24T08:06:38.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.465+0000 7f5073283700 1 -- 172.21.15.153:0/379534820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f506c074a20 con 0x7f506c158670 2023-11-24T08:06:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.465+0000 7f5061ffb700 1 -- 172.21.15.153:0/379534820 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f5068057ab0 con 0x7f506c158670 2023-11-24T08:06:38.468 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:06:38.468 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 -- 172.21.15.153:0/379534820 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f505006b110 msgr2=0x7f505006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f505006b110 0x7f505006d5d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f505c009930 tx=0x7f505c008040 comp rx=0 tx=0).stop 2023-11-24T08:06:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 -- 172.21.15.153:0/379534820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f506c158670 msgr2=0x7f506c0ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f506c158670 0x7f506c0ae190 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f506800c460 tx=0x7f506800c820 comp rx=0 tx=0).stop 2023-11-24T08:06:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 -- 172.21.15.153:0/379534820 shutdown_connections 2023-11-24T08:06:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f506c158a50 0x7f506c0ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f506c0c9fc0 0x7f506c155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f505006b110 0x7f505006d5d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 --2- 172.21.15.153:0/379534820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f506c158670 0x7f506c0ae190 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 -- 172.21.15.153:0/379534820 >> 172.21.15.153:0/379534820 conn(0x7f506c0b57b0 msgr2=0x7f506c06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:38.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 -- 172.21.15.153:0/379534820 shutdown_connections 2023-11-24T08:06:38.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:38.467+0000 7f5073283700 1 -- 172.21.15.153:0/379534820 wait complete. 2023-11-24T08:06:38.473 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:06:38.482 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:06:38.635 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":39.871306625000003,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.064357034448708,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:06:38.636 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.064357034448708 }, "state": "open", "uptime": 39.871306625 } ] 2023-11-24T08:06:38.636 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:43.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:43.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.768+0000 7f9af8dfe700 1 Processor -- start 2023-11-24T08:06:43.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.768+0000 7f9af8dfe700 1 -- start start 2023-11-24T08:06:43.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af8dfe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9af40746a0 0x7f9af40ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af8dfe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9af40ce9a0 0x7f9af406eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af8dfe700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af415fb30 con 0x7f9af4145510 2023-11-24T08:06:43.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af8dfe700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af415fd80 con 0x7f9af40746a0 2023-11-24T08:06:43.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af8dfe700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af4160060 con 0x7f9af40ce9a0 2023-11-24T08:06:43.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af1d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9af40746a0 0x7f9af40ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af1d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9af40746a0 0x7f9af40ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38902/0 (socket says 172.21.15.153:38902) 2023-11-24T08:06:43.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af1d9b700 1 -- 172.21.15.153:0/3633717457 learned_addr learned my addr 172.21.15.153:0/3633717457 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:43.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af2d9d700 1 --2- 172.21.15.153:0/3633717457 >> v2:172.21.15.164:3300/0 conn(0x7f9af40ce9a0 0x7f9af406eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af1d9b700 1 -- 172.21.15.153:0/3633717457 >> v2:172.21.15.164:3300/0 conn(0x7f9af40ce9a0 msgr2=0x7f9af406eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:43.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af1d9b700 1 --2- 172.21.15.153:0/3633717457 >> v2:172.21.15.164:3300/0 conn(0x7f9af40ce9a0 0x7f9af406eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af1d9b700 1 -- 172.21.15.153:0/3633717457 >> v1:172.21.15.164:6789/0 conn(0x7f9af4145510 legacy=0x7f9af4073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af1d9b700 1 -- 172.21.15.153:0/3633717457 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4160340 con 0x7f9af40746a0 2023-11-24T08:06:43.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.769+0000 7f9af2d9d700 1 --2- 172.21.15.153:0/3633717457 >> v2:172.21.15.164:3300/0 conn(0x7f9af40ce9a0 0x7f9af406eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:43.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af1d9b700 1 --2- 172.21.15.153:0/3633717457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40746a0 0x7f9af40ce460 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9af4156b80 tx=0x7f9ae4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54c3716e83b78ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:43.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af159a700 1 -- 172.21.15.153:0/3633717457 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400b870 con 0x7f9af40746a0 2023-11-24T08:06:43.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af159a700 1 -- 172.21.15.153:0/3633717457 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae400b9d0 con 0x7f9af40746a0 2023-11-24T08:06:43.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af159a700 1 -- 172.21.15.153:0/3633717457 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400bd60 con 0x7f9af40746a0 2023-11-24T08:06:43.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af8dfe700 1 -- 172.21.15.153:0/3633717457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40746a0 msgr2=0x7f9af40ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af8dfe700 1 --2- 172.21.15.153:0/3633717457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40746a0 0x7f9af40ce460 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9af4156b80 tx=0x7f9ae4009bd0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af8dfe700 1 -- 172.21.15.153:0/3633717457 shutdown_connections 2023-11-24T08:06:43.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af8dfe700 1 --2- 172.21.15.153:0/3633717457 >> v2:172.21.15.164:3300/0 conn(0x7f9af40ce9a0 0x7f9af406eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af8dfe700 1 --2- 172.21.15.153:0/3633717457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40746a0 0x7f9af40ce460 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af8dfe700 1 -- 172.21.15.153:0/3633717457 >> 172.21.15.153:0/3633717457 conn(0x7f9af4072990 msgr2=0x7f9af406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:43.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af8dfe700 1 -- 172.21.15.153:0/3633717457 shutdown_connections 2023-11-24T08:06:43.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.770+0000 7f9af8dfe700 1 -- 172.21.15.153:0/3633717457 wait complete. 2023-11-24T08:06:43.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.772+0000 7f9af8dfe700 1 Processor -- start 2023-11-24T08:06:43.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.772+0000 7f9af8dfe700 1 -- start start 2023-11-24T08:06:43.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af8dfe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40746a0 0x7f9af415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af8dfe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9af40ce9a0 0x7f9af41f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af8dfe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9af4145510 0x7f9af4154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af8dfe700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af41f4080 con 0x7f9af40746a0 2023-11-24T08:06:43.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af8dfe700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af41f31d0 con 0x7f9af40ce9a0 2023-11-24T08:06:43.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af8dfe700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af4156c80 con 0x7f9af4145510 2023-11-24T08:06:43.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40746a0 0x7f9af415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40746a0 0x7f9af415bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38908/0 (socket says 172.21.15.153:38908) 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af259c700 1 -- 172.21.15.153:0/2901231422 learned_addr learned my addr 172.21.15.153:0/2901231422 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af1d9b700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9af40ce9a0 0x7f9af41f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af259c700 1 -- 172.21.15.153:0/2901231422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9af4145510 msgr2=0x7f9af4154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af2d9d700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9af4145510 0x7f9af4154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af259c700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9af4145510 0x7f9af4154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af259c700 1 -- 172.21.15.153:0/2901231422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9af40ce9a0 msgr2=0x7f9af41f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af259c700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9af40ce9a0 0x7f9af41f2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.773+0000 7f9af259c700 1 -- 172.21.15.153:0/2901231422 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae4009550 con 0x7f9af40746a0 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.774+0000 7f9af259c700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40746a0 0x7f9af415bae0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800c450 tx=0x7f9ae800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.774+0000 7f9ae2ffd700 1 -- 172.21.15.153:0/2901231422 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80052d0 con 0x7f9af40746a0 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.774+0000 7f9ae2ffd700 1 -- 172.21.15.153:0/2901231422 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae8005430 con 0x7f9af40746a0 2023-11-24T08:06:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.774+0000 7f9af8dfe700 1 -- 172.21.15.153:0/2901231422 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af41f3400 con 0x7f9af40746a0 2023-11-24T08:06:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.774+0000 7f9ae2ffd700 1 -- 172.21.15.153:0/2901231422 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80038c0 con 0x7f9af40746a0 2023-11-24T08:06:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.774+0000 7f9af8dfe700 1 -- 172.21.15.153:0/2901231422 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af41f39c0 con 0x7f9af40746a0 2023-11-24T08:06:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.775+0000 7f9af8dfe700 1 -- 172.21.15.153:0/2901231422 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af4067f60 con 0x7f9af40746a0 2023-11-24T08:06:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.775+0000 7f9ae2ffd700 1 -- 172.21.15.153:0/2901231422 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f9ae8003a20 con 0x7f9af40746a0 2023-11-24T08:06:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.776+0000 7f9ae2ffd700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9ad406b110 0x7f9ad406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.776+0000 7f9ae2ffd700 1 -- 172.21.15.153:0/2901231422 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9ae8088d70 con 0x7f9af40746a0 2023-11-24T08:06:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.776+0000 7f9af1d9b700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9ad406b110 0x7f9ad406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.776+0000 7f9af1d9b700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9ad406b110 0x7f9ad406d5d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9af40b6280 tx=0x7f9ae4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:43.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:43.780+0000 7f9ae2ffd700 1 -- 172.21.15.153:0/2901231422 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ae8053ab0 con 0x7f9af40746a0 2023-11-24T08:06:44.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.016+0000 7f9af8dfe700 1 -- 172.21.15.153:0/2901231422 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9af40cde60 con 0x7f9af40746a0 2023-11-24T08:06:44.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.016+0000 7f9ae2ffd700 1 -- 172.21.15.153:0/2901231422 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f9ae80570d0 con 0x7f9af40746a0 2023-11-24T08:06:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:06:44.018 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:44.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 -- 172.21.15.153:0/2901231422 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9ad406b110 msgr2=0x7f9ad406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:44.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9ad406b110 0x7f9ad406d5d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9af40b6280 tx=0x7f9ae4008030 comp rx=0 tx=0).stop 2023-11-24T08:06:44.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 -- 172.21.15.153:0/2901231422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40746a0 msgr2=0x7f9af415bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:44.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40746a0 0x7f9af415bae0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800c450 tx=0x7f9ae800c810 comp rx=0 tx=0).stop 2023-11-24T08:06:44.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 -- 172.21.15.153:0/2901231422 shutdown_connections 2023-11-24T08:06:44.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9af4145510 0x7f9af4154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9ad406b110 0x7f9ad406d5d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40746a0 0x7f9af415bae0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 --2- 172.21.15.153:0/2901231422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9af40ce9a0 0x7f9af41f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 -- 172.21.15.153:0/2901231422 >> 172.21.15.153:0/2901231422 conn(0x7f9af4072990 msgr2=0x7f9af406fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:44.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 -- 172.21.15.153:0/2901231422 shutdown_connections 2023-11-24T08:06:44.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:44.018+0000 7f9af8dfe700 1 -- 172.21.15.153:0/2901231422 wait complete. 2023-11-24T08:06:44.023 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:06:44.032 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:06:44.174 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":45.410210372000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.809217784090613,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:06:44.175 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.809217784090613 }, "state": "open", "uptime": 45.410210372 } ] 2023-11-24T08:06:44.175 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:49.176 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.309+0000 7ff1bf30c700 1 Processor -- start 2023-11-24T08:06:49.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.309+0000 7ff1bf30c700 1 -- start start 2023-11-24T08:06:49.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.310+0000 7ff1bf30c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff1b80b3370 0x7ff1b81604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.310+0000 7ff1bf30c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b80b22d0 con 0x7ff1b80d1c70 2023-11-24T08:06:49.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.310+0000 7ff1bf30c700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b80b25b0 con 0x7ff1b815bdd0 2023-11-24T08:06:49.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.310+0000 7ff1bf30c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b80b2f50 con 0x7ff1b80b3370 2023-11-24T08:06:49.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.310+0000 7ff1bc8a7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff1b80b3370 0x7ff1b81604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.310+0000 7ff1bd8a9700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff1b80d1c70 0x7ff1b8165ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45024/0 (socket says 172.21.15.153:45024) 2023-11-24T08:06:49.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.310+0000 7ff1bd8a9700 1 -- 172.21.15.153:0/3727149800 learned_addr learned my addr 172.21.15.153:0/3727149800 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:06:49.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.310+0000 7ff1bc8a7700 1 --2- 172.21.15.153:0/3727149800 >> v2:172.21.15.153:3300/0 conn(0x7ff1b80b3370 0x7ff1b81604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38918/0 (socket says 172.21.15.153:38918) 2023-11-24T08:06:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.310+0000 7ff1bc8a7700 1 -- 172.21.15.153:0/3727149800 >> v1:172.21.15.164:6789/0 conn(0x7ff1b815bdd0 legacy=0x7ff1b80b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.310+0000 7ff1bc8a7700 1 -- 172.21.15.153:0/3727149800 >> v1:172.21.15.153:6789/0 conn(0x7ff1b80d1c70 legacy=0x7ff1b8165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.310+0000 7ff1bc8a7700 1 -- 172.21.15.153:0/3727149800 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80b2890 con 0x7ff1b80b3370 2023-11-24T08:06:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.311+0000 7ff1bc8a7700 1 --2- 172.21.15.153:0/3727149800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b80b3370 0x7ff1b81604e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009840 tx=0x7ff1b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba47167a3915e12 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.311+0000 7ff1affff700 1 -- 172.21.15.153:0/3727149800 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4004230 con 0x7ff1b80b3370 2023-11-24T08:06:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.311+0000 7ff1affff700 1 -- 172.21.15.153:0/3727149800 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b4004390 con 0x7ff1b80b3370 2023-11-24T08:06:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.311+0000 7ff1affff700 1 -- 172.21.15.153:0/3727149800 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40036a0 con 0x7ff1b80b3370 2023-11-24T08:06:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.311+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3727149800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b80b3370 msgr2=0x7ff1b81604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.311+0000 7ff1bf30c700 1 --2- 172.21.15.153:0/3727149800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b80b3370 0x7ff1b81604e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009840 tx=0x7ff1b4009b50 comp rx=0 tx=0).stop 2023-11-24T08:06:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.311+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3727149800 shutdown_connections 2023-11-24T08:06:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.311+0000 7ff1bf30c700 1 --2- 172.21.15.153:0/3727149800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b80b3370 0x7ff1b81604e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.311+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3727149800 >> 172.21.15.153:0/3727149800 conn(0x7ff1b80731a0 msgr2=0x7ff1b809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.311+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3727149800 shutdown_connections 2023-11-24T08:06:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.311+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3727149800 wait complete. 2023-11-24T08:06:49.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.313+0000 7ff1bf30c700 1 Processor -- start 2023-11-24T08:06:49.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.313+0000 7ff1bf30c700 1 -- start start 2023-11-24T08:06:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.313+0000 7ff1bf30c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b80b3370 0x7ff1b81542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.313+0000 7ff1bf30c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1b80d1c70 0x7ff1b80c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.313+0000 7ff1bf30c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1b815bdd0 0x7ff1b8158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.313+0000 7ff1bf30c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b81547e0 con 0x7ff1b80b3370 2023-11-24T08:06:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.313+0000 7ff1bf30c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b80c9cb0 con 0x7ff1b80d1c70 2023-11-24T08:06:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.313+0000 7ff1bf30c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b80b6980 con 0x7ff1b815bdd0 2023-11-24T08:06:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.313+0000 7ff1bd0a8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b80b3370 0x7ff1b81542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.313+0000 7ff1bd0a8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b80b3370 0x7ff1b81542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38922/0 (socket says 172.21.15.153:38922) 2023-11-24T08:06:49.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.313+0000 7ff1bd0a8700 1 -- 172.21.15.153:0/3024663079 learned_addr learned my addr 172.21.15.153:0/3024663079 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:49.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1bc8a7700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1b80d1c70 0x7ff1b80c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1bd8a9700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1b815bdd0 0x7ff1b8158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1bd0a8700 1 -- 172.21.15.153:0/3024663079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1b815bdd0 msgr2=0x7ff1b8158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1bd0a8700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1b815bdd0 0x7ff1b8158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1bd0a8700 1 -- 172.21.15.153:0/3024663079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1b80d1c70 msgr2=0x7ff1b80c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1bd0a8700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1b80d1c70 0x7ff1b80c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1bd0a8700 1 -- 172.21.15.153:0/3024663079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40094a0 con 0x7ff1b80b3370 2023-11-24T08:06:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1bc8a7700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1b80d1c70 0x7ff1b80c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1bd0a8700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b80b3370 0x7ff1b81542a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800c430 tx=0x7ff1a800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1adffb700 1 -- 172.21.15.153:0/3024663079 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a80052d0 con 0x7ff1b80b3370 2023-11-24T08:06:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1adffb700 1 -- 172.21.15.153:0/3024663079 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a8005450 con 0x7ff1b80b3370 2023-11-24T08:06:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3024663079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b80b6c60 con 0x7ff1b80b3370 2023-11-24T08:06:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1adffb700 1 -- 172.21.15.153:0/3024663079 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8006aa0 con 0x7ff1b80b3370 2023-11-24T08:06:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.314+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3024663079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b80b7220 con 0x7ff1b80b3370 2023-11-24T08:06:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.315+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3024663079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b80b7870 con 0x7ff1b80b3370 2023-11-24T08:06:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.316+0000 7ff1adffb700 1 -- 172.21.15.153:0/3024663079 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7ff1a8003680 con 0x7ff1b80b3370 2023-11-24T08:06:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.316+0000 7ff1adffb700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff19c06b110 0x7ff19c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.316+0000 7ff1adffb700 1 -- 172.21.15.153:0/3024663079 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff1a8088bc0 con 0x7ff1b80b3370 2023-11-24T08:06:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.316+0000 7ff1bc8a7700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff19c06b110 0x7ff19c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.316+0000 7ff1bc8a7700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff19c06b110 0x7ff19c06d5d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40090b0 tx=0x7ff1b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.321+0000 7ff1adffb700 1 -- 172.21.15.153:0/3024663079 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1a80539a0 con 0x7ff1b80b3370 2023-11-24T08:06:49.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.555+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3024663079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1b8067f60 con 0x7ff1b80b3370 2023-11-24T08:06:49.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.555+0000 7ff1adffb700 1 -- 172.21.15.153:0/3024663079 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7ff1a8056fc0 con 0x7ff1b80b3370 2023-11-24T08:06:49.557 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:06:49.557 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:49.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.557+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3024663079 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff19c06b110 msgr2=0x7ff19c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.557+0000 7ff1bf30c700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff19c06b110 0x7ff19c06d5d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40090b0 tx=0x7ff1b4008030 comp rx=0 tx=0).stop 2023-11-24T08:06:49.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.557+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3024663079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b80b3370 msgr2=0x7ff1b81542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.557+0000 7ff1bf30c700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b80b3370 0x7ff1b81542a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800c430 tx=0x7ff1a800c7f0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.557+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3024663079 shutdown_connections 2023-11-24T08:06:49.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.557+0000 7ff1bf30c700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1b815bdd0 0x7ff1b8158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.557+0000 7ff1bf30c700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff19c06b110 0x7ff19c06d5d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.557+0000 7ff1bf30c700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b80b3370 0x7ff1b81542a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.557+0000 7ff1bf30c700 1 --2- 172.21.15.153:0/3024663079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1b80d1c70 0x7ff1b80c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.557+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3024663079 >> 172.21.15.153:0/3024663079 conn(0x7ff1b80731a0 msgr2=0x7ff1b815f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.558+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3024663079 shutdown_connections 2023-11-24T08:06:49.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:49.558+0000 7ff1bf30c700 1 -- 172.21.15.153:0/3024663079 wait complete. 2023-11-24T08:06:49.561 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:06:49.572 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:06:49.712 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":50.948114136000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.55736808200518,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:06:49.712 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.55736808200518 }, "state": "open", "uptime": 50.948114136 } ] 2023-11-24T08:06:49.713 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:49.957 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:49.960 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:54.714 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:54.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.847+0000 7ff33c436700 1 Processor -- start 2023-11-24T08:06:54.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.847+0000 7ff33c436700 1 -- start start 2023-11-24T08:06:54.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff33c436700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3340b3370 0x7ff3341604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff33c436700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3340d1c70 0x7ff3340d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff33c436700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3340b22d0 con 0x7ff33415bdd0 2023-11-24T08:06:54.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff33c436700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3340b2f50 con 0x7ff3340b3370 2023-11-24T08:06:54.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff33c436700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340d2640 con 0x7ff3340d1c70 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff3399d1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3340b3370 0x7ff3341604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff3399d1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3340b3370 0x7ff3341604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38932/0 (socket says 172.21.15.153:38932) 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff3399d1700 1 -- 172.21.15.153:0/322245549 learned_addr learned my addr 172.21.15.153:0/322245549 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff33a9d3700 1 --2- 172.21.15.153:0/322245549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3340d1c70 0x7ff3340d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff3399d1700 1 -- 172.21.15.153:0/322245549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3340d1c70 msgr2=0x7ff3340d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff3399d1700 1 --2- 172.21.15.153:0/322245549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3340d1c70 0x7ff3340d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff3399d1700 1 -- 172.21.15.153:0/322245549 >> v1:172.21.15.164:6789/0 conn(0x7ff33415bdd0 legacy=0x7ff3340b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff3399d1700 1 -- 172.21.15.153:0/322245549 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3340b25b0 con 0x7ff3340b3370 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff33a9d3700 1 --2- 172.21.15.153:0/322245549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3340d1c70 0x7ff3340d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff3399d1700 1 --2- 172.21.15.153:0/322245549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3340b3370 0x7ff3341604e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff3300098f0 tx=0x7ff330009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c4724fe54cf2e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff3391d0700 1 -- 172.21.15.153:0/322245549 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000b8a0 con 0x7ff3340b3370 2023-11-24T08:06:54.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff3391d0700 1 -- 172.21.15.153:0/322245549 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33000ba00 con 0x7ff3340b3370 2023-11-24T08:06:54.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.848+0000 7ff3391d0700 1 -- 172.21.15.153:0/322245549 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000bd90 con 0x7ff3340b3370 2023-11-24T08:06:54.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.849+0000 7ff33c436700 1 -- 172.21.15.153:0/322245549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3340b3370 msgr2=0x7ff3341604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.849+0000 7ff33c436700 1 --2- 172.21.15.153:0/322245549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3340b3370 0x7ff3341604e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff3300098f0 tx=0x7ff330009c00 comp rx=0 tx=0).stop 2023-11-24T08:06:54.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.849+0000 7ff33c436700 1 -- 172.21.15.153:0/322245549 shutdown_connections 2023-11-24T08:06:54.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.849+0000 7ff33c436700 1 --2- 172.21.15.153:0/322245549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3340d1c70 0x7ff3340d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.849+0000 7ff33c436700 1 --2- 172.21.15.153:0/322245549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3340b3370 0x7ff3341604e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.849+0000 7ff33c436700 1 -- 172.21.15.153:0/322245549 >> 172.21.15.153:0/322245549 conn(0x7ff3340731a0 msgr2=0x7ff33409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:54.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.849+0000 7ff33c436700 1 -- 172.21.15.153:0/322245549 shutdown_connections 2023-11-24T08:06:54.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.849+0000 7ff33c436700 1 -- 172.21.15.153:0/322245549 wait complete. 2023-11-24T08:06:54.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.850+0000 7ff33c436700 1 Processor -- start 2023-11-24T08:06:54.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.850+0000 7ff33c436700 1 -- start start 2023-11-24T08:06:54.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33c436700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3340b3370 0x7ff3341572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33c436700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3340d1c70 0x7ff3340b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33c436700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff33415bdd0 0x7ff33406c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33c436700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340b48a0 con 0x7ff33415bdd0 2023-11-24T08:06:54.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33c436700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340b5140 con 0x7ff3340b3370 2023-11-24T08:06:54.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33c436700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff334157810 con 0x7ff3340d1c70 2023-11-24T08:06:54.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33a9d3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff33415bdd0 0x7ff33406c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33a9d3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff33415bdd0 0x7ff33406c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38940/0 (socket says 172.21.15.153:38940) 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33a9d3700 1 -- 172.21.15.153:0/2330969283 learned_addr learned my addr 172.21.15.153:0/2330969283 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33a9d3700 1 -- 172.21.15.153:0/2330969283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3340d1c70 msgr2=0x7ff3340b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33a9d3700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3340d1c70 0x7ff3340b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33a9d3700 1 -- 172.21.15.153:0/2330969283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3340b3370 msgr2=0x7ff3341572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33a9d3700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3340b3370 0x7ff3341572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.851+0000 7ff33a9d3700 1 -- 172.21.15.153:0/2330969283 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff330009550 con 0x7ff33415bdd0 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.852+0000 7ff33a9d3700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff33415bdd0 0x7ff33406c4d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff32c007f50 tx=0x7ff32c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.852+0000 7ff326ffd700 1 -- 172.21.15.153:0/2330969283 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00de60 con 0x7ff33415bdd0 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.852+0000 7ff326ffd700 1 -- 172.21.15.153:0/2330969283 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00f040 con 0x7ff33415bdd0 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.852+0000 7ff326ffd700 1 -- 172.21.15.153:0/2330969283 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c003c60 con 0x7ff33415bdd0 2023-11-24T08:06:54.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.852+0000 7ff33c436700 1 -- 172.21.15.153:0/2330969283 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33406ceb0 con 0x7ff33415bdd0 2023-11-24T08:06:54.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.852+0000 7ff33c436700 1 -- 172.21.15.153:0/2330969283 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3340b4dd0 con 0x7ff33415bdd0 2023-11-24T08:06:54.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.853+0000 7ff33c436700 1 -- 172.21.15.153:0/2330969283 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff334067f60 con 0x7ff33415bdd0 2023-11-24T08:06:54.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.853+0000 7ff326ffd700 1 -- 172.21.15.153:0/2330969283 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7ff32c004030 con 0x7ff33415bdd0 2023-11-24T08:06:54.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.853+0000 7ff326ffd700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff31806b110 0x7ff31806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.854+0000 7ff326ffd700 1 -- 172.21.15.153:0/2330969283 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff32c089cd0 con 0x7ff33415bdd0 2023-11-24T08:06:54.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.854+0000 7ff33a1d2700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff31806b110 0x7ff31806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.854+0000 7ff33a1d2700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff31806b110 0x7ff31806d5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff328000f60 tx=0x7ff328007a60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:54.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:54.858+0000 7ff326ffd700 1 -- 172.21.15.153:0/2330969283 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff32c054960 con 0x7ff33415bdd0 2023-11-24T08:06:55.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.091+0000 7ff33c436700 1 -- 172.21.15.153:0/2330969283 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3340b7c60 con 0x7ff33415bdd0 2023-11-24T08:06:55.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.091+0000 7ff326ffd700 1 -- 172.21.15.153:0/2330969283 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7ff32c01a090 con 0x7ff33415bdd0 2023-11-24T08:06:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:06:55.094 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:55.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.093+0000 7ff33c436700 1 -- 172.21.15.153:0/2330969283 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff31806b110 msgr2=0x7ff31806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.094+0000 7ff33c436700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff31806b110 0x7ff31806d5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff328000f60 tx=0x7ff328007a60 comp rx=0 tx=0).stop 2023-11-24T08:06:55.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.094+0000 7ff33c436700 1 -- 172.21.15.153:0/2330969283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff33415bdd0 msgr2=0x7ff33406c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.094+0000 7ff33c436700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff33415bdd0 0x7ff33406c4d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff32c007f50 tx=0x7ff32c00d460 comp rx=0 tx=0).stop 2023-11-24T08:06:55.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.094+0000 7ff33c436700 1 -- 172.21.15.153:0/2330969283 shutdown_connections 2023-11-24T08:06:55.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.094+0000 7ff33c436700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff31806b110 0x7ff31806d5d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.094+0000 7ff33c436700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff33415bdd0 0x7ff33406c4d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.094+0000 7ff33c436700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3340b3370 0x7ff3341572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.094+0000 7ff33c436700 1 --2- 172.21.15.153:0/2330969283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3340d1c70 0x7ff3340b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.094+0000 7ff33c436700 1 -- 172.21.15.153:0/2330969283 >> 172.21.15.153:0/2330969283 conn(0x7ff3340731a0 msgr2=0x7ff3340b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:55.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.094+0000 7ff33c436700 1 -- 172.21.15.153:0/2330969283 shutdown_connections 2023-11-24T08:06:55.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:06:55.094+0000 7ff33c436700 1 -- 172.21.15.153:0/2330969283 wait complete. 2023-11-24T08:06:55.098 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:06:55.108 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:06:55.251 INFO:teuthology.orchestra.run.smithi153.stdout:[{"id":5829,"entity":{"name":{"type":"client","num":5829},"addr":{"type":"any","addr":"172.21.15.153:0","nonce":3232823371}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":56.487017883,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.308675725561717,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5829 172.21.15.153:0/3232823371","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi153","pid":"103295","root":"/"}}] 2023-11-24T08:06:55.251 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi153", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "103295", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.153:0", "nonce": 3232823371, "type": "any" }, "name": { "num": 5829, "type": "client" } }, "id": 5829, "inst": "client.5829 172.21.15.153:0/3232823371", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.308675725561717 }, "state": "open", "uptime": 56.487017883 } ] 2023-11-24T08:06:55.251 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:07:00.253 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:00.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.377+0000 7f38d9091700 1 Processor -- start 2023-11-24T08:07:00.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.377+0000 7f38d9091700 1 -- start start 2023-11-24T08:07:00.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.378+0000 7f38d9091700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f38d40d2240 0x7f38d40b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.378+0000 7f38d9091700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40b1d40 con 0x7f38d415ddd0 2023-11-24T08:07:00.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.378+0000 7f38d9091700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40b28c0 con 0x7f38d415e1b0 2023-11-24T08:07:00.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.378+0000 7f38d9091700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d40b1f90 con 0x7f38d40d2240 2023-11-24T08:07:00.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.378+0000 7f38d2d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f38d415ddd0 0x7f38d40d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45050/0 (socket says 172.21.15.153:45050) 2023-11-24T08:07:00.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.378+0000 7f38d2d9d700 1 -- 172.21.15.153:0/2671798560 learned_addr learned my addr 172.21.15.153:0/2671798560 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:00.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.378+0000 7f38d259c700 1 --2- 172.21.15.153:0/2671798560 >> v2:172.21.15.164:3300/0 conn(0x7f38d40d2240 0x7f38d40b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.378+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927484264 0 0) 0x7f38d40b1d40 con 0x7f38d415ddd0 2023-11-24T08:07:00.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.378+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38bc0035b0 con 0x7f38d415ddd0 2023-11-24T08:07:00.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673579076 0 0) 0x7f38d40b28c0 con 0x7f38d415e1b0 2023-11-24T08:07:00.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38d40b1d40 con 0x7f38d415e1b0 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2753080323 0 0) 0x7f38bc0035b0 con 0x7f38d415ddd0 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 >> v2:172.21.15.164:3300/0 conn(0x7f38d40d2240 msgr2=0x7f38d40b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 --2- 172.21.15.153:0/2671798560 >> v2:172.21.15.164:3300/0 conn(0x7f38d40d2240 0x7f38d40b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 >> v1:172.21.15.164:6789/0 conn(0x7f38d415e1b0 legacy=0x7f38d406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40b2270 con 0x7f38d415ddd0 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f38c4001670 con 0x7f38d415ddd0 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 >> v1:172.21.15.153:6789/0 conn(0x7f38d415ddd0 legacy=0x7f38d40d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 --2- 172.21.15.153:0/2671798560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38bc003bc0 0x7f38bc003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 --2- 172.21.15.153:0/2671798560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38bc004850 0x7f38bc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 --2- 172.21.15.153:0/2671798560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38bc005260 0x7f38bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40b1f90 con 0x7f38bc004850 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc00c190 con 0x7f38bc003bc0 2023-11-24T08:07:00.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc00c350 con 0x7f38bc005260 2023-11-24T08:07:00.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d259c700 1 --2- 172.21.15.153:0/2671798560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38bc004850 0x7f38bc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d2d9d700 1 --2- 172.21.15.153:0/2671798560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38bc003bc0 0x7f38bc003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d359e700 1 --2- 172.21.15.153:0/2671798560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38bc005260 0x7f38bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d259c700 1 -- 172.21.15.153:0/2671798560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38bc005260 msgr2=0x7f38bc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:00.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d259c700 1 --2- 172.21.15.153:0/2671798560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38bc005260 0x7f38bc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d259c700 1 -- 172.21.15.153:0/2671798560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38bc003bc0 msgr2=0x7f38bc003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:00.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d259c700 1 --2- 172.21.15.153:0/2671798560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38bc003bc0 0x7f38bc003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d259c700 1 -- 172.21.15.153:0/2671798560 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc0035b0 con 0x7f38bc004850 2023-11-24T08:07:00.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d359e700 1 -- 172.21.15.153:0/2671798560 reap_dead start 2023-11-24T08:07:00.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.379+0000 7f38d259c700 1 --2- 172.21.15.153:0/2671798560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38bc004850 0x7f38bc004cd0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009b30 tx=0x7f38bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd09f959ff9aca9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:00.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.380+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c800e6c0 con 0x7f38bc004850 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.380+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c800e820 con 0x7f38bc004850 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.380+0000 7f38d1d9b700 1 -- 172.21.15.153:0/2671798560 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c800eb90 con 0x7f38bc004850 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.380+0000 7f38d9091700 1 -- 172.21.15.153:0/2671798560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38bc004850 msgr2=0x7f38bc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.380+0000 7f38d9091700 1 --2- 172.21.15.153:0/2671798560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38bc004850 0x7f38bc004cd0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009b30 tx=0x7f38bc005880 comp rx=0 tx=0).stop 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.380+0000 7f38d9091700 1 -- 172.21.15.153:0/2671798560 shutdown_connections 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.380+0000 7f38d9091700 1 --2- 172.21.15.153:0/2671798560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38bc004850 0x7f38bc004cd0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.380+0000 7f38d9091700 1 -- 172.21.15.153:0/2671798560 >> 172.21.15.153:0/2671798560 conn(0x7f38d40731a0 msgr2=0x7f38d409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.380+0000 7f38d9091700 1 -- 172.21.15.153:0/2671798560 shutdown_connections 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.380+0000 7f38d9091700 1 -- 172.21.15.153:0/2671798560 wait complete. 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.382+0000 7f38d9091700 1 Processor -- start 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.382+0000 7f38d9091700 1 -- start start 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.382+0000 7f38d9091700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38bc004850 0x7f38d40b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.382+0000 7f38d9091700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d414c950 0x7f38d409f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.382+0000 7f38d9091700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38d415a480 0x7f38d4160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.382+0000 7f38d9091700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d414b8b0 con 0x7f38d415a480 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.382+0000 7f38d9091700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d414bb90 con 0x7f38bc004850 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.382+0000 7f38d9091700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d414be70 con 0x7f38d414c950 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38d415a480 0x7f38d4160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38d415a480 0x7f38d4160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38962/0 (socket says 172.21.15.153:38962) 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d359e700 1 -- 172.21.15.153:0/934039391 learned_addr learned my addr 172.21.15.153:0/934039391 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d259c700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d414c950 0x7f38d409f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d2d9d700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38bc004850 0x7f38d40b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d359e700 1 -- 172.21.15.153:0/934039391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d414c950 msgr2=0x7f38d409f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d359e700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d414c950 0x7f38d409f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d359e700 1 -- 172.21.15.153:0/934039391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38bc004850 msgr2=0x7f38d40b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d359e700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38bc004850 0x7f38d40b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d359e700 1 -- 172.21.15.153:0/934039391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40b2ed0 con 0x7f38d415a480 2023-11-24T08:07:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d259c700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d414c950 0x7f38d409f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d359e700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38d415a480 0x7f38d4160150 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f38d4073130 tx=0x7f38cc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38bb7fe700 1 -- 172.21.15.153:0/934039391 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc003c10 con 0x7f38d415a480 2023-11-24T08:07:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38bb7fe700 1 -- 172.21.15.153:0/934039391 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc003d90 con 0x7f38d415a480 2023-11-24T08:07:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d9091700 1 -- 172.21.15.153:0/934039391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d414c150 con 0x7f38d415a480 2023-11-24T08:07:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38bb7fe700 1 -- 172.21.15.153:0/934039391 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc00dbd0 con 0x7f38d415a480 2023-11-24T08:07:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.383+0000 7f38d9091700 1 -- 172.21.15.153:0/934039391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d40b72f0 con 0x7f38d415a480 2023-11-24T08:07:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.384+0000 7f38d9091700 1 -- 172.21.15.153:0/934039391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d4067f60 con 0x7f38d415a480 2023-11-24T08:07:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.385+0000 7f38bb7fe700 1 -- 172.21.15.153:0/934039391 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f38cc00dd30 con 0x7f38d415a480 2023-11-24T08:07:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.385+0000 7f38bb7fe700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f38c006b110 0x7f38c006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.385+0000 7f38bb7fe700 1 -- 172.21.15.153:0/934039391 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f38cc089d40 con 0x7f38d415a480 2023-11-24T08:07:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.385+0000 7f38d2d9d700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f38c006b110 0x7f38c006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.385+0000 7f38d2d9d700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f38c006b110 0x7f38c006d5d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f38c4008fd0 tx=0x7f38c4006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.389+0000 7f38bb7fe700 1 -- 172.21.15.153:0/934039391 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f38cc0549c0 con 0x7f38d415a480 2023-11-24T08:07:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.621+0000 7f38d9091700 1 -- 172.21.15.153:0/934039391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38d40b7c60 con 0x7f38d415a480 2023-11-24T08:07:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.621+0000 7f38bb7fe700 1 -- 172.21.15.153:0/934039391 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f38cc057fe0 con 0x7f38d415a480 2023-11-24T08:07:00.623 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:00.624 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:07:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 -- 172.21.15.153:0/934039391 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f38c006b110 msgr2=0x7f38c006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f38c006b110 0x7f38c006d5d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f38c4008fd0 tx=0x7f38c4006040 comp rx=0 tx=0).stop 2023-11-24T08:07:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 -- 172.21.15.153:0/934039391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38d415a480 msgr2=0x7f38d4160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38d415a480 0x7f38d4160150 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f38d4073130 tx=0x7f38cc00d430 comp rx=0 tx=0).stop 2023-11-24T08:07:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 -- 172.21.15.153:0/934039391 shutdown_connections 2023-11-24T08:07:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f38c006b110 0x7f38c006d5d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38d415a480 0x7f38d4160150 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38bc004850 0x7f38d40b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 --2- 172.21.15.153:0/934039391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d414c950 0x7f38d409f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 -- 172.21.15.153:0/934039391 >> 172.21.15.153:0/934039391 conn(0x7f38d40731a0 msgr2=0x7f38d406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 -- 172.21.15.153:0/934039391 shutdown_connections 2023-11-24T08:07:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:00.624+0000 7f38d9091700 1 -- 172.21.15.153:0/934039391 wait complete. 2023-11-24T08:07:00.628 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:07:00.638 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-11-24T08:07:00.777 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2023-11-24T08:07:00.777 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-11-24T08:07:00.777 DEBUG:tasks.ceph_test_case:wait_until_true: success in 55s and 0 retries 2023-11-24T08:07:00.777 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:07:00.778 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:00.827 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:00.880 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:07:00.880 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:07:00.880 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:00.898 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3433 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T08:07:00.898 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:07:00.898 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:00.917 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=427 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T08:07:00.917 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:07:00.917 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:00.955 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3433 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T08:07:00.956 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:07:00.956 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:00.976 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=427 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T08:07:00.976 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:01.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.115+0000 7fde8adbc700 1 Processor -- start 2023-11-24T08:07:01.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.116+0000 7fde8adbc700 1 -- start start 2023-11-24T08:07:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.116+0000 7fde8adbc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 0x7fde841604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.116+0000 7fde8adbc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fde840b3370 0x7fde840b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.116+0000 7fde8adbc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fde840d1c70 0x7fde840d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.116+0000 7fde8adbc700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde840b2f50 con 0x7fde840b3370 2023-11-24T08:07:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.116+0000 7fde8adbc700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde840d2660 con 0x7fde840d1c70 2023-11-24T08:07:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.116+0000 7fde8adbc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840b2030 con 0x7fde8415bdd0 2023-11-24T08:07:01.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.116+0000 7fde83fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fde840b3370 0x7fde840b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde83fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fde840b3370 0x7fde840b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38966/0 (socket says 172.21.15.153:38966) 2023-11-24T08:07:01.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde83fff700 1 -- 172.21.15.153:0/4247304191 learned_addr learned my addr 172.21.15.153:0/4247304191 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:01.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde89359700 1 --2- 172.21.15.153:0/4247304191 >> v2:172.21.15.164:3300/0 conn(0x7fde840d1c70 0x7fde840d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde88b58700 1 --2- 172.21.15.153:0/4247304191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 0x7fde841604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde83fff700 1 -- 172.21.15.153:0/4247304191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 msgr2=0x7fde841604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde83fff700 1 --2- 172.21.15.153:0/4247304191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 0x7fde841604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde83fff700 1 -- 172.21.15.153:0/4247304191 >> v2:172.21.15.164:3300/0 conn(0x7fde840d1c70 msgr2=0x7fde840d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde83fff700 1 --2- 172.21.15.153:0/4247304191 >> v2:172.21.15.164:3300/0 conn(0x7fde840d1c70 0x7fde840d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde83fff700 1 -- 172.21.15.153:0/4247304191 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840b22d0 con 0x7fde840b3370 2023-11-24T08:07:01.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde89359700 1 --2- 172.21.15.153:0/4247304191 >> v2:172.21.15.164:3300/0 conn(0x7fde840d1c70 0x7fde840d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:01.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde88b58700 1 --2- 172.21.15.153:0/4247304191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 0x7fde841604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:01.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde83fff700 1 --2- 172.21.15.153:0/4247304191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde840b3370 0x7fde840b1af0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fde84160a20 tx=0x7fde70009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ca1e318fe2c508 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde837fe700 1 -- 172.21.15.153:0/4247304191 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000b870 con 0x7fde840b3370 2023-11-24T08:07:01.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde837fe700 1 -- 172.21.15.153:0/4247304191 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7000b9d0 con 0x7fde840b3370 2023-11-24T08:07:01.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.117+0000 7fde837fe700 1 -- 172.21.15.153:0/4247304191 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000bd60 con 0x7fde840b3370 2023-11-24T08:07:01.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.118+0000 7fde8adbc700 1 -- 172.21.15.153:0/4247304191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde840b3370 msgr2=0x7fde840b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.118+0000 7fde8adbc700 1 --2- 172.21.15.153:0/4247304191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde840b3370 0x7fde840b1af0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fde84160a20 tx=0x7fde70009bd0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.118+0000 7fde8adbc700 1 -- 172.21.15.153:0/4247304191 shutdown_connections 2023-11-24T08:07:01.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.118+0000 7fde8adbc700 1 --2- 172.21.15.153:0/4247304191 >> v2:172.21.15.164:3300/0 conn(0x7fde840d1c70 0x7fde840d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.118+0000 7fde8adbc700 1 --2- 172.21.15.153:0/4247304191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 0x7fde841604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.118+0000 7fde8adbc700 1 --2- 172.21.15.153:0/4247304191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde840b3370 0x7fde840b1af0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.118+0000 7fde8adbc700 1 -- 172.21.15.153:0/4247304191 >> 172.21.15.153:0/4247304191 conn(0x7fde840731a0 msgr2=0x7fde8409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:01.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.118+0000 7fde8adbc700 1 -- 172.21.15.153:0/4247304191 shutdown_connections 2023-11-24T08:07:01.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.118+0000 7fde8adbc700 1 -- 172.21.15.153:0/4247304191 wait complete. 2023-11-24T08:07:01.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.119+0000 7fde8adbc700 1 Processor -- start 2023-11-24T08:07:01.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.119+0000 7fde8adbc700 1 -- start start 2023-11-24T08:07:01.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde8adbc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde840b3370 0x7fde840c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde8adbc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde840d1c70 0x7fde84156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde8adbc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 0x7fde840c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde8adbc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840c6920 con 0x7fde840b3370 2023-11-24T08:07:01.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde8adbc700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840c78c0 con 0x7fde840d1c70 2023-11-24T08:07:01.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde8adbc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840b4970 con 0x7fde8415bdd0 2023-11-24T08:07:01.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde88b58700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde840b3370 0x7fde840c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde88b58700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde840b3370 0x7fde840c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38972/0 (socket says 172.21.15.153:38972) 2023-11-24T08:07:01.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde88b58700 1 -- 172.21.15.153:0/3079607482 learned_addr learned my addr 172.21.15.153:0/3079607482 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:01.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde83fff700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde840d1c70 0x7fde84156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde89359700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 0x7fde840c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde88b58700 1 -- 172.21.15.153:0/3079607482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 msgr2=0x7fde840c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde88b58700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 0x7fde840c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde88b58700 1 -- 172.21.15.153:0/3079607482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde840d1c70 msgr2=0x7fde84156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde88b58700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde840d1c70 0x7fde84156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde88b58700 1 -- 172.21.15.153:0/3079607482 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70009550 con 0x7fde840b3370 2023-11-24T08:07:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde89359700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 0x7fde840c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde88b58700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde840b3370 0x7fde840c63e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fde7800c750 tx=0x7fde7800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde817fa700 1 -- 172.21.15.153:0/3079607482 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde78011800 con 0x7fde840b3370 2023-11-24T08:07:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde8adbc700 1 -- 172.21.15.153:0/3079607482 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde840b67c0 con 0x7fde840b3370 2023-11-24T08:07:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde817fa700 1 -- 172.21.15.153:0/3079607482 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde78011960 con 0x7fde840b3370 2023-11-24T08:07:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.120+0000 7fde817fa700 1 -- 172.21.15.153:0/3079607482 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde78011cd0 con 0x7fde840b3370 2023-11-24T08:07:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.121+0000 7fde8adbc700 1 -- 172.21.15.153:0/3079607482 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde840b63f0 con 0x7fde840b3370 2023-11-24T08:07:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.121+0000 7fde8adbc700 1 -- 172.21.15.153:0/3079607482 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde84067f60 con 0x7fde840b3370 2023-11-24T08:07:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.122+0000 7fde817fa700 1 -- 172.21.15.153:0/3079607482 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fde78021350 con 0x7fde840b3370 2023-11-24T08:07:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.122+0000 7fde817fa700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fde6806b110 0x7fde6806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.122+0000 7fde817fa700 1 -- 172.21.15.153:0/3079607482 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fde78089ab0 con 0x7fde840b3370 2023-11-24T08:07:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.122+0000 7fde83fff700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fde6806b110 0x7fde6806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.123+0000 7fde83fff700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fde6806b110 0x7fde6806d5d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde70014040 tx=0x7fde70008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.127+0000 7fde817fa700 1 -- 172.21.15.153:0/3079607482 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde78054630 con 0x7fde840b3370 2023-11-24T08:07:01.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.363+0000 7fde8adbc700 1 -- 172.21.15.153:0/3079607482 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde840b4ae0 con 0x7fde840b3370 2023-11-24T08:07:01.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.364+0000 7fde817fa700 1 -- 172.21.15.153:0/3079607482 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fde78057c50 con 0x7fde840b3370 2023-11-24T08:07:01.365 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:01.366 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:07:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 -- 172.21.15.153:0/3079607482 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fde6806b110 msgr2=0x7fde6806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fde6806b110 0x7fde6806d5d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde70014040 tx=0x7fde70008030 comp rx=0 tx=0).stop 2023-11-24T08:07:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 -- 172.21.15.153:0/3079607482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde840b3370 msgr2=0x7fde840c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde840b3370 0x7fde840c63e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fde7800c750 tx=0x7fde7800ca60 comp rx=0 tx=0).stop 2023-11-24T08:07:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 -- 172.21.15.153:0/3079607482 shutdown_connections 2023-11-24T08:07:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8415bdd0 0x7fde840c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fde6806b110 0x7fde6806d5d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde840b3370 0x7fde840c63e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 --2- 172.21.15.153:0/3079607482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde840d1c70 0x7fde84156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 -- 172.21.15.153:0/3079607482 >> 172.21.15.153:0/3079607482 conn(0x7fde840731a0 msgr2=0x7fde8409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:01.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 -- 172.21.15.153:0/3079607482 shutdown_connections 2023-11-24T08:07:01.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.366+0000 7fde8adbc700 1 -- 172.21.15.153:0/3079607482 wait complete. 2023-11-24T08:07:01.369 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:07:01.380 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:01.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.500+0000 7f2097ed5700 1 Processor -- start 2023-11-24T08:07:01.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.500+0000 7f2097ed5700 1 -- start start 2023-11-24T08:07:01.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.501+0000 7f2097ed5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f209015bdd0 0x7f20901604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.501+0000 7f2097ed5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20900d1c70 0x7f20900d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.501+0000 7f2097ed5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20900b22d0 con 0x7f20900b3370 2023-11-24T08:07:01.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.501+0000 7f2097ed5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20900b2f50 con 0x7f209015bdd0 2023-11-24T08:07:01.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.501+0000 7f2097ed5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20900d2640 con 0x7f20900d1c70 2023-11-24T08:07:01.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.501+0000 7f2095c71700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f209015bdd0 0x7f20901604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.501+0000 7f2095470700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f20900b3370 0x7f20900b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45084/0 (socket says 172.21.15.153:45084) 2023-11-24T08:07:01.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.501+0000 7f2095470700 1 -- 172.21.15.153:0/648808803 learned_addr learned my addr 172.21.15.153:0/648808803 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:01.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.502+0000 7f2096472700 1 --2- 172.21.15.153:0/648808803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20900d1c70 0x7f20900d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.502+0000 7f2095c71700 1 -- 172.21.15.153:0/648808803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20900d1c70 msgr2=0x7f20900d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.502+0000 7f2095c71700 1 --2- 172.21.15.153:0/648808803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20900d1c70 0x7f20900d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.502+0000 7f2095c71700 1 -- 172.21.15.153:0/648808803 >> v1:172.21.15.153:6789/0 conn(0x7f20900b3370 legacy=0x7f20900b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.502+0000 7f2095c71700 1 -- 172.21.15.153:0/648808803 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20900b25b0 con 0x7f209015bdd0 2023-11-24T08:07:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.502+0000 7f2094c6f700 1 -- 172.21.15.153:0/648808803 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012813275 0 0) 0x7f20900b22d0 con 0x7f20900b3370 2023-11-24T08:07:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.502+0000 7f2095c71700 1 --2- 172.21.15.153:0/648808803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f209015bdd0 0x7f20901604e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2080009840 tx=0x7f2080009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e86e884fbfbf878 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.502+0000 7f2094c6f700 1 -- 172.21.15.153:0/648808803 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080011830 con 0x7f209015bdd0 2023-11-24T08:07:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.502+0000 7f2094c6f700 1 -- 172.21.15.153:0/648808803 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2080011990 con 0x7f209015bdd0 2023-11-24T08:07:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.502+0000 7f2094c6f700 1 -- 172.21.15.153:0/648808803 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080011d20 con 0x7f209015bdd0 2023-11-24T08:07:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.503+0000 7f2097ed5700 1 -- 172.21.15.153:0/648808803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f209015bdd0 msgr2=0x7f20901604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.503+0000 7f2097ed5700 1 --2- 172.21.15.153:0/648808803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f209015bdd0 0x7f20901604e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2080009840 tx=0x7f2080009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.503+0000 7f2097ed5700 1 -- 172.21.15.153:0/648808803 shutdown_connections 2023-11-24T08:07:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.503+0000 7f2097ed5700 1 --2- 172.21.15.153:0/648808803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20900d1c70 0x7f20900d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.503+0000 7f2097ed5700 1 --2- 172.21.15.153:0/648808803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f209015bdd0 0x7f20901604e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.503+0000 7f2097ed5700 1 -- 172.21.15.153:0/648808803 >> 172.21.15.153:0/648808803 conn(0x7f20900731a0 msgr2=0x7f209009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:01.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.503+0000 7f2097ed5700 1 -- 172.21.15.153:0/648808803 shutdown_connections 2023-11-24T08:07:01.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.503+0000 7f2097ed5700 1 -- 172.21.15.153:0/648808803 wait complete. 2023-11-24T08:07:01.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.504+0000 7f2097ed5700 1 Processor -- start 2023-11-24T08:07:01.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.504+0000 7f2097ed5700 1 -- start start 2023-11-24T08:07:01.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2097ed5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20900b3370 0x7f20900c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2097ed5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20900d1c70 0x7f20901f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2097ed5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209015bdd0 0x7f20901f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2097ed5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20900ca740 con 0x7f20900d1c70 2023-11-24T08:07:01.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2097ed5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20900c96a0 con 0x7f209015bdd0 2023-11-24T08:07:01.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2097ed5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20900c9980 con 0x7f20900b3370 2023-11-24T08:07:01.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2095470700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20900d1c70 0x7f20901f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2095470700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20900d1c70 0x7f20901f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38988/0 (socket says 172.21.15.153:38988) 2023-11-24T08:07:01.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2095470700 1 -- 172.21.15.153:0/1741436706 learned_addr learned my addr 172.21.15.153:0/1741436706 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:01.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2095c71700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20900b3370 0x7f20900c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2096472700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209015bdd0 0x7f20901f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2095470700 1 -- 172.21.15.153:0/1741436706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20900b3370 msgr2=0x7f20900c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2095470700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20900b3370 0x7f20900c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2095470700 1 -- 172.21.15.153:0/1741436706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209015bdd0 msgr2=0x7f20901f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2095470700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209015bdd0 0x7f20901f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2095470700 1 -- 172.21.15.153:0/1741436706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20800094a0 con 0x7f20900d1c70 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2096472700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209015bdd0 0x7f20901f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2095470700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20900d1c70 0x7f20901f5a70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f208c00c540 tx=0x7f208c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f20867fc700 1 -- 172.21.15.153:0/1741436706 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c004c80 con 0x7f20900d1c70 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f20867fc700 1 -- 172.21.15.153:0/1741436706 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c004de0 con 0x7f20900d1c70 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2097ed5700 1 -- 172.21.15.153:0/1741436706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20900c9c60 con 0x7f20900d1c70 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f20867fc700 1 -- 172.21.15.153:0/1741436706 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c007310 con 0x7f20900d1c70 2023-11-24T08:07:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.505+0000 7f2097ed5700 1 -- 172.21.15.153:0/1741436706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20900ca220 con 0x7f20900d1c70 2023-11-24T08:07:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.506+0000 7f2097ed5700 1 -- 172.21.15.153:0/1741436706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20900ca590 con 0x7f20900d1c70 2023-11-24T08:07:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.507+0000 7f20867fc700 1 -- 172.21.15.153:0/1741436706 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f208c007470 con 0x7f20900d1c70 2023-11-24T08:07:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.507+0000 7f20867fc700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f207406b080 0x7f207406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.507+0000 7f20867fc700 1 -- 172.21.15.153:0/1741436706 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f208c089600 con 0x7f20900d1c70 2023-11-24T08:07:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.507+0000 7f2095c71700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f207406b080 0x7f207406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.508+0000 7f2095c71700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f207406b080 0x7f207406d540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f20800090b0 tx=0x7f208001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.512+0000 7f20867fc700 1 -- 172.21.15.153:0/1741436706 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f208c0543f0 con 0x7f20900d1c70 2023-11-24T08:07:01.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.704+0000 7f2097ed5700 1 -- 172.21.15.153:0/1741436706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20900cbcc0 con 0x7f20900d1c70 2023-11-24T08:07:01.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.705+0000 7f20867fc700 1 -- 172.21.15.153:0/1741436706 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16640 (secure 0 0 0) 0x7f208c057a10 con 0x7f20900d1c70 2023-11-24T08:07:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:01.707 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":45,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:06:01.261362+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:41.978248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:42.535670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":5}]},{"pgid":"7.18","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:01.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 -- 172.21.15.153:0/1741436706 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f207406b080 msgr2=0x7f207406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f207406b080 0x7f207406d540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f20800090b0 tx=0x7f208001c040 comp rx=0 tx=0).stop 2023-11-24T08:07:01.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 -- 172.21.15.153:0/1741436706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20900d1c70 msgr2=0x7f20901f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20900d1c70 0x7f20901f5a70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f208c00c540 tx=0x7f208c00c850 comp rx=0 tx=0).stop 2023-11-24T08:07:01.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 -- 172.21.15.153:0/1741436706 shutdown_connections 2023-11-24T08:07:01.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209015bdd0 0x7f20901f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20900b3370 0x7f20900c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f207406b080 0x7f207406d540 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 --2- 172.21.15.153:0/1741436706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20900d1c70 0x7f20901f5a70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 -- 172.21.15.153:0/1741436706 >> 172.21.15.153:0/1741436706 conn(0x7f20900731a0 msgr2=0x7f209015a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:01.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 -- 172.21.15.153:0/1741436706 shutdown_connections 2023-11-24T08:07:01.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.707+0000 7f2097ed5700 1 -- 172.21.15.153:0/1741436706 wait complete. 2023-11-24T08:07:01.721 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:05:41.978248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:05:42.535670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:01.721 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:01.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.843+0000 7f6a91112700 1 Processor -- start 2023-11-24T08:07:01.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.843+0000 7f6a91112700 1 -- start start 2023-11-24T08:07:01.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a91112700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a8c0b4e00 0x7f6a8c0b5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a91112700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c0b4970 con 0x7f6a8c0cd840 2023-11-24T08:07:01.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a91112700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c0cfed0 con 0x7f6a8c15be20 2023-11-24T08:07:01.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a91112700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0b4360 con 0x7f6a8c0b4e00 2023-11-24T08:07:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a8b59e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6a8c0cd840 0x7f6a8c15c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45102/0 (socket says 172.21.15.153:45102) 2023-11-24T08:07:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a8b59e700 1 -- 172.21.15.153:0/3996551947 learned_addr learned my addr 172.21.15.153:0/3996551947 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a8a59c700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a8c0b4e00 0x7f6a8c0b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121352329 0 0) 0x7f6a8c0b4970 con 0x7f6a8c0cd840 2023-11-24T08:07:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a740035b0 con 0x7f6a8c0cd840 2023-11-24T08:07:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000777118 0 0) 0x7f6a740035b0 con 0x7f6a8c0cd840 2023-11-24T08:07:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a8c0b4e00 msgr2=0x7f6a8c0b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a8c0b4e00 0x7f6a8c0b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 >> v1:172.21.15.164:6789/0 conn(0x7f6a8c15be20 legacy=0x7f6a8c0af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c06f940 con 0x7f6a8c0cd840 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f6a840019f0 con 0x7f6a8c0cd840 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 >> v1:172.21.15.153:6789/0 conn(0x7f6a8c0cd840 legacy=0x7f6a8c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a74003a30 0x7f6a74003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a740043e0 0x7f6a740048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 0x7f6a7400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0b4360 con 0x7f6a74005060 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7400bf80 con 0x7f6a74003a30 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7400c140 con 0x7f6a740043e0 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.844+0000 7f6a8a59c700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a8c0b4e00 0x7f6a8c0b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a8b59e700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 0x7f6a7400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a8ad9d700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a74003a30 0x7f6a74003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a8a59c700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a740043e0 0x7f6a740048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a8b59e700 1 -- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a740043e0 msgr2=0x7f6a740048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a8b59e700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a740043e0 0x7f6a740048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a8b59e700 1 -- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a74003a30 msgr2=0x7f6a74003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a8b59e700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a74003a30 0x7f6a74003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a8b59e700 1 -- 172.21.15.153:0/3996551947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a740035b0 con 0x7f6a74005060 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a8b59e700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 0x7f6a7400ba10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400a830 tx=0x7f6a74005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2a85fd24dd9087 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84012600 con 0x7f6a74005060 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a84012780 con 0x7f6a74005060 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.845+0000 7f6a89d9b700 1 -- 172.21.15.153:0/3996551947 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84012b30 con 0x7f6a74005060 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.846+0000 7f6a91112700 1 -- 172.21.15.153:0/3996551947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 msgr2=0x7f6a7400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.846+0000 7f6a91112700 1 --2- 172.21.15.153:0/3996551947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 0x7f6a7400ba10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400a830 tx=0x7f6a74005880 comp rx=0 tx=0).stop 2023-11-24T08:07:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.846+0000 7f6a8b59e700 1 -- 172.21.15.153:0/3996551947 reap_dead start 2023-11-24T08:07:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.846+0000 7f6a91112700 1 -- 172.21.15.153:0/3996551947 shutdown_connections 2023-11-24T08:07:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.846+0000 7f6a91112700 1 -- 172.21.15.153:0/3996551947 >> 172.21.15.153:0/3996551947 conn(0x7f6a8c0b2050 msgr2=0x7f6a8c0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.846+0000 7f6a91112700 1 -- 172.21.15.153:0/3996551947 shutdown_connections 2023-11-24T08:07:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.846+0000 7f6a91112700 1 -- 172.21.15.153:0/3996551947 wait complete. 2023-11-24T08:07:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.847+0000 7f6a91112700 1 Processor -- start 2023-11-24T08:07:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.847+0000 7f6a91112700 1 -- start start 2023-11-24T08:07:01.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a91112700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 0x7f6a8c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a91112700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a8c15cbe0 0x7f6a8c148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a91112700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a8c1f3b50 0x7f6a8c0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a91112700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c15d6e0 con 0x7f6a74005060 2023-11-24T08:07:01.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a91112700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c15d400 con 0x7f6a8c15cbe0 2023-11-24T08:07:01.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a91112700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c06d720 con 0x7f6a8c1f3b50 2023-11-24T08:07:01.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 0x7f6a8c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 0x7f6a8c15efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39006/0 (socket says 172.21.15.153:39006) 2023-11-24T08:07:01.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8ad9d700 1 -- 172.21.15.153:0/973111478 learned_addr learned my addr 172.21.15.153:0/973111478 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8b59e700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a8c1f3b50 0x7f6a8c0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8a59c700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a8c15cbe0 0x7f6a8c148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8ad9d700 1 -- 172.21.15.153:0/973111478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a8c1f3b50 msgr2=0x7f6a8c0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8ad9d700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a8c1f3b50 0x7f6a8c0b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8ad9d700 1 -- 172.21.15.153:0/973111478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a8c15cbe0 msgr2=0x7f6a8c148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8ad9d700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a8c15cbe0 0x7f6a8c148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8ad9d700 1 -- 172.21.15.153:0/973111478 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c06da00 con 0x7f6a74005060 2023-11-24T08:07:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8a59c700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a8c15cbe0 0x7f6a8c148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.848+0000 7f6a8b59e700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a8c1f3b50 0x7f6a8c0b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.849+0000 7f6a8ad9d700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 0x7f6a8c15efa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00f7c0 tx=0x7f6a7c00fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.849+0000 7f6a737fe700 1 -- 172.21.15.153:0/973111478 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c0052e0 con 0x7f6a74005060 2023-11-24T08:07:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.849+0000 7f6a737fe700 1 -- 172.21.15.153:0/973111478 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c005460 con 0x7f6a74005060 2023-11-24T08:07:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.849+0000 7f6a91112700 1 -- 172.21.15.153:0/973111478 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c06dce0 con 0x7f6a74005060 2023-11-24T08:07:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.849+0000 7f6a737fe700 1 -- 172.21.15.153:0/973111478 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c0038c0 con 0x7f6a74005060 2023-11-24T08:07:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.849+0000 7f6a91112700 1 -- 172.21.15.153:0/973111478 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c148fb0 con 0x7f6a74005060 2023-11-24T08:07:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.850+0000 7f6a91112700 1 -- 172.21.15.153:0/973111478 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c068d90 con 0x7f6a74005060 2023-11-24T08:07:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.850+0000 7f6a737fe700 1 -- 172.21.15.153:0/973111478 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6a7c003a20 con 0x7f6a74005060 2023-11-24T08:07:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.851+0000 7f6a737fe700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a7806b080 0x7f6a7806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.851+0000 7f6a737fe700 1 -- 172.21.15.153:0/973111478 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6a7c0897e0 con 0x7f6a74005060 2023-11-24T08:07:01.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.851+0000 7f6a8a59c700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a7806b080 0x7f6a7806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.851+0000 7f6a8a59c700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a7806b080 0x7f6a7806d540 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0afcc0 tx=0x7f6a80008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:01.855+0000 7f6a737fe700 1 -- 172.21.15.153:0/973111478 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a7c054660 con 0x7f6a74005060 2023-11-24T08:07:02.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.043+0000 7f6a91112700 1 -- 172.21.15.153:0/973111478 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a8c06ded0 con 0x7f6a74005060 2023-11-24T08:07:02.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.044+0000 7f6a737fe700 1 -- 172.21.15.153:0/973111478 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a7c057c80 con 0x7f6a74005060 2023-11-24T08:07:02.046 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:07:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 -- 172.21.15.153:0/973111478 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a7806b080 msgr2=0x7f6a7806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a7806b080 0x7f6a7806d540 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0afcc0 tx=0x7f6a80008040 comp rx=0 tx=0).stop 2023-11-24T08:07:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 -- 172.21.15.153:0/973111478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 msgr2=0x7f6a8c15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 0x7f6a8c15efa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00f7c0 tx=0x7f6a7c00fb80 comp rx=0 tx=0).stop 2023-11-24T08:07:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 -- 172.21.15.153:0/973111478 shutdown_connections 2023-11-24T08:07:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a8c1f3b50 0x7f6a8c0b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6a7806b080 0x7f6a7806d540 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a74005060 0x7f6a8c15efa0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 --2- 172.21.15.153:0/973111478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a8c15cbe0 0x7f6a8c148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 -- 172.21.15.153:0/973111478 >> 172.21.15.153:0/973111478 conn(0x7f6a8c0b2050 msgr2=0x7f6a8c159280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 -- 172.21.15.153:0/973111478 shutdown_connections 2023-11-24T08:07:02.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.046+0000 7f6a91112700 1 -- 172.21.15.153:0/973111478 wait complete. 2023-11-24T08:07:02.060 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:02.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.182+0000 7f498a1ad700 1 Processor -- start 2023-11-24T08:07:02.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.182+0000 7f498a1ad700 1 -- start start 2023-11-24T08:07:02.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.182+0000 7f498a1ad700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f49841587f0 0x7f498406aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.182+0000 7f498a1ad700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f498415b370 0x7f498415b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.182+0000 7f498a1ad700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498406b530 con 0x7f49840b3c60 2023-11-24T08:07:02.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.182+0000 7f498a1ad700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49840ae5e0 con 0x7f498415b370 2023-11-24T08:07:02.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.182+0000 7f498a1ad700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498415be30 con 0x7f49841587f0 2023-11-24T08:07:02.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f4982ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f498415b370 0x7f498415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f4982ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f498415b370 0x7f498415b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39016/0 (socket says 172.21.15.153:39016) 2023-11-24T08:07:02.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f4982ffd700 1 -- 172.21.15.153:0/946480315 learned_addr learned my addr 172.21.15.153:0/946480315 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:02.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f49837fe700 1 --2- 172.21.15.153:0/946480315 >> v2:172.21.15.164:3300/0 conn(0x7f49841587f0 0x7f498406aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f4982ffd700 1 -- 172.21.15.153:0/946480315 >> v2:172.21.15.164:3300/0 conn(0x7f49841587f0 msgr2=0x7f498406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f4982ffd700 1 --2- 172.21.15.153:0/946480315 >> v2:172.21.15.164:3300/0 conn(0x7f49841587f0 0x7f498406aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f4982ffd700 1 -- 172.21.15.153:0/946480315 >> v1:172.21.15.164:6789/0 conn(0x7f49840b3c60 legacy=0x7f49840af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f4982ffd700 1 -- 172.21.15.153:0/946480315 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498415c110 con 0x7f498415b370 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f49837fe700 1 --2- 172.21.15.153:0/946480315 >> v2:172.21.15.164:3300/0 conn(0x7f49841587f0 0x7f498406aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f4982ffd700 1 --2- 172.21.15.153:0/946480315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f498415b370 0x7f498415b800 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f496c0098f0 tx=0x7f496c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835ceec5070e263c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f49827fc700 1 -- 172.21.15.153:0/946480315 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c004230 con 0x7f498415b370 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f49827fc700 1 -- 172.21.15.153:0/946480315 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c004390 con 0x7f498415b370 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.183+0000 7f49827fc700 1 -- 172.21.15.153:0/946480315 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c0036a0 con 0x7f498415b370 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.184+0000 7f498a1ad700 1 -- 172.21.15.153:0/946480315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f498415b370 msgr2=0x7f498415b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.184+0000 7f498a1ad700 1 --2- 172.21.15.153:0/946480315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f498415b370 0x7f498415b800 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f496c0098f0 tx=0x7f496c009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.184+0000 7f498a1ad700 1 -- 172.21.15.153:0/946480315 shutdown_connections 2023-11-24T08:07:02.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.184+0000 7f498a1ad700 1 --2- 172.21.15.153:0/946480315 >> v2:172.21.15.164:3300/0 conn(0x7f49841587f0 0x7f498406aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.184+0000 7f498a1ad700 1 --2- 172.21.15.153:0/946480315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f498415b370 0x7f498415b800 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.184+0000 7f498a1ad700 1 -- 172.21.15.153:0/946480315 >> 172.21.15.153:0/946480315 conn(0x7f49840d0bf0 msgr2=0x7f49840d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:02.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.184+0000 7f498a1ad700 1 -- 172.21.15.153:0/946480315 shutdown_connections 2023-11-24T08:07:02.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.184+0000 7f498a1ad700 1 -- 172.21.15.153:0/946480315 wait complete. 2023-11-24T08:07:02.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.185+0000 7f498a1ad700 1 Processor -- start 2023-11-24T08:07:02.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.185+0000 7f498a1ad700 1 -- start start 2023-11-24T08:07:02.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f498a1ad700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49840b3c60 0x7f4984147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f498a1ad700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49841587f0 0x7f49840b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f498a1ad700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f498415b370 0x7f4984073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f498a1ad700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4984151970 con 0x7f49841587f0 2023-11-24T08:07:02.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f498a1ad700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49841508d0 con 0x7f498415b370 2023-11-24T08:07:02.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f498a1ad700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4984150bb0 con 0x7f49840b3c60 2023-11-24T08:07:02.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f4982ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49841587f0 0x7f49840b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f4982ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49841587f0 0x7f49840b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39022/0 (socket says 172.21.15.153:39022) 2023-11-24T08:07:02.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f4982ffd700 1 -- 172.21.15.153:0/1168150265 learned_addr learned my addr 172.21.15.153:0/1168150265 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f49837fe700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49840b3c60 0x7f4984147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f4983fff700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f498415b370 0x7f4984073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f4982ffd700 1 -- 172.21.15.153:0/1168150265 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49840b3c60 msgr2=0x7f4984147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f4982ffd700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49840b3c60 0x7f4984147200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f4982ffd700 1 -- 172.21.15.153:0/1168150265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f498415b370 msgr2=0x7f4984073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f4982ffd700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f498415b370 0x7f4984073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.186+0000 7f4982ffd700 1 -- 172.21.15.153:0/1168150265 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c009550 con 0x7f49841587f0 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.187+0000 7f4982ffd700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49841587f0 0x7f49840b0ab0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f496c000c00 tx=0x7f496c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.187+0000 7f497bfff700 1 -- 172.21.15.153:0/1168150265 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c011830 con 0x7f49841587f0 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.187+0000 7f497bfff700 1 -- 172.21.15.153:0/1168150265 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c011990 con 0x7f49841587f0 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.187+0000 7f498a1ad700 1 -- 172.21.15.153:0/1168150265 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4984150e90 con 0x7f49841587f0 2023-11-24T08:07:02.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.187+0000 7f497bfff700 1 -- 172.21.15.153:0/1168150265 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c011d40 con 0x7f49841587f0 2023-11-24T08:07:02.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.187+0000 7f498a1ad700 1 -- 172.21.15.153:0/1168150265 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4984151450 con 0x7f49841587f0 2023-11-24T08:07:02.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.188+0000 7f498a1ad700 1 -- 172.21.15.153:0/1168150265 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49841515e0 con 0x7f49841587f0 2023-11-24T08:07:02.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.188+0000 7f497bfff700 1 -- 172.21.15.153:0/1168150265 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f496c01b440 con 0x7f49841587f0 2023-11-24T08:07:02.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.189+0000 7f497bfff700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f496406b080 0x7f496406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.189+0000 7f497bfff700 1 -- 172.21.15.153:0/1168150265 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f496c08b3f0 con 0x7f49841587f0 2023-11-24T08:07:02.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.189+0000 7f49837fe700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f496406b080 0x7f496406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.189+0000 7f49837fe700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f496406b080 0x7f496406d540 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4974006fd0 tx=0x7f4974008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.193+0000 7f497bfff700 1 -- 172.21.15.153:0/1168150265 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f496c0561d0 con 0x7f49841587f0 2023-11-24T08:07:02.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.382+0000 7f498a1ad700 1 -- 172.21.15.153:0/1168150265 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49840752f0 con 0x7f49841587f0 2023-11-24T08:07:02.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.384+0000 7f497bfff700 1 -- 172.21.15.153:0/1168150265 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+11 (secure 0 0 0) 0x7f496c0597f0 con 0x7f49841587f0 2023-11-24T08:07:02.385 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:07:02.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 -- 172.21.15.153:0/1168150265 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f496406b080 msgr2=0x7f496406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f496406b080 0x7f496406d540 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4974006fd0 tx=0x7f4974008040 comp rx=0 tx=0).stop 2023-11-24T08:07:02.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 -- 172.21.15.153:0/1168150265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49841587f0 msgr2=0x7f49840b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49841587f0 0x7f49840b0ab0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f496c000c00 tx=0x7f496c004750 comp rx=0 tx=0).stop 2023-11-24T08:07:02.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 -- 172.21.15.153:0/1168150265 shutdown_connections 2023-11-24T08:07:02.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f498415b370 0x7f4984073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49840b3c60 0x7f4984147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f496406b080 0x7f496406d540 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 --2- 172.21.15.153:0/1168150265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49841587f0 0x7f49840b0ab0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 -- 172.21.15.153:0/1168150265 >> 172.21.15.153:0/1168150265 conn(0x7f49840d0bf0 msgr2=0x7f498415de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:02.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 -- 172.21.15.153:0/1168150265 shutdown_connections 2023-11-24T08:07:02.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.386+0000 7f498a1ad700 1 -- 172.21.15.153:0/1168150265 wait complete. 2023-11-24T08:07:02.399 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.522+0000 7f7447c0f700 1 Processor -- start 2023-11-24T08:07:02.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.522+0000 7f7447c0f700 1 -- start start 2023-11-24T08:07:02.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f7447c0f700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f74401587f0 0x7f744006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f7447c0f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f74400b4370 0x7f744015b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f7447c0f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744006b530 con 0x7f744015b370 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f7447c0f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74400ae5e0 con 0x7f74400b4370 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f7447c0f700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744015be30 con 0x7f74401587f0 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f74461ac700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f74400b4370 0x7f744015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f74451aa700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f744015b370 0x7f74400b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45132/0 (socket says 172.21.15.153:45132) 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f74451aa700 1 -- 172.21.15.153:0/1771991298 learned_addr learned my addr 172.21.15.153:0/1771991298 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f74459ab700 1 --2- 172.21.15.153:0/1771991298 >> v2:172.21.15.164:3300/0 conn(0x7f74401587f0 0x7f744006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f74461ac700 1 -- 172.21.15.153:0/1771991298 >> v2:172.21.15.164:3300/0 conn(0x7f74401587f0 msgr2=0x7f744006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f74461ac700 1 --2- 172.21.15.153:0/1771991298 >> v2:172.21.15.164:3300/0 conn(0x7f74401587f0 0x7f744006aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f74461ac700 1 -- 172.21.15.153:0/1771991298 >> v1:172.21.15.153:6789/0 conn(0x7f744015b370 legacy=0x7f74400b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f74449a9700 1 -- 172.21.15.153:0/1771991298 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342924617 0 0) 0x7f744006b530 con 0x7f744015b370 2023-11-24T08:07:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f74461ac700 1 -- 172.21.15.153:0/1771991298 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744015c110 con 0x7f74400b4370 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f74459ab700 1 --2- 172.21.15.153:0/1771991298 >> v2:172.21.15.164:3300/0 conn(0x7f74401587f0 0x7f744006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.523+0000 7f74461ac700 1 --2- 172.21.15.153:0/1771991298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74400b4370 0x7f744015b800 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7438009d90 tx=0x7f743800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8272639c410e8a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.524+0000 7f74449a9700 1 -- 172.21.15.153:0/1771991298 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800e070 con 0x7f74400b4370 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.524+0000 7f74449a9700 1 -- 172.21.15.153:0/1771991298 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743800bb90 con 0x7f74400b4370 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.524+0000 7f74449a9700 1 -- 172.21.15.153:0/1771991298 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438012430 con 0x7f74400b4370 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.524+0000 7f7447c0f700 1 -- 172.21.15.153:0/1771991298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74400b4370 msgr2=0x7f744015b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.524+0000 7f7447c0f700 1 --2- 172.21.15.153:0/1771991298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74400b4370 0x7f744015b800 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7438009d90 tx=0x7f743800b330 comp rx=0 tx=0).stop 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.524+0000 7f7447c0f700 1 -- 172.21.15.153:0/1771991298 shutdown_connections 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.524+0000 7f7447c0f700 1 --2- 172.21.15.153:0/1771991298 >> v2:172.21.15.164:3300/0 conn(0x7f74401587f0 0x7f744006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.524+0000 7f7447c0f700 1 --2- 172.21.15.153:0/1771991298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74400b4370 0x7f744015b800 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.524+0000 7f7447c0f700 1 -- 172.21.15.153:0/1771991298 >> 172.21.15.153:0/1771991298 conn(0x7f74400d0bf0 msgr2=0x7f74400d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.524+0000 7f7447c0f700 1 -- 172.21.15.153:0/1771991298 shutdown_connections 2023-11-24T08:07:02.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.524+0000 7f7447c0f700 1 -- 172.21.15.153:0/1771991298 wait complete. 2023-11-24T08:07:02.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.525+0000 7f7447c0f700 1 Processor -- start 2023-11-24T08:07:02.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.525+0000 7f7447c0f700 1 -- start start 2023-11-24T08:07:02.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.526+0000 7f7447c0f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74400b4370 0x7f74400749a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.526+0000 7f7447c0f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74401587f0 0x7f74400c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.526+0000 7f7447c0f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f744015b370 0x7f74400c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.526+0000 7f7447c0f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74400c6e60 con 0x7f744015b370 2023-11-24T08:07:02.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.526+0000 7f7447c0f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74400c7100 con 0x7f74400b4370 2023-11-24T08:07:02.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.526+0000 7f7447c0f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74400c73e0 con 0x7f74401587f0 2023-11-24T08:07:02.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.526+0000 7f74461ac700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f744015b370 0x7f74400c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.526+0000 7f74461ac700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f744015b370 0x7f74400c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39038/0 (socket says 172.21.15.153:39038) 2023-11-24T08:07:02.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.526+0000 7f74461ac700 1 -- 172.21.15.153:0/682911205 learned_addr learned my addr 172.21.15.153:0/682911205 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:02.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.526+0000 7f74459ab700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74400b4370 0x7f74400749a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.526+0000 7f74451aa700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74401587f0 0x7f74400c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f74461ac700 1 -- 172.21.15.153:0/682911205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74401587f0 msgr2=0x7f74400c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f74461ac700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74401587f0 0x7f74400c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f74461ac700 1 -- 172.21.15.153:0/682911205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74400b4370 msgr2=0x7f74400749a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f74461ac700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74400b4370 0x7f74400749a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f74461ac700 1 -- 172.21.15.153:0/682911205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7438009a70 con 0x7f744015b370 2023-11-24T08:07:02.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f74451aa700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74401587f0 0x7f74400c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:02.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f74459ab700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74400b4370 0x7f74400749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f74461ac700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f744015b370 0x7f74400c5e40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7438014040 tx=0x7f7438004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f74367fc700 1 -- 172.21.15.153:0/682911205 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438012430 con 0x7f744015b370 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f74367fc700 1 -- 172.21.15.153:0/682911205 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438020070 con 0x7f744015b370 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f7447c0f700 1 -- 172.21.15.153:0/682911205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74400afee0 con 0x7f744015b370 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f74367fc700 1 -- 172.21.15.153:0/682911205 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438004280 con 0x7f744015b370 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.527+0000 7f7447c0f700 1 -- 172.21.15.153:0/682911205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74400b04a0 con 0x7f744015b370 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.528+0000 7f7447c0f700 1 -- 172.21.15.153:0/682911205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7440062190 con 0x7f744015b370 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.529+0000 7f74367fc700 1 -- 172.21.15.153:0/682911205 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f74380043e0 con 0x7f744015b370 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.529+0000 7f74367fc700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f742406b080 0x7f742406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.529+0000 7f74367fc700 1 -- 172.21.15.153:0/682911205 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7438022070 con 0x7f744015b370 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.529+0000 7f74459ab700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f742406b080 0x7f742406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.530+0000 7f74459ab700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f742406b080 0x7f742406d540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f743c009a50 tx=0x7f743c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.534+0000 7f74367fc700 1 -- 172.21.15.153:0/682911205 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7438056790 con 0x7f744015b370 2023-11-24T08:07:02.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.728+0000 7f7447c0f700 1 -- 172.21.15.153:0/682911205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74400b0630 con 0x7f744015b370 2023-11-24T08:07:02.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.729+0000 7f74367fc700 1 -- 172.21.15.153:0/682911205 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7438059db0 con 0x7f744015b370 2023-11-24T08:07:02.731 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:07:02.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 -- 172.21.15.153:0/682911205 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f742406b080 msgr2=0x7f742406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f742406b080 0x7f742406d540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f743c009a50 tx=0x7f743c008040 comp rx=0 tx=0).stop 2023-11-24T08:07:02.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 -- 172.21.15.153:0/682911205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f744015b370 msgr2=0x7f74400c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f744015b370 0x7f74400c5e40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7438014040 tx=0x7f7438004ad0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 -- 172.21.15.153:0/682911205 shutdown_connections 2023-11-24T08:07:02.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f742406b080 0x7f742406d540 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f744015b370 0x7f74400c5e40 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74400b4370 0x7f74400749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 --2- 172.21.15.153:0/682911205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74401587f0 0x7f74400c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 -- 172.21.15.153:0/682911205 >> 172.21.15.153:0/682911205 conn(0x7f74400d0bf0 msgr2=0x7f744006ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:02.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 -- 172.21.15.153:0/682911205 shutdown_connections 2023-11-24T08:07:02.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.731+0000 7f7447c0f700 1 -- 172.21.15.153:0/682911205 wait complete. 2023-11-24T08:07:02.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:02.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.863+0000 7f2342abe700 1 Processor -- start 2023-11-24T08:07:02.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.863+0000 7f2342abe700 1 -- start start 2023-11-24T08:07:02.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.864+0000 7f2342abe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f233c06c710 0x7f233c15eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.864+0000 7f2342abe700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c15f520 con 0x7f233c15ea60 2023-11-24T08:07:02.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.864+0000 7f2342abe700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c15f800 con 0x7f233c144660 2023-11-24T08:07:02.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.864+0000 7f2342abe700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c0b4230 con 0x7f233c06c710 2023-11-24T08:07:02.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.864+0000 7f234105b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f233c06c710 0x7f233c15eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.864+0000 7f233bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f233c15ea60 0x7f233c06c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45148/0 (socket says 172.21.15.153:45148) 2023-11-24T08:07:02.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.864+0000 7f233bfff700 1 -- 172.21.15.153:0/399348483 learned_addr learned my addr 172.21.15.153:0/399348483 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:02.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.864+0000 7f234105b700 1 -- 172.21.15.153:0/399348483 >> v1:172.21.15.164:6789/0 conn(0x7f233c144660 legacy=0x7f233c0b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.864+0000 7f234105b700 1 -- 172.21.15.153:0/399348483 >> v1:172.21.15.153:6789/0 conn(0x7f233c15ea60 legacy=0x7f233c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.864+0000 7f234105b700 1 -- 172.21.15.153:0/399348483 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0b3e50 con 0x7f233c06c710 2023-11-24T08:07:02.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.864+0000 7f234105b700 1 --2- 172.21.15.153:0/399348483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f233c06c710 0x7f233c15eef0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2334009d90 tx=0x7f233400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9603d308521abf61 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.865+0000 7f233b7fe700 1 -- 172.21.15.153:0/399348483 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233400e070 con 0x7f233c06c710 2023-11-24T08:07:02.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.865+0000 7f233b7fe700 1 -- 172.21.15.153:0/399348483 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233400bbd0 con 0x7f233c06c710 2023-11-24T08:07:02.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.865+0000 7f233b7fe700 1 -- 172.21.15.153:0/399348483 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334012430 con 0x7f233c06c710 2023-11-24T08:07:02.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.865+0000 7f2342abe700 1 -- 172.21.15.153:0/399348483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f233c06c710 msgr2=0x7f233c15eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.865+0000 7f2342abe700 1 --2- 172.21.15.153:0/399348483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f233c06c710 0x7f233c15eef0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2334009d90 tx=0x7f233400b330 comp rx=0 tx=0).stop 2023-11-24T08:07:02.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.865+0000 7f2342abe700 1 -- 172.21.15.153:0/399348483 shutdown_connections 2023-11-24T08:07:02.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.865+0000 7f2342abe700 1 --2- 172.21.15.153:0/399348483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f233c06c710 0x7f233c15eef0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.865+0000 7f2342abe700 1 -- 172.21.15.153:0/399348483 >> 172.21.15.153:0/399348483 conn(0x7f233c071ac0 msgr2=0x7f233c071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:02.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.865+0000 7f2342abe700 1 -- 172.21.15.153:0/399348483 shutdown_connections 2023-11-24T08:07:02.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.865+0000 7f2342abe700 1 -- 172.21.15.153:0/399348483 wait complete. 2023-11-24T08:07:02.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.867+0000 7f2342abe700 1 Processor -- start 2023-11-24T08:07:02.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.867+0000 7f2342abe700 1 -- start start 2023-11-24T08:07:02.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f2342abe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f233c06c710 0x7f233c1f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f2342abe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f233c144660 0x7f233c153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f2342abe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f233c15ea60 0x7f233c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f2342abe700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c156d70 con 0x7f233c144660 2023-11-24T08:07:02.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f2342abe700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c156160 con 0x7f233c06c710 2023-11-24T08:07:02.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f2342abe700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c156440 con 0x7f233c15ea60 2023-11-24T08:07:02.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f233bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f233c144660 0x7f233c153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f233bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f233c144660 0x7f233c153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39050/0 (socket says 172.21.15.153:39050) 2023-11-24T08:07:02.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f233bfff700 1 -- 172.21.15.153:0/1356524225 learned_addr learned my addr 172.21.15.153:0/1356524225 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:02.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f234085a700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f233c06c710 0x7f233c1f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f234105b700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f233c15ea60 0x7f233c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f233bfff700 1 -- 172.21.15.153:0/1356524225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f233c15ea60 msgr2=0x7f233c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f233bfff700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f233c15ea60 0x7f233c06aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f233bfff700 1 -- 172.21.15.153:0/1356524225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f233c06c710 msgr2=0x7f233c1f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f233bfff700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f233c06c710 0x7f233c1f1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f233bfff700 1 -- 172.21.15.153:0/1356524225 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334009a70 con 0x7f233c144660 2023-11-24T08:07:02.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f233bfff700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f233c144660 0x7f233c153fe0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f232800c480 tx=0x7f232800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.868+0000 7f23397fa700 1 -- 172.21.15.153:0/1356524225 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328005d70 con 0x7f233c144660 2023-11-24T08:07:02.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.869+0000 7f23397fa700 1 -- 172.21.15.153:0/1356524225 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232800ce90 con 0x7f233c144660 2023-11-24T08:07:02.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.869+0000 7f2342abe700 1 -- 172.21.15.153:0/1356524225 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c156720 con 0x7f233c144660 2023-11-24T08:07:02.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.869+0000 7f23397fa700 1 -- 172.21.15.153:0/1356524225 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23280072d0 con 0x7f233c144660 2023-11-24T08:07:02.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.869+0000 7f2342abe700 1 -- 172.21.15.153:0/1356524225 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c1f1580 con 0x7f233c144660 2023-11-24T08:07:02.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.869+0000 7f2342abe700 1 -- 172.21.15.153:0/1356524225 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c067f60 con 0x7f233c144660 2023-11-24T08:07:02.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.870+0000 7f23397fa700 1 -- 172.21.15.153:0/1356524225 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2328007430 con 0x7f233c144660 2023-11-24T08:07:02.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.870+0000 7f23397fa700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f232006b080 0x7f232006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.870+0000 7f23397fa700 1 -- 172.21.15.153:0/1356524225 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2328088b40 con 0x7f233c144660 2023-11-24T08:07:02.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.870+0000 7f234085a700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f232006b080 0x7f232006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.871+0000 7f234085a700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f232006b080 0x7f232006d540 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2330007fd0 tx=0x7f2330009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:02.875+0000 7f23397fa700 1 -- 172.21.15.153:0/1356524225 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23280539e0 con 0x7f233c144660 2023-11-24T08:07:03.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.106+0000 7f2342abe700 1 -- 172.21.15.153:0/1356524225 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f233c0b52c0 con 0x7f233c144660 2023-11-24T08:07:03.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.106+0000 7f23397fa700 1 -- 172.21.15.153:0/1356524225 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f2328017090 con 0x7f233c144660 2023-11-24T08:07:03.108 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:03.108 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:07:03.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 -- 172.21.15.153:0/1356524225 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f232006b080 msgr2=0x7f232006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f232006b080 0x7f232006d540 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2330007fd0 tx=0x7f2330009040 comp rx=0 tx=0).stop 2023-11-24T08:07:03.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 -- 172.21.15.153:0/1356524225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f233c144660 msgr2=0x7f233c153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f233c144660 0x7f233c153fe0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f232800c480 tx=0x7f232800c790 comp rx=0 tx=0).stop 2023-11-24T08:07:03.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 -- 172.21.15.153:0/1356524225 shutdown_connections 2023-11-24T08:07:03.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f233c15ea60 0x7f233c06aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f233c06c710 0x7f233c1f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f232006b080 0x7f232006d540 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 --2- 172.21.15.153:0/1356524225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f233c144660 0x7f233c153fe0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 -- 172.21.15.153:0/1356524225 >> 172.21.15.153:0/1356524225 conn(0x7f233c071ac0 msgr2=0x7f233c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:03.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 -- 172.21.15.153:0/1356524225 shutdown_connections 2023-11-24T08:07:03.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.108+0000 7f2342abe700 1 -- 172.21.15.153:0/1356524225 wait complete. 2023-11-24T08:07:03.111 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:07:03.122 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:03.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.243+0000 7f93e689b700 1 Processor -- start 2023-11-24T08:07:03.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.243+0000 7f93e689b700 1 -- start start 2023-11-24T08:07:03.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93e689b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e006c710 0x7f93e00cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93e689b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f93e00b49a0 0x7f93e00d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93e689b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e00d09a0 con 0x7f93e0152cc0 2023-11-24T08:07:03.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93e689b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e015c4b0 con 0x7f93e00b49a0 2023-11-24T08:07:03.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93e689b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e015c790 con 0x7f93e006c710 2023-11-24T08:07:03.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93e4e38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f93e00b49a0 0x7f93e00d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93dffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f93e0152cc0 0x7f93e006c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45160/0 (socket says 172.21.15.153:45160) 2023-11-24T08:07:03.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93dffff700 1 -- 172.21.15.153:0/1941970266 learned_addr learned my addr 172.21.15.153:0/1941970266 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:03.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93df7fe700 1 --2- 172.21.15.153:0/1941970266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e006c710 0x7f93e00cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93e4e38700 1 -- 172.21.15.153:0/1941970266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e006c710 msgr2=0x7f93e00cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:03.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93e4e38700 1 --2- 172.21.15.153:0/1941970266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e006c710 0x7f93e00cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93e4e38700 1 -- 172.21.15.153:0/1941970266 >> v1:172.21.15.153:6789/0 conn(0x7f93e0152cc0 legacy=0x7f93e006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93deffd700 1 -- 172.21.15.153:0/1941970266 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764182254 0 0) 0x7f93e00d09a0 con 0x7f93e0152cc0 2023-11-24T08:07:03.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.244+0000 7f93e4e38700 1 -- 172.21.15.153:0/1941970266 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e015ca70 con 0x7f93e00b49a0 2023-11-24T08:07:03.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93e4e38700 1 --2- 172.21.15.153:0/1941970266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e00b49a0 0x7f93e00d0460 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009d90 tx=0x7f93d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81ff81f1539669c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:03.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93deffd700 1 -- 172.21.15.153:0/1941970266 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800e070 con 0x7f93e00b49a0 2023-11-24T08:07:03.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93deffd700 1 -- 172.21.15.153:0/1941970266 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800bbd0 con 0x7f93e00b49a0 2023-11-24T08:07:03.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93deffd700 1 -- 172.21.15.153:0/1941970266 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8012430 con 0x7f93e00b49a0 2023-11-24T08:07:03.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93e689b700 1 -- 172.21.15.153:0/1941970266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e00b49a0 msgr2=0x7f93e00d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93e689b700 1 --2- 172.21.15.153:0/1941970266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e00b49a0 0x7f93e00d0460 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009d90 tx=0x7f93d800b330 comp rx=0 tx=0).stop 2023-11-24T08:07:03.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93e689b700 1 -- 172.21.15.153:0/1941970266 shutdown_connections 2023-11-24T08:07:03.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93e689b700 1 --2- 172.21.15.153:0/1941970266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e00b49a0 0x7f93e00d0460 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93e689b700 1 --2- 172.21.15.153:0/1941970266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e006c710 0x7f93e00cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93e689b700 1 -- 172.21.15.153:0/1941970266 >> 172.21.15.153:0/1941970266 conn(0x7f93e0071b90 msgr2=0x7f93e0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:03.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93e689b700 1 -- 172.21.15.153:0/1941970266 shutdown_connections 2023-11-24T08:07:03.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.245+0000 7f93e689b700 1 -- 172.21.15.153:0/1941970266 wait complete. 2023-11-24T08:07:03.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.247+0000 7f93e689b700 1 Processor -- start 2023-11-24T08:07:03.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.247+0000 7f93e689b700 1 -- start start 2023-11-24T08:07:03.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.247+0000 7f93e689b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e006c710 0x7f93e0150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.247+0000 7f93e689b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93e00b49a0 0x7f93e009c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.247+0000 7f93e689b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0152cc0 0x7f93e009c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.247+0000 7f93e689b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0150ba0 con 0x7f93e0152cc0 2023-11-24T08:07:03.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.247+0000 7f93e689b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e01f1ec0 con 0x7f93e00b49a0 2023-11-24T08:07:03.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.247+0000 7f93e689b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e009bed0 con 0x7f93e006c710 2023-11-24T08:07:03.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93e4e38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0152cc0 0x7f93e009c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93e4e38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0152cc0 0x7f93e009c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39066/0 (socket says 172.21.15.153:39066) 2023-11-24T08:07:03.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93e4e38700 1 -- 172.21.15.153:0/2625182456 learned_addr learned my addr 172.21.15.153:0/2625182456 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:03.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93dffff700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e006c710 0x7f93e0150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93df7fe700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93e00b49a0 0x7f93e009c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93e4e38700 1 -- 172.21.15.153:0/2625182456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e006c710 msgr2=0x7f93e0150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93e4e38700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e006c710 0x7f93e0150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93e4e38700 1 -- 172.21.15.153:0/2625182456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93e00b49a0 msgr2=0x7f93e009c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93e4e38700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93e00b49a0 0x7f93e009c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93e4e38700 1 -- 172.21.15.153:0/2625182456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8009a70 con 0x7f93e0152cc0 2023-11-24T08:07:03.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93e4e38700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0152cc0 0x7f93e009c960 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f93e00728e0 tx=0x7f93d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:03.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93dcff9700 1 -- 172.21.15.153:0/2625182456 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8012430 con 0x7f93e0152cc0 2023-11-24T08:07:03.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93dcff9700 1 -- 172.21.15.153:0/2625182456 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d8020070 con 0x7f93e0152cc0 2023-11-24T08:07:03.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93dcff9700 1 -- 172.21.15.153:0/2625182456 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8004280 con 0x7f93e0152cc0 2023-11-24T08:07:03.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93e689b700 1 -- 172.21.15.153:0/2625182456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e009d830 con 0x7f93e0152cc0 2023-11-24T08:07:03.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.248+0000 7f93e689b700 1 -- 172.21.15.153:0/2625182456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e009d270 con 0x7f93e0152cc0 2023-11-24T08:07:03.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.249+0000 7f93e689b700 1 -- 172.21.15.153:0/2625182456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e00753f0 con 0x7f93e0152cc0 2023-11-24T08:07:03.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.250+0000 7f93dcff9700 1 -- 172.21.15.153:0/2625182456 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f93d80043e0 con 0x7f93e0152cc0 2023-11-24T08:07:03.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.250+0000 7f93dcff9700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f93cc06b080 0x7f93cc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.250+0000 7f93dcff9700 1 -- 172.21.15.153:0/2625182456 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f93d8022070 con 0x7f93e0152cc0 2023-11-24T08:07:03.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.250+0000 7f93dffff700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f93cc06b080 0x7f93cc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.250+0000 7f93dffff700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f93cc06b080 0x7f93cc06d540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f93d4000f60 tx=0x7f93d4007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:03.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.255+0000 7f93dcff9700 1 -- 172.21.15.153:0/2625182456 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93d80567f0 con 0x7f93e0152cc0 2023-11-24T08:07:03.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.447+0000 7f93e689b700 1 -- 172.21.15.153:0/2625182456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93e015f9e0 con 0x7f93e0152cc0 2023-11-24T08:07:03.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.448+0000 7f93dcff9700 1 -- 172.21.15.153:0/2625182456 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16640 (secure 0 0 0) 0x7f93e015f9e0 con 0x7f93e0152cc0 2023-11-24T08:07:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:03.451 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":45,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:06:01.261362+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:41.978248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:42.535670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":5}]},{"pgid":"7.18","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:03.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 -- 172.21.15.153:0/2625182456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f93cc06b080 msgr2=0x7f93cc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f93cc06b080 0x7f93cc06d540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f93d4000f60 tx=0x7f93d4007e70 comp rx=0 tx=0).stop 2023-11-24T08:07:03.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 -- 172.21.15.153:0/2625182456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0152cc0 msgr2=0x7f93e009c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0152cc0 0x7f93e009c960 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f93e00728e0 tx=0x7f93d8004ad0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 -- 172.21.15.153:0/2625182456 shutdown_connections 2023-11-24T08:07:03.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f93cc06b080 0x7f93cc06d540 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0152cc0 0x7f93e009c960 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e006c710 0x7f93e0150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 --2- 172.21.15.153:0/2625182456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93e00b49a0 0x7f93e009c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 -- 172.21.15.153:0/2625182456 >> 172.21.15.153:0/2625182456 conn(0x7f93e0071b90 msgr2=0x7f93e006c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:03.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 -- 172.21.15.153:0/2625182456 shutdown_connections 2023-11-24T08:07:03.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.450+0000 7f93e689b700 1 -- 172.21.15.153:0/2625182456 wait complete. 2023-11-24T08:07:03.466 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:07:03.466 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:03.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.586+0000 7fa9eeea4700 1 Processor -- start 2023-11-24T08:07:03.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.586+0000 7fa9eeea4700 1 -- start start 2023-11-24T08:07:03.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.586+0000 7fa9eeea4700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa9e80d2380 0x7fa9e81604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.586+0000 7fa9eeea4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e80b22d0 con 0x7fa9e815bdd0 2023-11-24T08:07:03.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.586+0000 7fa9eeea4700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e80b25b0 con 0x7fa9e80b3370 2023-11-24T08:07:03.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.586+0000 7fa9eeea4700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e80b2f50 con 0x7fa9e80d2380 2023-11-24T08:07:03.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9ecc40700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa9e815bdd0 0x7fa9e80b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45174/0 (socket says 172.21.15.153:45174) 2023-11-24T08:07:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9ecc40700 1 -- 172.21.15.153:0/2665816439 learned_addr learned my addr 172.21.15.153:0/2665816439 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308599812 0 0) 0x7fa9e80b22d0 con 0x7fa9e815bdd0 2023-11-24T08:07:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9ed441700 1 --2- 172.21.15.153:0/2665816439 >> v2:172.21.15.164:3300/0 conn(0x7fa9e80d2380 0x7fa9e81604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d80035b0 con 0x7fa9e815bdd0 2023-11-24T08:07:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4205248500 0 0) 0x7fa9d80035b0 con 0x7fa9e815bdd0 2023-11-24T08:07:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 >> v2:172.21.15.164:3300/0 conn(0x7fa9e80d2380 msgr2=0x7fa9e81604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 --2- 172.21.15.153:0/2665816439 >> v2:172.21.15.164:3300/0 conn(0x7fa9e80d2380 0x7fa9e81604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 >> v1:172.21.15.164:6789/0 conn(0x7fa9e80b3370 legacy=0x7fa9e80d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e80b2890 con 0x7fa9e815bdd0 2023-11-24T08:07:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fa9dc001670 con 0x7fa9e815bdd0 2023-11-24T08:07:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 >> v1:172.21.15.153:6789/0 conn(0x7fa9e815bdd0 legacy=0x7fa9e80b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 --2- 172.21.15.153:0/2665816439 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9d8003a00 0x7fa9d8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 --2- 172.21.15.153:0/2665816439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 0x7fa9d8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 --2- 172.21.15.153:0/2665816439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9d8005210 0x7fa9d800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80b2f50 con 0x7fa9d8004850 2023-11-24T08:07:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d800c0b0 con 0x7fa9d8003a00 2023-11-24T08:07:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d800c270 con 0x7fa9d8005210 2023-11-24T08:07:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9e7fff700 1 --2- 172.21.15.153:0/2665816439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 0x7fa9d8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9ecc40700 1 --2- 172.21.15.153:0/2665816439 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9d8003a00 0x7fa9d8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.587+0000 7fa9ed441700 1 --2- 172.21.15.153:0/2665816439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9d8005210 0x7fa9d800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9e7fff700 1 -- 172.21.15.153:0/2665816439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9d8005210 msgr2=0x7fa9d800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9e7fff700 1 --2- 172.21.15.153:0/2665816439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9d8005210 0x7fa9d800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9e7fff700 1 -- 172.21.15.153:0/2665816439 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9d8003a00 msgr2=0x7fa9d8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9e7fff700 1 --2- 172.21.15.153:0/2665816439 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9d8003a00 0x7fa9d8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9e7fff700 1 -- 172.21.15.153:0/2665816439 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80035b0 con 0x7fa9d8004850 2023-11-24T08:07:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9ed441700 1 -- 172.21.15.153:0/2665816439 reap_dead start 2023-11-24T08:07:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9e7fff700 1 --2- 172.21.15.153:0/2665816439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 0x7fa9d8004cd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40017c0 tx=0x7fa9d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0d1b4246bfb5c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40052d0 con 0x7fa9d8004850 2023-11-24T08:07:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4005450 con 0x7fa9d8004850 2023-11-24T08:07:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9e77fe700 1 -- 172.21.15.153:0/2665816439 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40038c0 con 0x7fa9d8004850 2023-11-24T08:07:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9eeea4700 1 -- 172.21.15.153:0/2665816439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 msgr2=0x7fa9d8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9eeea4700 1 --2- 172.21.15.153:0/2665816439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 0x7fa9d8004cd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40017c0 tx=0x7fa9d8005880 comp rx=0 tx=0).stop 2023-11-24T08:07:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9eeea4700 1 -- 172.21.15.153:0/2665816439 shutdown_connections 2023-11-24T08:07:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9eeea4700 1 --2- 172.21.15.153:0/2665816439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 0x7fa9d8004cd0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.588+0000 7fa9eeea4700 1 -- 172.21.15.153:0/2665816439 >> 172.21.15.153:0/2665816439 conn(0x7fa9e80731a0 msgr2=0x7fa9e809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.589+0000 7fa9eeea4700 1 -- 172.21.15.153:0/2665816439 shutdown_connections 2023-11-24T08:07:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.589+0000 7fa9eeea4700 1 -- 172.21.15.153:0/2665816439 wait complete. 2023-11-24T08:07:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.590+0000 7fa9eeea4700 1 Processor -- start 2023-11-24T08:07:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.590+0000 7fa9eeea4700 1 -- start start 2023-11-24T08:07:03.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.590+0000 7fa9eeea4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 0x7fa9e80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9eeea4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9e81502a0 0x7fa9e80caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9eeea4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9e814fd50 0x7fa9e80cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9eeea4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80c8db0 con 0x7fa9d8004850 2023-11-24T08:07:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9eeea4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80cc710 con 0x7fa9e814fd50 2023-11-24T08:07:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9eeea4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80cb970 con 0x7fa9e81502a0 2023-11-24T08:07:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9ecc40700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 0x7fa9e80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9ecc40700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 0x7fa9e80ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39082/0 (socket says 172.21.15.153:39082) 2023-11-24T08:07:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9ecc40700 1 -- 172.21.15.153:0/3752422569 learned_addr learned my addr 172.21.15.153:0/3752422569 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9e7fff700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9e81502a0 0x7fa9e80caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9ed441700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9e814fd50 0x7fa9e80cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9ecc40700 1 -- 172.21.15.153:0/3752422569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9e81502a0 msgr2=0x7fa9e80caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9ecc40700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9e81502a0 0x7fa9e80caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9ecc40700 1 -- 172.21.15.153:0/3752422569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9e814fd50 msgr2=0x7fa9e80cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9ecc40700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9e814fd50 0x7fa9e80cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9ecc40700 1 -- 172.21.15.153:0/3752422569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e80c9000 con 0x7fa9d8004850 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9ecc40700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 0x7fa9e80ce610 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0072f0 tx=0x7fa9dc007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9e57fa700 1 -- 172.21.15.153:0/3752422569 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc011580 con 0x7fa9d8004850 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9e57fa700 1 -- 172.21.15.153:0/3752422569 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc0116e0 con 0x7fa9d8004850 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9eeea4700 1 -- 172.21.15.153:0/3752422569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e80c92e0 con 0x7fa9d8004850 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9e57fa700 1 -- 172.21.15.153:0/3752422569 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc011a70 con 0x7fa9d8004850 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.591+0000 7fa9eeea4700 1 -- 172.21.15.153:0/3752422569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e80c98a0 con 0x7fa9d8004850 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.592+0000 7fa9eeea4700 1 -- 172.21.15.153:0/3752422569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e8067f60 con 0x7fa9d8004850 2023-11-24T08:07:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.593+0000 7fa9e57fa700 1 -- 172.21.15.153:0/3752422569 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa9dc011bd0 con 0x7fa9d8004850 2023-11-24T08:07:03.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.594+0000 7fa9e57fa700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa9cc06b0b0 0x7fa9cc06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.594+0000 7fa9e57fa700 1 -- 172.21.15.153:0/3752422569 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa9dc089490 con 0x7fa9d8004850 2023-11-24T08:07:03.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.594+0000 7fa9e7fff700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa9cc06b0b0 0x7fa9cc06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.594+0000 7fa9e7fff700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa9cc06b0b0 0x7fa9cc06d570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4000c00 tx=0x7fa9d4009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:03.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.598+0000 7fa9e57fa700 1 -- 172.21.15.153:0/3752422569 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9dc054360 con 0x7fa9d8004850 2023-11-24T08:07:03.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.830+0000 7fa9eeea4700 1 -- 172.21.15.153:0/3752422569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9e80b7c60 con 0x7fa9d8004850 2023-11-24T08:07:03.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.831+0000 7fa9e57fa700 1 -- 172.21.15.153:0/3752422569 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fa9dc057980 con 0x7fa9d8004850 2023-11-24T08:07:03.840 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:03.841 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:07:03.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.832+0000 7fa9eeea4700 1 -- 172.21.15.153:0/3752422569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa9cc06b0b0 msgr2=0x7fa9cc06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.832+0000 7fa9eeea4700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa9cc06b0b0 0x7fa9cc06d570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4000c00 tx=0x7fa9d4009030 comp rx=0 tx=0).stop 2023-11-24T08:07:03.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.833+0000 7fa9eeea4700 1 -- 172.21.15.153:0/3752422569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 msgr2=0x7fa9e80ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.833+0000 7fa9eeea4700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 0x7fa9e80ce610 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0072f0 tx=0x7fa9dc007600 comp rx=0 tx=0).stop 2023-11-24T08:07:03.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.833+0000 7fa9eeea4700 1 -- 172.21.15.153:0/3752422569 shutdown_connections 2023-11-24T08:07:03.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.833+0000 7fa9eeea4700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9e814fd50 0x7fa9e80cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.833+0000 7fa9eeea4700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa9cc06b0b0 0x7fa9cc06d570 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.833+0000 7fa9eeea4700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9d8004850 0x7fa9e80ce610 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.833+0000 7fa9eeea4700 1 --2- 172.21.15.153:0/3752422569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9e81502a0 0x7fa9e80caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.833+0000 7fa9eeea4700 1 -- 172.21.15.153:0/3752422569 >> 172.21.15.153:0/3752422569 conn(0x7fa9e80731a0 msgr2=0x7fa9e80aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:03.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.833+0000 7fa9eeea4700 1 -- 172.21.15.153:0/3752422569 shutdown_connections 2023-11-24T08:07:03.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.833+0000 7fa9eeea4700 1 -- 172.21.15.153:0/3752422569 wait complete. 2023-11-24T08:07:03.847 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:07:03.850 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:03.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.974+0000 7fd0fad6f700 1 Processor -- start 2023-11-24T08:07:03.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.974+0000 7fd0fad6f700 1 -- start start 2023-11-24T08:07:03.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.974+0000 7fd0fad6f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd0f41446a0 0x7fd0f40b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.974+0000 7fd0fad6f700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd0f406c710 0x7fd0f40b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.974+0000 7fd0fad6f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f40af950 con 0x7fd0f40adf00 2023-11-24T08:07:03.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.974+0000 7fd0fad6f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f4144a80 con 0x7fd0f41446a0 2023-11-24T08:07:03.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.974+0000 7fd0fad6f700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f40afc30 con 0x7fd0f406c710 2023-11-24T08:07:03.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f8b0b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd0f41446a0 0x7fd0f40b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f8b0b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd0f41446a0 0x7fd0f40b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39090/0 (socket says 172.21.15.153:39090) 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f8b0b700 1 -- 172.21.15.153:0/2798733895 learned_addr learned my addr 172.21.15.153:0/2798733895 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f930c700 1 --2- 172.21.15.153:0/2798733895 >> v2:172.21.15.164:3300/0 conn(0x7fd0f406c710 0x7fd0f40b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f8b0b700 1 -- 172.21.15.153:0/2798733895 >> v2:172.21.15.164:3300/0 conn(0x7fd0f406c710 msgr2=0x7fd0f40b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f8b0b700 1 --2- 172.21.15.153:0/2798733895 >> v2:172.21.15.164:3300/0 conn(0x7fd0f406c710 0x7fd0f40b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f8b0b700 1 -- 172.21.15.153:0/2798733895 >> v1:172.21.15.164:6789/0 conn(0x7fd0f40adf00 legacy=0x7fd0f406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f8b0b700 1 -- 172.21.15.153:0/2798733895 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f40aff10 con 0x7fd0f41446a0 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f930c700 1 --2- 172.21.15.153:0/2798733895 >> v2:172.21.15.164:3300/0 conn(0x7fd0f406c710 0x7fd0f40b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f8b0b700 1 --2- 172.21.15.153:0/2798733895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0f41446a0 0x7fd0f40b5ae0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40aedf0 tx=0x7fd0e800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1ec521e9c623d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f37fe700 1 -- 172.21.15.153:0/2798733895 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800dcf0 con 0x7fd0f41446a0 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f37fe700 1 -- 172.21.15.153:0/2798733895 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e800de50 con 0x7fd0f41446a0 2023-11-24T08:07:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.975+0000 7fd0f37fe700 1 -- 172.21.15.153:0/2798733895 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8004250 con 0x7fd0f41446a0 2023-11-24T08:07:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.976+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2798733895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0f41446a0 msgr2=0x7fd0f40b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.976+0000 7fd0fad6f700 1 --2- 172.21.15.153:0/2798733895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0f41446a0 0x7fd0f40b5ae0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40aedf0 tx=0x7fd0e800be70 comp rx=0 tx=0).stop 2023-11-24T08:07:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.976+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2798733895 shutdown_connections 2023-11-24T08:07:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.976+0000 7fd0fad6f700 1 --2- 172.21.15.153:0/2798733895 >> v2:172.21.15.164:3300/0 conn(0x7fd0f406c710 0x7fd0f40b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.976+0000 7fd0fad6f700 1 --2- 172.21.15.153:0/2798733895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0f41446a0 0x7fd0f40b5ae0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.976+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2798733895 >> 172.21.15.153:0/2798733895 conn(0x7fd0f4071b90 msgr2=0x7fd0f4071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.976+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2798733895 shutdown_connections 2023-11-24T08:07:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.976+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2798733895 wait complete. 2023-11-24T08:07:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.977+0000 7fd0fad6f700 1 Processor -- start 2023-11-24T08:07:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.977+0000 7fd0fad6f700 1 -- start start 2023-11-24T08:07:03.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0fad6f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0f406c710 0x7fd0f409da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0fad6f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f40adf00 0x7fd0f409dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0fad6f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0f41446a0 0x7fd0f414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0fad6f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40d0070 con 0x7fd0f41446a0 2023-11-24T08:07:03.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0fad6f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f41496f0 con 0x7fd0f406c710 2023-11-24T08:07:03.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0fad6f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f41499d0 con 0x7fd0f40adf00 2023-11-24T08:07:03.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0f930c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0f41446a0 0x7fd0f414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0f930c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0f41446a0 0x7fd0f414b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39100/0 (socket says 172.21.15.153:39100) 2023-11-24T08:07:03.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0f930c700 1 -- 172.21.15.153:0/2058201272 learned_addr learned my addr 172.21.15.153:0/2058201272 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0f8b0b700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0f406c710 0x7fd0f409da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0f3fff700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f40adf00 0x7fd0f409dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0f930c700 1 -- 172.21.15.153:0/2058201272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f40adf00 msgr2=0x7fd0f409dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0f930c700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f40adf00 0x7fd0f409dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0f930c700 1 -- 172.21.15.153:0/2058201272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0f406c710 msgr2=0x7fd0f409da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0f930c700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0f406c710 0x7fd0f409da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0f930c700 1 -- 172.21.15.153:0/2058201272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e800b7f0 con 0x7fd0f41446a0 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.978+0000 7fd0f930c700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0f41446a0 0x7fd0f414b650 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00ce80 tx=0x7fd0ec00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.979+0000 7fd0f17fa700 1 -- 172.21.15.153:0/2058201272 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec00ad40 con 0x7fd0f41446a0 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.979+0000 7fd0f17fa700 1 -- 172.21.15.153:0/2058201272 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec015440 con 0x7fd0f41446a0 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.979+0000 7fd0f17fa700 1 -- 172.21.15.153:0/2058201272 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec00aea0 con 0x7fd0f41446a0 2023-11-24T08:07:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.979+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2058201272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f4149cb0 con 0x7fd0f41446a0 2023-11-24T08:07:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.979+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2058201272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f409b0d0 con 0x7fd0f41446a0 2023-11-24T08:07:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.980+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2058201272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f40753f0 con 0x7fd0f41446a0 2023-11-24T08:07:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.980+0000 7fd0f17fa700 1 -- 172.21.15.153:0/2058201272 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd0ec00d430 con 0x7fd0f41446a0 2023-11-24T08:07:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.981+0000 7fd0f17fa700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd0d806b080 0x7fd0d806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.981+0000 7fd0f17fa700 1 -- 172.21.15.153:0/2058201272 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd0ec089d00 con 0x7fd0f41446a0 2023-11-24T08:07:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.981+0000 7fd0f8b0b700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd0d806b080 0x7fd0d806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.981+0000 7fd0f8b0b700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd0d806b080 0x7fd0d806d540 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8000c00 tx=0x7fd0e801d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:03.985+0000 7fd0f17fa700 1 -- 172.21.15.153:0/2058201272 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0ec054b80 con 0x7fd0f41446a0 2023-11-24T08:07:04.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.222+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2058201272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0f4067f60 con 0x7fd0f41446a0 2023-11-24T08:07:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.222+0000 7fd0f17fa700 1 -- 172.21.15.153:0/2058201272 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fd0ec01a020 con 0x7fd0f41446a0 2023-11-24T08:07:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:04.224 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:43.574155+0000","modified":"2023-11-24T08:05:46.605461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6837/3585468907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3585468907},{"type":"v1","addr":"172.21.15.153:6837","nonce":3585468907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:07:04.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2058201272 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd0d806b080 msgr2=0x7fd0d806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd0d806b080 0x7fd0d806d540 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8000c00 tx=0x7fd0e801d040 comp rx=0 tx=0).stop 2023-11-24T08:07:04.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2058201272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0f41446a0 msgr2=0x7fd0f414b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0f41446a0 0x7fd0f414b650 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00ce80 tx=0x7fd0ec00ceb0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2058201272 shutdown_connections 2023-11-24T08:07:04.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd0d806b080 0x7fd0d806d540 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0f41446a0 0x7fd0f414b650 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0f406c710 0x7fd0f409da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 --2- 172.21.15.153:0/2058201272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f40adf00 0x7fd0f409dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2058201272 >> 172.21.15.153:0/2058201272 conn(0x7fd0f4071b90 msgr2=0x7fd0f40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:04.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2058201272 shutdown_connections 2023-11-24T08:07:04.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.225+0000 7fd0fad6f700 1 -- 172.21.15.153:0/2058201272 wait complete. 2023-11-24T08:07:04.228 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2023-11-24T08:07:04.238 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:04.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.357+0000 7f19a76b7700 1 Processor -- start 2023-11-24T08:07:04.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.357+0000 7f19a76b7700 1 -- start start 2023-11-24T08:07:04.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a76b7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19a00ce090 0x7f19a006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a76b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f19a0073f90 0x7f19a0074420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a76b7700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a006e7f0 con 0x7f19a015e2a0 2023-11-24T08:07:04.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a76b7700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a0074960 con 0x7f19a0073f90 2023-11-24T08:07:04.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a76b7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a006dec0 con 0x7f19a00ce090 2023-11-24T08:07:04.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a5c54700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f19a0073f90 0x7f19a0074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a5453700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f19a015e2a0 0x7f19a006ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45208/0 (socket says 172.21.15.153:45208) 2023-11-24T08:07:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a5453700 1 -- 172.21.15.153:0/281266727 learned_addr learned my addr 172.21.15.153:0/281266727 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a5c54700 1 -- 172.21.15.153:0/281266727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19a00ce090 msgr2=0x7f19a006ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a5c54700 1 --2- 172.21.15.153:0/281266727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19a00ce090 0x7f19a006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a5c54700 1 -- 172.21.15.153:0/281266727 >> v1:172.21.15.153:6789/0 conn(0x7f19a015e2a0 legacy=0x7f19a006ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.358+0000 7f19a5c54700 1 -- 172.21.15.153:0/281266727 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a006e1a0 con 0x7f19a0073f90 2023-11-24T08:07:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f19a5c54700 1 --2- 172.21.15.153:0/281266727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a0073f90 0x7f19a0074420 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1998009d90 tx=0x7f199800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2339aa5f30da83e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f1997fff700 1 -- 172.21.15.153:0/281266727 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199800e070 con 0x7f19a0073f90 2023-11-24T08:07:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f1997fff700 1 -- 172.21.15.153:0/281266727 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199800bbd0 con 0x7f19a0073f90 2023-11-24T08:07:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f1997fff700 1 -- 172.21.15.153:0/281266727 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998012430 con 0x7f19a0073f90 2023-11-24T08:07:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f19a76b7700 1 -- 172.21.15.153:0/281266727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a0073f90 msgr2=0x7f19a0074420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f19a76b7700 1 --2- 172.21.15.153:0/281266727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a0073f90 0x7f19a0074420 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1998009d90 tx=0x7f199800b330 comp rx=0 tx=0).stop 2023-11-24T08:07:04.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f19a76b7700 1 -- 172.21.15.153:0/281266727 shutdown_connections 2023-11-24T08:07:04.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f19a76b7700 1 --2- 172.21.15.153:0/281266727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a0073f90 0x7f19a0074420 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f19a76b7700 1 --2- 172.21.15.153:0/281266727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19a00ce090 0x7f19a006ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f19a76b7700 1 -- 172.21.15.153:0/281266727 >> 172.21.15.153:0/281266727 conn(0x7f19a00cd570 msgr2=0x7f19a00cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:04.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f19a76b7700 1 -- 172.21.15.153:0/281266727 shutdown_connections 2023-11-24T08:07:04.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.359+0000 7f19a76b7700 1 -- 172.21.15.153:0/281266727 wait complete. 2023-11-24T08:07:04.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.361+0000 7f19a76b7700 1 Processor -- start 2023-11-24T08:07:04.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.361+0000 7f19a76b7700 1 -- start start 2023-11-24T08:07:04.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.361+0000 7f19a76b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a0073f90 0x7f19a01f7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.361+0000 7f19a76b7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19a00ce090 0x7f19a01f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.361+0000 7f19a76b7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19a015e2a0 0x7f19a015c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.361+0000 7f19a76b7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a01f7d50 con 0x7f19a0073f90 2023-11-24T08:07:04.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.361+0000 7f19a76b7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00c63d0 con 0x7f19a015e2a0 2023-11-24T08:07:04.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.361+0000 7f19a76b7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00c6950 con 0x7f19a00ce090 2023-11-24T08:07:04.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.361+0000 7f19a5453700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a0073f90 0x7f19a01f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.361+0000 7f19a5453700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a0073f90 0x7f19a01f7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39110/0 (socket says 172.21.15.153:39110) 2023-11-24T08:07:04.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.361+0000 7f19a5453700 1 -- 172.21.15.153:0/3410934608 learned_addr learned my addr 172.21.15.153:0/3410934608 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:04.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.362+0000 7f19a5453700 1 -- 172.21.15.153:0/3410934608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19a00ce090 msgr2=0x7f19a01f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.362+0000 7f19a5453700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19a00ce090 0x7f19a01f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.362+0000 7f19a5453700 1 -- 172.21.15.153:0/3410934608 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19a015e2a0 msgr2=0x7f19a015c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.362+0000 7f19a5453700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19a015e2a0 0x7f19a015c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.362+0000 7f19a5453700 1 -- 172.21.15.153:0/3410934608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998009a70 con 0x7f19a0073f90 2023-11-24T08:07:04.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.362+0000 7f19a5453700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a0073f90 0x7f19a01f7810 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f199c00c520 tx=0x7f199c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:04.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.362+0000 7f1995ffb700 1 -- 172.21.15.153:0/3410934608 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c005d70 con 0x7f19a0073f90 2023-11-24T08:07:04.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.362+0000 7f1995ffb700 1 -- 172.21.15.153:0/3410934608 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0070d0 con 0x7f19a0073f90 2023-11-24T08:07:04.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.362+0000 7f1995ffb700 1 -- 172.21.15.153:0/3410934608 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c007440 con 0x7f19a0073f90 2023-11-24T08:07:04.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.362+0000 7f19a76b7700 1 -- 172.21.15.153:0/3410934608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a00c6670 con 0x7f19a0073f90 2023-11-24T08:07:04.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.362+0000 7f19a76b7700 1 -- 172.21.15.153:0/3410934608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a015f800 con 0x7f19a0073f90 2023-11-24T08:07:04.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.363+0000 7f19a76b7700 1 -- 172.21.15.153:0/3410934608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a0067f60 con 0x7f19a0073f90 2023-11-24T08:07:04.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.363+0000 7f1995ffb700 1 -- 172.21.15.153:0/3410934608 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f199c0075a0 con 0x7f19a0073f90 2023-11-24T08:07:04.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.364+0000 7f1995ffb700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f198406b080 0x7f198406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.364+0000 7f1995ffb700 1 -- 172.21.15.153:0/3410934608 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f199c088d40 con 0x7f19a0073f90 2023-11-24T08:07:04.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.364+0000 7f19a4c52700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f198406b080 0x7f198406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.364+0000 7f19a4c52700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f198406b080 0x7f198406d540 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f19a0161980 tx=0x7f1990006d20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:04.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.368+0000 7f1995ffb700 1 -- 172.21.15.153:0/3410934608 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f199c053be0 con 0x7f19a0073f90 2023-11-24T08:07:04.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.563+0000 7f19a76b7700 1 -- 172.21.15.153:0/3410934608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19a0072e00 con 0x7f19a0073f90 2023-11-24T08:07:04.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.564+0000 7f1995ffb700 1 -- 172.21.15.153:0/3410934608 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16640 (secure 0 0 0) 0x7f199c017090 con 0x7f19a0073f90 2023-11-24T08:07:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:04.566 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":45,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:06:01.261362+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:41.978248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:42.535670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":5}]},{"pgid":"7.18","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:04.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 -- 172.21.15.153:0/3410934608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f198406b080 msgr2=0x7f198406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f198406b080 0x7f198406d540 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f19a0161980 tx=0x7f1990006d20 comp rx=0 tx=0).stop 2023-11-24T08:07:04.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 -- 172.21.15.153:0/3410934608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a0073f90 msgr2=0x7f19a01f7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a0073f90 0x7f19a01f7810 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f199c00c520 tx=0x7f199c00c8e0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 -- 172.21.15.153:0/3410934608 shutdown_connections 2023-11-24T08:07:04.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19a015e2a0 0x7f19a015c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f198406b080 0x7f198406d540 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a0073f90 0x7f19a01f7810 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 --2- 172.21.15.153:0/3410934608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19a00ce090 0x7f19a01f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 -- 172.21.15.153:0/3410934608 >> 172.21.15.153:0/3410934608 conn(0x7f19a00cd570 msgr2=0x7f19a00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:04.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 -- 172.21.15.153:0/3410934608 shutdown_connections 2023-11-24T08:07:04.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.566+0000 7f19a76b7700 1 -- 172.21.15.153:0/3410934608 wait complete. 2023-11-24T08:07:04.580 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:07:04.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.700+0000 7f439c529700 1 Processor -- start 2023-11-24T08:07:04.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.700+0000 7f439c529700 1 -- start start 2023-11-24T08:07:04.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439c529700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43940b0ba0 0x7f43940af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439c529700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f439415ee90 0x7f439415b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439c529700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43940b2bd0 con 0x7f43940b0f80 2023-11-24T08:07:04.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439c529700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43940b1fc0 con 0x7f43940b0ba0 2023-11-24T08:07:04.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439c529700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43940b22a0 con 0x7f439415ee90 2023-11-24T08:07:04.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439a2c5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43940b0ba0 0x7f43940af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f4399ac4700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f43940b0f80 0x7f43940cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45224/0 (socket says 172.21.15.153:45224) 2023-11-24T08:07:04.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f4399ac4700 1 -- 172.21.15.153:0/1381630079 learned_addr learned my addr 172.21.15.153:0/1381630079 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:04.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439aac6700 1 --2- 172.21.15.153:0/1381630079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f439415ee90 0x7f439415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439a2c5700 1 -- 172.21.15.153:0/1381630079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f439415ee90 msgr2=0x7f439415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:04.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439a2c5700 1 --2- 172.21.15.153:0/1381630079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f439415ee90 0x7f439415b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439a2c5700 1 -- 172.21.15.153:0/1381630079 >> v1:172.21.15.153:6789/0 conn(0x7f43940b0f80 legacy=0x7f43940cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439a2c5700 1 -- 172.21.15.153:0/1381630079 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43940b2580 con 0x7f43940b0ba0 2023-11-24T08:07:04.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f43992c3700 1 -- 172.21.15.153:0/1381630079 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272719860 0 0) 0x7f43940b2bd0 con 0x7f43940b0f80 2023-11-24T08:07:04.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f439a2c5700 1 --2- 172.21.15.153:0/1381630079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43940b0ba0 0x7f43940af5c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f439000a9e0 tx=0x7f439000acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a848565a291bbdd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f43992c3700 1 -- 172.21.15.153:0/1381630079 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439000cb70 con 0x7f43940b0ba0 2023-11-24T08:07:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f43992c3700 1 -- 172.21.15.153:0/1381630079 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439000ccd0 con 0x7f43940b0ba0 2023-11-24T08:07:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.701+0000 7f43992c3700 1 -- 172.21.15.153:0/1381630079 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390018620 con 0x7f43940b0ba0 2023-11-24T08:07:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.702+0000 7f439c529700 1 -- 172.21.15.153:0/1381630079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43940b0ba0 msgr2=0x7f43940af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.702+0000 7f439c529700 1 --2- 172.21.15.153:0/1381630079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43940b0ba0 0x7f43940af5c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f439000a9e0 tx=0x7f439000acf0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.702+0000 7f439c529700 1 -- 172.21.15.153:0/1381630079 shutdown_connections 2023-11-24T08:07:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.702+0000 7f439c529700 1 --2- 172.21.15.153:0/1381630079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f439415ee90 0x7f439415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.702+0000 7f439c529700 1 --2- 172.21.15.153:0/1381630079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43940b0ba0 0x7f43940af5c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.702+0000 7f439c529700 1 -- 172.21.15.153:0/1381630079 >> 172.21.15.153:0/1381630079 conn(0x7f43940b57b0 msgr2=0x7f43940b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.702+0000 7f439c529700 1 -- 172.21.15.153:0/1381630079 shutdown_connections 2023-11-24T08:07:04.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.702+0000 7f439c529700 1 -- 172.21.15.153:0/1381630079 wait complete. 2023-11-24T08:07:04.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.703+0000 7f439c529700 1 Processor -- start 2023-11-24T08:07:04.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.703+0000 7f439c529700 1 -- start start 2023-11-24T08:07:04.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439c529700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43940b0ba0 0x7f43940ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439c529700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43940b0f80 0x7f43941507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439c529700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f439415ee90 0x7f439415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439c529700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43940af200 con 0x7f439415ee90 2023-11-24T08:07:04.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439c529700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43940ad9e0 con 0x7f43940b0f80 2023-11-24T08:07:04.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439c529700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43940b3060 con 0x7f43940b0ba0 2023-11-24T08:07:04.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439aac6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f439415ee90 0x7f439415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439aac6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f439415ee90 0x7f439415ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39128/0 (socket says 172.21.15.153:39128) 2023-11-24T08:07:04.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439aac6700 1 -- 172.21.15.153:0/3295694731 learned_addr learned my addr 172.21.15.153:0/3295694731 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:04.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439a2c5700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43940b0ba0 0x7f43940ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f4399ac4700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43940b0f80 0x7f43941507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439aac6700 1 -- 172.21.15.153:0/3295694731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43940b0ba0 msgr2=0x7f43940ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439aac6700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43940b0ba0 0x7f43940ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439aac6700 1 -- 172.21.15.153:0/3295694731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43940b0f80 msgr2=0x7f43941507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439aac6700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43940b0f80 0x7f43941507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f439aac6700 1 -- 172.21.15.153:0/3295694731 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439000a640 con 0x7f439415ee90 2023-11-24T08:07:04.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.704+0000 7f4399ac4700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43940b0f80 0x7f43941507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:04.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.705+0000 7f439aac6700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f439415ee90 0x7f439415ce10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f438c007e60 tx=0x7f438c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:04.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.705+0000 7f438affd700 1 -- 172.21.15.153:0/3295694731 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c00ede0 con 0x7f439415ee90 2023-11-24T08:07:04.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.705+0000 7f438affd700 1 -- 172.21.15.153:0/3295694731 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c014420 con 0x7f439415ee90 2023-11-24T08:07:04.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.705+0000 7f439c529700 1 -- 172.21.15.153:0/3295694731 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43940ad7b0 con 0x7f439415ee90 2023-11-24T08:07:04.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.705+0000 7f438affd700 1 -- 172.21.15.153:0/3295694731 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c0147d0 con 0x7f439415ee90 2023-11-24T08:07:04.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.705+0000 7f439c529700 1 -- 172.21.15.153:0/3295694731 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43940b3ba0 con 0x7f439415ee90 2023-11-24T08:07:04.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.706+0000 7f439c529700 1 -- 172.21.15.153:0/3295694731 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43941f5650 con 0x7f439415ee90 2023-11-24T08:07:04.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.706+0000 7f438affd700 1 -- 172.21.15.153:0/3295694731 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f438c014930 con 0x7f439415ee90 2023-11-24T08:07:04.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.706+0000 7f438affd700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f437806b080 0x7f437806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.706+0000 7f438affd700 1 -- 172.21.15.153:0/3295694731 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f438c089fc0 con 0x7f439415ee90 2023-11-24T08:07:04.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.706+0000 7f439a2c5700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f437806b080 0x7f437806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.707+0000 7f439a2c5700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f437806b080 0x7f437806d540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f439000a1c0 tx=0x7f4390012000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:04.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.711+0000 7f438affd700 1 -- 172.21.15.153:0/3295694731 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f438c0bce90 con 0x7f439415ee90 2023-11-24T08:07:04.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.944+0000 7f439c529700 1 -- 172.21.15.153:0/3295694731 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f43940b3d30 con 0x7f439415ee90 2023-11-24T08:07:04.947 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-11-24T08:07:04.945+0000 7f3f0fc90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:07:04.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.946+0000 7f438affd700 1 -- 172.21.15.153:0/3295694731 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f438c054db0 con 0x7f439415ee90 2023-11-24T08:07:04.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 -- 172.21.15.153:0/3295694731 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f437806b080 msgr2=0x7f437806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f437806b080 0x7f437806d540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f439000a1c0 tx=0x7f4390012000 comp rx=0 tx=0).stop 2023-11-24T08:07:04.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 -- 172.21.15.153:0/3295694731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f439415ee90 msgr2=0x7f439415ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f439415ee90 0x7f439415ce10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f438c007e60 tx=0x7f438c00e3c0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 -- 172.21.15.153:0/3295694731 shutdown_connections 2023-11-24T08:07:04.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f437806b080 0x7f437806d540 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f439415ee90 0x7f439415ce10 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43940b0ba0 0x7f43940ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 --2- 172.21.15.153:0/3295694731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43940b0f80 0x7f43941507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 -- 172.21.15.153:0/3295694731 >> 172.21.15.153:0/3295694731 conn(0x7f43940b57b0 msgr2=0x7f4394152670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:04.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 -- 172.21.15.153:0/3295694731 shutdown_connections 2023-11-24T08:07:04.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:04.949+0000 7f439c529700 1 -- 172.21.15.153:0/3295694731 wait complete. 2023-11-24T08:07:04.952 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:07:04.964 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:07:04.991 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-11-24T08:07:05.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.086+0000 7fd15deb5700 1 Processor -- start 2023-11-24T08:07:05.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.086+0000 7fd15deb5700 1 -- start start 2023-11-24T08:07:05.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.087+0000 7fd15deb5700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd1581587f0 0x7fd15806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:05.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.087+0000 7fd15deb5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1580b4370 0x7fd15815b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:05.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.087+0000 7fd15deb5700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15806b530 con 0x7fd15815b370 2023-11-24T08:07:05.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.087+0000 7fd15deb5700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1580ae5e0 con 0x7fd1581587f0 2023-11-24T08:07:05.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.087+0000 7fd15deb5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15815be30 con 0x7fd1580b4370 2023-11-24T08:07:05.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd1577fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd1581587f0 0x7fd15806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:05.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd157fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1580b4370 0x7fd15815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:05.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd156ffd700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fd15815b370 0x7fd1580b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:52936/0 (socket says 172.21.15.153:52936) 2023-11-24T08:07:05.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd1577fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd1581587f0 0x7fd15806aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:60736/0 (socket says 172.21.15.153:60736) 2023-11-24T08:07:05.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd156ffd700 1 -- 172.21.15.153:0/527429980 learned_addr learned my addr 172.21.15.153:0/527429980 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:05.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd157fff700 1 -- 172.21.15.153:0/527429980 >> v2:172.21.15.164:3300/0 conn(0x7fd1581587f0 msgr2=0x7fd15806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:05.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd157fff700 1 --2- 172.21.15.153:0/527429980 >> v2:172.21.15.164:3300/0 conn(0x7fd1581587f0 0x7fd15806aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:05.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd157fff700 1 -- 172.21.15.153:0/527429980 >> v1:172.21.15.164:6789/0 conn(0x7fd15815b370 legacy=0x7fd1580b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:05.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd157fff700 1 -- 172.21.15.153:0/527429980 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15815c110 con 0x7fd1580b4370 2023-11-24T08:07:05.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd1577fe700 1 --2- 172.21.15.153:0/527429980 >> v2:172.21.15.164:3300/0 conn(0x7fd1581587f0 0x7fd15806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:05.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd157fff700 1 --2- 172.21.15.153:0/527429980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1580b4370 0x7fd15815b800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd150009d90 tx=0x7fd15000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=481fc8cf1cf3496a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:05.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd1567fc700 1 -- 172.21.15.153:0/527429980 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15000e070 con 0x7fd1580b4370 2023-11-24T08:07:05.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd1567fc700 1 -- 172.21.15.153:0/527429980 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15000bb20 con 0x7fd1580b4370 2023-11-24T08:07:05.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.088+0000 7fd1567fc700 1 -- 172.21.15.153:0/527429980 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150012430 con 0x7fd1580b4370 2023-11-24T08:07:05.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.089+0000 7fd15deb5700 1 -- 172.21.15.153:0/527429980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1580b4370 msgr2=0x7fd15815b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:05.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.089+0000 7fd15deb5700 1 --2- 172.21.15.153:0/527429980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1580b4370 0x7fd15815b800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd150009d90 tx=0x7fd15000b330 comp rx=0 tx=0).stop 2023-11-24T08:07:05.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.089+0000 7fd15deb5700 1 -- 172.21.15.153:0/527429980 shutdown_connections 2023-11-24T08:07:05.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.089+0000 7fd15deb5700 1 --2- 172.21.15.153:0/527429980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1580b4370 0x7fd15815b800 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:05.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.089+0000 7fd15deb5700 1 --2- 172.21.15.153:0/527429980 >> v2:172.21.15.164:3300/0 conn(0x7fd1581587f0 0x7fd15806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:05.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.089+0000 7fd15deb5700 1 -- 172.21.15.153:0/527429980 >> 172.21.15.153:0/527429980 conn(0x7fd1580d0bf0 msgr2=0x7fd1580d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:05.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.089+0000 7fd15deb5700 1 -- 172.21.15.153:0/527429980 shutdown_connections 2023-11-24T08:07:05.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.089+0000 7fd15deb5700 1 -- 172.21.15.153:0/527429980 wait complete. 2023-11-24T08:07:05.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.090+0000 7fd15deb5700 1 Processor -- start 2023-11-24T08:07:05.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.090+0000 7fd15deb5700 1 -- start start 2023-11-24T08:07:05.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd15deb5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1580b4370 0x7fd1580c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:05.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd15deb5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1581587f0 0x7fd1581542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:05.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd15deb5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15815b370 0x7fd1580c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:05.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd15deb5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580c64b0 con 0x7fd1580b4370 2023-11-24T08:07:05.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd15deb5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580c6790 con 0x7fd15815b370 2023-11-24T08:07:05.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd15deb5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580c6a70 con 0x7fd1581587f0 2023-11-24T08:07:05.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd1577fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1580b4370 0x7fd1580c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:05.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd1577fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1580b4370 0x7fd1580c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39156/0 (socket says 172.21.15.153:39156) 2023-11-24T08:07:05.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd1577fe700 1 -- 172.21.15.153:0/847709349 learned_addr learned my addr 172.21.15.153:0/847709349 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:05.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd156ffd700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1581587f0 0x7fd1581542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:05.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd157fff700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15815b370 0x7fd1580c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:05.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd1577fe700 1 -- 172.21.15.153:0/847709349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1581587f0 msgr2=0x7fd1581542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:05.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd1577fe700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1581587f0 0x7fd1581542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:05.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd1577fe700 1 -- 172.21.15.153:0/847709349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15815b370 msgr2=0x7fd1580c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:05.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd1577fe700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15815b370 0x7fd1580c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:05.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd1577fe700 1 -- 172.21.15.153:0/847709349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1480094a0 con 0x7fd1580b4370 2023-11-24T08:07:05.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.091+0000 7fd156ffd700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1581587f0 0x7fd1581542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:05.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.092+0000 7fd1577fe700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1580b4370 0x7fd1580c7550 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd14800ebe0 tx=0x7fd14800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:05.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.092+0000 7fd13ffff700 1 -- 172.21.15.153:0/847709349 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800c850 con 0x7fd1580b4370 2023-11-24T08:07:05.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.092+0000 7fd13ffff700 1 -- 172.21.15.153:0/847709349 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14800c9b0 con 0x7fd1580b4370 2023-11-24T08:07:05.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.092+0000 7fd15deb5700 1 -- 172.21.15.153:0/847709349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd150009a70 con 0x7fd1580b4370 2023-11-24T08:07:05.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.092+0000 7fd13ffff700 1 -- 172.21.15.153:0/847709349 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800cd40 con 0x7fd1580b4370 2023-11-24T08:07:05.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.092+0000 7fd15deb5700 1 -- 172.21.15.153:0/847709349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1580c7030 con 0x7fd1580b4370 2023-11-24T08:07:05.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.093+0000 7fd15deb5700 1 -- 172.21.15.153:0/847709349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15806fab0 con 0x7fd1580b4370 2023-11-24T08:07:05.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.093+0000 7fd13ffff700 1 -- 172.21.15.153:0/847709349 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd148013470 con 0x7fd1580b4370 2023-11-24T08:07:05.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.094+0000 7fd13ffff700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14406b080 0x7fd14406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:05.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.094+0000 7fd13ffff700 1 -- 172.21.15.153:0/847709349 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd148089a00 con 0x7fd1580b4370 2023-11-24T08:07:05.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.094+0000 7fd156ffd700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14406b080 0x7fd14406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:05.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.094+0000 7fd156ffd700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14406b080 0x7fd14406d540 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd158156c40 tx=0x7fd14c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:05.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.098+0000 7fd13ffff700 1 -- 172.21.15.153:0/847709349 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1480547a0 con 0x7fd1580b4370 2023-11-24T08:07:05.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.335+0000 7fd15deb5700 1 -- 172.21.15.153:0/847709349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd158068fb0 con 0x7fd1580b4370 2023-11-24T08:07:05.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.948+0000 7fd13ffff700 1 -- 172.21.15.153:0/847709349 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd14800cea0 con 0x7fd1580b4370 2023-11-24T08:07:05.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.951+0000 7fd15deb5700 1 -- 172.21.15.153:0/847709349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14406b080 msgr2=0x7fd14406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:05.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.951+0000 7fd15deb5700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14406b080 0x7fd14406d540 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd158156c40 tx=0x7fd14c009040 comp rx=0 tx=0).stop 2023-11-24T08:07:05.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.951+0000 7fd15deb5700 1 -- 172.21.15.153:0/847709349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1580b4370 msgr2=0x7fd1580c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:05.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.951+0000 7fd15deb5700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1580b4370 0x7fd1580c7550 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd14800ebe0 tx=0x7fd14800eef0 comp rx=0 tx=0).stop 2023-11-24T08:07:05.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.951+0000 7fd15deb5700 1 -- 172.21.15.153:0/847709349 shutdown_connections 2023-11-24T08:07:05.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.951+0000 7fd15deb5700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15815b370 0x7fd1580c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:05.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.951+0000 7fd15deb5700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd14406b080 0x7fd14406d540 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:05.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.951+0000 7fd15deb5700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1580b4370 0x7fd1580c7550 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:05.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.951+0000 7fd15deb5700 1 --2- 172.21.15.153:0/847709349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1581587f0 0x7fd1581542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:05.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.951+0000 7fd15deb5700 1 -- 172.21.15.153:0/847709349 >> 172.21.15.153:0/847709349 conn(0x7fd1580d0bf0 msgr2=0x7fd158071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:05.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.952+0000 7fd15deb5700 1 -- 172.21.15.153:0/847709349 shutdown_connections 2023-11-24T08:07:05.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:05.952+0000 7fd15deb5700 1 -- 172.21.15.153:0/847709349 wait complete. 2023-11-24T08:07:05.968 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:07:06.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.140+0000 7f1d63a1c700 1 Processor -- start 2023-11-24T08:07:06.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.140+0000 7f1d63a1c700 1 -- start start 2023-11-24T08:07:06.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.141+0000 7f1d63a1c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1d5c0746a0 0x7f1d5c06e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:06.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.141+0000 7f1d63a1c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5c0b5e50 con 0x7f1d5c0b59c0 2023-11-24T08:07:06.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.141+0000 7f1d63a1c700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5c0b05c0 con 0x7f1d5c0b01e0 2023-11-24T08:07:06.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.141+0000 7f1d63a1c700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d5c1470a0 con 0x7f1d5c0746a0 2023-11-24T08:07:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.141+0000 7f1d61fb9700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1d5c0b59c0 0x7f1d5c06aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45274/0 (socket says 172.21.15.153:45274) 2023-11-24T08:07:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.141+0000 7f1d61fb9700 1 -- 172.21.15.153:0/3602534070 learned_addr learned my addr 172.21.15.153:0/3602534070 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935205783 0 0) 0x7f1d54001490 con 0x7f1d5c0b59c0 2023-11-24T08:07:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d60fb7700 1 --2- 172.21.15.153:0/3602534070 >> v2:172.21.15.164:3300/0 conn(0x7f1d5c0746a0 0x7f1d5c06e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d480035b0 con 0x7f1d5c0b59c0 2023-11-24T08:07:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 304559907 0 0) 0x7f1d480035b0 con 0x7f1d5c0b59c0 2023-11-24T08:07:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 >> v2:172.21.15.164:3300/0 conn(0x7f1d5c0746a0 msgr2=0x7f1d5c06e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 --2- 172.21.15.153:0/3602534070 >> v2:172.21.15.164:3300/0 conn(0x7f1d5c0746a0 0x7f1d5c06e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:06.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 >> v1:172.21.15.164:6789/0 conn(0x7f1d5c0b01e0 legacy=0x7f1d5c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c0b4250 con 0x7f1d5c0b59c0 2023-11-24T08:07:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f1d54001b80 con 0x7f1d5c0b59c0 2023-11-24T08:07:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 >> v1:172.21.15.153:6789/0 conn(0x7f1d5c0b59c0 legacy=0x7f1d5c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d48003a00 0x7f1d48003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d48004850 0x7f1d48004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d48005210 0x7f1d4800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c1470a0 con 0x7f1d48003a00 2023-11-24T08:07:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4800c1b0 con 0x7f1d48004850 2023-11-24T08:07:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4800c370 con 0x7f1d48005210 2023-11-24T08:07:06.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d617b8700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d48003a00 0x7f1d48003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:06.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d60fb7700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d48004850 0x7f1d48004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:06.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d61fb9700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d48005210 0x7f1d4800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:06.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d617b8700 1 -- 172.21.15.153:0/3602534070 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d48005210 msgr2=0x7f1d4800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:06.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d617b8700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d48005210 0x7f1d4800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:06.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d617b8700 1 -- 172.21.15.153:0/3602534070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d48004850 msgr2=0x7f1d48004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:06.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d617b8700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d48004850 0x7f1d48004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:06.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d617b8700 1 -- 172.21.15.153:0/3602534070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d480035b0 con 0x7f1d48003a00 2023-11-24T08:07:06.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d61fb9700 1 -- 172.21.15.153:0/3602534070 reap_dead start 2023-11-24T08:07:06.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d60fb7700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d48004850 0x7f1d48004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:06.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.142+0000 7f1d617b8700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d48003a00 0x7f1d48003e20 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0017c0 tx=0x7f1d48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddcd91c44f1cf07 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:06.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.143+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0052d0 con 0x7f1d48003a00 2023-11-24T08:07:06.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.143+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4c005450 con 0x7f1d48003a00 2023-11-24T08:07:06.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.143+0000 7f1d53fff700 1 -- 172.21.15.153:0/3602534070 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0038c0 con 0x7f1d48003a00 2023-11-24T08:07:06.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.143+0000 7f1d63a1c700 1 -- 172.21.15.153:0/3602534070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d48003a00 msgr2=0x7f1d48003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:06.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.143+0000 7f1d63a1c700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d48003a00 0x7f1d48003e20 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0017c0 tx=0x7f1d48005880 comp rx=0 tx=0).stop 2023-11-24T08:07:06.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.143+0000 7f1d63a1c700 1 -- 172.21.15.153:0/3602534070 shutdown_connections 2023-11-24T08:07:06.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.143+0000 7f1d63a1c700 1 --2- 172.21.15.153:0/3602534070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d48003a00 0x7f1d48003e20 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:06.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.143+0000 7f1d63a1c700 1 -- 172.21.15.153:0/3602534070 >> 172.21.15.153:0/3602534070 conn(0x7f1d5c0d0b40 msgr2=0x7f1d5c0d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:06.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.143+0000 7f1d63a1c700 1 -- 172.21.15.153:0/3602534070 shutdown_connections 2023-11-24T08:07:06.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.143+0000 7f1d63a1c700 1 -- 172.21.15.153:0/3602534070 wait complete. 2023-11-24T08:07:06.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.144+0000 7f1d63a1c700 1 Processor -- start 2023-11-24T08:07:06.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.144+0000 7f1d63a1c700 1 -- start start 2023-11-24T08:07:06.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d63a1c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d48003a00 0x7f1d5c160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:06.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d63a1c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d5c0c6ac0 0x7f1d5c1f7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:06.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d63a1c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d5c0c6f40 0x7f1d5c1f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:06.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d63a1c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c13feb0 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d63a1c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c0c74d0 con 0x7f1d48003a00 2023-11-24T08:07:06.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d63a1c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c0c77b0 con 0x7f1d5c0c6f40 2023-11-24T08:07:06.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d60fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d5c0c6ac0 0x7f1d5c1f7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:06.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d60fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d5c0c6ac0 0x7f1d5c1f7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39180/0 (socket says 172.21.15.153:39180) 2023-11-24T08:07:06.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d60fb7700 1 -- 172.21.15.153:0/744864489 learned_addr learned my addr 172.21.15.153:0/744864489 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:06.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d617b8700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d48003a00 0x7f1d5c160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:06.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d61fb9700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d5c0c6f40 0x7f1d5c1f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:06.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d60fb7700 1 -- 172.21.15.153:0/744864489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d5c0c6f40 msgr2=0x7f1d5c1f7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:06.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d60fb7700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d5c0c6f40 0x7f1d5c1f7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:06.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d60fb7700 1 -- 172.21.15.153:0/744864489 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d48003a00 msgr2=0x7f1d5c160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:06.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d60fb7700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d48003a00 0x7f1d5c160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:06.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.145+0000 7f1d60fb7700 1 -- 172.21.15.153:0/744864489 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c140100 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.146+0000 7f1d617b8700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d48003a00 0x7f1d5c160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:06.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.146+0000 7f1d60fb7700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d5c0c6ac0 0x7f1d5c1f7840 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1d58011550 tx=0x7f1d58011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:06.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.146+0000 7f1d51ffb700 1 -- 172.21.15.153:0/744864489 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58015870 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.146+0000 7f1d51ffb700 1 -- 172.21.15.153:0/744864489 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d580159d0 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.146+0000 7f1d63a1c700 1 -- 172.21.15.153:0/744864489 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5c1403e0 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.146+0000 7f1d51ffb700 1 -- 172.21.15.153:0/744864489 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58015d80 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.146+0000 7f1d63a1c700 1 -- 172.21.15.153:0/744864489 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5c161350 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.147+0000 7f1d63a1c700 1 -- 172.21.15.153:0/744864489 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5c140750 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.148+0000 7f1d51ffb700 1 -- 172.21.15.153:0/744864489 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1d58013400 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.148+0000 7f1d51ffb700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d4006b080 0x7f1d4006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:06.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.148+0000 7f1d51ffb700 1 -- 172.21.15.153:0/744864489 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1d58089b80 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.148+0000 7f1d617b8700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d4006b080 0x7f1d4006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:06.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.149+0000 7f1d617b8700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d4006b080 0x7f1d4006d540 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c000c00 tx=0x7f1d4c009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:06.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.153+0000 7f1d51ffb700 1 -- 172.21.15.153:0/744864489 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d580549b0 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.346+0000 7f1d63a1c700 1 -- 172.21.15.153:0/744864489 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1d5c067f60 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.954+0000 7f1d51ffb700 1 -- 172.21.15.153:0/744864489 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1d580230d0 con 0x7f1d5c0c6ac0 2023-11-24T08:07:06.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 -- 172.21.15.153:0/744864489 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d4006b080 msgr2=0x7f1d4006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:06.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d4006b080 0x7f1d4006d540 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c000c00 tx=0x7f1d4c009030 comp rx=0 tx=0).stop 2023-11-24T08:07:06.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 -- 172.21.15.153:0/744864489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d5c0c6ac0 msgr2=0x7f1d5c1f7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:06.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d5c0c6ac0 0x7f1d5c1f7840 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1d58011550 tx=0x7f1d58011910 comp rx=0 tx=0).stop 2023-11-24T08:07:06.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 -- 172.21.15.153:0/744864489 shutdown_connections 2023-11-24T08:07:06.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d5c0c6f40 0x7f1d5c1f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:06.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d48003a00 0x7f1d5c160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:06.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1d4006b080 0x7f1d4006d540 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:06.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 --2- 172.21.15.153:0/744864489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d5c0c6ac0 0x7f1d5c1f7840 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:06.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 -- 172.21.15.153:0/744864489 >> 172.21.15.153:0/744864489 conn(0x7f1d5c0d0b40 msgr2=0x7f1d5c073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:06.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 -- 172.21.15.153:0/744864489 shutdown_connections 2023-11-24T08:07:06.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:06.957+0000 7f1d63a1c700 1 -- 172.21.15.153:0/744864489 wait complete. 2023-11-24T08:07:06.961 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:07:06.973 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:07:07.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.099+0000 7f340ec19700 1 Processor -- start 2023-11-24T08:07:07.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.099+0000 7f340ec19700 1 -- start start 2023-11-24T08:07:07.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.100+0000 7f340ec19700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3408073f90 0x7f3408074440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.100+0000 7f340ec19700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3408071c00 0x7f3408072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.100+0000 7f340ec19700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34080b0590 con 0x7f340815e2a0 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.100+0000 7f340ec19700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3408074980 con 0x7f3408073f90 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.100+0000 7f340ec19700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34080d0690 con 0x7f3408071c00 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.100+0000 7f3407fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3408073f90 0x7f3408074440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.100+0000 7f3407fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3408073f90 0x7f3408074440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39190/0 (socket says 172.21.15.153:39190) 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.100+0000 7f3407fff700 1 -- 172.21.15.153:0/790163792 learned_addr learned my addr 172.21.15.153:0/790163792 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.101+0000 7f340d1b6700 1 --2- 172.21.15.153:0/790163792 >> v2:172.21.15.164:3300/0 conn(0x7f3408071c00 0x7f3408072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.101+0000 7f3407fff700 1 -- 172.21.15.153:0/790163792 >> v2:172.21.15.164:3300/0 conn(0x7f3408071c00 msgr2=0x7f3408072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.101+0000 7f3407fff700 1 --2- 172.21.15.153:0/790163792 >> v2:172.21.15.164:3300/0 conn(0x7f3408071c00 0x7f3408072070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.101+0000 7f3407fff700 1 -- 172.21.15.153:0/790163792 >> v1:172.21.15.164:6789/0 conn(0x7f340815e2a0 legacy=0x7f34080afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.101+0000 7f3407fff700 1 -- 172.21.15.153:0/790163792 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080cf7e0 con 0x7f3408073f90 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.101+0000 7f3407fff700 1 --2- 172.21.15.153:0/790163792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3408073f90 0x7f3408074440 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f34080d1b80 tx=0x7f33f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a789f77a07a468f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.101+0000 7f34077fe700 1 -- 172.21.15.153:0/790163792 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f4004230 con 0x7f3408073f90 2023-11-24T08:07:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.101+0000 7f34077fe700 1 -- 172.21.15.153:0/790163792 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f4004390 con 0x7f3408073f90 2023-11-24T08:07:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.101+0000 7f34077fe700 1 -- 172.21.15.153:0/790163792 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f40036a0 con 0x7f3408073f90 2023-11-24T08:07:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.102+0000 7f340ec19700 1 -- 172.21.15.153:0/790163792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3408073f90 msgr2=0x7f3408074440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.102+0000 7f340ec19700 1 --2- 172.21.15.153:0/790163792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3408073f90 0x7f3408074440 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f34080d1b80 tx=0x7f33f4009bd0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.102+0000 7f340ec19700 1 -- 172.21.15.153:0/790163792 shutdown_connections 2023-11-24T08:07:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.102+0000 7f340ec19700 1 --2- 172.21.15.153:0/790163792 >> v2:172.21.15.164:3300/0 conn(0x7f3408071c00 0x7f3408072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.102+0000 7f340ec19700 1 --2- 172.21.15.153:0/790163792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3408073f90 0x7f3408074440 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.102+0000 7f340ec19700 1 -- 172.21.15.153:0/790163792 >> 172.21.15.153:0/790163792 conn(0x7f34080d0af0 msgr2=0x7f34080d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.102+0000 7f340ec19700 1 -- 172.21.15.153:0/790163792 shutdown_connections 2023-11-24T08:07:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.102+0000 7f340ec19700 1 -- 172.21.15.153:0/790163792 wait complete. 2023-11-24T08:07:07.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.103+0000 7f340ec19700 1 Processor -- start 2023-11-24T08:07:07.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.103+0000 7f340ec19700 1 -- start start 2023-11-24T08:07:07.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340ec19700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3408071c00 0x7f340814ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340ec19700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3408073f90 0x7f34080cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340ec19700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f340815e2a0 0x7f34080cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340ec19700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34080cda30 con 0x7f3408071c00 2023-11-24T08:07:07.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340ec19700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34080cc990 con 0x7f340815e2a0 2023-11-24T08:07:07.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340ec19700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34080ccc70 con 0x7f3408073f90 2023-11-24T08:07:07.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340c9b5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3408071c00 0x7f340814ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:07.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340c9b5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3408071c00 0x7f340814ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39192/0 (socket says 172.21.15.153:39192) 2023-11-24T08:07:07.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340c9b5700 1 -- 172.21.15.153:0/1756942346 learned_addr learned my addr 172.21.15.153:0/1756942346 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:07.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340d1b6700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f340815e2a0 0x7f34080cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340c9b5700 1 -- 172.21.15.153:0/1756942346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3408073f90 msgr2=0x7f34080cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340c9b5700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3408073f90 0x7f34080cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340c9b5700 1 -- 172.21.15.153:0/1756942346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f340815e2a0 msgr2=0x7f34080cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340c9b5700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f340815e2a0 0x7f34080cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340c9b5700 1 -- 172.21.15.153:0/1756942346 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f4009550 con 0x7f3408071c00 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340c9b5700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3408071c00 0x7f340814ce40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00b4a0 tx=0x7f33fc00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f34057fa700 1 -- 172.21.15.153:0/1756942346 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc011830 con 0x7f3408071c00 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f34057fa700 1 -- 172.21.15.153:0/1756942346 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc011990 con 0x7f3408071c00 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f340ec19700 1 -- 172.21.15.153:0/1756942346 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34080ccf50 con 0x7f3408071c00 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.104+0000 7f34057fa700 1 -- 172.21.15.153:0/1756942346 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc011d40 con 0x7f3408071c00 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.105+0000 7f340ec19700 1 -- 172.21.15.153:0/1756942346 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34080cd510 con 0x7f3408071c00 2023-11-24T08:07:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.105+0000 7f340ec19700 1 -- 172.21.15.153:0/1756942346 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3408067f60 con 0x7f3408071c00 2023-11-24T08:07:07.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.106+0000 7f34057fa700 1 -- 172.21.15.153:0/1756942346 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f33fc01a400 con 0x7f3408071c00 2023-11-24T08:07:07.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.106+0000 7f34057fa700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f33ec06b080 0x7f33ec06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.106+0000 7f3407fff700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f33ec06b080 0x7f33ec06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:07.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.107+0000 7f34057fa700 1 -- 172.21.15.153:0/1756942346 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f33fc089660 con 0x7f3408071c00 2023-11-24T08:07:07.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.107+0000 7f3407fff700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f33ec06b080 0x7f33ec06d540 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3408072e80 tx=0x7f33f4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:07.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.111+0000 7f34057fa700 1 -- 172.21.15.153:0/1756942346 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33fc054480 con 0x7f3408071c00 2023-11-24T08:07:07.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.307+0000 7f340ec19700 1 -- 172.21.15.153:0/1756942346 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f340806b0c0 con 0x7f3408071c00 2023-11-24T08:07:07.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.956+0000 7f34057fa700 1 -- 172.21.15.153:0/1756942346 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) v1 ==== 169+0+0 (secure 0 0 0) 0x7f33fc0150d0 con 0x7f3408071c00 2023-11-24T08:07:07.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.959+0000 7f340ec19700 1 -- 172.21.15.153:0/1756942346 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f33ec06b080 msgr2=0x7f33ec06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:07.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.959+0000 7f340ec19700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f33ec06b080 0x7f33ec06d540 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3408072e80 tx=0x7f33f4010000 comp rx=0 tx=0).stop 2023-11-24T08:07:07.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.959+0000 7f340ec19700 1 -- 172.21.15.153:0/1756942346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3408071c00 msgr2=0x7f340814ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:07.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.959+0000 7f340ec19700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3408071c00 0x7f340814ce40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00b4a0 tx=0x7f33fc00b860 comp rx=0 tx=0).stop 2023-11-24T08:07:07.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.959+0000 7f340ec19700 1 -- 172.21.15.153:0/1756942346 shutdown_connections 2023-11-24T08:07:07.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.959+0000 7f340ec19700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f340815e2a0 0x7f34080cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.959+0000 7f340ec19700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f33ec06b080 0x7f33ec06d540 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.959+0000 7f340ec19700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3408071c00 0x7f340814ce40 secure :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00b4a0 tx=0x7f33fc00b860 comp rx=0 tx=0).stop 2023-11-24T08:07:07.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.959+0000 7f340ec19700 1 --2- 172.21.15.153:0/1756942346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3408073f90 0x7f34080cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.959+0000 7f340ec19700 1 -- 172.21.15.153:0/1756942346 >> 172.21.15.153:0/1756942346 conn(0x7f34080d0af0 msgr2=0x7f340806ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:07.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.960+0000 7f340ec19700 1 -- 172.21.15.153:0/1756942346 shutdown_connections 2023-11-24T08:07:07.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:07.961+0000 7f340ec19700 1 -- 172.21.15.153:0/1756942346 wait complete. 2023-11-24T08:07:07.964 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-11-24T08:07:07.979 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T08:07:08.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.105+0000 7f205cc82700 1 Processor -- start 2023-11-24T08:07:08.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.105+0000 7f205cc82700 1 -- start start 2023-11-24T08:07:08.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.106+0000 7f205cc82700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f205815e160 0x7f20580b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.106+0000 7f205cc82700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20580afc90 0x7f2058073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.106+0000 7f205cc82700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20580b3c60 con 0x7f20580744d0 2023-11-24T08:07:08.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.106+0000 7f205cc82700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20580b4500 con 0x7f205815e160 2023-11-24T08:07:08.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.106+0000 7f205cc82700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2058074960 con 0x7f20580afc90 2023-11-24T08:07:08.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f205659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f205815e160 0x7f20580b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f205659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f205815e160 0x7f20580b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39200/0 (socket says 172.21.15.153:39200) 2023-11-24T08:07:08.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f205659c700 1 -- 172.21.15.153:0/810013803 learned_addr learned my addr 172.21.15.153:0/810013803 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:08.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f2055d9b700 1 --2- 172.21.15.153:0/810013803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20580afc90 0x7f2058073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f205659c700 1 -- 172.21.15.153:0/810013803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20580afc90 msgr2=0x7f2058073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:08.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f205659c700 1 --2- 172.21.15.153:0/810013803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20580afc90 0x7f2058073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f205659c700 1 -- 172.21.15.153:0/810013803 >> v1:172.21.15.164:6789/0 conn(0x7f20580744d0 legacy=0x7f205806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f205659c700 1 -- 172.21.15.153:0/810013803 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20580b58c0 con 0x7f205815e160 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f205659c700 1 --2- 172.21.15.153:0/810013803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205815e160 0x7f20580b5da0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f204c0098f0 tx=0x7f204c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2646980d30374551 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f205559a700 1 -- 172.21.15.153:0/810013803 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c011830 con 0x7f205815e160 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f205559a700 1 -- 172.21.15.153:0/810013803 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c011990 con 0x7f205815e160 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.107+0000 7f205559a700 1 -- 172.21.15.153:0/810013803 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c011d20 con 0x7f205815e160 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.108+0000 7f205cc82700 1 -- 172.21.15.153:0/810013803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205815e160 msgr2=0x7f20580b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.108+0000 7f205cc82700 1 --2- 172.21.15.153:0/810013803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205815e160 0x7f20580b5da0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f204c0098f0 tx=0x7f204c009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.108+0000 7f205cc82700 1 -- 172.21.15.153:0/810013803 shutdown_connections 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.108+0000 7f205cc82700 1 --2- 172.21.15.153:0/810013803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f205815e160 0x7f20580b5da0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.108+0000 7f205cc82700 1 --2- 172.21.15.153:0/810013803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20580afc90 0x7f2058073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.108+0000 7f205cc82700 1 -- 172.21.15.153:0/810013803 >> 172.21.15.153:0/810013803 conn(0x7f20580d0bf0 msgr2=0x7f20580d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:08.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.108+0000 7f205cc82700 1 -- 172.21.15.153:0/810013803 shutdown_connections 2023-11-24T08:07:08.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.108+0000 7f205cc82700 1 -- 172.21.15.153:0/810013803 wait complete. 2023-11-24T08:07:08.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.109+0000 7f205cc82700 1 Processor -- start 2023-11-24T08:07:08.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.109+0000 7f205cc82700 1 -- start start 2023-11-24T08:07:08.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205cc82700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580744d0 0x7f20580b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205cc82700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20580afc90 0x7f20581f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205cc82700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205815e160 0x7f20581f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205cc82700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205814bed0 con 0x7f20580744d0 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205cc82700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20580c5c70 con 0x7f205815e160 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205cc82700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20581f38b0 con 0x7f20580afc90 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580744d0 0x7f20580b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580744d0 0x7f20580b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39206/0 (socket says 172.21.15.153:39206) 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205659c700 1 -- 172.21.15.153:0/43218567 learned_addr learned my addr 172.21.15.153:0/43218567 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f2055d9b700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20580afc90 0x7f20581f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f2056d9d700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205815e160 0x7f20581f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205659c700 1 -- 172.21.15.153:0/43218567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20580afc90 msgr2=0x7f20581f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205659c700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20580afc90 0x7f20581f2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205659c700 1 -- 172.21.15.153:0/43218567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205815e160 msgr2=0x7f20581f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205659c700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205815e160 0x7f20581f3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.110+0000 7f205659c700 1 -- 172.21.15.153:0/43218567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c009550 con 0x7f20580744d0 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.111+0000 7f205659c700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580744d0 0x7f20580b1ca0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f204c000c00 tx=0x7f204c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.111+0000 7f2046ffd700 1 -- 172.21.15.153:0/43218567 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c0036a0 con 0x7f20580744d0 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.111+0000 7f2046ffd700 1 -- 172.21.15.153:0/43218567 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c01e070 con 0x7f20580744d0 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.111+0000 7f205cc82700 1 -- 172.21.15.153:0/43218567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20580c5f40 con 0x7f20580744d0 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.111+0000 7f2046ffd700 1 -- 172.21.15.153:0/43218567 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c003a40 con 0x7f20580744d0 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.111+0000 7f205cc82700 1 -- 172.21.15.153:0/43218567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2058161070 con 0x7f20580744d0 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.112+0000 7f205cc82700 1 -- 172.21.15.153:0/43218567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20580b51c0 con 0x7f20580744d0 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.112+0000 7f2046ffd700 1 -- 172.21.15.153:0/43218567 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f204c003ba0 con 0x7f20580744d0 2023-11-24T08:07:08.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.112+0000 7f2046ffd700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203806b080 0x7f203806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.113+0000 7f2046ffd700 1 -- 172.21.15.153:0/43218567 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f204c08a5b0 con 0x7f20580744d0 2023-11-24T08:07:08.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.113+0000 7f2055d9b700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203806b080 0x7f203806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.113+0000 7f2055d9b700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203806b080 0x7f203806d540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f20580b2580 tx=0x7f2048008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.117+0000 7f2046ffd700 1 -- 172.21.15.153:0/43218567 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f204c055770 con 0x7f20580744d0 2023-11-24T08:07:08.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.318+0000 7f205cc82700 1 -- 172.21.15.153:0/43218567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2058068fb0 con 0x7f20580744d0 2023-11-24T08:07:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.321+0000 7f2046ffd700 1 -- 172.21.15.153:0/43218567 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f204c058d90 con 0x7f20580744d0 2023-11-24T08:07:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.323+0000 7f205cc82700 1 -- 172.21.15.153:0/43218567 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203806b080 msgr2=0x7f203806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.323+0000 7f205cc82700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203806b080 0x7f203806d540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f20580b2580 tx=0x7f2048008040 comp rx=0 tx=0).stop 2023-11-24T08:07:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.323+0000 7f205cc82700 1 -- 172.21.15.153:0/43218567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580744d0 msgr2=0x7f20580b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.323+0000 7f205cc82700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580744d0 0x7f20580b1ca0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f204c000c00 tx=0x7f204c004750 comp rx=0 tx=0).stop 2023-11-24T08:07:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.324+0000 7f205cc82700 1 -- 172.21.15.153:0/43218567 shutdown_connections 2023-11-24T08:07:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.324+0000 7f205cc82700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f205815e160 0x7f20581f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.324+0000 7f205cc82700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f203806b080 0x7f203806d540 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.324+0000 7f205cc82700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20580744d0 0x7f20580b1ca0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.324+0000 7f205cc82700 1 --2- 172.21.15.153:0/43218567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20580afc90 0x7f20581f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.324+0000 7f205cc82700 1 -- 172.21.15.153:0/43218567 >> 172.21.15.153:0/43218567 conn(0x7f20580d0bf0 msgr2=0x7f20580d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:08.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.324+0000 7f205cc82700 1 -- 172.21.15.153:0/43218567 shutdown_connections 2023-11-24T08:07:08.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.324+0000 7f205cc82700 1 -- 172.21.15.153:0/43218567 wait complete. 2023-11-24T08:07:08.338 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2023-11-24T08:07:08.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.456+0000 7f26d3b00700 1 Processor -- start 2023-11-24T08:07:08.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.456+0000 7f26d3b00700 1 -- start start 2023-11-24T08:07:08.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.457+0000 7f26d3b00700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f26cc15ddd0 0x7f26cc0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.457+0000 7f26d3b00700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26cc0d2240 0x7f26cc0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.457+0000 7f26d3b00700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc0b1d40 con 0x7f26cc15e1b0 2023-11-24T08:07:08.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.457+0000 7f26d3b00700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0b28c0 con 0x7f26cc0d2240 2023-11-24T08:07:08.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.457+0000 7f26d3b00700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc06c000 con 0x7f26cc15ddd0 2023-11-24T08:07:08.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.457+0000 7f26d209d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26cc0d2240 0x7f26cc0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.457+0000 7f26d109b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f26cc15e1b0 0x7f26cc0d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45318/0 (socket says 172.21.15.153:45318) 2023-11-24T08:07:08.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.457+0000 7f26d109b700 1 -- 172.21.15.153:0/3362925856 learned_addr learned my addr 172.21.15.153:0/3362925856 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:08.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.458+0000 7f26d189c700 1 --2- 172.21.15.153:0/3362925856 >> v2:172.21.15.164:3300/0 conn(0x7f26cc15ddd0 0x7f26cc0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.458+0000 7f26d209d700 1 -- 172.21.15.153:0/3362925856 >> v2:172.21.15.164:3300/0 conn(0x7f26cc15ddd0 msgr2=0x7f26cc0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:08.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.458+0000 7f26d209d700 1 --2- 172.21.15.153:0/3362925856 >> v2:172.21.15.164:3300/0 conn(0x7f26cc15ddd0 0x7f26cc0b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.458+0000 7f26d209d700 1 -- 172.21.15.153:0/3362925856 >> v1:172.21.15.153:6789/0 conn(0x7f26cc15e1b0 legacy=0x7f26cc0d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.458+0000 7f26d089a700 1 -- 172.21.15.153:0/3362925856 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462044969 0 0) 0x7f26cc0b1d40 con 0x7f26cc15e1b0 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.458+0000 7f26d209d700 1 -- 172.21.15.153:0/3362925856 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0b1f90 con 0x7f26cc0d2240 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.458+0000 7f26d189c700 1 --2- 172.21.15.153:0/3362925856 >> v2:172.21.15.164:3300/0 conn(0x7f26cc15ddd0 0x7f26cc0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.458+0000 7f26d209d700 1 --2- 172.21.15.153:0/3362925856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc0d2240 0x7f26cc0cf000 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009d90 tx=0x7f26c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569cc6fa4325135a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.458+0000 7f26d089a700 1 -- 172.21.15.153:0/3362925856 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c400e070 con 0x7f26cc0d2240 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.458+0000 7f26d089a700 1 -- 172.21.15.153:0/3362925856 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c400bb90 con 0x7f26cc0d2240 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.458+0000 7f26d089a700 1 -- 172.21.15.153:0/3362925856 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c4012430 con 0x7f26cc0d2240 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.459+0000 7f26d3b00700 1 -- 172.21.15.153:0/3362925856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc0d2240 msgr2=0x7f26cc0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.459+0000 7f26d3b00700 1 --2- 172.21.15.153:0/3362925856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc0d2240 0x7f26cc0cf000 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009d90 tx=0x7f26c400b330 comp rx=0 tx=0).stop 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.459+0000 7f26d3b00700 1 -- 172.21.15.153:0/3362925856 shutdown_connections 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.459+0000 7f26d3b00700 1 --2- 172.21.15.153:0/3362925856 >> v2:172.21.15.164:3300/0 conn(0x7f26cc15ddd0 0x7f26cc0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.459+0000 7f26d3b00700 1 --2- 172.21.15.153:0/3362925856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc0d2240 0x7f26cc0cf000 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.459+0000 7f26d3b00700 1 -- 172.21.15.153:0/3362925856 >> 172.21.15.153:0/3362925856 conn(0x7f26cc0731a0 msgr2=0x7f26cc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.459+0000 7f26d3b00700 1 -- 172.21.15.153:0/3362925856 shutdown_connections 2023-11-24T08:07:08.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.459+0000 7f26d3b00700 1 -- 172.21.15.153:0/3362925856 wait complete. 2023-11-24T08:07:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.460+0000 7f26d3b00700 1 Processor -- start 2023-11-24T08:07:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.460+0000 7f26d3b00700 1 -- start start 2023-11-24T08:07:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d3b00700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26cc0d2240 0x7f26cc09f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d3b00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26cc15ddd0 0x7f26cc0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d3b00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc15e1b0 0x7f26cc0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d3b00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc14c640 con 0x7f26cc15e1b0 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d3b00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc14ba50 con 0x7f26cc15ddd0 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d3b00700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc14ebf0 con 0x7f26cc0d2240 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d209d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc15e1b0 0x7f26cc0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d209d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc15e1b0 0x7f26cc0aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39222/0 (socket says 172.21.15.153:39222) 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d209d700 1 -- 172.21.15.153:0/778276872 learned_addr learned my addr 172.21.15.153:0/778276872 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d109b700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26cc15ddd0 0x7f26cc0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d189c700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26cc0d2240 0x7f26cc09f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d209d700 1 -- 172.21.15.153:0/778276872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26cc0d2240 msgr2=0x7f26cc09f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d209d700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26cc0d2240 0x7f26cc09f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d209d700 1 -- 172.21.15.153:0/778276872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26cc15ddd0 msgr2=0x7f26cc0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d209d700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26cc15ddd0 0x7f26cc0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d209d700 1 -- 172.21.15.153:0/778276872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c4009a70 con 0x7f26cc15e1b0 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d109b700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26cc15ddd0 0x7f26cc0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d209d700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc15e1b0 0x7f26cc0aefc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f26c4014040 tx=0x7f26c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26c27fc700 1 -- 172.21.15.153:0/778276872 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c4012430 con 0x7f26cc15e1b0 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26c27fc700 1 -- 172.21.15.153:0/778276872 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c4020070 con 0x7f26cc15e1b0 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d3b00700 1 -- 172.21.15.153:0/778276872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc0b2ed0 con 0x7f26cc15e1b0 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26c27fc700 1 -- 172.21.15.153:0/778276872 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c4004480 con 0x7f26cc15e1b0 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.461+0000 7f26d3b00700 1 -- 172.21.15.153:0/778276872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc14bff0 con 0x7f26cc15e1b0 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.462+0000 7f26d3b00700 1 -- 172.21.15.153:0/778276872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc067f60 con 0x7f26cc15e1b0 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.463+0000 7f26c27fc700 1 -- 172.21.15.153:0/778276872 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f26c40045e0 con 0x7f26cc15e1b0 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.463+0000 7f26c27fc700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b080 0x7f26b006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.463+0000 7f26d189c700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b080 0x7f26b006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.463+0000 7f26c27fc700 1 -- 172.21.15.153:0/778276872 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f26c4022070 con 0x7f26cc15e1b0 2023-11-24T08:07:08.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.464+0000 7f26d189c700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b080 0x7f26b006d540 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f26bc006fd0 tx=0x7f26bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:08.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.468+0000 7f26c27fc700 1 -- 172.21.15.153:0/778276872 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26c4056bd0 con 0x7f26cc15e1b0 2023-11-24T08:07:08.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.739+0000 7f26d3b00700 1 -- 172.21.15.153:0/778276872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7f26cc14c780 con 0x7f26cc15e1b0 2023-11-24T08:07:08.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.962+0000 7f26c27fc700 1 -- 172.21.15.153:0/778276872 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v163) v1 ==== 140+0+0 (secure 0 0 0) 0x7f26c405a1f0 con 0x7f26cc15e1b0 2023-11-24T08:07:08.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 -- 172.21.15.153:0/778276872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b080 msgr2=0x7f26b006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b080 0x7f26b006d540 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f26bc006fd0 tx=0x7f26bc008040 comp rx=0 tx=0).stop 2023-11-24T08:07:08.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 -- 172.21.15.153:0/778276872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc15e1b0 msgr2=0x7f26cc0aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:08.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc15e1b0 0x7f26cc0aefc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f26c4014040 tx=0x7f26c4004ad0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 -- 172.21.15.153:0/778276872 shutdown_connections 2023-11-24T08:07:08.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f26b006b080 0x7f26b006d540 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc15e1b0 0x7f26cc0aefc0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26cc0d2240 0x7f26cc09f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 --2- 172.21.15.153:0/778276872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26cc15ddd0 0x7f26cc0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:08.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 -- 172.21.15.153:0/778276872 >> 172.21.15.153:0/778276872 conn(0x7f26cc0731a0 msgr2=0x7f26cc0ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:08.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 -- 172.21.15.153:0/778276872 shutdown_connections 2023-11-24T08:07:08.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:08.965+0000 7f26d3b00700 1 -- 172.21.15.153:0/778276872 wait complete. 2023-11-24T08:07:08.980 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2023-11-24T08:07:08.980 INFO:tasks.cephfs_test_runner:Starting test: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T08:07:08.980 INFO:tasks.cephfs_test_runner:test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:07:08.981 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:09.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.111+0000 7f16d4a71700 1 Processor -- start 2023-11-24T08:07:09.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.111+0000 7f16d4a71700 1 -- start start 2023-11-24T08:07:09.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.112+0000 7f16d4a71700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d00b49a0 0x7f16d00d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.112+0000 7f16d4a71700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d015c4b0 con 0x7f16d0152cc0 2023-11-24T08:07:09.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.112+0000 7f16d4a71700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d015c790 con 0x7f16d006c710 2023-11-24T08:07:09.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.112+0000 7f16d4a71700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d015ca70 con 0x7f16d00b49a0 2023-11-24T08:07:09.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.112+0000 7f16ce59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f16d0152cc0 0x7f16d006c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45330/0 (socket says 172.21.15.153:45330) 2023-11-24T08:07:09.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.112+0000 7f16ce59c700 1 -- 172.21.15.153:0/601494515 learned_addr learned my addr 172.21.15.153:0/601494515 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:09.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116171380 0 0) 0x7f16d015c4b0 con 0x7f16d0152cc0 2023-11-24T08:07:09.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b80035b0 con 0x7f16d0152cc0 2023-11-24T08:07:09.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16ced9d700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d00b49a0 0x7f16d00d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3638453985 0 0) 0x7f16b80035b0 con 0x7f16d0152cc0 2023-11-24T08:07:09.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d00b49a0 msgr2=0x7f16d00d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:09.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d00b49a0 0x7f16d00d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 >> v1:172.21.15.164:6789/0 conn(0x7f16d006c710 legacy=0x7f16d00cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d015cd50 con 0x7f16d0152cc0 2023-11-24T08:07:09.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f16c0001670 con 0x7f16d0152cc0 2023-11-24T08:07:09.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 >> v1:172.21.15.153:6789/0 conn(0x7f16d0152cc0 legacy=0x7f16d006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16b8003a30 0x7f16b8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b8004850 0x7f16b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d00b49a0 0x7f16b8005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d015ca70 con 0x7f16b8003a30 2023-11-24T08:07:09.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b800bb70 con 0x7f16b8004850 2023-11-24T08:07:09.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b800bd30 con 0x7f16d00b49a0 2023-11-24T08:07:09.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16ce59c700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16b8003a30 0x7f16b8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16cdd9b700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b8004850 0x7f16b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16ced9d700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d00b49a0 0x7f16b8005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16ce59c700 1 -- 172.21.15.153:0/601494515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d00b49a0 msgr2=0x7f16b8005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:09.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16ce59c700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d00b49a0 0x7f16b8005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16ce59c700 1 -- 172.21.15.153:0/601494515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b8004850 msgr2=0x7f16b8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:09.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16ce59c700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b8004850 0x7f16b8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16ce59c700 1 -- 172.21.15.153:0/601494515 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b80035b0 con 0x7f16b8003a30 2023-11-24T08:07:09.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.113+0000 7f16ce59c700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16b8003a30 0x7f16b8003e50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f16c000c240 tx=0x7f16b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb604e6071f6a26 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.114+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0007c10 con 0x7f16b8003a30 2023-11-24T08:07:09.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.114+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c000ce00 con 0x7f16b8003a30 2023-11-24T08:07:09.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.114+0000 7f16cd59a700 1 -- 172.21.15.153:0/601494515 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0005ba0 con 0x7f16b8003a30 2023-11-24T08:07:09.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.114+0000 7f16d4a71700 1 -- 172.21.15.153:0/601494515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16b8003a30 msgr2=0x7f16b8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.114+0000 7f16d4a71700 1 --2- 172.21.15.153:0/601494515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16b8003a30 0x7f16b8003e50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f16c000c240 tx=0x7f16b8005880 comp rx=0 tx=0).stop 2023-11-24T08:07:09.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.114+0000 7f16ced9d700 1 -- 172.21.15.153:0/601494515 reap_dead start 2023-11-24T08:07:09.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.114+0000 7f16d4a71700 1 -- 172.21.15.153:0/601494515 shutdown_connections 2023-11-24T08:07:09.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.114+0000 7f16d4a71700 1 -- 172.21.15.153:0/601494515 >> 172.21.15.153:0/601494515 conn(0x7f16d0071b90 msgr2=0x7f16d0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:09.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.114+0000 7f16d4a71700 1 -- 172.21.15.153:0/601494515 shutdown_connections 2023-11-24T08:07:09.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.114+0000 7f16d4a71700 1 -- 172.21.15.153:0/601494515 wait complete. 2023-11-24T08:07:09.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.116+0000 7f16d4a71700 1 Processor -- start 2023-11-24T08:07:09.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.116+0000 7f16d4a71700 1 -- start start 2023-11-24T08:07:09.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.116+0000 7f16d4a71700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b8003a30 0x7f16d01475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.116+0000 7f16d4a71700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d014b270 0x7f16d006e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.116+0000 7f16d4a71700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16d00b1d10 0x7f16d00b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.116+0000 7f16d4a71700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00b2700 con 0x7f16d00b1d10 2023-11-24T08:07:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.116+0000 7f16d4a71700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d006fb00 con 0x7f16b8003a30 2023-11-24T08:07:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.116+0000 7f16d4a71700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d0147b10 con 0x7f16d014b270 2023-11-24T08:07:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.116+0000 7f16ced9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16d00b1d10 0x7f16d00b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.116+0000 7f16ced9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16d00b1d10 0x7f16d00b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39240/0 (socket says 172.21.15.153:39240) 2023-11-24T08:07:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.116+0000 7f16ced9d700 1 -- 172.21.15.153:0/2157517446 learned_addr learned my addr 172.21.15.153:0/2157517446 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:09.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16cdd9b700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d014b270 0x7f16d006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16ce59c700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b8003a30 0x7f16d01475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16ced9d700 1 -- 172.21.15.153:0/2157517446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d014b270 msgr2=0x7f16d006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16ced9d700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d014b270 0x7f16d006e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16ced9d700 1 -- 172.21.15.153:0/2157517446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b8003a30 msgr2=0x7f16d01475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16ced9d700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b8003a30 0x7f16d01475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16ced9d700 1 -- 172.21.15.153:0/2157517446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d006ea60 con 0x7f16d00b1d10 2023-11-24T08:07:09.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16ced9d700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16d00b1d10 0x7f16d00b21c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f16d015d030 tx=0x7f16c8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16beffd700 1 -- 172.21.15.153:0/2157517446 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800e040 con 0x7f16d00b1d10 2023-11-24T08:07:09.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16beffd700 1 -- 172.21.15.153:0/2157517446 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c800f040 con 0x7f16d00b1d10 2023-11-24T08:07:09.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16beffd700 1 -- 172.21.15.153:0/2157517446 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800fe40 con 0x7f16d00b1d10 2023-11-24T08:07:09.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16d4a71700 1 -- 172.21.15.153:0/2157517446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d006ed40 con 0x7f16d00b1d10 2023-11-24T08:07:09.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.117+0000 7f16d4a71700 1 -- 172.21.15.153:0/2157517446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d006f300 con 0x7f16d00b1d10 2023-11-24T08:07:09.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.118+0000 7f16d4a71700 1 -- 172.21.15.153:0/2157517446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d006f950 con 0x7f16d00b1d10 2023-11-24T08:07:09.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.118+0000 7f16beffd700 1 -- 172.21.15.153:0/2157517446 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f16c8022460 con 0x7f16d00b1d10 2023-11-24T08:07:09.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.119+0000 7f16beffd700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f16b006b080 0x7f16b006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.119+0000 7f16beffd700 1 -- 172.21.15.153:0/2157517446 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f16c8089b40 con 0x7f16d00b1d10 2023-11-24T08:07:09.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.119+0000 7f16ce59c700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f16b006b080 0x7f16b006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.119+0000 7f16ce59c700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f16b006b080 0x7f16b006d540 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f16c0015040 tx=0x7f16c0007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.123+0000 7f16beffd700 1 -- 172.21.15.153:0/2157517446 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16c8054b60 con 0x7f16d00b1d10 2023-11-24T08:07:09.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.316+0000 7f16d4a71700 1 -- 172.21.15.153:0/2157517446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16d00753f0 con 0x7f16d00b1d10 2023-11-24T08:07:09.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.316+0000 7f16beffd700 1 -- 172.21.15.153:0/2157517446 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+13024 (secure 0 0 0) 0x7f16c8058180 con 0x7f16d00b1d10 2023-11-24T08:07:09.318 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:09.318 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":48,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:07:07.955553+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6837/3585468907":"2023-11-25T08:07:04.946032+0000","172.21.15.153:6834/3585468907":"2023-11-25T08:07:04.946032+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:09.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.318+0000 7f16d4a71700 1 -- 172.21.15.153:0/2157517446 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f16b006b080 msgr2=0x7f16b006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.318+0000 7f16d4a71700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f16b006b080 0x7f16b006d540 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f16c0015040 tx=0x7f16c0007000 comp rx=0 tx=0).stop 2023-11-24T08:07:09.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.319+0000 7f16d4a71700 1 -- 172.21.15.153:0/2157517446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16d00b1d10 msgr2=0x7f16d00b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.319+0000 7f16d4a71700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16d00b1d10 0x7f16d00b21c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f16d015d030 tx=0x7f16c8011f60 comp rx=0 tx=0).stop 2023-11-24T08:07:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.319+0000 7f16d4a71700 1 -- 172.21.15.153:0/2157517446 shutdown_connections 2023-11-24T08:07:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.319+0000 7f16d4a71700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f16b006b080 0x7f16b006d540 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.319+0000 7f16d4a71700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16d00b1d10 0x7f16d00b21c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.319+0000 7f16d4a71700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b8003a30 0x7f16d01475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.319+0000 7f16d4a71700 1 --2- 172.21.15.153:0/2157517446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16d014b270 0x7f16d006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.319+0000 7f16d4a71700 1 -- 172.21.15.153:0/2157517446 >> 172.21.15.153:0/2157517446 conn(0x7f16d0071b90 msgr2=0x7f16d00cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.319+0000 7f16d4a71700 1 -- 172.21.15.153:0/2157517446 shutdown_connections 2023-11-24T08:07:09.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.319+0000 7f16d4a71700 1 -- 172.21.15.153:0/2157517446 wait complete. 2023-11-24T08:07:09.334 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:09.334 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:09.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.499+0000 7fbeab48c700 1 Processor -- start 2023-11-24T08:07:09.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.499+0000 7fbeab48c700 1 -- start start 2023-11-24T08:07:09.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.500+0000 7fbeab48c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbea415b370 0x7fbea415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.500+0000 7fbeab48c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbea40b3c60 0x7fbea40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.500+0000 7fbeab48c700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea40ae5e0 con 0x7fbea41587f0 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.500+0000 7fbeab48c700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea40b4610 con 0x7fbea40b3c60 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.500+0000 7fbeab48c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea415be30 con 0x7fbea415b370 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.500+0000 7fbea9a29700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbea40b3c60 0x7fbea40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.500+0000 7fbea8a27700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbea415b370 0x7fbea415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.500+0000 7fbea9228700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fbea41587f0 0x7fbea406aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:53030/0 (socket says 172.21.15.153:53030) 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.500+0000 7fbea9228700 1 -- 172.21.15.153:0/2028846529 learned_addr learned my addr 172.21.15.153:0/2028846529 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbea9a29700 1 -- 172.21.15.153:0/2028846529 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbea415b370 msgr2=0x7fbea415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbea9a29700 1 --2- 172.21.15.153:0/2028846529 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbea415b370 0x7fbea415b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbea9a29700 1 -- 172.21.15.153:0/2028846529 >> v1:172.21.15.164:6789/0 conn(0x7fbea41587f0 legacy=0x7fbea406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbea9a29700 1 -- 172.21.15.153:0/2028846529 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea415c110 con 0x7fbea40b3c60 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbe9bfff700 1 -- 172.21.15.153:0/2028846529 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076100804 0 0) 0x7fbea40ae5e0 con 0x7fbea41587f0 2023-11-24T08:07:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbea8a27700 1 --2- 172.21.15.153:0/2028846529 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbea415b370 0x7fbea415b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbea9a29700 1 --2- 172.21.15.153:0/2028846529 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea40b3c60 0x7fbea40b40d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c009d90 tx=0x7fbe9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89e528231fc9dc1b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbe9bfff700 1 -- 172.21.15.153:0/2028846529 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00e070 con 0x7fbea40b3c60 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbe9bfff700 1 -- 172.21.15.153:0/2028846529 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00bb20 con 0x7fbea40b3c60 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbe9bfff700 1 -- 172.21.15.153:0/2028846529 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c012430 con 0x7fbea40b3c60 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbeab48c700 1 -- 172.21.15.153:0/2028846529 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea40b3c60 msgr2=0x7fbea40b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbeab48c700 1 --2- 172.21.15.153:0/2028846529 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea40b3c60 0x7fbea40b40d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c009d90 tx=0x7fbe9c00b330 comp rx=0 tx=0).stop 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbeab48c700 1 -- 172.21.15.153:0/2028846529 shutdown_connections 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.501+0000 7fbeab48c700 1 --2- 172.21.15.153:0/2028846529 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea40b3c60 0x7fbea40b40d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.502+0000 7fbeab48c700 1 --2- 172.21.15.153:0/2028846529 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbea415b370 0x7fbea415b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.502+0000 7fbeab48c700 1 -- 172.21.15.153:0/2028846529 >> 172.21.15.153:0/2028846529 conn(0x7fbea40d0bf0 msgr2=0x7fbea40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.502+0000 7fbeab48c700 1 -- 172.21.15.153:0/2028846529 shutdown_connections 2023-11-24T08:07:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.502+0000 7fbeab48c700 1 -- 172.21.15.153:0/2028846529 wait complete. 2023-11-24T08:07:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.503+0000 7fbeab48c700 1 Processor -- start 2023-11-24T08:07:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.503+0000 7fbeab48c700 1 -- start start 2023-11-24T08:07:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbeab48c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea40b3c60 0x7fbea41f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbeab48c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea41587f0 0x7fbea406ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbeab48c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbea415b370 0x7fbea41f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbeab48c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea4145e90 con 0x7fbea41587f0 2023-11-24T08:07:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbeab48c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea41460a0 con 0x7fbea40b3c60 2023-11-24T08:07:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbeab48c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea4146380 con 0x7fbea415b370 2023-11-24T08:07:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea8a27700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea41587f0 0x7fbea406ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea8a27700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea41587f0 0x7fbea406ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39252/0 (socket says 172.21.15.153:39252) 2023-11-24T08:07:09.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea9228700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea40b3c60 0x7fbea41f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea8a27700 1 -- 172.21.15.153:0/3641462026 learned_addr learned my addr 172.21.15.153:0/3641462026 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:09.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea9a29700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbea415b370 0x7fbea41f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea8a27700 1 -- 172.21.15.153:0/3641462026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbea415b370 msgr2=0x7fbea41f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea8a27700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbea415b370 0x7fbea41f2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea8a27700 1 -- 172.21.15.153:0/3641462026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea40b3c60 msgr2=0x7fbea41f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea8a27700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea40b3c60 0x7fbea41f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea8a27700 1 -- 172.21.15.153:0/3641462026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe940094a0 con 0x7fbea41587f0 2023-11-24T08:07:09.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea9228700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea40b3c60 0x7fbea41f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:09.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbea8a27700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea41587f0 0x7fbea406ba30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400ebe0 tx=0x7fbe9400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.504+0000 7fbe99ffb700 1 -- 172.21.15.153:0/3641462026 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94009760 con 0x7fbea41587f0 2023-11-24T08:07:09.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.505+0000 7fbe99ffb700 1 -- 172.21.15.153:0/3641462026 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9400c850 con 0x7fbea41587f0 2023-11-24T08:07:09.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.505+0000 7fbeab48c700 1 -- 172.21.15.153:0/3641462026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c009a70 con 0x7fbea41587f0 2023-11-24T08:07:09.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.505+0000 7fbe99ffb700 1 -- 172.21.15.153:0/3641462026 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9400cbe0 con 0x7fbea41587f0 2023-11-24T08:07:09.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.505+0000 7fbeab48c700 1 -- 172.21.15.153:0/3641462026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea4146940 con 0x7fbea41587f0 2023-11-24T08:07:09.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.506+0000 7fbeab48c700 1 -- 172.21.15.153:0/3641462026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea4068fb0 con 0x7fbea41587f0 2023-11-24T08:07:09.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.506+0000 7fbe99ffb700 1 -- 172.21.15.153:0/3641462026 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbe9400cd40 con 0x7fbea41587f0 2023-11-24T08:07:09.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.506+0000 7fbe99ffb700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe8806b080 0x7fbe8806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.507+0000 7fbe99ffb700 1 -- 172.21.15.153:0/3641462026 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbe94089610 con 0x7fbea41587f0 2023-11-24T08:07:09.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.507+0000 7fbea9228700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe8806b080 0x7fbe8806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.507+0000 7fbea9228700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe8806b080 0x7fbe8806d540 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbea0007fd0 tx=0x7fbea0007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.511+0000 7fbe99ffb700 1 -- 172.21.15.153:0/3641462026 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe94054740 con 0x7fbea41587f0 2023-11-24T08:07:09.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.702+0000 7fbeab48c700 1 -- 172.21.15.153:0/3641462026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbea406cb30 con 0x7fbea41587f0 2023-11-24T08:07:09.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.703+0000 7fbe99ffb700 1 -- 172.21.15.153:0/3641462026 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe94057d60 con 0x7fbea41587f0 2023-11-24T08:07:09.705 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:07:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 -- 172.21.15.153:0/3641462026 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe8806b080 msgr2=0x7fbe8806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe8806b080 0x7fbe8806d540 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbea0007fd0 tx=0x7fbea0007de0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 -- 172.21.15.153:0/3641462026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea41587f0 msgr2=0x7fbea406ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea41587f0 0x7fbea406ba30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400ebe0 tx=0x7fbe9400eef0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 -- 172.21.15.153:0/3641462026 shutdown_connections 2023-11-24T08:07:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbea415b370 0x7fbea41f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea40b3c60 0x7fbea41f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe8806b080 0x7fbe8806d540 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 --2- 172.21.15.153:0/3641462026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea41587f0 0x7fbea406ba30 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 -- 172.21.15.153:0/3641462026 >> 172.21.15.153:0/3641462026 conn(0x7fbea40d0bf0 msgr2=0x7fbea406ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:09.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 -- 172.21.15.153:0/3641462026 shutdown_connections 2023-11-24T08:07:09.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.705+0000 7fbeab48c700 1 -- 172.21.15.153:0/3641462026 wait complete. 2023-11-24T08:07:09.719 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:07:09.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.837+0000 7f2de476f700 1 Processor -- start 2023-11-24T08:07:09.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.837+0000 7f2de476f700 1 -- start start 2023-11-24T08:07:09.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.838+0000 7f2de476f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ddc152cc0 0x7f2ddc06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.838+0000 7f2de476f700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2ddc0b49a0 0x7f2ddc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.838+0000 7f2de476f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ddc15c4b0 con 0x7f2ddc0cff20 2023-11-24T08:07:09.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.838+0000 7f2de476f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc15c790 con 0x7f2ddc152cc0 2023-11-24T08:07:09.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.838+0000 7f2de476f700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc15ca70 con 0x7f2ddc0b49a0 2023-11-24T08:07:09.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.838+0000 7f2de250b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ddc152cc0 0x7f2ddc06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.838+0000 7f2de250b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ddc152cc0 0x7f2ddc06c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39258/0 (socket says 172.21.15.153:39258) 2023-11-24T08:07:09.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.838+0000 7f2de250b700 1 -- 172.21.15.153:0/3087992038 learned_addr learned my addr 172.21.15.153:0/3087992038 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:09.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.839+0000 7f2de1d0a700 1 --2- 172.21.15.153:0/3087992038 >> v2:172.21.15.164:3300/0 conn(0x7f2ddc0b49a0 0x7f2ddc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.839+0000 7f2de250b700 1 -- 172.21.15.153:0/3087992038 >> v2:172.21.15.164:3300/0 conn(0x7f2ddc0b49a0 msgr2=0x7f2ddc06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:09.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.839+0000 7f2de250b700 1 --2- 172.21.15.153:0/3087992038 >> v2:172.21.15.164:3300/0 conn(0x7f2ddc0b49a0 0x7f2ddc06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.839+0000 7f2de250b700 1 -- 172.21.15.153:0/3087992038 >> v1:172.21.15.164:6789/0 conn(0x7f2ddc0cff20 legacy=0x7f2ddc0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.839+0000 7f2de250b700 1 -- 172.21.15.153:0/3087992038 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc15cd50 con 0x7f2ddc152cc0 2023-11-24T08:07:09.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.839+0000 7f2de250b700 1 --2- 172.21.15.153:0/3087992038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ddc152cc0 0x7f2ddc06c000 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0b4e50 tx=0x7f2dd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0383ddab7ec7933 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.839+0000 7f2de1509700 1 -- 172.21.15.153:0/3087992038 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0011830 con 0x7f2ddc152cc0 2023-11-24T08:07:09.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.839+0000 7f2de1509700 1 -- 172.21.15.153:0/3087992038 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd0011990 con 0x7f2ddc152cc0 2023-11-24T08:07:09.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.839+0000 7f2de1509700 1 -- 172.21.15.153:0/3087992038 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0011d20 con 0x7f2ddc152cc0 2023-11-24T08:07:09.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.840+0000 7f2de476f700 1 -- 172.21.15.153:0/3087992038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ddc152cc0 msgr2=0x7f2ddc06c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.840+0000 7f2de476f700 1 --2- 172.21.15.153:0/3087992038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ddc152cc0 0x7f2ddc06c000 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0b4e50 tx=0x7f2dd0009bd0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.840+0000 7f2de476f700 1 -- 172.21.15.153:0/3087992038 shutdown_connections 2023-11-24T08:07:09.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.840+0000 7f2de476f700 1 --2- 172.21.15.153:0/3087992038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ddc152cc0 0x7f2ddc06c000 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.840+0000 7f2de476f700 1 --2- 172.21.15.153:0/3087992038 >> v2:172.21.15.164:3300/0 conn(0x7f2ddc0b49a0 0x7f2ddc06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.840+0000 7f2de476f700 1 -- 172.21.15.153:0/3087992038 >> 172.21.15.153:0/3087992038 conn(0x7f2ddc071b90 msgr2=0x7f2ddc071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:09.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.840+0000 7f2de476f700 1 -- 172.21.15.153:0/3087992038 shutdown_connections 2023-11-24T08:07:09.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.840+0000 7f2de476f700 1 -- 172.21.15.153:0/3087992038 wait complete. 2023-11-24T08:07:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.841+0000 7f2de476f700 1 Processor -- start 2023-11-24T08:07:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.841+0000 7f2de476f700 1 -- start start 2023-11-24T08:07:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de476f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ddc0b49a0 0x7f2ddc147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de476f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ddc0cff20 0x7f2ddc154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de476f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ddc152cc0 0x7f2ddc1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de476f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc151a60 con 0x7f2ddc0b49a0 2023-11-24T08:07:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de476f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc156a70 con 0x7f2ddc0cff20 2023-11-24T08:07:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de476f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc156d50 con 0x7f2ddc152cc0 2023-11-24T08:07:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de250b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ddc0b49a0 0x7f2ddc147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de250b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ddc0b49a0 0x7f2ddc147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39262/0 (socket says 172.21.15.153:39262) 2023-11-24T08:07:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de250b700 1 -- 172.21.15.153:0/3166695413 learned_addr learned my addr 172.21.15.153:0/3166695413 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de1d0a700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ddc0cff20 0x7f2ddc154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de2d0c700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ddc152cc0 0x7f2ddc1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de250b700 1 -- 172.21.15.153:0/3166695413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ddc152cc0 msgr2=0x7f2ddc1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de250b700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ddc152cc0 0x7f2ddc1553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de250b700 1 -- 172.21.15.153:0/3166695413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ddc0cff20 msgr2=0x7f2ddc154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de250b700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ddc0cff20 0x7f2ddc154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de250b700 1 -- 172.21.15.153:0/3166695413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0009550 con 0x7f2ddc0b49a0 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de250b700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ddc0b49a0 0x7f2ddc147330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009c10 tx=0x7f2dd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2dceffd700 1 -- 172.21.15.153:0/3166695413 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00036a0 con 0x7f2ddc0b49a0 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2dceffd700 1 -- 172.21.15.153:0/3166695413 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd001e070 con 0x7f2ddc0b49a0 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de476f700 1 -- 172.21.15.153:0/3166695413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc157030 con 0x7f2ddc0b49a0 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2dceffd700 1 -- 172.21.15.153:0/3166695413 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0003a60 con 0x7f2ddc0b49a0 2023-11-24T08:07:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.842+0000 7f2de476f700 1 -- 172.21.15.153:0/3166695413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc1575f0 con 0x7f2ddc0b49a0 2023-11-24T08:07:09.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.843+0000 7f2de476f700 1 -- 172.21.15.153:0/3166695413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ddc0753f0 con 0x7f2ddc0b49a0 2023-11-24T08:07:09.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.844+0000 7f2dceffd700 1 -- 172.21.15.153:0/3166695413 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2dd0003bc0 con 0x7f2ddc0b49a0 2023-11-24T08:07:09.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.844+0000 7f2dceffd700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2dc006b080 0x7f2dc006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.844+0000 7f2de1d0a700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2dc006b080 0x7f2dc006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.844+0000 7f2dceffd700 1 -- 172.21.15.153:0/3166695413 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2dd008a500 con 0x7f2ddc0b49a0 2023-11-24T08:07:09.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.845+0000 7f2de1d0a700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2dc006b080 0x7f2dc006d540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc147df0 tx=0x7f2dd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:09.849+0000 7f2dceffd700 1 -- 172.21.15.153:0/3166695413 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2dd00556c0 con 0x7f2ddc0b49a0 2023-11-24T08:07:10.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.127+0000 7f2de476f700 1 -- 172.21.15.153:0/3166695413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f2ddc067f60 con 0x7f2ddc0b49a0 2023-11-24T08:07:10.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.968+0000 7f2dceffd700 1 -- 172.21.15.153:0/3166695413 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v165) v1 ==== 164+0+0 (secure 0 0 0) 0x7f2dd0058ce0 con 0x7f2ddc0b49a0 2023-11-24T08:07:10.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.971+0000 7f2de476f700 1 -- 172.21.15.153:0/3166695413 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2dc006b080 msgr2=0x7f2dc006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.971+0000 7f2de476f700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2dc006b080 0x7f2dc006d540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc147df0 tx=0x7f2dd8008040 comp rx=0 tx=0).stop 2023-11-24T08:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.971+0000 7f2de476f700 1 -- 172.21.15.153:0/3166695413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ddc0b49a0 msgr2=0x7f2ddc147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.971+0000 7f2de476f700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ddc0b49a0 0x7f2ddc147330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009c10 tx=0x7f2dd0004750 comp rx=0 tx=0).stop 2023-11-24T08:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.972+0000 7f2de476f700 1 -- 172.21.15.153:0/3166695413 shutdown_connections 2023-11-24T08:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.972+0000 7f2de476f700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ddc152cc0 0x7f2ddc1553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.972+0000 7f2de476f700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2dc006b080 0x7f2dc006d540 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.972+0000 7f2de476f700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ddc0b49a0 0x7f2ddc147330 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.972+0000 7f2de476f700 1 --2- 172.21.15.153:0/3166695413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ddc0cff20 0x7f2ddc154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.972+0000 7f2de476f700 1 -- 172.21.15.153:0/3166695413 >> 172.21.15.153:0/3166695413 conn(0x7f2ddc071b90 msgr2=0x7f2ddc06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.972+0000 7f2de476f700 1 -- 172.21.15.153:0/3166695413 shutdown_connections 2023-11-24T08:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:10.972+0000 7f2de476f700 1 -- 172.21.15.153:0/3166695413 wait complete. 2023-11-24T08:07:10.988 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:07:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.116+0000 7f801aee6700 1 Processor -- start 2023-11-24T08:07:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.116+0000 7f801aee6700 1 -- start start 2023-11-24T08:07:11.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f801aee6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f801415e160 0x7f80140b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f801aee6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80140afc90 0x7f8014073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f801aee6700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80140b3c60 con 0x7f80140744d0 2023-11-24T08:07:11.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f801aee6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80140b4500 con 0x7f801415e160 2023-11-24T08:07:11.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f801aee6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8014074960 con 0x7f80140afc90 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f8018c82700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f801415e160 0x7f80140b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f8018c82700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f801415e160 0x7f80140b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39270/0 (socket says 172.21.15.153:39270) 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f8018c82700 1 -- 172.21.15.153:0/3574656723 learned_addr learned my addr 172.21.15.153:0/3574656723 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f8013fff700 1 --2- 172.21.15.153:0/3574656723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80140afc90 0x7f8014073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f8018c82700 1 -- 172.21.15.153:0/3574656723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80140afc90 msgr2=0x7f8014073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f8018c82700 1 --2- 172.21.15.153:0/3574656723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80140afc90 0x7f8014073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f8018c82700 1 -- 172.21.15.153:0/3574656723 >> v1:172.21.15.164:6789/0 conn(0x7f80140744d0 legacy=0x7f801406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f8018c82700 1 -- 172.21.15.153:0/3574656723 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80140b58c0 con 0x7f801415e160 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.117+0000 7f8018c82700 1 --2- 172.21.15.153:0/3574656723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f801415e160 0x7f80140b5da0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f80080098f0 tx=0x7f8008009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a382e109bcff9e28 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.118+0000 7f80137fe700 1 -- 172.21.15.153:0/3574656723 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008004230 con 0x7f801415e160 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.118+0000 7f80137fe700 1 -- 172.21.15.153:0/3574656723 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8008004390 con 0x7f801415e160 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.118+0000 7f80137fe700 1 -- 172.21.15.153:0/3574656723 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80080036a0 con 0x7f801415e160 2023-11-24T08:07:11.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.118+0000 7f801aee6700 1 -- 172.21.15.153:0/3574656723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f801415e160 msgr2=0x7f80140b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.118+0000 7f801aee6700 1 --2- 172.21.15.153:0/3574656723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f801415e160 0x7f80140b5da0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f80080098f0 tx=0x7f8008009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.118+0000 7f801aee6700 1 -- 172.21.15.153:0/3574656723 shutdown_connections 2023-11-24T08:07:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.118+0000 7f801aee6700 1 --2- 172.21.15.153:0/3574656723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f801415e160 0x7f80140b5da0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.118+0000 7f801aee6700 1 --2- 172.21.15.153:0/3574656723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80140afc90 0x7f8014073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.118+0000 7f801aee6700 1 -- 172.21.15.153:0/3574656723 >> 172.21.15.153:0/3574656723 conn(0x7f80140d0bf0 msgr2=0x7f80140d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.118+0000 7f801aee6700 1 -- 172.21.15.153:0/3574656723 shutdown_connections 2023-11-24T08:07:11.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.118+0000 7f801aee6700 1 -- 172.21.15.153:0/3574656723 wait complete. 2023-11-24T08:07:11.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.119+0000 7f801aee6700 1 Processor -- start 2023-11-24T08:07:11.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.119+0000 7f801aee6700 1 -- start start 2023-11-24T08:07:11.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.120+0000 7f801aee6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80140744d0 0x7f801414e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.120+0000 7f801aee6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80140afc90 0x7f801414d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.120+0000 7f801aee6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f801415e160 0x7f801414a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.120+0000 7f801aee6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80141f38c0 con 0x7f801415e160 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.120+0000 7f801aee6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801414dac0 con 0x7f80140afc90 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.120+0000 7f801aee6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801414ac60 con 0x7f80140744d0 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.120+0000 7f8019483700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f801415e160 0x7f801414a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.120+0000 7f8019483700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f801415e160 0x7f801414a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39280/0 (socket says 172.21.15.153:39280) 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.120+0000 7f8019483700 1 -- 172.21.15.153:0/779543915 learned_addr learned my addr 172.21.15.153:0/779543915 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f8013fff700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80140afc90 0x7f801414d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f8018c82700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80140744d0 0x7f801414e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f8019483700 1 -- 172.21.15.153:0/779543915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80140744d0 msgr2=0x7f801414e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f8019483700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80140744d0 0x7f801414e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f8019483700 1 -- 172.21.15.153:0/779543915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80140afc90 msgr2=0x7f801414d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f8019483700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80140afc90 0x7f801414d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f8019483700 1 -- 172.21.15.153:0/779543915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008009550 con 0x7f801415e160 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f8019483700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f801415e160 0x7f801414a250 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f800c00cc10 tx=0x7f800c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f80117fa700 1 -- 172.21.15.153:0/779543915 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c00abb0 con 0x7f801415e160 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f80117fa700 1 -- 172.21.15.153:0/779543915 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c00ad10 con 0x7f801415e160 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f801aee6700 1 -- 172.21.15.153:0/779543915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801414af40 con 0x7f801415e160 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f80117fa700 1 -- 172.21.15.153:0/779543915 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c012660 con 0x7f801415e160 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.121+0000 7f801aee6700 1 -- 172.21.15.153:0/779543915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801414b500 con 0x7f801415e160 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.122+0000 7f801aee6700 1 -- 172.21.15.153:0/779543915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8014068fb0 con 0x7f801415e160 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.122+0000 7f80117fa700 1 -- 172.21.15.153:0/779543915 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f800c0127c0 con 0x7f801415e160 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.123+0000 7f80117fa700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7ff806b080 0x7f7ff806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.123+0000 7f8018c82700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7ff806b080 0x7f7ff806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.123+0000 7f80117fa700 1 -- 172.21.15.153:0/779543915 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f800c089d60 con 0x7f801415e160 2023-11-24T08:07:11.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.123+0000 7f8018c82700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7ff806b080 0x7f7ff806d540 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8008009130 tx=0x7f8008008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.127+0000 7f80117fa700 1 -- 172.21.15.153:0/779543915 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f800c054f20 con 0x7f801415e160 2023-11-24T08:07:11.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.320+0000 7f801aee6700 1 -- 172.21.15.153:0/779543915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f801406c140 con 0x7f801415e160 2023-11-24T08:07:11.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.323+0000 7f80117fa700 1 -- 172.21.15.153:0/779543915 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f800c016070 con 0x7f801415e160 2023-11-24T08:07:11.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 -- 172.21.15.153:0/779543915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7ff806b080 msgr2=0x7f7ff806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7ff806b080 0x7f7ff806d540 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8008009130 tx=0x7f8008008030 comp rx=0 tx=0).stop 2023-11-24T08:07:11.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 -- 172.21.15.153:0/779543915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f801415e160 msgr2=0x7f801414a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f801415e160 0x7f801414a250 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f800c00cc10 tx=0x7f800c00a060 comp rx=0 tx=0).stop 2023-11-24T08:07:11.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 -- 172.21.15.153:0/779543915 shutdown_connections 2023-11-24T08:07:11.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7ff806b080 0x7f7ff806d540 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f801415e160 0x7f801414a250 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80140744d0 0x7f801414e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 --2- 172.21.15.153:0/779543915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80140afc90 0x7f801414d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 -- 172.21.15.153:0/779543915 >> 172.21.15.153:0/779543915 conn(0x7f80140d0bf0 msgr2=0x7f801406ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:11.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 -- 172.21.15.153:0/779543915 shutdown_connections 2023-11-24T08:07:11.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.325+0000 7f801aee6700 1 -- 172.21.15.153:0/779543915 wait complete. 2023-11-24T08:07:11.339 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:07:11.339 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:11.378 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:11.430 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:07:11.430 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:07:11.430 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:11.448 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3433 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T08:07:11.448 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:07:11.448 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:11.473 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=427 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T08:07:11.473 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:07:11.473 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:11.505 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3433 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T08:07:11.505 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:07:11.505 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:11.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=427 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T08:07:11.533 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T08:07:11.533 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:11.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.664+0000 7f9c2f069700 1 Processor -- start 2023-11-24T08:07:11.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.664+0000 7f9c2f069700 1 -- start start 2023-11-24T08:07:11.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.665+0000 7f9c2f069700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c2815ddd0 0x7f9c280b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.665+0000 7f9c2f069700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9c2815e1b0 0x7f9c280cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.665+0000 7f9c2f069700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c280b1d40 con 0x7f9c280d1b30 2023-11-24T08:07:11.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.665+0000 7f9c2f069700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c280b28c0 con 0x7f9c2815e1b0 2023-11-24T08:07:11.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.665+0000 7f9c2f069700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2806c000 con 0x7f9c2815ddd0 2023-11-24T08:07:11.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.665+0000 7f9c2d606700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9c280d1b30 0x7f9c28161c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45392/0 (socket says 172.21.15.153:45392) 2023-11-24T08:07:11.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.665+0000 7f9c2d606700 1 -- 172.21.15.153:0/4156035090 learned_addr learned my addr 172.21.15.153:0/4156035090 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:11.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c27fff700 1 --2- 172.21.15.153:0/4156035090 >> v2:172.21.15.164:3300/0 conn(0x7f9c2815e1b0 0x7f9c280cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c2ce05700 1 --2- 172.21.15.153:0/4156035090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c2815ddd0 0x7f9c280b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c277fe700 1 -- 172.21.15.153:0/4156035090 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719004374 0 0) 0x7f9c280b1d40 con 0x7f9c280d1b30 2023-11-24T08:07:11.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c277fe700 1 -- 172.21.15.153:0/4156035090 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c180035b0 con 0x7f9c280d1b30 2023-11-24T08:07:11.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c277fe700 1 -- 172.21.15.153:0/4156035090 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2895754343 0 0) 0x7f9c180035b0 con 0x7f9c280d1b30 2023-11-24T08:07:11.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c2ce05700 1 -- 172.21.15.153:0/4156035090 >> v2:172.21.15.164:3300/0 conn(0x7f9c2815e1b0 msgr2=0x7f9c280cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:11.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c2ce05700 1 --2- 172.21.15.153:0/4156035090 >> v2:172.21.15.164:3300/0 conn(0x7f9c2815e1b0 0x7f9c280cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c2ce05700 1 -- 172.21.15.153:0/4156035090 >> v1:172.21.15.153:6789/0 conn(0x7f9c280d1b30 legacy=0x7f9c28161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c2ce05700 1 -- 172.21.15.153:0/4156035090 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c280b1f90 con 0x7f9c2815ddd0 2023-11-24T08:07:11.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c27fff700 1 --2- 172.21.15.153:0/4156035090 >> v2:172.21.15.164:3300/0 conn(0x7f9c2815e1b0 0x7f9c280cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:11.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c2ce05700 1 --2- 172.21.15.153:0/4156035090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c2815ddd0 0x7f9c280b1680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009840 tx=0x7f9c1c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b47c9a976f22fc9e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c277fe700 1 -- 172.21.15.153:0/4156035090 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c200019f0 con 0x7f9c2815ddd0 2023-11-24T08:07:11.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c277fe700 1 -- 172.21.15.153:0/4156035090 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c004030 con 0x7f9c2815ddd0 2023-11-24T08:07:11.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.666+0000 7f9c277fe700 1 -- 172.21.15.153:0/4156035090 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0043c0 con 0x7f9c2815ddd0 2023-11-24T08:07:11.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.667+0000 7f9c2f069700 1 -- 172.21.15.153:0/4156035090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c2815ddd0 msgr2=0x7f9c280b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.667+0000 7f9c2f069700 1 --2- 172.21.15.153:0/4156035090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c2815ddd0 0x7f9c280b1680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009840 tx=0x7f9c1c009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:11.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.667+0000 7f9c2f069700 1 -- 172.21.15.153:0/4156035090 shutdown_connections 2023-11-24T08:07:11.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.667+0000 7f9c2f069700 1 --2- 172.21.15.153:0/4156035090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c2815ddd0 0x7f9c280b1680 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.667+0000 7f9c2f069700 1 --2- 172.21.15.153:0/4156035090 >> v2:172.21.15.164:3300/0 conn(0x7f9c2815e1b0 0x7f9c280cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.667+0000 7f9c2f069700 1 -- 172.21.15.153:0/4156035090 >> 172.21.15.153:0/4156035090 conn(0x7f9c280731a0 msgr2=0x7f9c2809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:11.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.667+0000 7f9c2f069700 1 -- 172.21.15.153:0/4156035090 shutdown_connections 2023-11-24T08:07:11.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.667+0000 7f9c2f069700 1 -- 172.21.15.153:0/4156035090 wait complete. 2023-11-24T08:07:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.668+0000 7f9c2f069700 1 Processor -- start 2023-11-24T08:07:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.668+0000 7f9c2f069700 1 -- start start 2023-11-24T08:07:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c2f069700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c280d1b30 0x7f9c281494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c2f069700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c2815ddd0 0x7f9c28143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c2f069700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c2815e1b0 0x7f9c28145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c2f069700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28159850 con 0x7f9c2815ddd0 2023-11-24T08:07:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c2f069700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c281499f0 con 0x7f9c2815e1b0 2023-11-24T08:07:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c2f069700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28146630 con 0x7f9c280d1b30 2023-11-24T08:07:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c27fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c2815ddd0 0x7f9c28143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c27fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c2815ddd0 0x7f9c28143ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39292/0 (socket says 172.21.15.153:39292) 2023-11-24T08:07:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c27fff700 1 -- 172.21.15.153:0/1346249908 learned_addr learned my addr 172.21.15.153:0/1346249908 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c2ce05700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c280d1b30 0x7f9c281494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c2d606700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c2815e1b0 0x7f9c28145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c27fff700 1 -- 172.21.15.153:0/1346249908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c280d1b30 msgr2=0x7f9c281494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c27fff700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c280d1b30 0x7f9c281494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c27fff700 1 -- 172.21.15.153:0/1346249908 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c2815e1b0 msgr2=0x7f9c28145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c27fff700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c2815e1b0 0x7f9c28145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.669+0000 7f9c27fff700 1 -- 172.21.15.153:0/1346249908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c140094a0 con 0x7f9c2815ddd0 2023-11-24T08:07:11.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.670+0000 7f9c27fff700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c2815ddd0 0x7f9c28143ae0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400ebe0 tx=0x7f9c1400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.670+0000 7f9c257fa700 1 -- 172.21.15.153:0/1346249908 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14009760 con 0x7f9c2815ddd0 2023-11-24T08:07:11.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.670+0000 7f9c257fa700 1 -- 172.21.15.153:0/1346249908 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1400c850 con 0x7f9c2815ddd0 2023-11-24T08:07:11.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.670+0000 7f9c2f069700 1 -- 172.21.15.153:0/1346249908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1c0094a0 con 0x7f9c2815ddd0 2023-11-24T08:07:11.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.670+0000 7f9c257fa700 1 -- 172.21.15.153:0/1346249908 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400cbe0 con 0x7f9c2815ddd0 2023-11-24T08:07:11.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.670+0000 7f9c2f069700 1 -- 172.21.15.153:0/1346249908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c280b2ed0 con 0x7f9c2815ddd0 2023-11-24T08:07:11.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.671+0000 7f9c2f069700 1 -- 172.21.15.153:0/1346249908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c28146b20 con 0x7f9c2815ddd0 2023-11-24T08:07:11.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.671+0000 7f9c257fa700 1 -- 172.21.15.153:0/1346249908 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9c1400cd40 con 0x7f9c2815ddd0 2023-11-24T08:07:11.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.671+0000 7f9c257fa700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c0c06b080 0x7f9c0c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.672+0000 7f9c257fa700 1 -- 172.21.15.153:0/1346249908 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c14089620 con 0x7f9c2815ddd0 2023-11-24T08:07:11.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.672+0000 7f9c2ce05700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c0c06b080 0x7f9c0c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.672+0000 7f9c2ce05700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c0c06b080 0x7f9c0c06d540 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0090b0 tx=0x7f9c1c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.676+0000 7f9c257fa700 1 -- 172.21.15.153:0/1346249908 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c28146b20 con 0x7f9c2815ddd0 2023-11-24T08:07:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.907+0000 7f9c2f069700 1 -- 172.21.15.153:0/1346249908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c28159990 con 0x7f9c2815ddd0 2023-11-24T08:07:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.908+0000 7f9c257fa700 1 -- 172.21.15.153:0/1346249908 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f9c14021e90 con 0x7f9c2815ddd0 2023-11-24T08:07:11.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:11.910 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1709079257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1709079257},{"type":"v1","addr":"172.21.15.164:6834","nonce":1709079257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4092105455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4092105455},{"type":"v1","addr":"172.21.15.164:6835","nonce":4092105455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/1536536437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":1536536437},{"type":"v1","addr":"172.21.15.153:6836","nonce":1536536437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6009,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/2429025337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2429025337},{"type":"v1","addr":"172.21.15.153:6837","nonce":2429025337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[]} 2023-11-24T08:07:11.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 -- 172.21.15.153:0/1346249908 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c0c06b080 msgr2=0x7f9c0c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c0c06b080 0x7f9c0c06d540 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0090b0 tx=0x7f9c1c008030 comp rx=0 tx=0).stop 2023-11-24T08:07:11.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 -- 172.21.15.153:0/1346249908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c2815ddd0 msgr2=0x7f9c28143ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c2815ddd0 0x7f9c28143ae0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400ebe0 tx=0x7f9c1400eef0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 -- 172.21.15.153:0/1346249908 shutdown_connections 2023-11-24T08:07:11.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c2815e1b0 0x7f9c28145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c280d1b30 0x7f9c281494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c0c06b080 0x7f9c0c06d540 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 --2- 172.21.15.153:0/1346249908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c2815ddd0 0x7f9c28143ae0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 -- 172.21.15.153:0/1346249908 >> 172.21.15.153:0/1346249908 conn(0x7f9c280731a0 msgr2=0x7f9c2806fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:11.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 -- 172.21.15.153:0/1346249908 shutdown_connections 2023-11-24T08:07:11.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:11.910+0000 7f9c2f069700 1 -- 172.21.15.153:0/1346249908 wait complete. 2023-11-24T08:07:11.913 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 29 2023-11-24T08:07:11.924 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:07:11.924 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T08:07:11.924 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:07:11.925 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:11.925 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:07:11.925 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T08:07:11.925 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:07:11.925 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:11.925 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:07:11.926 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T08:07:11.926 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:07:11.926 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:11.926 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:07:11.926 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T08:07:11.926 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:07:11.927 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:11.936 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:07:11.936 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:07:11.937 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:07:11.937 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:07:11.939 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:07:11.939 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:07:11.940 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:07:11.940 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:07:11.978 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:07:11.978 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:11.978 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:07:11.979 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:11.982 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:07:11.982 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:11.982 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:07:11.983 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:11.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T08:07:12.058 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-11-24T08:07:12.060 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-11-24T08:07:12.070 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-11-24T08:07:12.071 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-11-24T08:07:12.071 INFO:tasks.ceph.mds.d.smithi164.stderr:2023-11-24T08:07:12.069+0000 7fbe4fa3e700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-24T08:07:12.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.108+0000 7f9beb7e3700 1 Processor -- start 2023-11-24T08:07:12.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.109+0000 7f9beb7e3700 1 -- start start 2023-11-24T08:07:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.109+0000 7f9beb7e3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9be41446a0 0x7f9be40b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.109+0000 7f9beb7e3700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9be40adf00 0x7f9be406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.109+0000 7f9beb7e3700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be40af950 con 0x7f9be406c540 2023-11-24T08:07:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.109+0000 7f9beb7e3700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be406c9f0 con 0x7f9be41446a0 2023-11-24T08:07:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.109+0000 7f9beb7e3700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be4144a80 con 0x7f9be40adf00 2023-11-24T08:07:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9be957f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9be41446a0 0x7f9be40b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9be957f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9be41446a0 0x7f9be40b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39322/0 (socket says 172.21.15.153:39322) 2023-11-24T08:07:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9be957f700 1 -- 172.21.15.153:0/676432346 learned_addr learned my addr 172.21.15.153:0/676432346 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9be8d7e700 1 --2- 172.21.15.153:0/676432346 >> v2:172.21.15.164:3300/0 conn(0x7f9be40adf00 0x7f9be406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9be957f700 1 -- 172.21.15.153:0/676432346 >> v2:172.21.15.164:3300/0 conn(0x7f9be40adf00 msgr2=0x7f9be406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9be957f700 1 --2- 172.21.15.153:0/676432346 >> v2:172.21.15.164:3300/0 conn(0x7f9be40adf00 0x7f9be406c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9be957f700 1 -- 172.21.15.153:0/676432346 >> v1:172.21.15.164:6789/0 conn(0x7f9be406c540 legacy=0x7f9be406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9be957f700 1 -- 172.21.15.153:0/676432346 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be40afc30 con 0x7f9be41446a0 2023-11-24T08:07:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9be957f700 1 --2- 172.21.15.153:0/676432346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9be41446a0 0x7f9be40b5ae0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9be409f030 tx=0x7f9bd4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9bf0f3f163e4e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9bdbfff700 1 -- 172.21.15.153:0/676432346 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4004230 con 0x7f9be41446a0 2023-11-24T08:07:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9bdbfff700 1 -- 172.21.15.153:0/676432346 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd4004390 con 0x7f9be41446a0 2023-11-24T08:07:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.110+0000 7f9bdbfff700 1 -- 172.21.15.153:0/676432346 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd40036a0 con 0x7f9be41446a0 2023-11-24T08:07:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.111+0000 7f9beb7e3700 1 -- 172.21.15.153:0/676432346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9be41446a0 msgr2=0x7f9be40b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.111+0000 7f9beb7e3700 1 --2- 172.21.15.153:0/676432346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9be41446a0 0x7f9be40b5ae0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9be409f030 tx=0x7f9bd4009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.111+0000 7f9beb7e3700 1 -- 172.21.15.153:0/676432346 shutdown_connections 2023-11-24T08:07:12.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.111+0000 7f9beb7e3700 1 --2- 172.21.15.153:0/676432346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9be41446a0 0x7f9be40b5ae0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.111+0000 7f9beb7e3700 1 --2- 172.21.15.153:0/676432346 >> v2:172.21.15.164:3300/0 conn(0x7f9be40adf00 0x7f9be406c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.111+0000 7f9beb7e3700 1 -- 172.21.15.153:0/676432346 >> 172.21.15.153:0/676432346 conn(0x7f9be4071b90 msgr2=0x7f9be4071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:12.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.111+0000 7f9beb7e3700 1 -- 172.21.15.153:0/676432346 shutdown_connections 2023-11-24T08:07:12.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.111+0000 7f9beb7e3700 1 -- 172.21.15.153:0/676432346 wait complete. 2023-11-24T08:07:12.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.112+0000 7f9beb7e3700 1 Processor -- start 2023-11-24T08:07:12.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.112+0000 7f9beb7e3700 1 -- start start 2023-11-24T08:07:12.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9beb7e3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9be406c540 0x7f9be413a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9beb7e3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9be40adf00 0x7f9be40ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9beb7e3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9be41446a0 0x7f9be41433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9beb7e3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be409ad30 con 0x7f9be406c540 2023-11-24T08:07:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9beb7e3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be415b3e0 con 0x7f9be41446a0 2023-11-24T08:07:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9beb7e3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be415b6c0 con 0x7f9be40adf00 2023-11-24T08:07:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9be957f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9be406c540 0x7f9be413a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9be957f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9be406c540 0x7f9be413a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39328/0 (socket says 172.21.15.153:39328) 2023-11-24T08:07:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9be957f700 1 -- 172.21.15.153:0/496630401 learned_addr learned my addr 172.21.15.153:0/496630401 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9be8d7e700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9be40adf00 0x7f9be40ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9be9d80700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9be41446a0 0x7f9be41433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9be957f700 1 -- 172.21.15.153:0/496630401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9be40adf00 msgr2=0x7f9be40ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9be957f700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9be40adf00 0x7f9be40ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9be957f700 1 -- 172.21.15.153:0/496630401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9be41446a0 msgr2=0x7f9be41433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9be957f700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9be41446a0 0x7f9be41433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9be957f700 1 -- 172.21.15.153:0/496630401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd4009550 con 0x7f9be406c540 2023-11-24T08:07:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9be957f700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9be406c540 0x7f9be413a5b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009870 tx=0x7f9bd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9bd9ffb700 1 -- 172.21.15.153:0/496630401 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4003e20 con 0x7f9be406c540 2023-11-24T08:07:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9bd9ffb700 1 -- 172.21.15.153:0/496630401 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd4011630 con 0x7f9be406c540 2023-11-24T08:07:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9bd9ffb700 1 -- 172.21.15.153:0/496630401 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd40119e0 con 0x7f9be406c540 2023-11-24T08:07:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.113+0000 7f9beb7e3700 1 -- 172.21.15.153:0/496630401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be415b9a0 con 0x7f9be406c540 2023-11-24T08:07:12.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.114+0000 7f9beb7e3700 1 -- 172.21.15.153:0/496630401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be409de60 con 0x7f9be406c540 2023-11-24T08:07:12.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.114+0000 7f9beb7e3700 1 -- 172.21.15.153:0/496630401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be40753f0 con 0x7f9be406c540 2023-11-24T08:07:12.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.115+0000 7f9bd9ffb700 1 -- 172.21.15.153:0/496630401 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9bd4011b40 con 0x7f9be406c540 2023-11-24T08:07:12.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.115+0000 7f9bd9ffb700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9bc806b080 0x7f9bc806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.115+0000 7f9bd9ffb700 1 -- 172.21.15.153:0/496630401 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9bd408ae40 con 0x7f9be406c540 2023-11-24T08:07:12.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.115+0000 7f9be8d7e700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9bc806b080 0x7f9bc806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.116+0000 7f9be8d7e700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9bc806b080 0x7f9bc806d540 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9be415acf0 tx=0x7f9be0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.120+0000 7f9bd9ffb700 1 -- 172.21.15.153:0/496630401 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9bd4055f80 con 0x7f9be406c540 2023-11-24T08:07:12.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.327+0000 7f9beb7e3700 1 -- 172.21.15.153:0/496630401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9be4067f60 con 0x7f9be406c540 2023-11-24T08:07:12.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.980+0000 7f9bd9ffb700 1 -- 172.21.15.153:0/496630401 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9bd40595a0 con 0x7f9be406c540 2023-11-24T08:07:12.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 -- 172.21.15.153:0/496630401 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9bc806b080 msgr2=0x7f9bc806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9bc806b080 0x7f9bc806d540 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9be415acf0 tx=0x7f9be0008040 comp rx=0 tx=0).stop 2023-11-24T08:07:12.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 -- 172.21.15.153:0/496630401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9be406c540 msgr2=0x7f9be413a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9be406c540 0x7f9be413a5b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009870 tx=0x7f9bd4004750 comp rx=0 tx=0).stop 2023-11-24T08:07:12.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 -- 172.21.15.153:0/496630401 shutdown_connections 2023-11-24T08:07:12.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9be41446a0 0x7f9be41433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9bc806b080 0x7f9bc806d540 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9be406c540 0x7f9be413a5b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 --2- 172.21.15.153:0/496630401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9be40adf00 0x7f9be40ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 -- 172.21.15.153:0/496630401 >> 172.21.15.153:0/496630401 conn(0x7f9be4071b90 msgr2=0x7f9be406da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 -- 172.21.15.153:0/496630401 shutdown_connections 2023-11-24T08:07:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:12.983+0000 7f9beb7e3700 1 -- 172.21.15.153:0/496630401 wait complete. 2023-11-24T08:07:12.986 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-11-24T08:07:13.000 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T08:07:13.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.122+0000 7fd82f7ea700 1 Processor -- start 2023-11-24T08:07:13.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.122+0000 7fd82f7ea700 1 -- start start 2023-11-24T08:07:13.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd82f7ea700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd82815e080 0x7fd8280b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd82f7ea700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280ae430 con 0x7fd8280af4d0 2023-11-24T08:07:13.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd82f7ea700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280ae710 con 0x7fd82806c710 2023-11-24T08:07:13.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd82f7ea700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280af0b0 con 0x7fd82815e080 2023-11-24T08:07:13.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd82cd85700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd8280af4d0 0x7fd82806c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45442/0 (socket says 172.21.15.153:45442) 2023-11-24T08:07:13.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd82cd85700 1 -- 172.21.15.153:0/3051322337 learned_addr learned my addr 172.21.15.153:0/3051322337 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:13.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd82d586700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd82815e080 0x7fd8280b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108641772 0 0) 0x7fd8280ae430 con 0x7fd8280af4d0 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8140035b0 con 0x7fd8280af4d0 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130898315 0 0) 0x7fd8280ae710 con 0x7fd82806c710 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8280ae430 con 0x7fd82806c710 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2201990220 0 0) 0x7fd8140035b0 con 0x7fd8280af4d0 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd82815e080 msgr2=0x7fd8280b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd81ffff700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd82815e080 0x7fd8280b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 >> v1:172.21.15.164:6789/0 conn(0x7fd82806c710 legacy=0x7fd82806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280ae9f0 con 0x7fd8280af4d0 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fd818001670 con 0x7fd8280af4d0 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.123+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 >> v1:172.21.15.153:6789/0 conn(0x7fd8280af4d0 legacy=0x7fd82806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd81ffff700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd82815e080 0x7fd814003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd81ffff700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd814004170 0x7fd814004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd81ffff700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd814004d90 0x7fd814005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280af0b0 con 0x7fd814004170 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81400bb50 con 0x7fd814004d90 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81400bd10 con 0x7fd82815e080 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd82cd85700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd814004170 0x7fd814004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd82d586700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd82815e080 0x7fd814003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd82dd87700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd814004d90 0x7fd814005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd82cd85700 1 -- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd82815e080 msgr2=0x7fd814003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd82cd85700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd82815e080 0x7fd814003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd82cd85700 1 -- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd814004d90 msgr2=0x7fd814005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd82cd85700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd814004d90 0x7fd814005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd82cd85700 1 -- 172.21.15.153:0/3051322337 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8140035b0 con 0x7fd814004170 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd82dd87700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd814004d90 0x7fd814005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd82cd85700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd814004170 0x7fd814004850 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd8280af950 tx=0x7fd814005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67134be72b6cd7bf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818005b60 con 0x7fd814004170 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd818005cc0 con 0x7fd814004170 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.124+0000 7fd81ffff700 1 -- 172.21.15.153:0/3051322337 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81800cb90 con 0x7fd814004170 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.125+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3051322337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd814004170 msgr2=0x7fd814004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.125+0000 7fd82f7ea700 1 --2- 172.21.15.153:0/3051322337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd814004170 0x7fd814004850 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd8280af950 tx=0x7fd814005880 comp rx=0 tx=0).stop 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.125+0000 7fd82dd87700 1 -- 172.21.15.153:0/3051322337 reap_dead start 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.125+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3051322337 shutdown_connections 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.125+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3051322337 >> 172.21.15.153:0/3051322337 conn(0x7fd828071b90 msgr2=0x7fd828071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.125+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3051322337 shutdown_connections 2023-11-24T08:07:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.125+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3051322337 wait complete. 2023-11-24T08:07:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.126+0000 7fd82f7ea700 1 Processor -- start 2023-11-24T08:07:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.126+0000 7fd82f7ea700 1 -- start start 2023-11-24T08:07:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82f7ea700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd814004170 0x7fd828141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82f7ea700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8281515f0 0x7fd8281582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82f7ea700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8281587e0 0x7fd828158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82f7ea700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281424c0 con 0x7fd8281587e0 2023-11-24T08:07:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82f7ea700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd828160c40 con 0x7fd814004170 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82f7ea700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd828160f20 con 0x7fd8281515f0 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82dd87700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8281587e0 0x7fd828158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82dd87700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8281587e0 0x7fd828158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39354/0 (socket says 172.21.15.153:39354) 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82dd87700 1 -- 172.21.15.153:0/3178493987 learned_addr learned my addr 172.21.15.153:0/3178493987 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82d586700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd814004170 0x7fd828141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82cd85700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8281515f0 0x7fd8281582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82dd87700 1 -- 172.21.15.153:0/3178493987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8281515f0 msgr2=0x7fd8281582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82dd87700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8281515f0 0x7fd8281582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82dd87700 1 -- 172.21.15.153:0/3178493987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd814004170 msgr2=0x7fd828141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82dd87700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd814004170 0x7fd828141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82dd87700 1 -- 172.21.15.153:0/3178493987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd828161200 con 0x7fd8281587e0 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82cd85700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8281515f0 0x7fd8281582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd82dd87700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8281587e0 0x7fd828158c70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd82809f040 tx=0x7fd82000c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.127+0000 7fd81dffb700 1 -- 172.21.15.153:0/3178493987 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820003a00 con 0x7fd8281587e0 2023-11-24T08:07:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.128+0000 7fd81dffb700 1 -- 172.21.15.153:0/3178493987 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd820003b60 con 0x7fd8281587e0 2023-11-24T08:07:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.128+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3178493987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8281539e0 con 0x7fd8281587e0 2023-11-24T08:07:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.128+0000 7fd81dffb700 1 -- 172.21.15.153:0/3178493987 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000c920 con 0x7fd8281587e0 2023-11-24T08:07:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.128+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3178493987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd828153690 con 0x7fd8281587e0 2023-11-24T08:07:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.129+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3178493987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd828153850 con 0x7fd8281587e0 2023-11-24T08:07:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.129+0000 7fd81dffb700 1 -- 172.21.15.153:0/3178493987 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd82000ca80 con 0x7fd8281587e0 2023-11-24T08:07:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.129+0000 7fd81dffb700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd80c06b080 0x7fd80c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.129+0000 7fd81dffb700 1 -- 172.21.15.153:0/3178493987 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd820089660 con 0x7fd8281587e0 2023-11-24T08:07:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.129+0000 7fd82d586700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd80c06b080 0x7fd80c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.130+0000 7fd82d586700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd80c06b080 0x7fd80c06d540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd824009b80 tx=0x7fd824009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.134+0000 7fd81dffb700 1 -- 172.21.15.153:0/3178493987 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd820054870 con 0x7fd8281587e0 2023-11-24T08:07:13.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.403+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3178493987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd8280753f0 con 0x7fd8281587e0 2023-11-24T08:07:13.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.404+0000 7fd81dffb700 1 -- 172.21.15.153:0/3178493987 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd820057e90 con 0x7fd8281587e0 2023-11-24T08:07:13.405 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:13.406 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:07:13.406 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-11-24T08:07:13.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.406 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-11-24T08:07:13.406 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlx+KYHxAAFmTb68c8Q+OPuEy1aTPrRA==", 2023-11-24T08:07:13.406 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.406 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:07:13.406 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:07:13.406 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:07:13.406 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.406 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.407 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-11-24T08:07:13.407 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlYf05LBAAG8lBFt4GsIw9WCLOz1Nb6w==", 2023-11-24T08:07:13.407 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.407 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:07:13.407 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:07:13.407 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:07:13.407 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.408 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-11-24T08:07:13.408 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlVGztJhAAEqdk6SYM6OJ4VTgapBBIvA==", 2023-11-24T08:07:13.408 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.408 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:07:13.408 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:07:13.408 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:07:13.408 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.408 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBle4zFMxAAsrvbC5k9Zj3Dz46bnOU0Pw==", 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.410 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-11-24T08:07:13.410 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDMWGBlqA2SFBAAO/T01CTkjA4nWupGuLvJfA==", 2023-11-24T08:07:13.410 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.410 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:13.410 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:07:13.410 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.410 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.410 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-11-24T08:07:13.411 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDPWGBl1D4rFBAAsB5U6NIJd1MnxnYz7iNsbg==", 2023-11-24T08:07:13.411 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.411 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:13.411 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:07:13.411 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.411 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDSWGBlh+SCExAAWteEjpmcESWppG2uGuvRhA==", 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.412 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDVWGBlEjPOEhAA6fy3O+YzwFZ625c8GvAdww==", 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDbWGBlE8p6FxAA49f3frFNrFYxTVgvUn/UNA==", 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.413 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDeWGBlNlnlFhAAD8/M/46F/1PmYqMFPvatSQ==", 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.415 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-11-24T08:07:13.415 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDhWGBlqQlSFhAAj8WBN4TrdU4xhBALj5+4JQ==", 2023-11-24T08:07:13.415 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.415 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:13.415 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:07:13.415 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.415 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.416 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-11-24T08:07:13.416 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDkWGBljhGHFhAAhYVbRp1+nSzfgBwpHAzvKA==", 2023-11-24T08:07:13.416 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.416 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:13.416 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-11-24T08:07:13.416 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.416 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.417 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-11-24T08:07:13.417 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlu28wOBAATnuO3XTplxrcn9JD3ta5XQ==", 2023-11-24T08:07:13.417 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.418 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:07:13.418 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-11-24T08:07:13.418 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T08:07:13.418 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.419 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-11-24T08:07:13.419 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDJWGBlT7tPAxAAl1DsWQCIaZcKFC5TNkWxoA==", 2023-11-24T08:07:13.419 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.419 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:07:13.419 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-11-24T08:07:13.419 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-11-24T08:07:13.419 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-11-24T08:07:13.419 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.419 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlSJ+FOxAAphdCFULGDZbuhcHaYu318A==", 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDJWGBliyYXCRAA/QCK4goQ9KvHf+XNyGoVnA==", 2023-11-24T08:07:13.420 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlGYiFARAAFj/se3SGAKuQG/xAyzbo9A==", 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-11-24T08:07:13.421 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-11-24T08:07:13.422 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.422 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.422 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-11-24T08:07:13.422 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBle/UvHBAAeeyUHoDjzbEwVnrh42R/pQ==", 2023-11-24T08:07:13.422 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.422 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-11-24T08:07:13.422 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-11-24T08:07:13.422 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.422 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDIWGBlXSmiFxAA7jtMExuEpOroMzEOELomPg==", 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-11-24T08:07:13.423 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:07:13.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3178493987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd80c06b080 msgr2=0x7fd80c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd80c06b080 0x7fd80c06d540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd824009b80 tx=0x7fd824009210 comp rx=0 tx=0).stop 2023-11-24T08:07:13.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3178493987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8281587e0 msgr2=0x7fd828158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8281587e0 0x7fd828158c70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd82809f040 tx=0x7fd82000c3c0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3178493987 shutdown_connections 2023-11-24T08:07:13.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd80c06b080 0x7fd80c06d540 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8281587e0 0x7fd828158c70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd814004170 0x7fd828141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 --2- 172.21.15.153:0/3178493987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8281515f0 0x7fd8281582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3178493987 >> 172.21.15.153:0/3178493987 conn(0x7fd828071b90 msgr2=0x7fd8280af980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3178493987 shutdown_connections 2023-11-24T08:07:13.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.406+0000 7fd82f7ea700 1 -- 172.21.15.153:0/3178493987 wait complete. 2023-11-24T08:07:13.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:13.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.546+0000 7ffa56cc7700 1 Processor -- start 2023-11-24T08:07:13.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.546+0000 7ffa56cc7700 1 -- start start 2023-11-24T08:07:13.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa56cc7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa500b0f80 0x7ffa5015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa56cc7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa500cd770 0x7ffa5015a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa56cc7700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa500b2bd0 con 0x7ffa500b0ba0 2023-11-24T08:07:13.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa56cc7700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa500b1fc0 con 0x7ffa500b0f80 2023-11-24T08:07:13.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa56cc7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500b22a0 con 0x7ffa500cd770 2023-11-24T08:07:13.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa4ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa500b0f80 0x7ffa5015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa54a63700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ffa500b0ba0 0x7ffa500af5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45462/0 (socket says 172.21.15.153:45462) 2023-11-24T08:07:13.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa4ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa500b0f80 0x7ffa5015a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39360/0 (socket says 172.21.15.153:39360) 2023-11-24T08:07:13.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa54a63700 1 -- 172.21.15.153:0/457106971 learned_addr learned my addr 172.21.15.153:0/457106971 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:13.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa4ffff700 1 -- 172.21.15.153:0/457106971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa500cd770 msgr2=0x7ffa5015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:13.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa4ffff700 1 --2- 172.21.15.153:0/457106971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa500cd770 0x7ffa5015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa4ffff700 1 -- 172.21.15.153:0/457106971 >> v1:172.21.15.153:6789/0 conn(0x7ffa500b0ba0 legacy=0x7ffa500af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa4ffff700 1 -- 172.21.15.153:0/457106971 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500b2580 con 0x7ffa500b0f80 2023-11-24T08:07:13.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa4f7fe700 1 -- 172.21.15.153:0/457106971 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601111712 0 0) 0x7ffa500b2bd0 con 0x7ffa500b0ba0 2023-11-24T08:07:13.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa4ffff700 1 --2- 172.21.15.153:0/457106971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa500b0f80 0x7ffa5015a440 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009840 tx=0x7ffa3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cd032b09e2a7f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa4f7fe700 1 -- 172.21.15.153:0/457106971 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c011830 con 0x7ffa500b0f80 2023-11-24T08:07:13.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa4f7fe700 1 -- 172.21.15.153:0/457106971 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c011990 con 0x7ffa500b0f80 2023-11-24T08:07:13.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.547+0000 7ffa4f7fe700 1 -- 172.21.15.153:0/457106971 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c011d20 con 0x7ffa500b0f80 2023-11-24T08:07:13.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.548+0000 7ffa56cc7700 1 -- 172.21.15.153:0/457106971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa500b0f80 msgr2=0x7ffa5015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.548+0000 7ffa56cc7700 1 --2- 172.21.15.153:0/457106971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa500b0f80 0x7ffa5015a440 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009840 tx=0x7ffa3c009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:13.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.548+0000 7ffa56cc7700 1 -- 172.21.15.153:0/457106971 shutdown_connections 2023-11-24T08:07:13.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.548+0000 7ffa56cc7700 1 --2- 172.21.15.153:0/457106971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa500cd770 0x7ffa5015a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.548+0000 7ffa56cc7700 1 --2- 172.21.15.153:0/457106971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa500b0f80 0x7ffa5015a440 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.548+0000 7ffa56cc7700 1 -- 172.21.15.153:0/457106971 >> 172.21.15.153:0/457106971 conn(0x7ffa500b57b0 msgr2=0x7ffa500b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.548+0000 7ffa56cc7700 1 -- 172.21.15.153:0/457106971 shutdown_connections 2023-11-24T08:07:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.548+0000 7ffa56cc7700 1 -- 172.21.15.153:0/457106971 wait complete. 2023-11-24T08:07:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.549+0000 7ffa56cc7700 1 Processor -- start 2023-11-24T08:07:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.549+0000 7ffa56cc7700 1 -- start start 2023-11-24T08:07:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.550+0000 7ffa56cc7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa500b0ba0 0x7ffa50145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.550+0000 7ffa56cc7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa500b0f80 0x7ffa500b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.550+0000 7ffa56cc7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa500cd770 0x7ffa50061a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.550+0000 7ffa56cc7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500b3080 con 0x7ffa500cd770 2023-11-24T08:07:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.550+0000 7ffa56cc7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500b3ea0 con 0x7ffa500b0f80 2023-11-24T08:07:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.550+0000 7ffa56cc7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500b4330 con 0x7ffa500b0ba0 2023-11-24T08:07:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.550+0000 7ffa55264700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa500cd770 0x7ffa50061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.550+0000 7ffa55264700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa500cd770 0x7ffa50061a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39368/0 (socket says 172.21.15.153:39368) 2023-11-24T08:07:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.550+0000 7ffa55264700 1 -- 172.21.15.153:0/2790875786 learned_addr learned my addr 172.21.15.153:0/2790875786 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.550+0000 7ffa4ffff700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa500b0f80 0x7ffa500b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.550+0000 7ffa54a63700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa500b0ba0 0x7ffa50145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa55264700 1 -- 172.21.15.153:0/2790875786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa500b0ba0 msgr2=0x7ffa50145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa55264700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa500b0ba0 0x7ffa50145920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa55264700 1 -- 172.21.15.153:0/2790875786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa500b0f80 msgr2=0x7ffa500b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa55264700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa500b0f80 0x7ffa500b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa55264700 1 -- 172.21.15.153:0/2790875786 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c0094a0 con 0x7ffa500cd770 2023-11-24T08:07:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa4ffff700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa500b0f80 0x7ffa500b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa55264700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa500cd770 0x7ffa50061a10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800b970 tx=0x7ffa4800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa4d7fa700 1 -- 172.21.15.153:0/2790875786 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800c9b0 con 0x7ffa500cd770 2023-11-24T08:07:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa4d7fa700 1 -- 172.21.15.153:0/2790875786 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4800cb30 con 0x7ffa500cd770 2023-11-24T08:07:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa56cc7700 1 -- 172.21.15.153:0/2790875786 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa500b5070 con 0x7ffa500cd770 2023-11-24T08:07:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa4d7fa700 1 -- 172.21.15.153:0/2790875786 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48014440 con 0x7ffa500cd770 2023-11-24T08:07:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.551+0000 7ffa56cc7700 1 -- 172.21.15.153:0/2790875786 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa500b3570 con 0x7ffa500cd770 2023-11-24T08:07:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.552+0000 7ffa56cc7700 1 -- 172.21.15.153:0/2790875786 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa500b1d70 con 0x7ffa500cd770 2023-11-24T08:07:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.552+0000 7ffa4d7fa700 1 -- 172.21.15.153:0/2790875786 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ffa4801d3b0 con 0x7ffa500cd770 2023-11-24T08:07:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.553+0000 7ffa4d7fa700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa3406b080 0x7ffa3406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.553+0000 7ffa4d7fa700 1 -- 172.21.15.153:0/2790875786 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffa48089420 con 0x7ffa500cd770 2023-11-24T08:07:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.553+0000 7ffa54a63700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa3406b080 0x7ffa3406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.553+0000 7ffa54a63700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa3406b080 0x7ffa3406d540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffa44000f60 tx=0x7ffa44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.557+0000 7ffa4d7fa700 1 -- 172.21.15.153:0/2790875786 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa48054510 con 0x7ffa500cd770 2023-11-24T08:07:13.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.751+0000 7ffa56cc7700 1 -- 172.21.15.153:0/2790875786 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa500b4010 con 0x7ffa500cd770 2023-11-24T08:07:13.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.752+0000 7ffa4d7fa700 1 -- 172.21.15.153:0/2790875786 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+12893 (secure 0 0 0) 0x7ffa48019020 con 0x7ffa500cd770 2023-11-24T08:07:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:13.754 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":52,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:07:12.993920+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:13.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 -- 172.21.15.153:0/2790875786 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa3406b080 msgr2=0x7ffa3406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa3406b080 0x7ffa3406d540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffa44000f60 tx=0x7ffa44009040 comp rx=0 tx=0).stop 2023-11-24T08:07:13.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 -- 172.21.15.153:0/2790875786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa500cd770 msgr2=0x7ffa50061a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa500cd770 0x7ffa50061a10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800b970 tx=0x7ffa4800bd30 comp rx=0 tx=0).stop 2023-11-24T08:07:13.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 -- 172.21.15.153:0/2790875786 shutdown_connections 2023-11-24T08:07:13.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ffa3406b080 0x7ffa3406d540 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa500cd770 0x7ffa50061a10 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa500b0ba0 0x7ffa50145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 --2- 172.21.15.153:0/2790875786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa500b0f80 0x7ffa500b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 -- 172.21.15.153:0/2790875786 >> 172.21.15.153:0/2790875786 conn(0x7ffa500b57b0 msgr2=0x7ffa500cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 -- 172.21.15.153:0/2790875786 shutdown_connections 2023-11-24T08:07:13.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.754+0000 7ffa56cc7700 1 -- 172.21.15.153:0/2790875786 wait complete. 2023-11-24T08:07:13.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:13.768 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.891+0000 7f288be05700 1 Processor -- start 2023-11-24T08:07:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.891+0000 7f288be05700 1 -- start start 2023-11-24T08:07:13.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f288be05700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288415e160 0x7f28840b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f288be05700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28840afc90 0x7f2884073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f288be05700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840b3c60 con 0x7f28840744d0 2023-11-24T08:07:13.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f288be05700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840b4500 con 0x7f28840afc90 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f288be05700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2884074960 con 0x7f288415e160 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f28893a0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28840afc90 0x7f2884073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f28893a0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28840afc90 0x7f2884073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39374/0 (socket says 172.21.15.153:39374) 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f28893a0700 1 -- 172.21.15.153:0/4037340236 learned_addr learned my addr 172.21.15.153:0/4037340236 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f2889ba1700 1 --2- 172.21.15.153:0/4037340236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288415e160 0x7f28840b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f28893a0700 1 -- 172.21.15.153:0/4037340236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288415e160 msgr2=0x7f28840b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f28893a0700 1 --2- 172.21.15.153:0/4037340236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288415e160 0x7f28840b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f28893a0700 1 -- 172.21.15.153:0/4037340236 >> v1:172.21.15.164:6789/0 conn(0x7f28840744d0 legacy=0x7f288406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f28893a0700 1 -- 172.21.15.153:0/4037340236 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840b58c0 con 0x7f28840afc90 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.892+0000 7f28893a0700 1 --2- 172.21.15.153:0/4037340236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28840afc90 0x7f2884073f90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f28740098f0 tx=0x7f2874009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f69839132d3eed8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.893+0000 7f2888b9f700 1 -- 172.21.15.153:0/4037340236 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874011830 con 0x7f28840afc90 2023-11-24T08:07:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.893+0000 7f2888b9f700 1 -- 172.21.15.153:0/4037340236 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2874011990 con 0x7f28840afc90 2023-11-24T08:07:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.893+0000 7f2888b9f700 1 -- 172.21.15.153:0/4037340236 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874011d20 con 0x7f28840afc90 2023-11-24T08:07:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.893+0000 7f288be05700 1 -- 172.21.15.153:0/4037340236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28840afc90 msgr2=0x7f2884073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.893+0000 7f288be05700 1 --2- 172.21.15.153:0/4037340236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28840afc90 0x7f2884073f90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f28740098f0 tx=0x7f2874009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.893+0000 7f288be05700 1 -- 172.21.15.153:0/4037340236 shutdown_connections 2023-11-24T08:07:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.893+0000 7f288be05700 1 --2- 172.21.15.153:0/4037340236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f288415e160 0x7f28840b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.893+0000 7f288be05700 1 --2- 172.21.15.153:0/4037340236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28840afc90 0x7f2884073f90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.893+0000 7f288be05700 1 -- 172.21.15.153:0/4037340236 >> 172.21.15.153:0/4037340236 conn(0x7f28840d0bf0 msgr2=0x7f28840d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.893+0000 7f288be05700 1 -- 172.21.15.153:0/4037340236 shutdown_connections 2023-11-24T08:07:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.893+0000 7f288be05700 1 -- 172.21.15.153:0/4037340236 wait complete. 2023-11-24T08:07:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.894+0000 7f288be05700 1 Processor -- start 2023-11-24T08:07:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.894+0000 7f288be05700 1 -- start start 2023-11-24T08:07:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.895+0000 7f288be05700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28840744d0 0x7f288415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.895+0000 7f288be05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28840afc90 0x7f2884159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.895+0000 7f288be05700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f288415e160 0x7f288415a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.895+0000 7f288be05700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2884160270 con 0x7f28840afc90 2023-11-24T08:07:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.895+0000 7f288be05700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2884145f00 con 0x7f288415e160 2023-11-24T08:07:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.895+0000 7f288be05700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2884155040 con 0x7f28840744d0 2023-11-24T08:07:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.895+0000 7f28893a0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28840afc90 0x7f2884159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.895+0000 7f28893a0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28840afc90 0x7f2884159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39380/0 (socket says 172.21.15.153:39380) 2023-11-24T08:07:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.895+0000 7f28893a0700 1 -- 172.21.15.153:0/1121186060 learned_addr learned my addr 172.21.15.153:0/1121186060 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.895+0000 7f2889ba1700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28840744d0 0x7f288415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.895+0000 7f288a3a2700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f288415e160 0x7f288415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.896+0000 7f28893a0700 1 -- 172.21.15.153:0/1121186060 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28840744d0 msgr2=0x7f288415f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.896+0000 7f28893a0700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28840744d0 0x7f288415f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.896+0000 7f28893a0700 1 -- 172.21.15.153:0/1121186060 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f288415e160 msgr2=0x7f288415a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.896+0000 7f28893a0700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f288415e160 0x7f288415a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.896+0000 7f28893a0700 1 -- 172.21.15.153:0/1121186060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874009550 con 0x7f28840afc90 2023-11-24T08:07:13.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.896+0000 7f28893a0700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28840afc90 0x7f2884159ad0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2874009c40 tx=0x7f2874004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.896+0000 7f287a7fc700 1 -- 172.21.15.153:0/1121186060 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874004400 con 0x7f28840afc90 2023-11-24T08:07:13.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.896+0000 7f287a7fc700 1 -- 172.21.15.153:0/1121186060 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287401f070 con 0x7f28840afc90 2023-11-24T08:07:13.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.896+0000 7f288be05700 1 -- 172.21.15.153:0/1121186060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288415f730 con 0x7f28840afc90 2023-11-24T08:07:13.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.896+0000 7f287a7fc700 1 -- 172.21.15.153:0/1121186060 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28740038e0 con 0x7f28840afc90 2023-11-24T08:07:13.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.896+0000 7f288be05700 1 -- 172.21.15.153:0/1121186060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288415fcb0 con 0x7f28840afc90 2023-11-24T08:07:13.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.897+0000 7f288be05700 1 -- 172.21.15.153:0/1121186060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2884068fb0 con 0x7f28840afc90 2023-11-24T08:07:13.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.897+0000 7f287a7fc700 1 -- 172.21.15.153:0/1121186060 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2874021030 con 0x7f28840afc90 2023-11-24T08:07:13.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.898+0000 7f287a7fc700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f286806b080 0x7f286806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.898+0000 7f287a7fc700 1 -- 172.21.15.153:0/1121186060 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f287408a810 con 0x7f28840afc90 2023-11-24T08:07:13.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.898+0000 7f2889ba1700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f286806b080 0x7f286806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.898+0000 7f2889ba1700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f286806b080 0x7f286806d540 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2880009b40 tx=0x7f2880009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:13.902+0000 7f287a7fc700 1 -- 172.21.15.153:0/1121186060 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2874055a20 con 0x7f28840afc90 2023-11-24T08:07:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.095+0000 7f288be05700 1 -- 172.21.15.153:0/1121186060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f288406c140 con 0x7f28840afc90 2023-11-24T08:07:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.096+0000 7f287a7fc700 1 -- 172.21.15.153:0/1121186060 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2874015020 con 0x7f28840afc90 2023-11-24T08:07:14.097 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:07:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 -- 172.21.15.153:0/1121186060 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f286806b080 msgr2=0x7f286806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f286806b080 0x7f286806d540 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2880009b40 tx=0x7f2880009210 comp rx=0 tx=0).stop 2023-11-24T08:07:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 -- 172.21.15.153:0/1121186060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28840afc90 msgr2=0x7f2884159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28840afc90 0x7f2884159ad0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2874009c40 tx=0x7f2874004750 comp rx=0 tx=0).stop 2023-11-24T08:07:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 -- 172.21.15.153:0/1121186060 shutdown_connections 2023-11-24T08:07:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f288415e160 0x7f288415a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28840744d0 0x7f288415f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f286806b080 0x7f286806d540 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 --2- 172.21.15.153:0/1121186060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28840afc90 0x7f2884159ad0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 -- 172.21.15.153:0/1121186060 >> 172.21.15.153:0/1121186060 conn(0x7f28840d0bf0 msgr2=0x7f28840d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 -- 172.21.15.153:0/1121186060 shutdown_connections 2023-11-24T08:07:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.098+0000 7f288be05700 1 -- 172.21.15.153:0/1121186060 wait complete. 2023-11-24T08:07:14.113 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:07:14.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.232+0000 7f4a9bffe700 1 Processor -- start 2023-11-24T08:07:14.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.232+0000 7f4a9bffe700 1 -- start start 2023-11-24T08:07:14.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a9bffe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4a941446a0 0x7f4a940b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a9bffe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4a940adf00 0x7f4a9406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a9bffe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a9406c540 0x7f4a9406da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a9bffe700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a94144a80 con 0x7f4a940adf00 2023-11-24T08:07:14.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a9bffe700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9406c9c0 con 0x7f4a941446a0 2023-11-24T08:07:14.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a9bffe700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a940af950 con 0x7f4a9406c540 2023-11-24T08:07:14.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a99599700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4a940adf00 0x7f4a9406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a99599700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4a940adf00 0x7f4a9406c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39390/0 (socket says 172.21.15.153:39390) 2023-11-24T08:07:14.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a99599700 1 -- 172.21.15.153:0/3070408371 learned_addr learned my addr 172.21.15.153:0/3070408371 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:14.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a99599700 1 -- 172.21.15.153:0/3070408371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a9406c540 msgr2=0x7f4a9406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:14.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a99599700 1 --2- 172.21.15.153:0/3070408371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a9406c540 0x7f4a9406da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a99599700 1 -- 172.21.15.153:0/3070408371 >> v2:172.21.15.164:3300/0 conn(0x7f4a941446a0 msgr2=0x7f4a940b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a99599700 1 --2- 172.21.15.153:0/3070408371 >> v2:172.21.15.164:3300/0 conn(0x7f4a941446a0 0x7f4a940b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a99599700 1 -- 172.21.15.153:0/3070408371 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a940afc30 con 0x7f4a940adf00 2023-11-24T08:07:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a99599700 1 --2- 172.21.15.153:0/3070408371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a940adf00 0x7f4a9406c000 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4a940729a0 tx=0x7f4a84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801b165ee44921c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.233+0000 7f4a98d98700 1 -- 172.21.15.153:0/3070408371 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8400b870 con 0x7f4a940adf00 2023-11-24T08:07:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.234+0000 7f4a98d98700 1 -- 172.21.15.153:0/3070408371 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8400b9d0 con 0x7f4a940adf00 2023-11-24T08:07:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.234+0000 7f4a98d98700 1 -- 172.21.15.153:0/3070408371 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8400bd60 con 0x7f4a940adf00 2023-11-24T08:07:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.234+0000 7f4a9bffe700 1 -- 172.21.15.153:0/3070408371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a940adf00 msgr2=0x7f4a9406c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.234+0000 7f4a9bffe700 1 --2- 172.21.15.153:0/3070408371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a940adf00 0x7f4a9406c000 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4a940729a0 tx=0x7f4a84009bd0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.234+0000 7f4a9bffe700 1 -- 172.21.15.153:0/3070408371 shutdown_connections 2023-11-24T08:07:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.234+0000 7f4a9bffe700 1 --2- 172.21.15.153:0/3070408371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a9406c540 0x7f4a9406da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.234+0000 7f4a9bffe700 1 --2- 172.21.15.153:0/3070408371 >> v2:172.21.15.164:3300/0 conn(0x7f4a941446a0 0x7f4a940b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.234+0000 7f4a9bffe700 1 --2- 172.21.15.153:0/3070408371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a940adf00 0x7f4a9406c000 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.234+0000 7f4a9bffe700 1 -- 172.21.15.153:0/3070408371 >> 172.21.15.153:0/3070408371 conn(0x7f4a94071b90 msgr2=0x7f4a94071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:14.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.234+0000 7f4a9bffe700 1 -- 172.21.15.153:0/3070408371 shutdown_connections 2023-11-24T08:07:14.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.234+0000 7f4a9bffe700 1 -- 172.21.15.153:0/3070408371 wait complete. 2023-11-24T08:07:14.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.235+0000 7f4a9bffe700 1 Processor -- start 2023-11-24T08:07:14.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.235+0000 7f4a9bffe700 1 -- start start 2023-11-24T08:07:14.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.236+0000 7f4a9bffe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a9406c540 0x7f4a9415a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.236+0000 7f4a9bffe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a940adf00 0x7f4a940ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.236+0000 7f4a9bffe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a941446a0 0x7f4a94073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.236+0000 7f4a9bffe700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a940cfdf0 con 0x7f4a941446a0 2023-11-24T08:07:14.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.236+0000 7f4a9bffe700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a940cf170 con 0x7f4a940adf00 2023-11-24T08:07:14.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.236+0000 7f4a9bffe700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a940cf450 con 0x7f4a9406c540 2023-11-24T08:07:14.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.236+0000 7f4a9a59b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a941446a0 0x7f4a94073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.236+0000 7f4a9a59b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a941446a0 0x7f4a94073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39398/0 (socket says 172.21.15.153:39398) 2023-11-24T08:07:14.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.236+0000 7f4a9a59b700 1 -- 172.21.15.153:0/751827502 learned_addr learned my addr 172.21.15.153:0/751827502 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:14.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.236+0000 7f4a99d9a700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a9406c540 0x7f4a9415a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.236+0000 7f4a99599700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a940adf00 0x7f4a940ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.237+0000 7f4a9a59b700 1 -- 172.21.15.153:0/751827502 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a9406c540 msgr2=0x7f4a9415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.237+0000 7f4a9a59b700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a9406c540 0x7f4a9415a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.237+0000 7f4a9a59b700 1 -- 172.21.15.153:0/751827502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a940adf00 msgr2=0x7f4a940ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.237+0000 7f4a9a59b700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a940adf00 0x7f4a940ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.237+0000 7f4a9a59b700 1 -- 172.21.15.153:0/751827502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a84009550 con 0x7f4a941446a0 2023-11-24T08:07:14.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.237+0000 7f4a9a59b700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a941446a0 0x7f4a94073f90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00b970 tx=0x7f4a8c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.237+0000 7f4a8a7fc700 1 -- 172.21.15.153:0/751827502 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c00c9b0 con 0x7f4a941446a0 2023-11-24T08:07:14.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.237+0000 7f4a8a7fc700 1 -- 172.21.15.153:0/751827502 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8c00cb30 con 0x7f4a941446a0 2023-11-24T08:07:14.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.237+0000 7f4a9bffe700 1 -- 172.21.15.153:0/751827502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a940cf730 con 0x7f4a941446a0 2023-11-24T08:07:14.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.237+0000 7f4a8a7fc700 1 -- 172.21.15.153:0/751827502 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c014440 con 0x7f4a941446a0 2023-11-24T08:07:14.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.237+0000 7f4a9bffe700 1 -- 172.21.15.153:0/751827502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a940ced40 con 0x7f4a941446a0 2023-11-24T08:07:14.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.238+0000 7f4a9bffe700 1 -- 172.21.15.153:0/751827502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a940753f0 con 0x7f4a941446a0 2023-11-24T08:07:14.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.238+0000 7f4a8a7fc700 1 -- 172.21.15.153:0/751827502 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4a8c01d3b0 con 0x7f4a941446a0 2023-11-24T08:07:14.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.239+0000 7f4a8a7fc700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4a7806b080 0x7f4a7806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.239+0000 7f4a8a7fc700 1 -- 172.21.15.153:0/751827502 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4a8c006e40 con 0x7f4a941446a0 2023-11-24T08:07:14.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.239+0000 7f4a99d9a700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4a7806b080 0x7f4a7806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.239+0000 7f4a99d9a700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4a7806b080 0x7f4a7806d540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000a810 tx=0x7f4a90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.243+0000 7f4a8a7fc700 1 -- 172.21.15.153:0/751827502 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4a8c054510 con 0x7f4a941446a0 2023-11-24T08:07:14.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.439+0000 7f4a9bffe700 1 -- 172.21.15.153:0/751827502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4a9413b000 con 0x7f4a941446a0 2023-11-24T08:07:14.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.439+0000 7f4a8a7fc700 1 -- 172.21.15.153:0/751827502 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4a8c019090 con 0x7f4a941446a0 2023-11-24T08:07:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:14.442 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-11-24T08:07:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-11-24T08:07:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": ".mgr" 2023-11-24T08:07:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:14.442 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-11-24T08:07:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 -- 172.21.15.153:0/751827502 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4a7806b080 msgr2=0x7f4a7806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4a7806b080 0x7f4a7806d540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000a810 tx=0x7f4a90008040 comp rx=0 tx=0).stop 2023-11-24T08:07:14.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 -- 172.21.15.153:0/751827502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a941446a0 msgr2=0x7f4a94073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a941446a0 0x7f4a94073f90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00b970 tx=0x7f4a8c00bd30 comp rx=0 tx=0).stop 2023-11-24T08:07:14.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 -- 172.21.15.153:0/751827502 shutdown_connections 2023-11-24T08:07:14.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f4a7806b080 0x7f4a7806d540 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a941446a0 0x7f4a94073f90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a9406c540 0x7f4a9415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 --2- 172.21.15.153:0/751827502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a940adf00 0x7f4a940ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 -- 172.21.15.153:0/751827502 >> 172.21.15.153:0/751827502 conn(0x7f4a94071b90 msgr2=0x7f4a940b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:14.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 -- 172.21.15.153:0/751827502 shutdown_connections 2023-11-24T08:07:14.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.441+0000 7f4a9bffe700 1 -- 172.21.15.153:0/751827502 wait complete. 2023-11-24T08:07:14.455 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:07:14.455 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:07:14.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.578+0000 7f98b8abb700 1 Processor -- start 2023-11-24T08:07:14.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.578+0000 7f98b8abb700 1 -- start start 2023-11-24T08:07:14.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.579+0000 7f98b8abb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f98b40b03c0 0x7f98b4166d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.579+0000 7f98b8abb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b40d01c0 con 0x7f98b40d1ab0 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.579+0000 7f98b8abb700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b4070910 con 0x7f98b40cf040 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.579+0000 7f98b8abb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b4070bf0 con 0x7f98b40b03c0 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.579+0000 7f98b2d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f98b40b03c0 0x7f98b4166d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.579+0000 7f98b1d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f98b40d1ab0 0x7f98b40d1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45506/0 (socket says 172.21.15.153:45506) 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.580+0000 7f98b1d9b700 1 -- 172.21.15.153:0/1036137384 learned_addr learned my addr 172.21.15.153:0/1036137384 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.580+0000 7f98b2d9d700 1 -- 172.21.15.153:0/1036137384 >> v1:172.21.15.164:6789/0 conn(0x7f98b40cf040 legacy=0x7f98b406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.580+0000 7f98b2d9d700 1 -- 172.21.15.153:0/1036137384 >> v1:172.21.15.153:6789/0 conn(0x7f98b40d1ab0 legacy=0x7f98b40d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.580+0000 7f98b2d9d700 1 -- 172.21.15.153:0/1036137384 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b40aebb0 con 0x7f98b40b03c0 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.580+0000 7f98b159a700 1 -- 172.21.15.153:0/1036137384 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780000989 0 0) 0x7f98b40d01c0 con 0x7f98b40d1ab0 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.580+0000 7f98b2d9d700 1 --2- 172.21.15.153:0/1036137384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b40b03c0 0x7f98b4166d10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009d90 tx=0x7f98ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155ba654929ba97c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.580+0000 7f98b159a700 1 -- 172.21.15.153:0/1036137384 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac00e070 con 0x7f98b40b03c0 2023-11-24T08:07:14.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.580+0000 7f98b159a700 1 -- 172.21.15.153:0/1036137384 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac00bbd0 con 0x7f98b40b03c0 2023-11-24T08:07:14.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.580+0000 7f98b159a700 1 -- 172.21.15.153:0/1036137384 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac012430 con 0x7f98b40b03c0 2023-11-24T08:07:14.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.581+0000 7f98b8abb700 1 -- 172.21.15.153:0/1036137384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b40b03c0 msgr2=0x7f98b4166d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.581+0000 7f98b8abb700 1 --2- 172.21.15.153:0/1036137384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b40b03c0 0x7f98b4166d10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009d90 tx=0x7f98ac00b330 comp rx=0 tx=0).stop 2023-11-24T08:07:14.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.581+0000 7f98b8abb700 1 -- 172.21.15.153:0/1036137384 shutdown_connections 2023-11-24T08:07:14.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.581+0000 7f98b8abb700 1 --2- 172.21.15.153:0/1036137384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b40b03c0 0x7f98b4166d10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.581+0000 7f98b8abb700 1 -- 172.21.15.153:0/1036137384 >> 172.21.15.153:0/1036137384 conn(0x7f98b409aa00 msgr2=0x7f98b409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:14.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.581+0000 7f98b8abb700 1 -- 172.21.15.153:0/1036137384 shutdown_connections 2023-11-24T08:07:14.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.581+0000 7f98b8abb700 1 -- 172.21.15.153:0/1036137384 wait complete. 2023-11-24T08:07:14.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.582+0000 7f98b8abb700 1 Processor -- start 2023-11-24T08:07:14.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.582+0000 7f98b8abb700 1 -- start start 2023-11-24T08:07:14.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b8abb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98b40b03c0 0x7f98b40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b8abb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b40cf040 0x7f98b40ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b8abb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98b40d1ab0 0x7f98b414fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b8abb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b415a8d0 con 0x7f98b40cf040 2023-11-24T08:07:14.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b8abb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40b5d50 con 0x7f98b40b03c0 2023-11-24T08:07:14.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b8abb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40b6030 con 0x7f98b40d1ab0 2023-11-24T08:07:14.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b40cf040 0x7f98b40ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b40cf040 0x7f98b40ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39410/0 (socket says 172.21.15.153:39410) 2023-11-24T08:07:14.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b1d9b700 1 -- 172.21.15.153:0/1884179770 learned_addr learned my addr 172.21.15.153:0/1884179770 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b259c700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98b40b03c0 0x7f98b40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b2d9d700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98b40d1ab0 0x7f98b414fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b1d9b700 1 -- 172.21.15.153:0/1884179770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98b40d1ab0 msgr2=0x7f98b414fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b1d9b700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98b40d1ab0 0x7f98b414fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b1d9b700 1 -- 172.21.15.153:0/1884179770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98b40b03c0 msgr2=0x7f98b40c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b1d9b700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98b40b03c0 0x7f98b40c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b1d9b700 1 -- 172.21.15.153:0/1884179770 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac009a70 con 0x7f98b40cf040 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b259c700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98b40b03c0 0x7f98b40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.583+0000 7f98b1d9b700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b40cf040 0x7f98b40ca250 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c520 tx=0x7f98a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.584+0000 7f98a2ffd700 1 -- 172.21.15.153:0/1884179770 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4004c80 con 0x7f98b40cf040 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.584+0000 7f98a2ffd700 1 -- 172.21.15.153:0/1884179770 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4004e20 con 0x7f98b40cf040 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.584+0000 7f98a2ffd700 1 -- 172.21.15.153:0/1884179770 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4007310 con 0x7f98b40cf040 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.584+0000 7f98b8abb700 1 -- 172.21.15.153:0/1884179770 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b40b6310 con 0x7f98b40cf040 2023-11-24T08:07:14.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.584+0000 7f98b8abb700 1 -- 172.21.15.153:0/1884179770 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b40b68d0 con 0x7f98b40cf040 2023-11-24T08:07:14.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.585+0000 7f98b8abb700 1 -- 172.21.15.153:0/1884179770 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b4067f60 con 0x7f98b40cf040 2023-11-24T08:07:14.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.585+0000 7f98a2ffd700 1 -- 172.21.15.153:0/1884179770 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f98a4007470 con 0x7f98b40cf040 2023-11-24T08:07:14.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.585+0000 7f98a2ffd700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f989406b0b0 0x7f989406d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.586+0000 7f98a2ffd700 1 -- 172.21.15.153:0/1884179770 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98a4089230 con 0x7f98b40cf040 2023-11-24T08:07:14.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.586+0000 7f98b259c700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f989406b0b0 0x7f989406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.586+0000 7f98b259c700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f989406b0b0 0x7f989406d570 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98a8000f60 tx=0x7f98a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.590+0000 7f98a2ffd700 1 -- 172.21.15.153:0/1884179770 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98a40543b0 con 0x7f98b40cf040 2023-11-24T08:07:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:14.782+0000 7f98b8abb700 1 -- 172.21.15.153:0/1884179770 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f98b40b7a90 con 0x7f98b40cf040 2023-11-24T08:07:15.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.162+0000 7f98a2ffd700 1 -- 172.21.15.153:0/1884179770 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f98a40579d0 con 0x7f98b40cf040 2023-11-24T08:07:15.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.165+0000 7f98b8abb700 1 -- 172.21.15.153:0/1884179770 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f989406b0b0 msgr2=0x7f989406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.165+0000 7f98b8abb700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f989406b0b0 0x7f989406d570 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98a8000f60 tx=0x7f98a8009040 comp rx=0 tx=0).stop 2023-11-24T08:07:15.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.165+0000 7f98b8abb700 1 -- 172.21.15.153:0/1884179770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b40cf040 msgr2=0x7f98b40ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.165+0000 7f98b8abb700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b40cf040 0x7f98b40ca250 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c520 tx=0x7f98a400c8e0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.165+0000 7f98b8abb700 1 -- 172.21.15.153:0/1884179770 shutdown_connections 2023-11-24T08:07:15.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.165+0000 7f98b8abb700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98b40d1ab0 0x7f98b414fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.165+0000 7f98b8abb700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98b40b03c0 0x7f98b40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.165+0000 7f98b8abb700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f989406b0b0 0x7f989406d570 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.165+0000 7f98b8abb700 1 --2- 172.21.15.153:0/1884179770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b40cf040 0x7f98b40ca250 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.165+0000 7f98b8abb700 1 -- 172.21.15.153:0/1884179770 >> 172.21.15.153:0/1884179770 conn(0x7f98b409aa00 msgr2=0x7f98b406fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:15.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.165+0000 7f98b8abb700 1 -- 172.21.15.153:0/1884179770 shutdown_connections 2023-11-24T08:07:15.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.166+0000 7f98b8abb700 1 -- 172.21.15.153:0/1884179770 wait complete. 2023-11-24T08:07:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-11-24T08:07:15.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:07:15.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.310+0000 7f80f3f8d700 1 Processor -- start 2023-11-24T08:07:15.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.310+0000 7f80f3f8d700 1 -- start start 2023-11-24T08:07:15.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f3f8d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f80ec0c6c30 0x7f80ec0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f3f8d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80ec0cef40 0x7f80ec0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f3f8d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec0d0140 con 0x7f80ec15bf50 2023-11-24T08:07:15.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f3f8d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec15c330 con 0x7f80ec0c6c30 2023-11-24T08:07:15.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f3f8d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0cf3d0 con 0x7f80ec0cef40 2023-11-24T08:07:15.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f1528700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f80ec0c6c30 0x7f80ec0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f1528700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f80ec0c6c30 0x7f80ec0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39418/0 (socket says 172.21.15.153:39418) 2023-11-24T08:07:15.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f1528700 1 -- 172.21.15.153:0/2124001273 learned_addr learned my addr 172.21.15.153:0/2124001273 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:15.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f252a700 1 --2- 172.21.15.153:0/2124001273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80ec0cef40 0x7f80ec0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f1528700 1 -- 172.21.15.153:0/2124001273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80ec0cef40 msgr2=0x7f80ec0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:15.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f1528700 1 --2- 172.21.15.153:0/2124001273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80ec0cef40 0x7f80ec0cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f1528700 1 -- 172.21.15.153:0/2124001273 >> v1:172.21.15.164:6789/0 conn(0x7f80ec15bf50 legacy=0x7f80ec0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f1528700 1 -- 172.21.15.153:0/2124001273 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0d03e0 con 0x7f80ec0c6c30 2023-11-24T08:07:15.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.311+0000 7f80f1528700 1 --2- 172.21.15.153:0/2124001273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec0c6c30 0x7f80ec0cea00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0098f0 tx=0x7f80dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5882b1f476d8ef90 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:15.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.312+0000 7f80f0d27700 1 -- 172.21.15.153:0/2124001273 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00b8a0 con 0x7f80ec0c6c30 2023-11-24T08:07:15.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.312+0000 7f80f0d27700 1 -- 172.21.15.153:0/2124001273 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc00ba00 con 0x7f80ec0c6c30 2023-11-24T08:07:15.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.312+0000 7f80f0d27700 1 -- 172.21.15.153:0/2124001273 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00bd90 con 0x7f80ec0c6c30 2023-11-24T08:07:15.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.312+0000 7f80f3f8d700 1 -- 172.21.15.153:0/2124001273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec0c6c30 msgr2=0x7f80ec0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.312+0000 7f80f3f8d700 1 --2- 172.21.15.153:0/2124001273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec0c6c30 0x7f80ec0cea00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0098f0 tx=0x7f80dc009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:15.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.312+0000 7f80f3f8d700 1 -- 172.21.15.153:0/2124001273 shutdown_connections 2023-11-24T08:07:15.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.312+0000 7f80f3f8d700 1 --2- 172.21.15.153:0/2124001273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80ec0cef40 0x7f80ec0cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.312+0000 7f80f3f8d700 1 --2- 172.21.15.153:0/2124001273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec0c6c30 0x7f80ec0cea00 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.312+0000 7f80f3f8d700 1 -- 172.21.15.153:0/2124001273 >> 172.21.15.153:0/2124001273 conn(0x7f80ec0b3780 msgr2=0x7f80ec0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:15.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.312+0000 7f80f3f8d700 1 -- 172.21.15.153:0/2124001273 shutdown_connections 2023-11-24T08:07:15.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.312+0000 7f80f3f8d700 1 -- 172.21.15.153:0/2124001273 wait complete. 2023-11-24T08:07:15.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.313+0000 7f80f3f8d700 1 Processor -- start 2023-11-24T08:07:15.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.313+0000 7f80f3f8d700 1 -- start start 2023-11-24T08:07:15.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.314+0000 7f80f3f8d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80ec0c6c30 0x7f80ec149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.314+0000 7f80f3f8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec0cef40 0x7f80ec0b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.314+0000 7f80f3f8d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80ec15bf50 0x7f80ec0ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.314+0000 7f80f3f8d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0b5e60 con 0x7f80ec0cef40 2023-11-24T08:07:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.314+0000 7f80f3f8d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0b5250 con 0x7f80ec0c6c30 2023-11-24T08:07:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.314+0000 7f80f3f8d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0b5530 con 0x7f80ec15bf50 2023-11-24T08:07:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.314+0000 7f80f1528700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec0cef40 0x7f80ec0b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.314+0000 7f80f1528700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec0cef40 0x7f80ec0b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39424/0 (socket says 172.21.15.153:39424) 2023-11-24T08:07:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.314+0000 7f80f1528700 1 -- 172.21.15.153:0/4211236412 learned_addr learned my addr 172.21.15.153:0/4211236412 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.314+0000 7f80f252a700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80ec15bf50 0x7f80ec0ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.314+0000 7f80f1d29700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80ec0c6c30 0x7f80ec149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.315+0000 7f80f1528700 1 -- 172.21.15.153:0/4211236412 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80ec15bf50 msgr2=0x7f80ec0ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.315+0000 7f80f1528700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80ec15bf50 0x7f80ec0ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.315+0000 7f80f1528700 1 -- 172.21.15.153:0/4211236412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80ec0c6c30 msgr2=0x7f80ec149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.315+0000 7f80f1528700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80ec0c6c30 0x7f80ec149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.315+0000 7f80f1528700 1 -- 172.21.15.153:0/4211236412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc009550 con 0x7f80ec0cef40 2023-11-24T08:07:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.315+0000 7f80f1528700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec0cef40 0x7f80ec0b4870 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009c40 tx=0x7f80dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.315+0000 7f80e27fc700 1 -- 172.21.15.153:0/4211236412 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0036a0 con 0x7f80ec0cef40 2023-11-24T08:07:15.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.315+0000 7f80e27fc700 1 -- 172.21.15.153:0/4211236412 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc01f070 con 0x7f80ec0cef40 2023-11-24T08:07:15.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.315+0000 7f80f3f8d700 1 -- 172.21.15.153:0/4211236412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec0b5810 con 0x7f80ec0cef40 2023-11-24T08:07:15.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.315+0000 7f80e27fc700 1 -- 172.21.15.153:0/4211236412 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc003a60 con 0x7f80ec0cef40 2023-11-24T08:07:15.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.315+0000 7f80f3f8d700 1 -- 172.21.15.153:0/4211236412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec149660 con 0x7f80ec0cef40 2023-11-24T08:07:15.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.316+0000 7f80f3f8d700 1 -- 172.21.15.153:0/4211236412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec0b5fd0 con 0x7f80ec0cef40 2023-11-24T08:07:15.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.316+0000 7f80e27fc700 1 -- 172.21.15.153:0/4211236412 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f80dc003bc0 con 0x7f80ec0cef40 2023-11-24T08:07:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.317+0000 7f80e27fc700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f80d006b080 0x7f80d006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.317+0000 7f80e27fc700 1 -- 172.21.15.153:0/4211236412 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f80dc021070 con 0x7f80ec0cef40 2023-11-24T08:07:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.317+0000 7f80f1d29700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f80d006b080 0x7f80d006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.317+0000 7f80f1d29700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f80d006b080 0x7f80d006d540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f80ec070c40 tx=0x7f80e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.321+0000 7f80e27fc700 1 -- 172.21.15.153:0/4211236412 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80dc0560f0 con 0x7f80ec0cef40 2023-11-24T08:07:15.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:15.511+0000 7f80f3f8d700 1 -- 172.21.15.153:0/4211236412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f80ec1497f0 con 0x7f80ec0cef40 2023-11-24T08:07:16.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.167+0000 7f80e27fc700 1 -- 172.21.15.153:0/4211236412 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v54) v1 ==== 170+0+0 (secure 0 0 0) 0x7f80dc059710 con 0x7f80ec0cef40 2023-11-24T08:07:16.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 -- 172.21.15.153:0/4211236412 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f80d006b080 msgr2=0x7f80d006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f80d006b080 0x7f80d006d540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f80ec070c40 tx=0x7f80e8009040 comp rx=0 tx=0).stop 2023-11-24T08:07:16.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 -- 172.21.15.153:0/4211236412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec0cef40 msgr2=0x7f80ec0b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec0cef40 0x7f80ec0b4870 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009c40 tx=0x7f80dc004750 comp rx=0 tx=0).stop 2023-11-24T08:07:16.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 -- 172.21.15.153:0/4211236412 shutdown_connections 2023-11-24T08:07:16.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f80ec15bf50 0x7f80ec0ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80ec0c6c30 0x7f80ec149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f80d006b080 0x7f80d006d540 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 --2- 172.21.15.153:0/4211236412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80ec0cef40 0x7f80ec0b4870 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 -- 172.21.15.153:0/4211236412 >> 172.21.15.153:0/4211236412 conn(0x7f80ec0b3780 msgr2=0x7f80ec0c7050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:16.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 -- 172.21.15.153:0/4211236412 shutdown_connections 2023-11-24T08:07:16.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.170+0000 7f80f3f8d700 1 -- 172.21.15.153:0/4211236412 wait complete. 2023-11-24T08:07:16.174 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-11-24T08:07:16.194 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:07:16.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.317+0000 7f7e85a60700 1 Processor -- start 2023-11-24T08:07:16.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.317+0000 7f7e85a60700 1 -- start start 2023-11-24T08:07:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.318+0000 7f7e85a60700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 0x7f7e8006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.318+0000 7f7e85a60700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7e800b3250 0x7f7e8006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.318+0000 7f7e85a60700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e800b6fb0 con 0x7f7e8015e320 2023-11-24T08:07:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.318+0000 7f7e85a60700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e800d4da0 con 0x7f7e800b3250 2023-11-24T08:07:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.318+0000 7f7e85a60700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800d2c10 con 0x7f7e800b93c0 2023-11-24T08:07:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7f7fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7e800b3250 0x7f7e8006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7e7fc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 0x7f7e8006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7f7fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7e800b3250 0x7f7e8006b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:32788/0 (socket says 172.21.15.153:32788) 2023-11-24T08:07:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7e7fc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 0x7f7e8006aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:51502/0 (socket says 172.21.15.153:51502) 2023-11-24T08:07:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7effd700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f7e8015e320 0x7f7e800d2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:53216/0 (socket says 172.21.15.153:53216) 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7e7fc700 1 -- 172.21.15.153:0/1694708876 learned_addr learned my addr 172.21.15.153:0/1694708876 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7e7fc700 1 -- 172.21.15.153:0/1694708876 >> v2:172.21.15.164:3300/0 conn(0x7f7e800b3250 msgr2=0x7f7e8006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7e7fc700 1 --2- 172.21.15.153:0/1694708876 >> v2:172.21.15.164:3300/0 conn(0x7f7e800b3250 0x7f7e8006b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7e7fc700 1 -- 172.21.15.153:0/1694708876 >> v1:172.21.15.164:6789/0 conn(0x7f7e8015e320 legacy=0x7f7e800d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7e7fc700 1 -- 172.21.15.153:0/1694708876 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e800d2ef0 con 0x7f7e800b93c0 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7f7fe700 1 --2- 172.21.15.153:0/1694708876 >> v2:172.21.15.164:3300/0 conn(0x7f7e800b3250 0x7f7e8006b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7e7fc700 1 --2- 172.21.15.153:0/1694708876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 0x7f7e8006aff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e700098f0 tx=0x7f7e70009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98a16fdbbaea51b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7dffb700 1 -- 172.21.15.153:0/1694708876 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011830 con 0x7f7e800b93c0 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7dffb700 1 -- 172.21.15.153:0/1694708876 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e70011990 con 0x7f7e800b93c0 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.319+0000 7f7e7dffb700 1 -- 172.21.15.153:0/1694708876 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011d20 con 0x7f7e800b93c0 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.320+0000 7f7e85a60700 1 -- 172.21.15.153:0/1694708876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 msgr2=0x7f7e8006aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.320+0000 7f7e85a60700 1 --2- 172.21.15.153:0/1694708876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 0x7f7e8006aff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e700098f0 tx=0x7f7e70009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.320+0000 7f7e85a60700 1 -- 172.21.15.153:0/1694708876 shutdown_connections 2023-11-24T08:07:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.320+0000 7f7e85a60700 1 --2- 172.21.15.153:0/1694708876 >> v2:172.21.15.164:3300/0 conn(0x7f7e800b3250 0x7f7e8006b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.320+0000 7f7e85a60700 1 --2- 172.21.15.153:0/1694708876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 0x7f7e8006aff0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.320+0000 7f7e85a60700 1 -- 172.21.15.153:0/1694708876 >> 172.21.15.153:0/1694708876 conn(0x7f7e800d3e50 msgr2=0x7f7e800d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:16.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.320+0000 7f7e85a60700 1 -- 172.21.15.153:0/1694708876 shutdown_connections 2023-11-24T08:07:16.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.320+0000 7f7e85a60700 1 -- 172.21.15.153:0/1694708876 wait complete. 2023-11-24T08:07:16.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.321+0000 7f7e85a60700 1 Processor -- start 2023-11-24T08:07:16.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.321+0000 7f7e85a60700 1 -- start start 2023-11-24T08:07:16.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e85a60700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e800b3250 0x7f7e800c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e85a60700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 0x7f7e800b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e85a60700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8015e320 0x7f7e800b8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e85a60700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80155e70 con 0x7f7e8015e320 2023-11-24T08:07:16.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e85a60700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80156150 con 0x7f7e800b3250 2023-11-24T08:07:16.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e85a60700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80160b00 con 0x7f7e800b93c0 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e7f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8015e320 0x7f7e800b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e7f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8015e320 0x7f7e800b8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39440/0 (socket says 172.21.15.153:39440) 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e7f7fe700 1 -- 172.21.15.153:0/3218511062 learned_addr learned my addr 172.21.15.153:0/3218511062 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e7effd700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e800b3250 0x7f7e800c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e7e7fc700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 0x7f7e800b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e7f7fe700 1 -- 172.21.15.153:0/3218511062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 msgr2=0x7f7e800b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e7f7fe700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 0x7f7e800b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e7f7fe700 1 -- 172.21.15.153:0/3218511062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e800b3250 msgr2=0x7f7e800c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e7f7fe700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e800b3250 0x7f7e800c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e7f7fe700 1 -- 172.21.15.153:0/3218511062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78009a70 con 0x7f7e8015e320 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.322+0000 7f7e7e7fc700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 0x7f7e800b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.323+0000 7f7e7f7fe700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8015e320 0x7f7e800b8940 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009f00 tx=0x7f7e7800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.323+0000 7f7e67fff700 1 -- 172.21.15.153:0/3218511062 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e78009d70 con 0x7f7e8015e320 2023-11-24T08:07:16.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.323+0000 7f7e67fff700 1 -- 172.21.15.153:0/3218511062 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7800f040 con 0x7f7e8015e320 2023-11-24T08:07:16.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.323+0000 7f7e85a60700 1 -- 172.21.15.153:0/3218511062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e70009550 con 0x7f7e8015e320 2023-11-24T08:07:16.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.323+0000 7f7e67fff700 1 -- 172.21.15.153:0/3218511062 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800cd70 con 0x7f7e8015e320 2023-11-24T08:07:16.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.323+0000 7f7e85a60700 1 -- 172.21.15.153:0/3218511062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e800c82b0 con 0x7f7e8015e320 2023-11-24T08:07:16.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.324+0000 7f7e85a60700 1 -- 172.21.15.153:0/3218511062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e800cfc10 con 0x7f7e8015e320 2023-11-24T08:07:16.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.324+0000 7f7e67fff700 1 -- 172.21.15.153:0/3218511062 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7e78014480 con 0x7f7e8015e320 2023-11-24T08:07:16.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.325+0000 7f7e67fff700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7e6c06b080 0x7f7e6c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.325+0000 7f7e7effd700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7e6c06b080 0x7f7e6c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.325+0000 7f7e67fff700 1 -- 172.21.15.153:0/3218511062 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7e7808a030 con 0x7f7e8015e320 2023-11-24T08:07:16.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.325+0000 7f7e7effd700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7e6c06b080 0x7f7e6c06d540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e74000f60 tx=0x7f7e74007ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.330+0000 7f7e67fff700 1 -- 172.21.15.153:0/3218511062 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e78054db0 con 0x7f7e8015e320 2023-11-24T08:07:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:16.564+0000 7f7e85a60700 1 -- 172.21.15.153:0/3218511062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7e80068fb0 con 0x7f7e8015e320 2023-11-24T08:07:17.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.169+0000 7f7e67fff700 1 -- 172.21.15.153:0/3218511062 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v32) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7e780583d0 con 0x7f7e8015e320 2023-11-24T08:07:17.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.172+0000 7f7e85a60700 1 -- 172.21.15.153:0/3218511062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7e6c06b080 msgr2=0x7f7e6c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.172+0000 7f7e85a60700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7e6c06b080 0x7f7e6c06d540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e74000f60 tx=0x7f7e74007ed0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.172+0000 7f7e85a60700 1 -- 172.21.15.153:0/3218511062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8015e320 msgr2=0x7f7e800b8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.172+0000 7f7e85a60700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8015e320 0x7f7e800b8940 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009f00 tx=0x7f7e7800c3a0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.172+0000 7f7e85a60700 1 -- 172.21.15.153:0/3218511062 shutdown_connections 2023-11-24T08:07:17.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.172+0000 7f7e85a60700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7e6c06b080 0x7f7e6c06d540 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.172+0000 7f7e85a60700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8015e320 0x7f7e800b8940 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.172+0000 7f7e85a60700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e800b3250 0x7f7e800c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.172+0000 7f7e85a60700 1 --2- 172.21.15.153:0/3218511062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e800b93c0 0x7f7e800b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.172+0000 7f7e85a60700 1 -- 172.21.15.153:0/3218511062 >> 172.21.15.153:0/3218511062 conn(0x7f7e800d3e50 msgr2=0x7f7e8015b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.173+0000 7f7e85a60700 1 -- 172.21.15.153:0/3218511062 shutdown_connections 2023-11-24T08:07:17.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.173+0000 7f7e85a60700 1 -- 172.21.15.153:0/3218511062 wait complete. 2023-11-24T08:07:17.178 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 8 and data pool 9 2023-11-24T08:07:17.199 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:17.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.328+0000 7f0ba3295700 1 Processor -- start 2023-11-24T08:07:17.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.328+0000 7f0ba3295700 1 -- start start 2023-11-24T08:07:17.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0ba3295700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0b9c06c710 0x7f0b9c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0ba3295700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c0ae430 con 0x7f0b9c0af4d0 2023-11-24T08:07:17.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0ba3295700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c0ae710 con 0x7f0b9c15e080 2023-11-24T08:07:17.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0ba3295700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9c0af0b0 con 0x7f0b9c06c710 2023-11-24T08:07:17.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0ba1832700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0b9c0af4d0 0x7f0b9c06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45552/0 (socket says 172.21.15.153:45552) 2023-11-24T08:07:17.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0ba1832700 1 -- 172.21.15.153:0/1831737545 learned_addr learned my addr 172.21.15.153:0/1831737545 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:17.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0ba0830700 1 --2- 172.21.15.153:0/1831737545 >> v2:172.21.15.164:3300/0 conn(0x7f0b9c06c710 0x7f0b9c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575127310 0 0) 0x7f0b9c0ae430 con 0x7f0b9c0af4d0 2023-11-24T08:07:17.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b880035b0 con 0x7f0b9c0af4d0 2023-11-24T08:07:17.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383534032 0 0) 0x7f0b9c0ae710 con 0x7f0b9c15e080 2023-11-24T08:07:17.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b9c0ae430 con 0x7f0b9c15e080 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1615171073 0 0) 0x7f0b880035b0 con 0x7f0b9c0af4d0 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 >> v2:172.21.15.164:3300/0 conn(0x7f0b9c06c710 msgr2=0x7f0b9c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 --2- 172.21.15.153:0/1831737545 >> v2:172.21.15.164:3300/0 conn(0x7f0b9c06c710 0x7f0b9c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 >> v1:172.21.15.164:6789/0 conn(0x7f0b9c15e080 legacy=0x7f0b9c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c0ae9f0 con 0x7f0b9c0af4d0 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f0b940019f0 con 0x7f0b9c0af4d0 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 >> v1:172.21.15.153:6789/0 conn(0x7f0b9c0af4d0 legacy=0x7f0b9c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.329+0000 7f0b93fff700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b88003be0 0x7f0b88003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0b93fff700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b88004850 0x7f0b88004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0b93fff700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b88005210 0x7f0b8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0af0b0 con 0x7f0b88003be0 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8800c0e0 con 0x7f0b88005210 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8800c2a0 con 0x7f0b88004850 2023-11-24T08:07:17.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0ba1031700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b88003be0 0x7f0b88003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0ba0830700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b88004850 0x7f0b88004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0ba1832700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b88005210 0x7f0b8800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0ba1031700 1 -- 172.21.15.153:0/1831737545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b88004850 msgr2=0x7f0b88004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0ba1031700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b88004850 0x7f0b88004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0ba1031700 1 -- 172.21.15.153:0/1831737545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b88005210 msgr2=0x7f0b8800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0ba1031700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b88005210 0x7f0b8800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0ba1031700 1 -- 172.21.15.153:0/1831737545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b880035b0 con 0x7f0b88003be0 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0ba1832700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b88005210 0x7f0b8800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0ba1832700 1 -- 172.21.15.153:0/1831737545 reap_dead start 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0ba1031700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b88003be0 0x7f0b88003fe0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0b98001940 tx=0x7f0b88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7182652c8d1787 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98001430 con 0x7f0b88003be0 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b98001d70 con 0x7f0b88003be0 2023-11-24T08:07:17.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.330+0000 7f0b93fff700 1 -- 172.21.15.153:0/1831737545 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98005530 con 0x7f0b88003be0 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.331+0000 7f0ba3295700 1 -- 172.21.15.153:0/1831737545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b88003be0 msgr2=0x7f0b88003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.331+0000 7f0ba3295700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b88003be0 0x7f0b88003fe0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0b98001940 tx=0x7f0b88005880 comp rx=0 tx=0).stop 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.331+0000 7f0ba3295700 1 -- 172.21.15.153:0/1831737545 shutdown_connections 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.331+0000 7f0ba3295700 1 --2- 172.21.15.153:0/1831737545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b88003be0 0x7f0b88003fe0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.331+0000 7f0ba3295700 1 -- 172.21.15.153:0/1831737545 >> 172.21.15.153:0/1831737545 conn(0x7f0b9c071b90 msgr2=0x7f0b9c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.331+0000 7f0ba3295700 1 -- 172.21.15.153:0/1831737545 shutdown_connections 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.331+0000 7f0ba3295700 1 -- 172.21.15.153:0/1831737545 wait complete. 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.332+0000 7f0ba3295700 1 Processor -- start 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.332+0000 7f0ba3295700 1 -- start start 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba3295700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b88003be0 0x7f0b9c15a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba3295700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c1571c0 0x7f0b9c160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba3295700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b9c160e90 0x7f0b9c144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba3295700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0cfbc0 con 0x7f0b9c1571c0 2023-11-24T08:07:17.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba3295700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0cffe0 con 0x7f0b9c160e90 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba3295700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c157a10 con 0x7f0b88003be0 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba0830700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c1571c0 0x7f0b9c160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba0830700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c1571c0 0x7f0b9c160950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39458/0 (socket says 172.21.15.153:39458) 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba0830700 1 -- 172.21.15.153:0/618453100 learned_addr learned my addr 172.21.15.153:0/618453100 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba1031700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b88003be0 0x7f0b9c15a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba1832700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b9c160e90 0x7f0b9c144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba0830700 1 -- 172.21.15.153:0/618453100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b88003be0 msgr2=0x7f0b9c15a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba0830700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b88003be0 0x7f0b9c15a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba0830700 1 -- 172.21.15.153:0/618453100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b9c160e90 msgr2=0x7f0b9c144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba0830700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b9c160e90 0x7f0b9c144560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba0830700 1 -- 172.21.15.153:0/618453100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c161310 con 0x7f0b9c1571c0 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba0830700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c1571c0 0x7f0b9c160950 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c011ad0 tx=0x7f0b8c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0b91ffb700 1 -- 172.21.15.153:0/618453100 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c00f980 con 0x7f0b9c1571c0 2023-11-24T08:07:17.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0b91ffb700 1 -- 172.21.15.153:0/618453100 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c00fae0 con 0x7f0b9c1571c0 2023-11-24T08:07:17.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0ba3295700 1 -- 172.21.15.153:0/618453100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9c0cf220 con 0x7f0b9c1571c0 2023-11-24T08:07:17.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.333+0000 7f0b91ffb700 1 -- 172.21.15.153:0/618453100 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c00fe90 con 0x7f0b9c1571c0 2023-11-24T08:07:17.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.334+0000 7f0ba3295700 1 -- 172.21.15.153:0/618453100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9c0cf7e0 con 0x7f0b9c1571c0 2023-11-24T08:07:17.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.335+0000 7f0ba3295700 1 -- 172.21.15.153:0/618453100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9c0753f0 con 0x7f0b9c1571c0 2023-11-24T08:07:17.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.335+0000 7f0b91ffb700 1 -- 172.21.15.153:0/618453100 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0b8c014440 con 0x7f0b9c1571c0 2023-11-24T08:07:17.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.336+0000 7f0b91ffb700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b8006b0b0 0x7f0b8006d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.336+0000 7f0b91ffb700 1 -- 172.21.15.153:0/618453100 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b8c089ef0 con 0x7f0b9c1571c0 2023-11-24T08:07:17.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.336+0000 7f0ba1031700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b8006b0b0 0x7f0b8006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.336+0000 7f0ba1031700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b8006b0b0 0x7f0b8006d570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0b98005040 tx=0x7f0b9800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.340+0000 7f0b91ffb700 1 -- 172.21.15.153:0/618453100 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b8c054d20 con 0x7f0b9c1571c0 2023-11-24T08:07:17.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.532+0000 7f0ba3295700 1 -- 172.21.15.153:0/618453100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b9c0cfd00 con 0x7f0b9c1571c0 2023-11-24T08:07:17.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.533+0000 7f0b91ffb700 1 -- 172.21.15.153:0/618453100 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16614 (secure 0 0 0) 0x7f0b9c0cfd00 con 0x7f0b9c1571c0 2023-11-24T08:07:17.535 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:17.535 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":55,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:07:16.566283+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:14.800746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:15.529815+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.535+0000 7f0ba3295700 1 -- 172.21.15.153:0/618453100 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b8006b0b0 msgr2=0x7f0b8006d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.535+0000 7f0ba3295700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b8006b0b0 0x7f0b8006d570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0b98005040 tx=0x7f0b9800a000 comp rx=0 tx=0).stop 2023-11-24T08:07:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.536+0000 7f0ba3295700 1 -- 172.21.15.153:0/618453100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c1571c0 msgr2=0x7f0b9c160950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.536+0000 7f0ba3295700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c1571c0 0x7f0b9c160950 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c011ad0 tx=0x7f0b8c011e90 comp rx=0 tx=0).stop 2023-11-24T08:07:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.536+0000 7f0ba3295700 1 -- 172.21.15.153:0/618453100 shutdown_connections 2023-11-24T08:07:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.536+0000 7f0ba3295700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b9c160e90 0x7f0b9c144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.536+0000 7f0ba3295700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b88003be0 0x7f0b9c15a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.536+0000 7f0ba3295700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0b8006b0b0 0x7f0b8006d570 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.536+0000 7f0ba3295700 1 --2- 172.21.15.153:0/618453100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c1571c0 0x7f0b9c160950 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.536+0000 7f0ba3295700 1 -- 172.21.15.153:0/618453100 >> 172.21.15.153:0/618453100 conn(0x7f0b9c071b90 msgr2=0x7f0b9c06bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.536+0000 7f0ba3295700 1 -- 172.21.15.153:0/618453100 shutdown_connections 2023-11-24T08:07:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.536+0000 7f0ba3295700 1 -- 172.21.15.153:0/618453100 wait complete. 2023-11-24T08:07:17.550 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:17.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.670+0000 7fba5a500700 1 Processor -- start 2023-11-24T08:07:17.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.670+0000 7fba5a500700 1 -- start start 2023-11-24T08:07:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.670+0000 7fba5a500700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fba5415e080 0x7fba540b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.670+0000 7fba5a500700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba5406c710 0x7fba540afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.670+0000 7fba5a500700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba540ae430 con 0x7fba540af4d0 2023-11-24T08:07:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.670+0000 7fba5a500700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba540af0b0 con 0x7fba5415e080 2023-11-24T08:07:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.670+0000 7fba5a500700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba540b05a0 con 0x7fba5406c710 2023-11-24T08:07:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba537fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fba540af4d0 0x7fba5406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45568/0 (socket says 172.21.15.153:45568) 2023-11-24T08:07:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba537fe700 1 -- 172.21.15.153:0/800418541 learned_addr learned my addr 172.21.15.153:0/800418541 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba53fff700 1 --2- 172.21.15.153:0/800418541 >> v2:172.21.15.164:3300/0 conn(0x7fba5415e080 0x7fba540b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba58a9d700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba5406c710 0x7fba540afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885193535 0 0) 0x7fba540ae430 con 0x7fba540af4d0 2023-11-24T08:07:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba3c0035b0 con 0x7fba540af4d0 2023-11-24T08:07:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 600707990 0 0) 0x7fba3c0035b0 con 0x7fba540af4d0 2023-11-24T08:07:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba5406c710 msgr2=0x7fba540afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba5406c710 0x7fba540afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 >> v2:172.21.15.164:3300/0 conn(0x7fba5415e080 msgr2=0x7fba540b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 --2- 172.21.15.153:0/800418541 >> v2:172.21.15.164:3300/0 conn(0x7fba5415e080 0x7fba540b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba540ae710 con 0x7fba540af4d0 2023-11-24T08:07:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fba48001670 con 0x7fba540af4d0 2023-11-24T08:07:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 >> v1:172.21.15.153:6789/0 conn(0x7fba540af4d0 legacy=0x7fba5406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba3c003a30 0x7fba3c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba3c004850 0x7fba3c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba5406c710 0x7fba3c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba540af0b0 con 0x7fba3c003a30 2023-11-24T08:07:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba540b05a0 con 0x7fba3c004850 2023-11-24T08:07:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c00ba10 con 0x7fba5406c710 2023-11-24T08:07:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba53fff700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba3c003a30 0x7fba3c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba58a9d700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba5406c710 0x7fba3c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.671+0000 7fba537fe700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba3c004850 0x7fba3c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba53fff700 1 -- 172.21.15.153:0/800418541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba5406c710 msgr2=0x7fba3c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba53fff700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba5406c710 0x7fba3c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba53fff700 1 -- 172.21.15.153:0/800418541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba3c004850 msgr2=0x7fba3c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba53fff700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba3c004850 0x7fba3c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba53fff700 1 -- 172.21.15.153:0/800418541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c0035b0 con 0x7fba3c003a30 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba53fff700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba3c003a30 0x7fba3c003e50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fba44009b60 tx=0x7fba3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1859f19510a0b70 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4400e6c0 con 0x7fba3c003a30 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4400e820 con 0x7fba3c003a30 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba52ffd700 1 -- 172.21.15.153:0/800418541 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4400eb90 con 0x7fba3c003a30 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba5a500700 1 -- 172.21.15.153:0/800418541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba3c003a30 msgr2=0x7fba3c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba5a500700 1 --2- 172.21.15.153:0/800418541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba3c003a30 0x7fba3c003e50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fba44009b60 tx=0x7fba3c005880 comp rx=0 tx=0).stop 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba58a9d700 1 -- 172.21.15.153:0/800418541 reap_dead start 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.672+0000 7fba5a500700 1 -- 172.21.15.153:0/800418541 shutdown_connections 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.673+0000 7fba5a500700 1 -- 172.21.15.153:0/800418541 >> 172.21.15.153:0/800418541 conn(0x7fba54071b90 msgr2=0x7fba54071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.673+0000 7fba5a500700 1 -- 172.21.15.153:0/800418541 shutdown_connections 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.673+0000 7fba5a500700 1 -- 172.21.15.153:0/800418541 wait complete. 2023-11-24T08:07:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.674+0000 7fba5a500700 1 Processor -- start 2023-11-24T08:07:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.674+0000 7fba5a500700 1 -- start start 2023-11-24T08:07:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba5a500700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba54149580 0x7fba54155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba5a500700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba54159cf0 0x7fba54160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba5a500700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba540b0720 0x7fba540b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba5a500700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba54155a00 con 0x7fba540b0720 2023-11-24T08:07:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba5a500700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5415f2a0 con 0x7fba54149580 2023-11-24T08:07:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba5a500700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba540b10e0 con 0x7fba54159cf0 2023-11-24T08:07:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba58a9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba540b0720 0x7fba540b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba58a9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba540b0720 0x7fba540b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39478/0 (socket says 172.21.15.153:39478) 2023-11-24T08:07:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba53fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba54149580 0x7fba54155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba58a9d700 1 -- 172.21.15.153:0/2259094328 learned_addr learned my addr 172.21.15.153:0/2259094328 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba537fe700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba54159cf0 0x7fba54160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba58a9d700 1 -- 172.21.15.153:0/2259094328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba54159cf0 msgr2=0x7fba54160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba58a9d700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba54159cf0 0x7fba54160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba58a9d700 1 -- 172.21.15.153:0/2259094328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba54149580 msgr2=0x7fba54155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba58a9d700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba54149580 0x7fba54155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba58a9d700 1 -- 172.21.15.153:0/2259094328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba541553d0 con 0x7fba540b0720 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba58a9d700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba540b0720 0x7fba540b0ba0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fba54161a70 tx=0x7fba4c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba50ff9700 1 -- 172.21.15.153:0/2259094328 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00e040 con 0x7fba540b0720 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba50ff9700 1 -- 172.21.15.153:0/2259094328 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c00f040 con 0x7fba540b0720 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba5a500700 1 -- 172.21.15.153:0/2259094328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba54160f90 con 0x7fba540b0720 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba50ff9700 1 -- 172.21.15.153:0/2259094328 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c004270 con 0x7fba540b0720 2023-11-24T08:07:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.675+0000 7fba5a500700 1 -- 172.21.15.153:0/2259094328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba54155620 con 0x7fba540b0720 2023-11-24T08:07:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.676+0000 7fba5a500700 1 -- 172.21.15.153:0/2259094328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba540753f0 con 0x7fba540b0720 2023-11-24T08:07:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.677+0000 7fba50ff9700 1 -- 172.21.15.153:0/2259094328 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fba4c0043d0 con 0x7fba540b0720 2023-11-24T08:07:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.677+0000 7fba50ff9700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba4006b0b0 0x7fba4006d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.677+0000 7fba50ff9700 1 -- 172.21.15.153:0/2259094328 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba4c089d80 con 0x7fba540b0720 2023-11-24T08:07:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.677+0000 7fba53fff700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba4006b0b0 0x7fba4006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.678+0000 7fba53fff700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba4006b0b0 0x7fba4006d570 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fba440090b0 tx=0x7fba4401f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.682+0000 7fba50ff9700 1 -- 172.21.15.153:0/2259094328 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba4c054a90 con 0x7fba540b0720 2023-11-24T08:07:17.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.875+0000 7fba5a500700 1 -- 172.21.15.153:0/2259094328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba54067f60 con 0x7fba540b0720 2023-11-24T08:07:17.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.877+0000 7fba50ff9700 1 -- 172.21.15.153:0/2259094328 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16614 (secure 0 0 0) 0x7fba4c0580b0 con 0x7fba540b0720 2023-11-24T08:07:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:17.879 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":55,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:07:16.566283+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:14.800746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:15.529815+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 -- 172.21.15.153:0/2259094328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba4006b0b0 msgr2=0x7fba4006d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba4006b0b0 0x7fba4006d570 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fba440090b0 tx=0x7fba4401f040 comp rx=0 tx=0).stop 2023-11-24T08:07:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 -- 172.21.15.153:0/2259094328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba540b0720 msgr2=0x7fba540b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba540b0720 0x7fba540b0ba0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fba54161a70 tx=0x7fba4c011e60 comp rx=0 tx=0).stop 2023-11-24T08:07:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 -- 172.21.15.153:0/2259094328 shutdown_connections 2023-11-24T08:07:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fba4006b0b0 0x7fba4006d570 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba540b0720 0x7fba540b0ba0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba54149580 0x7fba54155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 --2- 172.21.15.153:0/2259094328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba54159cf0 0x7fba54160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 -- 172.21.15.153:0/2259094328 >> 172.21.15.153:0/2259094328 conn(0x7fba54071b90 msgr2=0x7fba540b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 -- 172.21.15.153:0/2259094328 shutdown_connections 2023-11-24T08:07:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:17.879+0000 7fba5a500700 1 -- 172.21.15.153:0/2259094328 wait complete. 2023-11-24T08:07:17.893 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:07:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.016+0000 7fc9add04700 1 Processor -- start 2023-11-24T08:07:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.016+0000 7fc9add04700 1 -- start start 2023-11-24T08:07:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9add04700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc9a815e160 0x7fc9a80b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9add04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9a80afc90 0x7fc9a8073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9add04700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a80b3c60 con 0x7fc9a80744d0 2023-11-24T08:07:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9add04700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a80b4500 con 0x7fc9a80afc90 2023-11-24T08:07:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9add04700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a8074940 con 0x7fc9a815e160 2023-11-24T08:07:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9a6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9a80afc90 0x7fc9a8073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9a6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9a80afc90 0x7fc9a8073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39484/0 (socket says 172.21.15.153:39484) 2023-11-24T08:07:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9a6ffd700 1 -- 172.21.15.153:0/1554506393 learned_addr learned my addr 172.21.15.153:0/1554506393 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9a77fe700 1 --2- 172.21.15.153:0/1554506393 >> v2:172.21.15.164:3300/0 conn(0x7fc9a815e160 0x7fc9a80b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9a6ffd700 1 -- 172.21.15.153:0/1554506393 >> v2:172.21.15.164:3300/0 conn(0x7fc9a815e160 msgr2=0x7fc9a80b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9a6ffd700 1 --2- 172.21.15.153:0/1554506393 >> v2:172.21.15.164:3300/0 conn(0x7fc9a815e160 0x7fc9a80b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9a6ffd700 1 -- 172.21.15.153:0/1554506393 >> v1:172.21.15.164:6789/0 conn(0x7fc9a80744d0 legacy=0x7fc9a806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9a6ffd700 1 -- 172.21.15.153:0/1554506393 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a80b58c0 con 0x7fc9a80afc90 2023-11-24T08:07:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.017+0000 7fc9a6ffd700 1 --2- 172.21.15.153:0/1554506393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a80afc90 0x7fc9a8073f90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc9a809efa0 tx=0x7fc998009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc77b31cbb446be5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.018+0000 7fc9a67fc700 1 -- 172.21.15.153:0/1554506393 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998004230 con 0x7fc9a80afc90 2023-11-24T08:07:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.018+0000 7fc9a67fc700 1 -- 172.21.15.153:0/1554506393 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc998004390 con 0x7fc9a80afc90 2023-11-24T08:07:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.018+0000 7fc9a67fc700 1 -- 172.21.15.153:0/1554506393 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9980036a0 con 0x7fc9a80afc90 2023-11-24T08:07:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.018+0000 7fc9add04700 1 -- 172.21.15.153:0/1554506393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a80afc90 msgr2=0x7fc9a8073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.018+0000 7fc9add04700 1 --2- 172.21.15.153:0/1554506393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a80afc90 0x7fc9a8073f90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc9a809efa0 tx=0x7fc998009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.018+0000 7fc9add04700 1 -- 172.21.15.153:0/1554506393 shutdown_connections 2023-11-24T08:07:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.018+0000 7fc9add04700 1 --2- 172.21.15.153:0/1554506393 >> v2:172.21.15.164:3300/0 conn(0x7fc9a815e160 0x7fc9a80b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.018+0000 7fc9add04700 1 --2- 172.21.15.153:0/1554506393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a80afc90 0x7fc9a8073f90 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.018+0000 7fc9add04700 1 -- 172.21.15.153:0/1554506393 >> 172.21.15.153:0/1554506393 conn(0x7fc9a80d0bf0 msgr2=0x7fc9a80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.018+0000 7fc9add04700 1 -- 172.21.15.153:0/1554506393 shutdown_connections 2023-11-24T08:07:18.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.018+0000 7fc9add04700 1 -- 172.21.15.153:0/1554506393 wait complete. 2023-11-24T08:07:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.019+0000 7fc9add04700 1 Processor -- start 2023-11-24T08:07:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.019+0000 7fc9add04700 1 -- start start 2023-11-24T08:07:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.020+0000 7fc9add04700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9a80744d0 0x7fc9a8160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.020+0000 7fc9add04700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9a80afc90 0x7fc9a81544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.020+0000 7fc9add04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a815e160 0x7fc9a8149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.020+0000 7fc9add04700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8160b00 con 0x7fc9a815e160 2023-11-24T08:07:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.020+0000 7fc9add04700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8160de0 con 0x7fc9a80744d0 2023-11-24T08:07:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.020+0000 7fc9add04700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a81610c0 con 0x7fc9a80afc90 2023-11-24T08:07:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.020+0000 7fc9a7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a815e160 0x7fc9a8149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.020+0000 7fc9a7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a815e160 0x7fc9a8149160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39490/0 (socket says 172.21.15.153:39490) 2023-11-24T08:07:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.020+0000 7fc9a7fff700 1 -- 172.21.15.153:0/107524797 learned_addr learned my addr 172.21.15.153:0/107524797 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc9a7fff700 1 -- 172.21.15.153:0/107524797 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9a80afc90 msgr2=0x7fc9a81544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc9a6ffd700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9a80afc90 0x7fc9a81544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc9a77fe700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9a80744d0 0x7fc9a8160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc9a7fff700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9a80afc90 0x7fc9a81544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc9a7fff700 1 -- 172.21.15.153:0/107524797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9a80744d0 msgr2=0x7fc9a8160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc9a7fff700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9a80744d0 0x7fc9a8160420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc9a7fff700 1 -- 172.21.15.153:0/107524797 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc998009550 con 0x7fc9a815e160 2023-11-24T08:07:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc9a7fff700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a815e160 0x7fc9a8149160 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000cc10 tx=0x7fc9a000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc98ffff700 1 -- 172.21.15.153:0/107524797 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000abb0 con 0x7fc9a815e160 2023-11-24T08:07:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc98ffff700 1 -- 172.21.15.153:0/107524797 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a000ad10 con 0x7fc9a815e160 2023-11-24T08:07:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc9add04700 1 -- 172.21.15.153:0/107524797 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a81613a0 con 0x7fc9a815e160 2023-11-24T08:07:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc98ffff700 1 -- 172.21.15.153:0/107524797 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0012660 con 0x7fc9a815e160 2023-11-24T08:07:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.021+0000 7fc9add04700 1 -- 172.21.15.153:0/107524797 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a81550d0 con 0x7fc9a815e160 2023-11-24T08:07:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.022+0000 7fc9add04700 1 -- 172.21.15.153:0/107524797 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a80b54a0 con 0x7fc9a815e160 2023-11-24T08:07:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.022+0000 7fc98ffff700 1 -- 172.21.15.153:0/107524797 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc9a00127c0 con 0x7fc9a815e160 2023-11-24T08:07:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.023+0000 7fc98ffff700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc99406b080 0x7fc99406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.023+0000 7fc98ffff700 1 -- 172.21.15.153:0/107524797 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9a008a0f0 con 0x7fc9a815e160 2023-11-24T08:07:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.023+0000 7fc9a77fe700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc99406b080 0x7fc99406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.023+0000 7fc9a77fe700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc99406b080 0x7fc99406d540 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00b840 tx=0x7fc99c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.027+0000 7fc98ffff700 1 -- 172.21.15.153:0/107524797 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9a0054f20 con 0x7fc9a815e160 2023-11-24T08:07:18.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:18.269+0000 7fc9add04700 1 -- 172.21.15.153:0/107524797 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc9a8158950 con 0x7fc9a815e160 2023-11-24T08:07:18.989 INFO:tasks.ceph.mds.d.smithi164.stderr:2023-11-24T08:07:18.988+0000 7fbe49a32700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:07:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.191+0000 7fc98ffff700 1 -- 172.21.15.153:0/107524797 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc9a8158950 con 0x7fc9a815e160 2023-11-24T08:07:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 -- 172.21.15.153:0/107524797 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc99406b080 msgr2=0x7fc99406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc99406b080 0x7fc99406d540 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00b840 tx=0x7fc99c008040 comp rx=0 tx=0).stop 2023-11-24T08:07:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 -- 172.21.15.153:0/107524797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a815e160 msgr2=0x7fc9a8149160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a815e160 0x7fc9a8149160 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000cc10 tx=0x7fc9a000a060 comp rx=0 tx=0).stop 2023-11-24T08:07:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 -- 172.21.15.153:0/107524797 shutdown_connections 2023-11-24T08:07:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc99406b080 0x7fc99406d540 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a815e160 0x7fc9a8149160 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9a80744d0 0x7fc9a8160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 --2- 172.21.15.153:0/107524797 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9a80afc90 0x7fc9a81544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 -- 172.21.15.153:0/107524797 >> 172.21.15.153:0/107524797 conn(0x7fc9a80d0bf0 msgr2=0x7fc9a80add40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 -- 172.21.15.153:0/107524797 shutdown_connections 2023-11-24T08:07:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.194+0000 7fc9add04700 1 -- 172.21.15.153:0/107524797 wait complete. 2023-11-24T08:07:19.211 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:07:19.211 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:07:19.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.338+0000 7f052a7a6700 1 Processor -- start 2023-11-24T08:07:19.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.339+0000 7f052a7a6700 1 -- start start 2023-11-24T08:07:19.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.339+0000 7f052a7a6700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f05240746a0 0x7f05240b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.339+0000 7f052a7a6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05240b3c60 con 0x7f052415e160 2023-11-24T08:07:19.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.339+0000 7f052a7a6700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05240b58c0 con 0x7f05240afc90 2023-11-24T08:07:19.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.339+0000 7f052a7a6700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05240b4500 con 0x7f05240746a0 2023-11-24T08:07:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.339+0000 7f0523fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f052415e160 0x7f0524073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45600/0 (socket says 172.21.15.153:45600) 2023-11-24T08:07:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.339+0000 7f0523fff700 1 -- 172.21.15.153:0/2559863750 learned_addr learned my addr 172.21.15.153:0/2559863750 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019417592 0 0) 0x7f05240b3c60 con 0x7f052415e160 2023-11-24T08:07:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f050c0035b0 con 0x7f052415e160 2023-11-24T08:07:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f05237fe700 1 --2- 172.21.15.153:0/2559863750 >> v2:172.21.15.164:3300/0 conn(0x7f05240746a0 0x7f05240b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 460650527 0 0) 0x7f050c0035b0 con 0x7f052415e160 2023-11-24T08:07:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 >> v2:172.21.15.164:3300/0 conn(0x7f05240746a0 msgr2=0x7f05240b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 --2- 172.21.15.153:0/2559863750 >> v2:172.21.15.164:3300/0 conn(0x7f05240746a0 0x7f05240b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 >> v1:172.21.15.164:6789/0 conn(0x7f05240afc90 legacy=0x7f052406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052406bdc0 con 0x7f052415e160 2023-11-24T08:07:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f0518001670 con 0x7f052415e160 2023-11-24T08:07:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f05237fe700 1 --2- 172.21.15.153:0/2559863750 >> v2:172.21.15.164:3300/0 conn(0x7f05240746a0 0x7f05240b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 >> v1:172.21.15.153:6789/0 conn(0x7f052415e160 legacy=0x7f0524073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050c003a00 0x7f050c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f050c004850 0x7f050c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f050c005210 0x7f050c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05240b4500 con 0x7f050c003a00 2023-11-24T08:07:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c00c160 con 0x7f050c005210 2023-11-24T08:07:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c00c320 con 0x7f050c004850 2023-11-24T08:07:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0523fff700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050c003a00 0x7f050c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f05237fe700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f050c004850 0x7f050c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0528d43700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f050c005210 0x7f050c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0523fff700 1 -- 172.21.15.153:0/2559863750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f050c004850 msgr2=0x7f050c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0523fff700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f050c004850 0x7f050c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0523fff700 1 -- 172.21.15.153:0/2559863750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f050c005210 msgr2=0x7f050c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0523fff700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f050c005210 0x7f050c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0523fff700 1 -- 172.21.15.153:0/2559863750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c0035b0 con 0x7f050c003a00 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f05237fe700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f050c004850 0x7f050c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.340+0000 7f0528d43700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f050c005210 0x7f050c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f0528d43700 1 -- 172.21.15.153:0/2559863750 reap_dead start 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f0523fff700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050c003a00 0x7f050c003e20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f051800c2a0 tx=0x7f050c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5154a89f54c3b6a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518007c10 con 0x7f050c003a00 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051800cde0 con 0x7f050c003a00 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f0522ffd700 1 -- 172.21.15.153:0/2559863750 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518005ba0 con 0x7f050c003a00 2023-11-24T08:07:19.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f052a7a6700 1 -- 172.21.15.153:0/2559863750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050c003a00 msgr2=0x7f050c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f052a7a6700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050c003a00 0x7f050c003e20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f051800c2a0 tx=0x7f050c005880 comp rx=0 tx=0).stop 2023-11-24T08:07:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f052a7a6700 1 -- 172.21.15.153:0/2559863750 shutdown_connections 2023-11-24T08:07:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f052a7a6700 1 --2- 172.21.15.153:0/2559863750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f050c003a00 0x7f050c003e20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f052a7a6700 1 -- 172.21.15.153:0/2559863750 >> 172.21.15.153:0/2559863750 conn(0x7f05240d0bf0 msgr2=0x7f05240d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f052a7a6700 1 -- 172.21.15.153:0/2559863750 shutdown_connections 2023-11-24T08:07:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.341+0000 7f052a7a6700 1 -- 172.21.15.153:0/2559863750 wait complete. 2023-11-24T08:07:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.343+0000 7f052a7a6700 1 Processor -- start 2023-11-24T08:07:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.343+0000 7f052a7a6700 1 -- start start 2023-11-24T08:07:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.343+0000 7f052a7a6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f050c003a00 0x7f052414e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.343+0000 7f052a7a6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05241f3df0 0x7f05240c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.343+0000 7f052a7a6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05240c79a0 0x7f05240c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f052a7a6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05240c8f80 con 0x7f05241f3df0 2023-11-24T08:07:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f052a7a6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05240c7e30 con 0x7f05240c79a0 2023-11-24T08:07:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f052a7a6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05240c6c10 con 0x7f050c003a00 2023-11-24T08:07:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f05237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05241f3df0 0x7f05240c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f05237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05241f3df0 0x7f05240c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39510/0 (socket says 172.21.15.153:39510) 2023-11-24T08:07:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f05237fe700 1 -- 172.21.15.153:0/2754099349 learned_addr learned my addr 172.21.15.153:0/2754099349 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f0523fff700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f050c003a00 0x7f052414e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f0528d43700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05240c79a0 0x7f05240c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f05237fe700 1 -- 172.21.15.153:0/2754099349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f050c003a00 msgr2=0x7f052414e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f05237fe700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f050c003a00 0x7f052414e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f05237fe700 1 -- 172.21.15.153:0/2754099349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05240c79a0 msgr2=0x7f05240c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f05237fe700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05240c79a0 0x7f05240c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f05237fe700 1 -- 172.21.15.153:0/2754099349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052415e7f0 con 0x7f05241f3df0 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f0523fff700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f050c003a00 0x7f052414e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f05237fe700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05241f3df0 0x7f05240c7460 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f05140109a0 tx=0x7f0514010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f0520ff9700 1 -- 172.21.15.153:0/2754099349 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051400ea10 con 0x7f05241f3df0 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f0520ff9700 1 -- 172.21.15.153:0/2754099349 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051400c050 con 0x7f05241f3df0 2023-11-24T08:07:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f052a7a6700 1 -- 172.21.15.153:0/2754099349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052415ead0 con 0x7f05241f3df0 2023-11-24T08:07:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f0520ff9700 1 -- 172.21.15.153:0/2754099349 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051400ed90 con 0x7f05241f3df0 2023-11-24T08:07:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.344+0000 7f052a7a6700 1 -- 172.21.15.153:0/2754099349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052415f090 con 0x7f05241f3df0 2023-11-24T08:07:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.345+0000 7f052a7a6700 1 -- 172.21.15.153:0/2754099349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052415f220 con 0x7f05241f3df0 2023-11-24T08:07:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.346+0000 7f0520ff9700 1 -- 172.21.15.153:0/2754099349 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0514015470 con 0x7f05241f3df0 2023-11-24T08:07:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.346+0000 7f0520ff9700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f051006b080 0x7f051006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.346+0000 7f0523fff700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f051006b080 0x7f051006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.346+0000 7f0520ff9700 1 -- 172.21.15.153:0/2754099349 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f051408a1f0 con 0x7f05241f3df0 2023-11-24T08:07:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.347+0000 7f0523fff700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f051006b080 0x7f051006d540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0518000c00 tx=0x7f0518007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.351+0000 7f0520ff9700 1 -- 172.21.15.153:0/2754099349 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0514054fa0 con 0x7f05241f3df0 2023-11-24T08:07:19.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:19.586+0000 7f052a7a6700 1 -- 172.21.15.153:0/2754099349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f052406c140 con 0x7f05241f3df0 2023-11-24T08:07:20.019 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:20.021 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:20.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.195+0000 7f0520ff9700 1 -- 172.21.15.153:0/2754099349 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7f05140585c0 con 0x7f05241f3df0 2023-11-24T08:07:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.197+0000 7f052a7a6700 1 -- 172.21.15.153:0/2754099349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f051006b080 msgr2=0x7f051006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.197+0000 7f052a7a6700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f051006b080 0x7f051006d540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0518000c00 tx=0x7f0518007000 comp rx=0 tx=0).stop 2023-11-24T08:07:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.197+0000 7f052a7a6700 1 -- 172.21.15.153:0/2754099349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05241f3df0 msgr2=0x7f05240c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.197+0000 7f052a7a6700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05241f3df0 0x7f05240c7460 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f05140109a0 tx=0x7f0514010d60 comp rx=0 tx=0).stop 2023-11-24T08:07:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.197+0000 7f052a7a6700 1 -- 172.21.15.153:0/2754099349 shutdown_connections 2023-11-24T08:07:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.197+0000 7f052a7a6700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05240c79a0 0x7f05240c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.197+0000 7f052a7a6700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f050c003a00 0x7f052414e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.197+0000 7f052a7a6700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f051006b080 0x7f051006d540 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.197+0000 7f052a7a6700 1 --2- 172.21.15.153:0/2754099349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05241f3df0 0x7f05240c7460 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.197+0000 7f052a7a6700 1 -- 172.21.15.153:0/2754099349 >> 172.21.15.153:0/2754099349 conn(0x7f05240d0bf0 msgr2=0x7f05240add40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.198+0000 7f052a7a6700 1 -- 172.21.15.153:0/2754099349 shutdown_connections 2023-11-24T08:07:20.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.198+0000 7f052a7a6700 1 -- 172.21.15.153:0/2754099349 wait complete. 2023-11-24T08:07:20.213 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:07:20.213 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:20.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.332+0000 7ff8160ac700 1 Processor -- start 2023-11-24T08:07:20.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.332+0000 7ff8160ac700 1 -- start start 2023-11-24T08:07:20.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff8160ac700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff81015e080 0x7ff8100b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff8160ac700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff8100af4d0 0x7ff8100afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff8160ac700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8100ae430 con 0x7ff81006c000 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff8160ac700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8100af0b0 con 0x7ff81015e080 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff8160ac700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8100b05a0 con 0x7ff8100af4d0 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff80f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff81015e080 0x7ff8100b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff80ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff81006c000 0x7ff810073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45624/0 (socket says 172.21.15.153:45624) 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff80ffff700 1 -- 172.21.15.153:0/714535312 learned_addr learned my addr 172.21.15.153:0/714535312 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff80effd700 1 --2- 172.21.15.153:0/714535312 >> v2:172.21.15.164:3300/0 conn(0x7ff8100af4d0 0x7ff8100afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff80f7fe700 1 -- 172.21.15.153:0/714535312 >> v2:172.21.15.164:3300/0 conn(0x7ff8100af4d0 msgr2=0x7ff8100afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff80f7fe700 1 --2- 172.21.15.153:0/714535312 >> v2:172.21.15.164:3300/0 conn(0x7ff8100af4d0 0x7ff8100afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff80f7fe700 1 -- 172.21.15.153:0/714535312 >> v1:172.21.15.153:6789/0 conn(0x7ff81006c000 legacy=0x7ff810073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff80f7fe700 1 -- 172.21.15.153:0/714535312 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100ae710 con 0x7ff81015e080 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff80e7fc700 1 -- 172.21.15.153:0/714535312 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992271972 0 0) 0x7ff8100ae430 con 0x7ff81006c000 2023-11-24T08:07:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.333+0000 7ff80effd700 1 --2- 172.21.15.153:0/714535312 >> v2:172.21.15.164:3300/0 conn(0x7ff8100af4d0 0x7ff8100afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff80f7fe700 1 --2- 172.21.15.153:0/714535312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff81015e080 0x7ff8100b5050 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff81006e4e0 tx=0x7ff7f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a09c6cc67b72eb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff80e7fc700 1 -- 172.21.15.153:0/714535312 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8011830 con 0x7ff81015e080 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff80e7fc700 1 -- 172.21.15.153:0/714535312 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f8011990 con 0x7ff81015e080 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff80e7fc700 1 -- 172.21.15.153:0/714535312 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8011d20 con 0x7ff81015e080 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff8160ac700 1 -- 172.21.15.153:0/714535312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff81015e080 msgr2=0x7ff8100b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff8160ac700 1 --2- 172.21.15.153:0/714535312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff81015e080 0x7ff8100b5050 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff81006e4e0 tx=0x7ff7f8009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff8160ac700 1 -- 172.21.15.153:0/714535312 shutdown_connections 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff8160ac700 1 --2- 172.21.15.153:0/714535312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff81015e080 0x7ff8100b5050 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff8160ac700 1 --2- 172.21.15.153:0/714535312 >> v2:172.21.15.164:3300/0 conn(0x7ff8100af4d0 0x7ff8100afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff8160ac700 1 -- 172.21.15.153:0/714535312 >> 172.21.15.153:0/714535312 conn(0x7ff810071b90 msgr2=0x7ff810071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff8160ac700 1 -- 172.21.15.153:0/714535312 shutdown_connections 2023-11-24T08:07:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.334+0000 7ff8160ac700 1 -- 172.21.15.153:0/714535312 wait complete. 2023-11-24T08:07:20.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.335+0000 7ff8160ac700 1 Processor -- start 2023-11-24T08:07:20.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.336+0000 7ff8160ac700 1 -- start start 2023-11-24T08:07:20.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.336+0000 7ff8160ac700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81006c000 0x7ff810155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.336+0000 7ff8160ac700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8100af4d0 0x7ff810158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.336+0000 7ff8160ac700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff81015e080 0x7ff810154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.336+0000 7ff8160ac700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff810153bc0 con 0x7ff81015e080 2023-11-24T08:07:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.336+0000 7ff8160ac700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff810157830 con 0x7ff8100af4d0 2023-11-24T08:07:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.336+0000 7ff8160ac700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff810157b10 con 0x7ff81006c000 2023-11-24T08:07:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff80ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff81015e080 0x7ff810154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff80ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff81015e080 0x7ff810154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39526/0 (socket says 172.21.15.153:39526) 2023-11-24T08:07:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff80ffff700 1 -- 172.21.15.153:0/2383399028 learned_addr learned my addr 172.21.15.153:0/2383399028 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff80effd700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8100af4d0 0x7ff810158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff80f7fe700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81006c000 0x7ff810155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff80ffff700 1 -- 172.21.15.153:0/2383399028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81006c000 msgr2=0x7ff810155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff80ffff700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81006c000 0x7ff810155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff80ffff700 1 -- 172.21.15.153:0/2383399028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8100af4d0 msgr2=0x7ff810158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff80ffff700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8100af4d0 0x7ff810158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff80ffff700 1 -- 172.21.15.153:0/2383399028 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f80094a0 con 0x7ff81015e080 2023-11-24T08:07:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff80ffff700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff81015e080 0x7ff810154cc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff80800cca0 tx=0x7ff80800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff807fff700 1 -- 172.21.15.153:0/2383399028 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800aaf0 con 0x7ff81015e080 2023-11-24T08:07:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff807fff700 1 -- 172.21.15.153:0/2383399028 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80800ac50 con 0x7ff81015e080 2023-11-24T08:07:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff8160ac700 1 -- 172.21.15.153:0/2383399028 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff810157df0 con 0x7ff81015e080 2023-11-24T08:07:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff807fff700 1 -- 172.21.15.153:0/2383399028 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8080070d0 con 0x7ff81015e080 2023-11-24T08:07:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.337+0000 7ff8160ac700 1 -- 172.21.15.153:0/2383399028 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8101583b0 con 0x7ff81015e080 2023-11-24T08:07:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.338+0000 7ff8160ac700 1 -- 172.21.15.153:0/2383399028 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8100753f0 con 0x7ff81015e080 2023-11-24T08:07:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.339+0000 7ff807fff700 1 -- 172.21.15.153:0/2383399028 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff808007230 con 0x7ff81015e080 2023-11-24T08:07:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.339+0000 7ff807fff700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7f006b080 0x7ff7f006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.339+0000 7ff807fff700 1 -- 172.21.15.153:0/2383399028 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff808089700 con 0x7ff81015e080 2023-11-24T08:07:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.339+0000 7ff80f7fe700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7f006b080 0x7ff7f006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.340+0000 7ff80f7fe700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7f006b080 0x7ff7f006d540 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80097c0 tx=0x7ff7f801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.344+0000 7ff807fff700 1 -- 172.21.15.153:0/2383399028 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8080544a0 con 0x7ff81015e080 2023-11-24T08:07:20.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.577+0000 7ff8160ac700 1 -- 172.21.15.153:0/2383399028 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8100b00d0 con 0x7ff81015e080 2023-11-24T08:07:20.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.578+0000 7ff807fff700 1 -- 172.21.15.153:0/2383399028 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4922 (secure 0 0 0) 0x7ff808018020 con 0x7ff81015e080 2023-11-24T08:07:20.580 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:20.580 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3525215026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3525215026},{"type":"v1","addr":"172.21.15.153:6837","nonce":3525215026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5318,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/946995567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":946995567},{"type":"v1","addr":"172.21.15.164:6834","nonce":946995567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6075,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/3002476497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3002476497},{"type":"v1","addr":"172.21.15.153:6836","nonce":3002476497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:16.566591+0000","modified":"2023-11-24T08:07:19.587429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6090":{"gid":6090,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/3019873912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3019873912},{"type":"v1","addr":"172.21.15.164:6835","nonce":3019873912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:20.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 -- 172.21.15.153:0/2383399028 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7f006b080 msgr2=0x7ff7f006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7f006b080 0x7ff7f006d540 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80097c0 tx=0x7ff7f801c040 comp rx=0 tx=0).stop 2023-11-24T08:07:20.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 -- 172.21.15.153:0/2383399028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff81015e080 msgr2=0x7ff810154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff81015e080 0x7ff810154cc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff80800cca0 tx=0x7ff80800a060 comp rx=0 tx=0).stop 2023-11-24T08:07:20.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 -- 172.21.15.153:0/2383399028 shutdown_connections 2023-11-24T08:07:20.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff7f006b080 0x7ff7f006d540 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff81015e080 0x7ff810154cc0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff81006c000 0x7ff810155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 --2- 172.21.15.153:0/2383399028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8100af4d0 0x7ff810158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 -- 172.21.15.153:0/2383399028 >> 172.21.15.153:0/2383399028 conn(0x7ff810071b90 msgr2=0x7ff810073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 -- 172.21.15.153:0/2383399028 shutdown_connections 2023-11-24T08:07:20.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.580+0000 7ff8160ac700 1 -- 172.21.15.153:0/2383399028 wait complete. 2023-11-24T08:07:20.583 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 36 2023-11-24T08:07:20.594 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:20.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.713+0000 7f41021f2700 1 Processor -- start 2023-11-24T08:07:20.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.713+0000 7f41021f2700 1 -- start start 2023-11-24T08:07:20.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.714+0000 7f41021f2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f40fc0d22f0 0x7f40fc0d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.714+0000 7f41021f2700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc0d0150 con 0x7f40fc15e080 2023-11-24T08:07:20.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.714+0000 7f41021f2700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc0cee50 con 0x7f40fc0ce4d0 2023-11-24T08:07:20.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.714+0000 7f41021f2700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc15e460 con 0x7f40fc0d22f0 2023-11-24T08:07:20.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.714+0000 7f40fbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f40fc0d22f0 0x7f40fc0d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.714+0000 7f40fb7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f40fc15e080 0x7f40fc0cc2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45634/0 (socket says 172.21.15.153:45634) 2023-11-24T08:07:20.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.714+0000 7f40fb7fe700 1 -- 172.21.15.153:0/1260717992 learned_addr learned my addr 172.21.15.153:0/1260717992 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:20.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f40fbfff700 1 -- 172.21.15.153:0/1260717992 >> v1:172.21.15.164:6789/0 conn(0x7f40fc0ce4d0 legacy=0x7f40fc0d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f40fbfff700 1 -- 172.21.15.153:0/1260717992 >> v1:172.21.15.153:6789/0 conn(0x7f40fc15e080 legacy=0x7f40fc0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f40fbfff700 1 -- 172.21.15.153:0/1260717992 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc0cf130 con 0x7f40fc0d22f0 2023-11-24T08:07:20.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f40fa7fc700 1 -- 172.21.15.153:0/1260717992 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078310842 0 0) 0x7f40fc0d0150 con 0x7f40fc15e080 2023-11-24T08:07:20.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f40fbfff700 1 --2- 172.21.15.153:0/1260717992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40fc0d22f0 0x7f40fc0d05e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009d90 tx=0x7f40f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39da6f8f003b2afa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f40fa7fc700 1 -- 172.21.15.153:0/1260717992 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400e070 con 0x7f40fc0d22f0 2023-11-24T08:07:20.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f40fa7fc700 1 -- 172.21.15.153:0/1260717992 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f400bbd0 con 0x7f40fc0d22f0 2023-11-24T08:07:20.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f40fa7fc700 1 -- 172.21.15.153:0/1260717992 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4012430 con 0x7f40fc0d22f0 2023-11-24T08:07:20.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f41021f2700 1 -- 172.21.15.153:0/1260717992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40fc0d22f0 msgr2=0x7f40fc0d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f41021f2700 1 --2- 172.21.15.153:0/1260717992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40fc0d22f0 0x7f40fc0d05e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009d90 tx=0x7f40f400b330 comp rx=0 tx=0).stop 2023-11-24T08:07:20.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f41021f2700 1 -- 172.21.15.153:0/1260717992 shutdown_connections 2023-11-24T08:07:20.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f41021f2700 1 --2- 172.21.15.153:0/1260717992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40fc0d22f0 0x7f40fc0d05e0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f41021f2700 1 -- 172.21.15.153:0/1260717992 >> 172.21.15.153:0/1260717992 conn(0x7f40fc073130 msgr2=0x7f40fc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.715+0000 7f41021f2700 1 -- 172.21.15.153:0/1260717992 shutdown_connections 2023-11-24T08:07:20.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.716+0000 7f41021f2700 1 -- 172.21.15.153:0/1260717992 wait complete. 2023-11-24T08:07:20.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.717+0000 7f41021f2700 1 Processor -- start 2023-11-24T08:07:20.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.717+0000 7f41021f2700 1 -- start start 2023-11-24T08:07:20.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.718+0000 7f41021f2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40fc0ce4d0 0x7f40fc14d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.718+0000 7f41021f2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40fc0d22f0 0x7f40fc0b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.718+0000 7f41021f2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40fc15e080 0x7f40fc0b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.718+0000 7f41021f2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc14d650 con 0x7f40fc0d22f0 2023-11-24T08:07:20.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.718+0000 7f41021f2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0c7220 con 0x7f40fc0ce4d0 2023-11-24T08:07:20.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.718+0000 7f41021f2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0c7500 con 0x7f40fc15e080 2023-11-24T08:07:20.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.718+0000 7f40faffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40fc0d22f0 0x7f40fc0b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.718+0000 7f40faffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40fc0d22f0 0x7f40fc0b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39538/0 (socket says 172.21.15.153:39538) 2023-11-24T08:07:20.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.718+0000 7f40faffd700 1 -- 172.21.15.153:0/4065653943 learned_addr learned my addr 172.21.15.153:0/4065653943 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:20.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.718+0000 7f40fb7fe700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40fc0ce4d0 0x7f40fc14d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.718+0000 7f40fbfff700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40fc15e080 0x7f40fc0b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.719+0000 7f40faffd700 1 -- 172.21.15.153:0/4065653943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40fc15e080 msgr2=0x7f40fc0b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.719+0000 7f40faffd700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40fc15e080 0x7f40fc0b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.719+0000 7f40faffd700 1 -- 172.21.15.153:0/4065653943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40fc0ce4d0 msgr2=0x7f40fc14d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.719+0000 7f40faffd700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40fc0ce4d0 0x7f40fc14d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.719+0000 7f40faffd700 1 -- 172.21.15.153:0/4065653943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f4009a70 con 0x7f40fc0d22f0 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.719+0000 7f40faffd700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40fc0d22f0 0x7f40fc0b4870 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f40ec00c4e0 tx=0x7f40ec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.719+0000 7f40e3fff700 1 -- 172.21.15.153:0/4065653943 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec0052d0 con 0x7f40fc0d22f0 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.719+0000 7f40e3fff700 1 -- 172.21.15.153:0/4065653943 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ec005430 con 0x7f40fc0d22f0 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.719+0000 7f41021f2700 1 -- 172.21.15.153:0/4065653943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc0c77e0 con 0x7f40fc0d22f0 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.719+0000 7f40e3fff700 1 -- 172.21.15.153:0/4065653943 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec0038c0 con 0x7f40fc0d22f0 2023-11-24T08:07:20.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.719+0000 7f41021f2700 1 -- 172.21.15.153:0/4065653943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc0c7da0 con 0x7f40fc0d22f0 2023-11-24T08:07:20.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.720+0000 7f41021f2700 1 -- 172.21.15.153:0/4065653943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40fc0c7f60 con 0x7f40fc0d22f0 2023-11-24T08:07:20.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.720+0000 7f40e3fff700 1 -- 172.21.15.153:0/4065653943 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f40ec003a20 con 0x7f40fc0d22f0 2023-11-24T08:07:20.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.721+0000 7f40e3fff700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f40e806b080 0x7f40e806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.721+0000 7f40e3fff700 1 -- 172.21.15.153:0/4065653943 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40ec088e60 con 0x7f40fc0d22f0 2023-11-24T08:07:20.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.721+0000 7f40fb7fe700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f40e806b080 0x7f40e806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.721+0000 7f40fb7fe700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f40e806b080 0x7f40e806d540 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f40f0000f60 tx=0x7f40f0007d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.725+0000 7f40e3fff700 1 -- 172.21.15.153:0/4065653943 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40ec053c00 con 0x7f40fc0d22f0 2023-11-24T08:07:20.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.917+0000 7f41021f2700 1 -- 172.21.15.153:0/4065653943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40fc0c80f0 con 0x7f40fc0d22f0 2023-11-24T08:07:20.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.918+0000 7f40e3fff700 1 -- 172.21.15.153:0/4065653943 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16601 (secure 0 0 0) 0x7f40ec017020 con 0x7f40fc0d22f0 2023-11-24T08:07:20.920 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:20.920 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":56,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:07:18.180030+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:14.800746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:15.529815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:20.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.920+0000 7f41021f2700 1 -- 172.21.15.153:0/4065653943 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f40e806b080 msgr2=0x7f40e806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.920+0000 7f41021f2700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f40e806b080 0x7f40e806d540 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f40f0000f60 tx=0x7f40f0007d90 comp rx=0 tx=0).stop 2023-11-24T08:07:20.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.920+0000 7f41021f2700 1 -- 172.21.15.153:0/4065653943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40fc0d22f0 msgr2=0x7f40fc0b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.920+0000 7f41021f2700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40fc0d22f0 0x7f40fc0b4870 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f40ec00c4e0 tx=0x7f40ec00c8a0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.921+0000 7f41021f2700 1 -- 172.21.15.153:0/4065653943 shutdown_connections 2023-11-24T08:07:20.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.921+0000 7f41021f2700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40fc15e080 0x7f40fc0b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.921+0000 7f41021f2700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40fc0ce4d0 0x7f40fc14d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.921+0000 7f41021f2700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f40e806b080 0x7f40e806d540 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.921+0000 7f41021f2700 1 --2- 172.21.15.153:0/4065653943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40fc0d22f0 0x7f40fc0b4870 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.921+0000 7f41021f2700 1 -- 172.21.15.153:0/4065653943 >> 172.21.15.153:0/4065653943 conn(0x7f40fc073130 msgr2=0x7f40fc15a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.921+0000 7f41021f2700 1 -- 172.21.15.153:0/4065653943 shutdown_connections 2023-11-24T08:07:20.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:20.921+0000 7f41021f2700 1 -- 172.21.15.153:0/4065653943 wait complete. 2023-11-24T08:07:20.935 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:07:20.935 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:21.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.054+0000 7f554dc6d700 1 Processor -- start 2023-11-24T08:07:21.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.054+0000 7f554dc6d700 1 -- start start 2023-11-24T08:07:21.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f554dc6d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f55480b04b0 0x7f55480622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f554dc6d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 0x7f55480b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f554dc6d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554815c540 con 0x7f554815c160 2023-11-24T08:07:21.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f554dc6d700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55480b2ee0 con 0x7f55480b04b0 2023-11-24T08:07:21.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f554dc6d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55480add40 con 0x7f55480af1e0 2023-11-24T08:07:21.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f5547fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 0x7f55480b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f553ffff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f55480b04b0 0x7f55480622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f5547fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 0x7f55480b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:51618/0 (socket says 172.21.15.153:51618) 2023-11-24T08:07:21.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f5547fff700 1 -- 172.21.15.153:0/1242380473 learned_addr learned my addr 172.21.15.153:0/1242380473 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:21.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f55477fe700 1 --1- 172.21.15.153:0/1242380473 >> v1:172.21.15.164:6789/0 conn(0x7f554815c160 0x7f55480afda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:53330/0 (socket says 172.21.15.153:53330) 2023-11-24T08:07:21.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f553ffff700 1 -- 172.21.15.153:0/1242380473 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 msgr2=0x7f55480b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:21.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f553ffff700 1 --2- 172.21.15.153:0/1242380473 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 0x7f55480b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f553ffff700 1 -- 172.21.15.153:0/1242380473 >> v1:172.21.15.164:6789/0 conn(0x7f554815c160 legacy=0x7f55480afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f553ffff700 1 -- 172.21.15.153:0/1242380473 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55480ad410 con 0x7f55480b04b0 2023-11-24T08:07:21.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.055+0000 7f5547fff700 1 --2- 172.21.15.153:0/1242380473 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 0x7f55480b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:21.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f553ffff700 1 --2- 172.21.15.153:0/1242380473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55480b04b0 0x7f55480622a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5530009840 tx=0x7f5530009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f06ffd02cedb74a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f5546ffd700 1 -- 172.21.15.153:0/1242380473 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530011830 con 0x7f55480b04b0 2023-11-24T08:07:21.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f5546ffd700 1 -- 172.21.15.153:0/1242380473 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5530011990 con 0x7f55480b04b0 2023-11-24T08:07:21.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f5546ffd700 1 -- 172.21.15.153:0/1242380473 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530011d20 con 0x7f55480b04b0 2023-11-24T08:07:21.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f554dc6d700 1 -- 172.21.15.153:0/1242380473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55480b04b0 msgr2=0x7f55480622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f554dc6d700 1 --2- 172.21.15.153:0/1242380473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55480b04b0 0x7f55480622a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5530009840 tx=0x7f5530009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:21.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f554dc6d700 1 -- 172.21.15.153:0/1242380473 shutdown_connections 2023-11-24T08:07:21.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f554dc6d700 1 --2- 172.21.15.153:0/1242380473 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 0x7f55480b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f554dc6d700 1 --2- 172.21.15.153:0/1242380473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55480b04b0 0x7f55480622a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f554dc6d700 1 -- 172.21.15.153:0/1242380473 >> 172.21.15.153:0/1242380473 conn(0x7f55480b57b0 msgr2=0x7f55480b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f554dc6d700 1 -- 172.21.15.153:0/1242380473 shutdown_connections 2023-11-24T08:07:21.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.056+0000 7f554dc6d700 1 -- 172.21.15.153:0/1242380473 wait complete. 2023-11-24T08:07:21.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.058+0000 7f554dc6d700 1 Processor -- start 2023-11-24T08:07:21.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.058+0000 7f554dc6d700 1 -- start start 2023-11-24T08:07:21.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.058+0000 7f554dc6d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 0x7f55480977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.058+0000 7f554dc6d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55480b04b0 0x7f5548097ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.058+0000 7f554dc6d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f554815c160 0x7f55481516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.058+0000 7f554dc6d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55480982d0 con 0x7f55480b04b0 2023-11-24T08:07:21.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.058+0000 7f554dc6d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5548099210 con 0x7f554815c160 2023-11-24T08:07:21.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.058+0000 7f554dc6d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55480988e0 con 0x7f55480af1e0 2023-11-24T08:07:21.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.058+0000 7f553ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55480b04b0 0x7f5548097ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f553ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55480b04b0 0x7f5548097ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39552/0 (socket says 172.21.15.153:39552) 2023-11-24T08:07:21.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f553ffff700 1 -- 172.21.15.153:0/2172197479 learned_addr learned my addr 172.21.15.153:0/2172197479 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:21.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f5547fff700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f554815c160 0x7f55481516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f55477fe700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 0x7f55480977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f553ffff700 1 -- 172.21.15.153:0/2172197479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 msgr2=0x7f55480977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f553ffff700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 0x7f55480977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f553ffff700 1 -- 172.21.15.153:0/2172197479 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f554815c160 msgr2=0x7f55481516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f553ffff700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f554815c160 0x7f55481516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f553ffff700 1 -- 172.21.15.153:0/2172197479 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5540009b30 con 0x7f55480b04b0 2023-11-24T08:07:21.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f553ffff700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55480b04b0 0x7f5548097ce0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5530009fd0 tx=0x7f5530004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f5544ff9700 1 -- 172.21.15.153:0/2172197479 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530004550 con 0x7f55480b04b0 2023-11-24T08:07:21.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f5544ff9700 1 -- 172.21.15.153:0/2172197479 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553001e070 con 0x7f55480b04b0 2023-11-24T08:07:21.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f5544ff9700 1 -- 172.21.15.153:0/2172197479 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300038e0 con 0x7f55480b04b0 2023-11-24T08:07:21.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f554dc6d700 1 -- 172.21.15.153:0/2172197479 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55300094a0 con 0x7f55480b04b0 2023-11-24T08:07:21.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.059+0000 7f554dc6d700 1 -- 172.21.15.153:0/2172197479 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5548098ea0 con 0x7f55480b04b0 2023-11-24T08:07:21.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.060+0000 7f554dc6d700 1 -- 172.21.15.153:0/2172197479 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55480689c0 con 0x7f55480b04b0 2023-11-24T08:07:21.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.061+0000 7f5544ff9700 1 -- 172.21.15.153:0/2172197479 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5530003a40 con 0x7f55480b04b0 2023-11-24T08:07:21.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.061+0000 7f5544ff9700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f552806b080 0x7f552806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.061+0000 7f55477fe700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f552806b080 0x7f552806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.061+0000 7f5544ff9700 1 -- 172.21.15.153:0/2172197479 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f553008a7f0 con 0x7f55480b04b0 2023-11-24T08:07:21.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.061+0000 7f55477fe700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f552806b080 0x7f552806d540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5538000f60 tx=0x7f5538007f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.065+0000 7f5544ff9700 1 -- 172.21.15.153:0/2172197479 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f55300556e0 con 0x7f55480b04b0 2023-11-24T08:07:21.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.254+0000 7f554dc6d700 1 -- 172.21.15.153:0/2172197479 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5548098a50 con 0x7f552806b080 2023-11-24T08:07:21.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.261+0000 7f5544ff9700 1 -- 172.21.15.153:0/2172197479 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274449 (secure 0 0 0) 0x7f5548098a50 con 0x7f552806b080 2023-11-24T08:07:21.266 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:21.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.264+0000 7f554dc6d700 1 -- 172.21.15.153:0/2172197479 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f552806b080 msgr2=0x7f552806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.264+0000 7f554dc6d700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f552806b080 0x7f552806d540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5538000f60 tx=0x7f5538007f10 comp rx=0 tx=0).stop 2023-11-24T08:07:21.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.264+0000 7f554dc6d700 1 -- 172.21.15.153:0/2172197479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55480b04b0 msgr2=0x7f5548097ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.264+0000 7f554dc6d700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55480b04b0 0x7f5548097ce0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5530009fd0 tx=0x7f5530004750 comp rx=0 tx=0).stop 2023-11-24T08:07:21.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.264+0000 7f554dc6d700 1 -- 172.21.15.153:0/2172197479 shutdown_connections 2023-11-24T08:07:21.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.264+0000 7f554dc6d700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f554815c160 0x7f55481516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.264+0000 7f554dc6d700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55480af1e0 0x7f55480977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.264+0000 7f554dc6d700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f552806b080 0x7f552806d540 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.264+0000 7f554dc6d700 1 --2- 172.21.15.153:0/2172197479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55480b04b0 0x7f5548097ce0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.264+0000 7f554dc6d700 1 -- 172.21.15.153:0/2172197479 >> 172.21.15.153:0/2172197479 conn(0x7f55480b57b0 msgr2=0x7f554806e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.265+0000 7f554dc6d700 1 -- 172.21.15.153:0/2172197479 shutdown_connections 2023-11-24T08:07:21.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.265+0000 7f554dc6d700 1 -- 172.21.15.153:0/2172197479 wait complete. 2023-11-24T08:07:21.270 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:07:21.278 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-11-24T08:07:20.082015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222212,"kb_used_data":6020,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752508,"statfs":{"total":773094113280,"available":772866568192,"internally_reserved":0,"allocated":6164480,"data_stored":3202117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.917683"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T08:07:13.104236+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:07:13.104236+0000","last_peered":"2023-11-24T08:07:13.104236+0000","last_clean":"2023-11-24T08:07:13.104236+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:07:13.104236+0000","last_undegraded":"2023-11-24T08:07:13.104236+0000","last_fullsized":"2023-11-24T08:07:13.104236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28216,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1216512,"data_stored":843168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72199999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.073,"15min":1.073},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.85299999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.33200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":10.285,"15min":10.285},"last":0.442}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.30299999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.371},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.745,"5min":2.089,"15min":2.089},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68400000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.496}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.48499999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.747,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.27100000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.317}]},{"osd":2,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33300000000000002,"15min":0.31900000000000001},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.371},{"interface":"front","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.626,"15min":0.626},"last":0.28499999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.54000000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.5,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60699999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1659999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.623},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1212416,"data_stored":842149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.224}]},{"osd":2,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.625,"5min":1.343,"15min":1.343},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61299999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.33400000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78600000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.60399999999999998,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.93200000000000005,"15min":1.0720000000000001},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82499999999999996,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.032,"15min":1.204},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":4,"15min":4},"last":0.503}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.316,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.497,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.44,"15min":0.47199999999999998},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53600000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61799999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.501}]},{"osd":3,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.59099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":5.673,"15min":5.673},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":1.216,"15min":1.216},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.246,"15min":1.246},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.82699999999999996},"min":{"1min":0.503,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.82999999999999996},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82099999999999995,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.88},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.758,"15min":5.758},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.89000000000000001},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":5.726,"15min":5.726},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.499,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.85699999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.80300000000000005,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89400000000000002,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.94899999999999995},"min":{"1min":0.52000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99399999999999999,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.39600000000000002},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.59699999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58799999999999997,"5min":1.351,"15min":1.351},"last":0.372}]},{"osd":1,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40100000000000002,"15min":0.42699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.503,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.745,"5min":1.621,"15min":1.621},"last":0.315}]},{"osd":2,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.439},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63900000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45800000000000002,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64500000000000002,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80500000000000005,"5min":1.389,"15min":1.389},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90700000000000003,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.675,"15min":1.675},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":1.417,"15min":1.417},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.67100000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95899999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.56899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.5},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.46899999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77100000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":1.101,"15min":1.101},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.433}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.34699999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":1.476,"15min":1.476},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.751,"5min":1.556,"15min":1.556},"last":0.55100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.499},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":1,"15min":1},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.77300000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":0.752},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.624}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:21.284 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:21.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.437+0000 7fabb75b6700 1 Processor -- start 2023-11-24T08:07:21.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.438+0000 7fabb75b6700 1 -- start start 2023-11-24T08:07:21.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.438+0000 7fabb75b6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb01446a0 0x7fabb00b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.438+0000 7fabb75b6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb00af950 con 0x7fabb006c710 2023-11-24T08:07:21.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.438+0000 7fabb75b6700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb00afc30 con 0x7fabb00adf00 2023-11-24T08:07:21.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.438+0000 7fabb75b6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0144a80 con 0x7fabb01446a0 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.438+0000 7fabb5b53700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fabb006c710 0x7fabb00b3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45664/0 (socket says 172.21.15.153:45664) 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.438+0000 7fabb5b53700 1 -- 172.21.15.153:0/729936294 learned_addr learned my addr 172.21.15.153:0/729936294 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134404772 0 0) 0x7fabb00af950 con 0x7fabb006c710 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab9c0035b0 con 0x7fabb006c710 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7fabb5352700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb01446a0 0x7fabb00b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 71096391 0 0) 0x7fab9c0035b0 con 0x7fabb006c710 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb01446a0 msgr2=0x7fabb00b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb01446a0 0x7fabb00b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 >> v1:172.21.15.164:6789/0 conn(0x7fabb00adf00 legacy=0x7fabb006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb00aff10 con 0x7fabb006c710 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7faba80019f0 con 0x7fabb006c710 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7fabb5352700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb01446a0 0x7fabb00b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 >> v1:172.21.15.153:6789/0 conn(0x7fabb006c710 legacy=0x7fabb00b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c003a30 0x7fab9c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab9c004850 0x7fab9c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb01446a0 0x7fab9c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0144a80 con 0x7fab9c003a30 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c00bb10 con 0x7fab9c004850 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c00bcd0 con 0x7fabb01446a0 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7fabb5352700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c003a30 0x7fab9c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7fabb5b53700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb01446a0 0x7fab9c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7fabb4b51700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab9c004850 0x7fab9c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7fabb5352700 1 -- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb01446a0 msgr2=0x7fab9c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:21.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7fabb5352700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb01446a0 0x7fab9c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7fabb5352700 1 -- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab9c004850 msgr2=0x7fab9c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:21.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7fabb5352700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab9c004850 0x7fab9c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.439+0000 7fabb5352700 1 -- 172.21.15.153:0/729936294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c0035b0 con 0x7fab9c003a30 2023-11-24T08:07:21.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.440+0000 7fabb5352700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c003a30 0x7fab9c003e50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7faba0009950 tx=0x7fab9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fac852a300508fe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.440+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba000c070 con 0x7fab9c003a30 2023-11-24T08:07:21.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.440+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba0013610 con 0x7fab9c003a30 2023-11-24T08:07:21.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.440+0000 7faba7fff700 1 -- 172.21.15.153:0/729936294 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00139a0 con 0x7fab9c003a30 2023-11-24T08:07:21.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.440+0000 7fabb75b6700 1 -- 172.21.15.153:0/729936294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c003a30 msgr2=0x7fab9c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.440+0000 7fabb75b6700 1 --2- 172.21.15.153:0/729936294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c003a30 0x7fab9c003e50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7faba0009950 tx=0x7fab9c005880 comp rx=0 tx=0).stop 2023-11-24T08:07:21.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.440+0000 7fabb5b53700 1 -- 172.21.15.153:0/729936294 reap_dead start 2023-11-24T08:07:21.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.440+0000 7fabb75b6700 1 -- 172.21.15.153:0/729936294 shutdown_connections 2023-11-24T08:07:21.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.440+0000 7fabb75b6700 1 -- 172.21.15.153:0/729936294 >> 172.21.15.153:0/729936294 conn(0x7fabb0071b90 msgr2=0x7fabb0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.440+0000 7fabb75b6700 1 -- 172.21.15.153:0/729936294 shutdown_connections 2023-11-24T08:07:21.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.440+0000 7fabb75b6700 1 -- 172.21.15.153:0/729936294 wait complete. 2023-11-24T08:07:21.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.442+0000 7fabb75b6700 1 Processor -- start 2023-11-24T08:07:21.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.442+0000 7fabb75b6700 1 -- start start 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.442+0000 7fabb75b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb014d300 0x7fabb014dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.442+0000 7fabb75b6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabb014f600 0x7fabb015d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.442+0000 7fabb75b6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb014e000 0x7fabb015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.442+0000 7fabb75b6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb014f170 con 0x7fabb014d300 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.442+0000 7fabb75b6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb014e560 con 0x7fabb014f600 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.442+0000 7fabb75b6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb014e840 con 0x7fabb014e000 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.442+0000 7fabb5352700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb014d300 0x7fabb014dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb5352700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb014d300 0x7fabb014dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39568/0 (socket says 172.21.15.153:39568) 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb5352700 1 -- 172.21.15.153:0/115245314 learned_addr learned my addr 172.21.15.153:0/115245314 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb4b51700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabb014f600 0x7fabb015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb5b53700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb014e000 0x7fabb015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb5352700 1 -- 172.21.15.153:0/115245314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb014e000 msgr2=0x7fabb015dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb5352700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb014e000 0x7fabb015dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb5352700 1 -- 172.21.15.153:0/115245314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabb014f600 msgr2=0x7fabb015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb5352700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabb014f600 0x7fabb015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb5352700 1 -- 172.21.15.153:0/115245314 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb014eb20 con 0x7fabb014d300 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb5b53700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb014e000 0x7fabb015dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb5352700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb014d300 0x7fabb014dac0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7faba0015000 tx=0x7faba00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7faba5ffb700 1 -- 172.21.15.153:0/115245314 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba0013410 con 0x7fabb014d300 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7faba5ffb700 1 -- 172.21.15.153:0/115245314 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba001c630 con 0x7fabb014d300 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb75b6700 1 -- 172.21.15.153:0/115245314 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb014ee00 con 0x7fabb014d300 2023-11-24T08:07:21.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7faba5ffb700 1 -- 172.21.15.153:0/115245314 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba001c9e0 con 0x7fabb014d300 2023-11-24T08:07:21.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.443+0000 7fabb75b6700 1 -- 172.21.15.153:0/115245314 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb014d6e0 con 0x7fabb014d300 2023-11-24T08:07:21.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.444+0000 7fabb75b6700 1 -- 172.21.15.153:0/115245314 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb00753f0 con 0x7fabb014d300 2023-11-24T08:07:21.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.445+0000 7faba5ffb700 1 -- 172.21.15.153:0/115245314 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7faba001cb40 con 0x7fabb014d300 2023-11-24T08:07:21.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.445+0000 7faba5ffb700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fab9406b080 0x7fab9406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.445+0000 7faba5ffb700 1 -- 172.21.15.153:0/115245314 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faba008a280 con 0x7fabb014d300 2023-11-24T08:07:21.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.445+0000 7fabb4b51700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fab9406b080 0x7fab9406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.445+0000 7fabb4b51700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fab9406b080 0x7fab9406d540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fabb015af20 tx=0x7fabac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.449+0000 7faba5ffb700 1 -- 172.21.15.153:0/115245314 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faba0054fb0 con 0x7fabb014d300 2023-11-24T08:07:21.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.635+0000 7fabb75b6700 1 -- 172.21.15.153:0/115245314 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabb00b04d0 con 0x7fab9406b080 2023-11-24T08:07:21.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.642+0000 7faba5ffb700 1 -- 172.21.15.153:0/115245314 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274449 (secure 0 0 0) 0x7fabac001d70 con 0x7fab9406b080 2023-11-24T08:07:21.648 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:21.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 -- 172.21.15.153:0/115245314 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fab9406b080 msgr2=0x7fab9406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fab9406b080 0x7fab9406d540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fabb015af20 tx=0x7fabac009040 comp rx=0 tx=0).stop 2023-11-24T08:07:21.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 -- 172.21.15.153:0/115245314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb014d300 msgr2=0x7fabb014dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb014d300 0x7fabb014dac0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7faba0015000 tx=0x7faba00047c0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 -- 172.21.15.153:0/115245314 shutdown_connections 2023-11-24T08:07:21.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabb014e000 0x7fabb015dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fab9406b080 0x7fab9406d540 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb014d300 0x7fabb014dac0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 --2- 172.21.15.153:0/115245314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabb014f600 0x7fabb015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 -- 172.21.15.153:0/115245314 >> 172.21.15.153:0/115245314 conn(0x7fabb0071b90 msgr2=0x7fabb006b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 -- 172.21.15.153:0/115245314 shutdown_connections 2023-11-24T08:07:21.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.645+0000 7fabb75b6700 1 -- 172.21.15.153:0/115245314 wait complete. 2023-11-24T08:07:21.653 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:07:21.659 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-11-24T08:07:20.082015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222212,"kb_used_data":6020,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752508,"statfs":{"total":773094113280,"available":772866568192,"internally_reserved":0,"allocated":6164480,"data_stored":3202117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.917683"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T08:07:13.104236+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:07:13.104236+0000","last_peered":"2023-11-24T08:07:13.104236+0000","last_clean":"2023-11-24T08:07:13.104236+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:07:13.104236+0000","last_undegraded":"2023-11-24T08:07:13.104236+0000","last_fullsized":"2023-11-24T08:07:13.104236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28216,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1216512,"data_stored":843168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72199999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.073,"15min":1.073},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.85299999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.33200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":10.285,"15min":10.285},"last":0.442}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.30299999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.371},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.745,"5min":2.089,"15min":2.089},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68400000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.496}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.48499999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.747,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.27100000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.317}]},{"osd":2,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33300000000000002,"15min":0.31900000000000001},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.371},{"interface":"front","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.626,"15min":0.626},"last":0.28499999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.54000000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.5,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60699999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1659999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.623},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1212416,"data_stored":842149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.224}]},{"osd":2,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.625,"5min":1.343,"15min":1.343},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61299999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.33400000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78600000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.60399999999999998,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.93200000000000005,"15min":1.0720000000000001},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82499999999999996,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.032,"15min":1.204},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":4,"15min":4},"last":0.503}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.316,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.497,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.44,"15min":0.47199999999999998},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53600000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61799999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.501}]},{"osd":3,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.59099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":5.673,"15min":5.673},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":1.216,"15min":1.216},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.246,"15min":1.246},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.82699999999999996},"min":{"1min":0.503,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.82999999999999996},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82099999999999995,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.88},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.758,"15min":5.758},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.89000000000000001},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":5.726,"15min":5.726},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.499,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.85699999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.80300000000000005,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89400000000000002,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.94899999999999995},"min":{"1min":0.52000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99399999999999999,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.39600000000000002},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.59699999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58799999999999997,"5min":1.351,"15min":1.351},"last":0.372}]},{"osd":1,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40100000000000002,"15min":0.42699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.503,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.745,"5min":1.621,"15min":1.621},"last":0.315}]},{"osd":2,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.439},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63900000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45800000000000002,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64500000000000002,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80500000000000005,"5min":1.389,"15min":1.389},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90700000000000003,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.675,"15min":1.675},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":1.417,"15min":1.417},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.67100000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95899999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.56899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.5},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.46899999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77100000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":1.101,"15min":1.101},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.433}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.34699999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":1.476,"15min":1.476},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.751,"5min":1.556,"15min":1.556},"last":0.55100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.499},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":1,"15min":1},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.77300000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":0.752},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.624}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:21.664 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:21.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.819+0000 7fafb8372700 1 Processor -- start 2023-11-24T08:07:21.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.819+0000 7fafb8372700 1 -- start start 2023-11-24T08:07:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.820+0000 7fafb8372700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fafb006c710 0x7fafb00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.820+0000 7fafb8372700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00ae430 con 0x7fafb00af4d0 2023-11-24T08:07:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.820+0000 7fafb8372700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00ae710 con 0x7fafb015e080 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.820+0000 7fafb8372700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00af0b0 con 0x7fafb006c710 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.820+0000 7fafb690f700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fafb00af4d0 0x7fafb006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45684/0 (socket says 172.21.15.153:45684) 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.820+0000 7fafb690f700 1 -- 172.21.15.153:0/1270827928 learned_addr learned my addr 172.21.15.153:0/1270827928 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.820+0000 7fafb590d700 1 --2- 172.21.15.153:0/1270827928 >> v2:172.21.15.164:3300/0 conn(0x7fafb006c710 0x7fafb00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.821+0000 7fafb510c700 1 -- 172.21.15.153:0/1270827928 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288845181 0 0) 0x7fafb00ae430 con 0x7fafb00af4d0 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.821+0000 7fafb510c700 1 -- 172.21.15.153:0/1270827928 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf9c0035b0 con 0x7fafb00af4d0 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.821+0000 7fafb590d700 1 -- 172.21.15.153:0/1270827928 >> v1:172.21.15.164:6789/0 conn(0x7fafb015e080 legacy=0x7fafb006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.821+0000 7fafb510c700 1 -- 172.21.15.153:0/1270827928 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939512800 0 0) 0x7fafb00ae710 con 0x7fafb015e080 2023-11-24T08:07:21.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.821+0000 7fafb590d700 1 -- 172.21.15.153:0/1270827928 >> v1:172.21.15.153:6789/0 conn(0x7fafb00af4d0 legacy=0x7fafb006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.821+0000 7fafb590d700 1 -- 172.21.15.153:0/1270827928 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00ae9f0 con 0x7fafb006c710 2023-11-24T08:07:21.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.821+0000 7fafb590d700 1 --2- 172.21.15.153:0/1270827928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafb006c710 0x7fafb00b5050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fafac009840 tx=0x7fafac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff277a3f74fbacb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.821+0000 7fafb510c700 1 -- 172.21.15.153:0/1270827928 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac011830 con 0x7fafb006c710 2023-11-24T08:07:21.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.821+0000 7fafb510c700 1 -- 172.21.15.153:0/1270827928 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac011990 con 0x7fafb006c710 2023-11-24T08:07:21.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.821+0000 7fafb510c700 1 -- 172.21.15.153:0/1270827928 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac011d20 con 0x7fafb006c710 2023-11-24T08:07:21.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.822+0000 7fafb8372700 1 -- 172.21.15.153:0/1270827928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafb006c710 msgr2=0x7fafb00b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.822+0000 7fafb8372700 1 --2- 172.21.15.153:0/1270827928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafb006c710 0x7fafb00b5050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fafac009840 tx=0x7fafac009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:21.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.822+0000 7fafb8372700 1 -- 172.21.15.153:0/1270827928 shutdown_connections 2023-11-24T08:07:21.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.822+0000 7fafb8372700 1 --2- 172.21.15.153:0/1270827928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafb006c710 0x7fafb00b5050 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.822+0000 7fafb8372700 1 -- 172.21.15.153:0/1270827928 >> 172.21.15.153:0/1270827928 conn(0x7fafb0071b90 msgr2=0x7fafb0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.822+0000 7fafb8372700 1 -- 172.21.15.153:0/1270827928 shutdown_connections 2023-11-24T08:07:21.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.822+0000 7fafb8372700 1 -- 172.21.15.153:0/1270827928 wait complete. 2023-11-24T08:07:21.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.823+0000 7fafb8372700 1 Processor -- start 2023-11-24T08:07:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.823+0000 7fafb8372700 1 -- start start 2023-11-24T08:07:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb8372700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafb006c710 0x7fafb01465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb8372700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafb00af4d0 0x7fafb015e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb8372700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafb015e080 0x7fafb00cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb8372700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb015e9a0 con 0x7fafb006c710 2023-11-24T08:07:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb8372700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0153cc0 con 0x7fafb00af4d0 2023-11-24T08:07:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb8372700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0153fa0 con 0x7fafb015e080 2023-11-24T08:07:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb610e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafb006c710 0x7fafb01465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb610e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafb006c710 0x7fafb01465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39582/0 (socket says 172.21.15.153:39582) 2023-11-24T08:07:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb610e700 1 -- 172.21.15.153:0/1049659901 learned_addr learned my addr 172.21.15.153:0/1049659901 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb590d700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafb00af4d0 0x7fafb015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb690f700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafb015e080 0x7fafb00cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb610e700 1 -- 172.21.15.153:0/1049659901 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafb015e080 msgr2=0x7fafb00cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb610e700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafb015e080 0x7fafb00cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb610e700 1 -- 172.21.15.153:0/1049659901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafb00af4d0 msgr2=0x7fafb015e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb610e700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafb00af4d0 0x7fafb015e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb610e700 1 -- 172.21.15.153:0/1049659901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0094a0 con 0x7fafb006c710 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb610e700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafb006c710 0x7fafb01465e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c550 tx=0x7fafa000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafa6ffd700 1 -- 172.21.15.153:0/1049659901 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00054e0 con 0x7fafb006c710 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafa6ffd700 1 -- 172.21.15.153:0/1049659901 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0003680 con 0x7fafb006c710 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafb8372700 1 -- 172.21.15.153:0/1049659901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb0154280 con 0x7fafb006c710 2023-11-24T08:07:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.824+0000 7fafa6ffd700 1 -- 172.21.15.153:0/1049659901 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0003a30 con 0x7fafb006c710 2023-11-24T08:07:21.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.825+0000 7fafb8372700 1 -- 172.21.15.153:0/1049659901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb0154840 con 0x7fafb006c710 2023-11-24T08:07:21.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.825+0000 7fafb8372700 1 -- 172.21.15.153:0/1049659901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb00753f0 con 0x7fafb006c710 2023-11-24T08:07:21.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.826+0000 7fafa6ffd700 1 -- 172.21.15.153:0/1049659901 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fafa0003b90 con 0x7fafb006c710 2023-11-24T08:07:21.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.826+0000 7fafa6ffd700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf9406b080 0x7faf9406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.826+0000 7fafb590d700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf9406b080 0x7faf9406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.826+0000 7fafa6ffd700 1 -- 172.21.15.153:0/1049659901 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafa0088d90 con 0x7fafb006c710 2023-11-24T08:07:21.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.827+0000 7fafb590d700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf9406b080 0x7faf9406d540 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fafac009fd0 tx=0x7fafac01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:21.831+0000 7fafa6ffd700 1 -- 172.21.15.153:0/1049659901 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafa0053bc0 con 0x7fafb006c710 2023-11-24T08:07:22.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.016+0000 7fafb8372700 1 -- 172.21.15.153:0/1049659901 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fafb0154110 con 0x7faf9406b080 2023-11-24T08:07:22.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.023+0000 7fafa6ffd700 1 -- 172.21.15.153:0/1049659901 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274449 (secure 0 0 0) 0x7fafb0154110 con 0x7faf9406b080 2023-11-24T08:07:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:22.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 -- 172.21.15.153:0/1049659901 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf9406b080 msgr2=0x7faf9406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf9406b080 0x7faf9406d540 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fafac009fd0 tx=0x7fafac01c040 comp rx=0 tx=0).stop 2023-11-24T08:07:22.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 -- 172.21.15.153:0/1049659901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafb006c710 msgr2=0x7fafb01465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafb006c710 0x7fafb01465e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c550 tx=0x7fafa000c910 comp rx=0 tx=0).stop 2023-11-24T08:07:22.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 -- 172.21.15.153:0/1049659901 shutdown_connections 2023-11-24T08:07:22.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafb015e080 0x7fafb00cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7faf9406b080 0x7faf9406d540 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafb006c710 0x7fafb01465e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 --2- 172.21.15.153:0/1049659901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafb00af4d0 0x7fafb015e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 -- 172.21.15.153:0/1049659901 >> 172.21.15.153:0/1049659901 conn(0x7fafb0071b90 msgr2=0x7fafb00b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 -- 172.21.15.153:0/1049659901 shutdown_connections 2023-11-24T08:07:22.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.026+0000 7fafb8372700 1 -- 172.21.15.153:0/1049659901 wait complete. 2023-11-24T08:07:22.031 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:07:22.040 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-11-24T08:07:20.082015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222212,"kb_used_data":6020,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752508,"statfs":{"total":773094113280,"available":772866568192,"internally_reserved":0,"allocated":6164480,"data_stored":3202117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.917683"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:16.163949+0000","last_change":"2023-11-24T08:07:16.163949+0000","last_active":"2023-11-24T08:07:16.163949+0000","last_peered":"2023-11-24T08:07:16.163949+0000","last_clean":"2023-11-24T08:07:16.163949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:16.163949+0000","last_undegraded":"2023-11-24T08:07:16.163949+0000","last_fullsized":"2023-11-24T08:07:16.163949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:07:15.162118+0000","last_change":"2023-11-24T08:07:15.162118+0000","last_active":"2023-11-24T08:07:15.162118+0000","last_peered":"2023-11-24T08:07:15.162118+0000","last_clean":"2023-11-24T08:07:15.162118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:07:15.162118+0000","last_undegraded":"2023-11-24T08:07:15.162118+0000","last_fullsized":"2023-11-24T08:07:15.162118+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T08:07:13.104236+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:07:13.104236+0000","last_peered":"2023-11-24T08:07:13.104236+0000","last_clean":"2023-11-24T08:07:13.104236+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:07:13.104236+0000","last_undegraded":"2023-11-24T08:07:13.104236+0000","last_fullsized":"2023-11-24T08:07:13.104236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28216,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1216512,"data_stored":843168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72199999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.073,"15min":1.073},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.85299999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.33200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":10.285,"15min":10.285},"last":0.442}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.30299999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.371},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.745,"5min":2.089,"15min":2.089},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68400000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.496}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.48499999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.747,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.27100000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.317}]},{"osd":2,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33300000000000002,"15min":0.31900000000000001},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.371},{"interface":"front","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.626,"15min":0.626},"last":0.28499999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.54000000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.5,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60699999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1659999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.623},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1212416,"data_stored":842149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.224}]},{"osd":2,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.625,"5min":1.343,"15min":1.343},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61299999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.33400000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78600000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.60399999999999998,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.93200000000000005,"15min":1.0720000000000001},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82499999999999996,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.032,"15min":1.204},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":4,"15min":4},"last":0.503}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.316,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.497,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.44,"15min":0.47199999999999998},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53600000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61799999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.501}]},{"osd":3,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.59099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":5.673,"15min":5.673},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":1.216,"15min":1.216},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.246,"15min":1.246},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.82699999999999996},"min":{"1min":0.503,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.82999999999999996},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82099999999999995,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.88},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.758,"15min":5.758},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.89000000000000001},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":5.726,"15min":5.726},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.499,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.85699999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.80300000000000005,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89400000000000002,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.94899999999999995},"min":{"1min":0.52000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99399999999999999,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.39600000000000002},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.59699999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58799999999999997,"5min":1.351,"15min":1.351},"last":0.372}]},{"osd":1,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40100000000000002,"15min":0.42699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.503,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.745,"5min":1.621,"15min":1.621},"last":0.315}]},{"osd":2,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.439},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63900000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45800000000000002,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64500000000000002,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80500000000000005,"5min":1.389,"15min":1.389},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90700000000000003,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.675,"15min":1.675},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":1.417,"15min":1.417},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.67100000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95899999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.56899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.5},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.46899999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77100000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":1.101,"15min":1.101},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.433}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.34699999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":1.476,"15min":1.476},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.751,"5min":1.556,"15min":1.556},"last":0.55100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":252800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.499},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":1,"15min":1},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.77300000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":0.752},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.624}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:22.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-11-24T08:07:22.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-11-24T08:07:22.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-11-24T08:07:22.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-11-24T08:07:22.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-11-24T08:07:22.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-11-24T08:07:22.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-11-24T08:07:22.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-11-24T08:07:22.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-11-24T08:07:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-11-24T08:07:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-11-24T08:07:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-11-24T08:07:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-11-24T08:07:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-11-24T08:07:22.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-11-24T08:07:22.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-11-24T08:07:22.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-11-24T08:07:22.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-11-24T08:07:22.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-11-24T08:07:22.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-11-24T08:07:22.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-11-24T08:07:22.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-11-24T08:07:22.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-11-24T08:07:22.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-11-24T08:07:22.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-11-24T08:07:22.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-11-24T08:07:22.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-11-24T08:07:22.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-11-24T08:07:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-11-24T08:07:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-11-24T08:07:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-11-24T08:07:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-11-24T08:07:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-11-24T08:07:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-11-24T08:07:22.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-11-24T08:07:22.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-11-24T08:07:22.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-11-24T08:07:22.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-11-24T08:07:22.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-11-24T08:07:22.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-11-24T08:07:22.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-11-24T08:07:22.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-11-24T08:07:22.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-11-24T08:07:22.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-11-24T08:07:22.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-11-24T08:07:22.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-11-24T08:07:22.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-11-24T08:07:22.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-11-24T08:07:22.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-11-24T08:07:22.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-11-24T08:07:22.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-11-24T08:07:22.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-11-24T08:07:22.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-11-24T08:07:22.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-11-24T08:07:22.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-11-24T08:07:22.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-11-24T08:07:22.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-11-24T08:07:22.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-11-24T08:07:22.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-11-24T08:07:22.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-11-24T08:07:22.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-11-24T08:07:22.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-11-24T08:07:22.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-11-24T08:07:22.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-11-24T08:07:22.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-11-24T08:07:22.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-11-24T08:07:22.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-11-24T08:07:22.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-11-24T08:07:22.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-11-24T08:07:22.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-11-24T08:07:22.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-11-24T08:07:22.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-11-24T08:07:22.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-11-24T08:07:22.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-11-24T08:07:22.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-11-24T08:07:22.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-11-24T08:07:22.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-11-24T08:07:22.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-11-24T08:07:22.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-11-24T08:07:22.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-11-24T08:07:22.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-11-24T08:07:22.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-11-24T08:07:22.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-11-24T08:07:22.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-11-24T08:07:22.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-11-24T08:07:22.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-11-24T08:07:22.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-11-24T08:07:22.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-11-24T08:07:22.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-11-24T08:07:22.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-11-24T08:07:22.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-11-24T08:07:22.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-11-24T08:07:22.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-11-24T08:07:22.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-11-24T08:07:22.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-11-24T08:07:22.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:16.163949+0000', 'last_change': '2023-11-24T08:07:16.163949+0000', 'last_active': '2023-11-24T08:07:16.163949+0000', 'last_peered': '2023-11-24T08:07:16.163949+0000', 'last_clean': '2023-11-24T08:07:16.163949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:16.163949+0000', 'last_undegraded': '2023-11-24T08:07:16.163949+0000', 'last_fullsized': '2023-11-24T08:07:16.163949+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:16.163949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-11-24T08:07:22.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T08:07:15.162118+0000', 'last_change': '2023-11-24T08:07:15.162118+0000', 'last_active': '2023-11-24T08:07:15.162118+0000', 'last_peered': '2023-11-24T08:07:15.162118+0000', 'last_clean': '2023-11-24T08:07:15.162118+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:07:15.162118+0000', 'last_undegraded': '2023-11-24T08:07:15.162118+0000', 'last_fullsized': '2023-11-24T08:07:15.162118+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'last_clean_scrub_stamp': '2023-11-24T08:07:15.162118+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T08:07:22.065 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-24T08:07:22.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.199+0000 7f88071c9700 1 Processor -- start 2023-11-24T08:07:22.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.200+0000 7f88071c9700 1 -- start start 2023-11-24T08:07:22.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.200+0000 7f88071c9700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f880015e1e0 0x7f88000d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.200+0000 7f88071c9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88000d0f80 0x7f88000b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.200+0000 7f88071c9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88000d20b0 con 0x7f88000d3a00 2023-11-24T08:07:22.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.200+0000 7f88071c9700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88000d3150 con 0x7f880015e1e0 2023-11-24T08:07:22.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.200+0000 7f88071c9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880015e5c0 con 0x7f88000d0f80 2023-11-24T08:07:22.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.201+0000 7f8804f65700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f880015e1e0 0x7f88000d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.201+0000 7f8805766700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88000d0f80 0x7f88000b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.201+0000 7f8804f65700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f880015e1e0 0x7f88000d34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:32944/0 (socket says 172.21.15.153:32944) 2023-11-24T08:07:22.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.201+0000 7f8804f65700 1 -- 172.21.15.153:0/2153007321 learned_addr learned my addr 172.21.15.153:0/2153007321 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:22.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.201+0000 7f8805766700 1 -- 172.21.15.153:0/2153007321 >> v2:172.21.15.164:3300/0 conn(0x7f880015e1e0 msgr2=0x7f88000d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:22.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.201+0000 7f8805766700 1 --2- 172.21.15.153:0/2153007321 >> v2:172.21.15.164:3300/0 conn(0x7f880015e1e0 0x7f88000d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.201+0000 7f8805766700 1 -- 172.21.15.153:0/2153007321 >> v1:172.21.15.164:6789/0 conn(0x7f88000d3a00 legacy=0x7f88000d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.201+0000 7f8805766700 1 -- 172.21.15.153:0/2153007321 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88000d2390 con 0x7f88000d0f80 2023-11-24T08:07:22.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.201+0000 7f8804f65700 1 --2- 172.21.15.153:0/2153007321 >> v2:172.21.15.164:3300/0 conn(0x7f880015e1e0 0x7f88000d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:22.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.201+0000 7f8805766700 1 --2- 172.21.15.153:0/2153007321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88000d0f80 0x7f88000b6ef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009d90 tx=0x7f87f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84d9dddde384ce57 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.203+0000 7f87ff7fe700 1 -- 172.21.15.153:0/2153007321 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f800e070 con 0x7f88000d0f80 2023-11-24T08:07:22.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.203+0000 7f87ff7fe700 1 -- 172.21.15.153:0/2153007321 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f800bb20 con 0x7f88000d0f80 2023-11-24T08:07:22.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.203+0000 7f87ff7fe700 1 -- 172.21.15.153:0/2153007321 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8012430 con 0x7f88000d0f80 2023-11-24T08:07:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.204+0000 7f88071c9700 1 -- 172.21.15.153:0/2153007321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88000d0f80 msgr2=0x7f88000b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.204+0000 7f88071c9700 1 --2- 172.21.15.153:0/2153007321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88000d0f80 0x7f88000b6ef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009d90 tx=0x7f87f800b330 comp rx=0 tx=0).stop 2023-11-24T08:07:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.204+0000 7f88071c9700 1 -- 172.21.15.153:0/2153007321 shutdown_connections 2023-11-24T08:07:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.204+0000 7f88071c9700 1 --2- 172.21.15.153:0/2153007321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88000d0f80 0x7f88000b6ef0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.204+0000 7f88071c9700 1 --2- 172.21.15.153:0/2153007321 >> v2:172.21.15.164:3300/0 conn(0x7f880015e1e0 0x7f88000d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.204+0000 7f88071c9700 1 -- 172.21.15.153:0/2153007321 >> 172.21.15.153:0/2153007321 conn(0x7f88000b5b50 msgr2=0x7f88000b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.204+0000 7f88071c9700 1 -- 172.21.15.153:0/2153007321 shutdown_connections 2023-11-24T08:07:22.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.204+0000 7f88071c9700 1 -- 172.21.15.153:0/2153007321 wait complete. 2023-11-24T08:07:22.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.205+0000 7f88071c9700 1 Processor -- start 2023-11-24T08:07:22.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.205+0000 7f88071c9700 1 -- start start 2023-11-24T08:07:22.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.206+0000 7f88071c9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88000d0f80 0x7f88001f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.206+0000 7f88071c9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88000d3a00 0x7f88001f7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.206+0000 7f88071c9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f880015e1e0 0x7f8800160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.206+0000 7f88071c9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88001612d0 con 0x7f88000d3a00 2023-11-24T08:07:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.206+0000 7f88071c9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88001f3e70 con 0x7f88000d0f80 2023-11-24T08:07:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.206+0000 7f88071c9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88001f4150 con 0x7f880015e1e0 2023-11-24T08:07:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.206+0000 7f87fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88000d3a00 0x7f88001f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.206+0000 7f87fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88000d3a00 0x7f88001f7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39598/0 (socket says 172.21.15.153:39598) 2023-11-24T08:07:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.206+0000 7f87fffff700 1 -- 172.21.15.153:0/168801032 learned_addr learned my addr 172.21.15.153:0/168801032 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.206+0000 7f8804f65700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88000d0f80 0x7f88001f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.206+0000 7f8805766700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f880015e1e0 0x7f8800160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.207+0000 7f87fffff700 1 -- 172.21.15.153:0/168801032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f880015e1e0 msgr2=0x7f8800160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.207+0000 7f87fffff700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f880015e1e0 0x7f8800160560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.207+0000 7f87fffff700 1 -- 172.21.15.153:0/168801032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88000d0f80 msgr2=0x7f88001f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.207+0000 7f87fffff700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88000d0f80 0x7f88001f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.207+0000 7f87fffff700 1 -- 172.21.15.153:0/168801032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f4009550 con 0x7f88000d3a00 2023-11-24T08:07:22.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.207+0000 7f87fffff700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88000d3a00 0x7f88001f7820 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00c500 tx=0x7f87ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.207+0000 7f87fd7fa700 1 -- 172.21.15.153:0/168801032 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0052d0 con 0x7f88000d3a00 2023-11-24T08:07:22.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.207+0000 7f87fd7fa700 1 -- 172.21.15.153:0/168801032 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec005430 con 0x7f88000d3a00 2023-11-24T08:07:22.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.207+0000 7f88071c9700 1 -- 172.21.15.153:0/168801032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f8009a70 con 0x7f88000d3a00 2023-11-24T08:07:22.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.207+0000 7f87fd7fa700 1 -- 172.21.15.153:0/168801032 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec006aa0 con 0x7f88000d3a00 2023-11-24T08:07:22.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.207+0000 7f88071c9700 1 -- 172.21.15.153:0/168801032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88001f4710 con 0x7f88000d3a00 2023-11-24T08:07:22.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.208+0000 7f88071c9700 1 -- 172.21.15.153:0/168801032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88000751e0 con 0x7f88000d3a00 2023-11-24T08:07:22.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.208+0000 7f87fd7fa700 1 -- 172.21.15.153:0/168801032 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f87ec003680 con 0x7f88000d3a00 2023-11-24T08:07:22.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.209+0000 7f87fd7fa700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f87e406b080 0x7f87e406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.209+0000 7f87fd7fa700 1 -- 172.21.15.153:0/168801032 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87ec088c50 con 0x7f88000d3a00 2023-11-24T08:07:22.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.209+0000 7f8804f65700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f87e406b080 0x7f87e406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.209+0000 7f8804f65700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f87e406b080 0x7f87e406d540 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009c50 tx=0x7f87f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.213+0000 7f87fd7fa700 1 -- 172.21.15.153:0/168801032 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87ec08e020 con 0x7f88000d3a00 2023-11-24T08:07:22.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.482+0000 7f88071c9700 1 -- 172.21.15.153:0/168801032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f88000624a0 con 0x7f88000d3a00 2023-11-24T08:07:22.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.483+0000 7f87fd7fa700 1 -- 172.21.15.153:0/168801032 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7f87ec0539f0 con 0x7f88000d3a00 2023-11-24T08:07:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:22.485 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":208,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1700813045,"num_in_osds":8,"osd_in_since":1700813036,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":227971072,"bytes_avail":772866142208,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":36,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6090}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-24T08:06:52.076575+0000","services":{}},"progress_events":{}} 2023-11-24T08:07:22.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.484+0000 7f88071c9700 1 -- 172.21.15.153:0/168801032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f87e406b080 msgr2=0x7f87e406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.484+0000 7f88071c9700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f87e406b080 0x7f87e406d540 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009c50 tx=0x7f87f4008040 comp rx=0 tx=0).stop 2023-11-24T08:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.484+0000 7f88071c9700 1 -- 172.21.15.153:0/168801032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88000d3a00 msgr2=0x7f88001f7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.484+0000 7f88071c9700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88000d3a00 0x7f88001f7820 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00c500 tx=0x7f87ec00c8c0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.485+0000 7f88071c9700 1 -- 172.21.15.153:0/168801032 shutdown_connections 2023-11-24T08:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.485+0000 7f88071c9700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f880015e1e0 0x7f8800160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.485+0000 7f88071c9700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88000d0f80 0x7f88001f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.485+0000 7f88071c9700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f87e406b080 0x7f87e406d540 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.485+0000 7f88071c9700 1 --2- 172.21.15.153:0/168801032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88000d3a00 0x7f88001f7820 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.485+0000 7f88071c9700 1 -- 172.21.15.153:0/168801032 >> 172.21.15.153:0/168801032 conn(0x7f88000b5b50 msgr2=0x7f88000b7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.485+0000 7f88071c9700 1 -- 172.21.15.153:0/168801032 shutdown_connections 2023-11-24T08:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.485+0000 7f88071c9700 1 -- 172.21.15.153:0/168801032 wait complete. 2023-11-24T08:07:22.498 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-24T08:07:22.499 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:22.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.618+0000 7f2e7a285700 1 Processor -- start 2023-11-24T08:07:22.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.618+0000 7f2e7a285700 1 -- start start 2023-11-24T08:07:22.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.618+0000 7f2e7a285700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e7415c160 0x7f2e740622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.618+0000 7f2e7a285700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2e740b2870 0x7f2e740afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.618+0000 7f2e7a285700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e740b02e0 0x7f2e740ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.618+0000 7f2e7a285700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740b2cf0 con 0x7f2e740b02e0 2023-11-24T08:07:22.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.618+0000 7f2e7a285700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740b0770 con 0x7f2e740b2870 2023-11-24T08:07:22.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.618+0000 7f2e7a285700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7415c540 con 0x7f2e7415c160 2023-11-24T08:07:22.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e78822700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e740b02e0 0x7f2e740ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e78822700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e740b02e0 0x7f2e740ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39608/0 (socket says 172.21.15.153:39608) 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e78822700 1 -- 172.21.15.153:0/3476622970 learned_addr learned my addr 172.21.15.153:0/3476622970 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e737fe700 1 --2- 172.21.15.153:0/3476622970 >> v2:172.21.15.164:3300/0 conn(0x7f2e740b2870 0x7f2e740afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e73fff700 1 --2- 172.21.15.153:0/3476622970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e7415c160 0x7f2e740622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e78822700 1 -- 172.21.15.153:0/3476622970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e7415c160 msgr2=0x7f2e740622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e78822700 1 --2- 172.21.15.153:0/3476622970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e7415c160 0x7f2e740622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e78822700 1 -- 172.21.15.153:0/3476622970 >> v2:172.21.15.164:3300/0 conn(0x7f2e740b2870 msgr2=0x7f2e740afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e78822700 1 --2- 172.21.15.153:0/3476622970 >> v2:172.21.15.164:3300/0 conn(0x7f2e740b2870 0x7f2e740afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e78822700 1 -- 172.21.15.153:0/3476622970 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e740b2ee0 con 0x7f2e740b02e0 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e737fe700 1 --2- 172.21.15.153:0/3476622970 >> v2:172.21.15.164:3300/0 conn(0x7f2e740b2870 0x7f2e740afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e73fff700 1 --2- 172.21.15.153:0/3476622970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e7415c160 0x7f2e740622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e78822700 1 --2- 172.21.15.153:0/3476622970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740b02e0 0x7f2e740ae1d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2e740b55e0 tx=0x7f2e6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88caa2fcbbfcaa58 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e72ffd700 1 -- 172.21.15.153:0/3476622970 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00e070 con 0x7f2e740b02e0 2023-11-24T08:07:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e72ffd700 1 -- 172.21.15.153:0/3476622970 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c00b980 con 0x7f2e740b02e0 2023-11-24T08:07:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.619+0000 7f2e72ffd700 1 -- 172.21.15.153:0/3476622970 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00bd30 con 0x7f2e740b02e0 2023-11-24T08:07:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.620+0000 7f2e7a285700 1 -- 172.21.15.153:0/3476622970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740b02e0 msgr2=0x7f2e740ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.620+0000 7f2e7a285700 1 --2- 172.21.15.153:0/3476622970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740b02e0 0x7f2e740ae1d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2e740b55e0 tx=0x7f2e6c00b330 comp rx=0 tx=0).stop 2023-11-24T08:07:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.620+0000 7f2e7a285700 1 -- 172.21.15.153:0/3476622970 shutdown_connections 2023-11-24T08:07:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.620+0000 7f2e7a285700 1 --2- 172.21.15.153:0/3476622970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740b02e0 0x7f2e740ae1d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.620+0000 7f2e7a285700 1 --2- 172.21.15.153:0/3476622970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e7415c160 0x7f2e740622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.620+0000 7f2e7a285700 1 --2- 172.21.15.153:0/3476622970 >> v2:172.21.15.164:3300/0 conn(0x7f2e740b2870 0x7f2e740afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.620+0000 7f2e7a285700 1 -- 172.21.15.153:0/3476622970 >> 172.21.15.153:0/3476622970 conn(0x7f2e740b57b0 msgr2=0x7f2e740b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.620+0000 7f2e7a285700 1 -- 172.21.15.153:0/3476622970 shutdown_connections 2023-11-24T08:07:22.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.620+0000 7f2e7a285700 1 -- 172.21.15.153:0/3476622970 wait complete. 2023-11-24T08:07:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.621+0000 7f2e7a285700 1 Processor -- start 2023-11-24T08:07:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.621+0000 7f2e7a285700 1 -- start start 2023-11-24T08:07:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e7a285700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e740b02e0 0x7f2e7414d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e7a285700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740b2870 0x7f2e74157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e7a285700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e7415c160 0x7f2e74159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e7a285700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7414ebe0 con 0x7f2e740b2870 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e7a285700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74158240 con 0x7f2e740b02e0 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e7a285700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741584e0 con 0x7f2e7415c160 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e737fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740b2870 0x7f2e74157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e737fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740b2870 0x7f2e74157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39612/0 (socket says 172.21.15.153:39612) 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e737fe700 1 -- 172.21.15.153:0/2331833944 learned_addr learned my addr 172.21.15.153:0/2331833944 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e737fe700 1 -- 172.21.15.153:0/2331833944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e7415c160 msgr2=0x7f2e74159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e737fe700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e7415c160 0x7f2e74159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e737fe700 1 -- 172.21.15.153:0/2331833944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e740b02e0 msgr2=0x7f2e7414d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e737fe700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e740b02e0 0x7f2e7414d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e737fe700 1 -- 172.21.15.153:0/2331833944 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c009b30 con 0x7f2e740b2870 2023-11-24T08:07:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e737fe700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740b2870 0x7f2e74157d00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c740 tx=0x7f2e6800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e70ff9700 1 -- 172.21.15.153:0/2331833944 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68011800 con 0x7f2e740b2870 2023-11-24T08:07:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.622+0000 7f2e70ff9700 1 -- 172.21.15.153:0/2331833944 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68011960 con 0x7f2e740b2870 2023-11-24T08:07:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.623+0000 7f2e7a285700 1 -- 172.21.15.153:0/2331833944 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e741587c0 con 0x7f2e740b2870 2023-11-24T08:07:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.623+0000 7f2e70ff9700 1 -- 172.21.15.153:0/2331833944 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68011cd0 con 0x7f2e740b2870 2023-11-24T08:07:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.623+0000 7f2e7a285700 1 -- 172.21.15.153:0/2331833944 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e74158aa0 con 0x7f2e740b2870 2023-11-24T08:07:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.623+0000 7f2e7a285700 1 -- 172.21.15.153:0/2331833944 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e74067f60 con 0x7f2e740b2870 2023-11-24T08:07:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.624+0000 7f2e70ff9700 1 -- 172.21.15.153:0/2331833944 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2e68021350 con 0x7f2e740b2870 2023-11-24T08:07:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.624+0000 7f2e70ff9700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2e6006b080 0x7f2e6006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.624+0000 7f2e70ff9700 1 -- 172.21.15.153:0/2331833944 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e680899b0 con 0x7f2e740b2870 2023-11-24T08:07:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.625+0000 7f2e73fff700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2e6006b080 0x7f2e6006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.625+0000 7f2e73fff700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2e6006b080 0x7f2e6006d540 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400a8b0 tx=0x7f2e64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.629+0000 7f2e70ff9700 1 -- 172.21.15.153:0/2331833944 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e680546e0 con 0x7f2e740b2870 2023-11-24T08:07:22.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.815+0000 7f2e7a285700 1 -- 172.21.15.153:0/2331833944 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e740ad6f0 con 0x7f2e6006b080 2023-11-24T08:07:22.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.823+0000 7f2e70ff9700 1 -- 172.21.15.153:0/2331833944 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289201 (secure 0 0 0) 0x7f2e640113d0 con 0x7f2e6006b080 2023-11-24T08:07:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:22.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 -- 172.21.15.153:0/2331833944 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2e6006b080 msgr2=0x7f2e6006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2e6006b080 0x7f2e6006d540 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400a8b0 tx=0x7f2e64008040 comp rx=0 tx=0).stop 2023-11-24T08:07:22.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 -- 172.21.15.153:0/2331833944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740b2870 msgr2=0x7f2e74157d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740b2870 0x7f2e74157d00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c740 tx=0x7f2e6800cb00 comp rx=0 tx=0).stop 2023-11-24T08:07:22.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 -- 172.21.15.153:0/2331833944 shutdown_connections 2023-11-24T08:07:22.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e7415c160 0x7f2e74159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e740b02e0 0x7f2e7414d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2e6006b080 0x7f2e6006d540 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 --2- 172.21.15.153:0/2331833944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740b2870 0x7f2e74157d00 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 -- 172.21.15.153:0/2331833944 >> 172.21.15.153:0/2331833944 conn(0x7f2e740b57b0 msgr2=0x7f2e740ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 -- 172.21.15.153:0/2331833944 shutdown_connections 2023-11-24T08:07:22.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:22.826+0000 7f2e7a285700 1 -- 172.21.15.153:0/2331833944 wait complete. 2023-11-24T08:07:22.831 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:07:22.840 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-11-24T08:07:22.082475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222628,"kb_used_data":6432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752092,"statfs":{"total":773094113280,"available":772866142208,"internally_reserved":0,"allocated":6586368,"data_stored":3389309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001096"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.212434+0000","last_change":"2023-11-24T08:07:17.207652+0000","last_active":"2023-11-24T08:07:17.212434+0000","last_peered":"2023-11-24T08:07:17.212434+0000","last_clean":"2023-11-24T08:07:17.212434+0000","last_became_active":"2023-11-24T08:07:17.207303+0000","last_became_peered":"2023-11-24T08:07:17.207303+0000","last_unstale":"2023-11-24T08:07:17.212434+0000","last_undegraded":"2023-11-24T08:07:17.212434+0000","last_fullsized":"2023-11-24T08:07:17.212434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:20.215715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.211897+0000","last_change":"2023-11-24T08:07:17.208978+0000","last_active":"2023-11-24T08:07:17.211897+0000","last_peered":"2023-11-24T08:07:17.211897+0000","last_clean":"2023-11-24T08:07:17.211897+0000","last_became_active":"2023-11-24T08:07:17.208688+0000","last_became_peered":"2023-11-24T08:07:17.208688+0000","last_unstale":"2023-11-24T08:07:17.211897+0000","last_undegraded":"2023-11-24T08:07:17.211897+0000","last_fullsized":"2023-11-24T08:07:17.211897+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:30:59.074224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804293+0000","last_change":"2023-11-24T08:07:17.189819+0000","last_active":"2023-11-24T08:07:18.804293+0000","last_peered":"2023-11-24T08:07:18.804293+0000","last_clean":"2023-11-24T08:07:18.804293+0000","last_became_active":"2023-11-24T08:07:17.189536+0000","last_became_peered":"2023-11-24T08:07:17.189536+0000","last_unstale":"2023-11-24T08:07:18.804293+0000","last_undegraded":"2023-11-24T08:07:18.804293+0000","last_fullsized":"2023-11-24T08:07:18.804293+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:35.365864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207862+0000","last_change":"2023-11-24T08:07:17.195442+0000","last_active":"2023-11-24T08:07:19.207862+0000","last_peered":"2023-11-24T08:07:19.207862+0000","last_clean":"2023-11-24T08:07:19.207862+0000","last_became_active":"2023-11-24T08:07:17.195138+0000","last_became_peered":"2023-11-24T08:07:17.195138+0000","last_unstale":"2023-11-24T08:07:19.207862+0000","last_undegraded":"2023-11-24T08:07:19.207862+0000","last_fullsized":"2023-11-24T08:07:19.207862+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:38.869591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.200313+0000","last_change":"2023-11-24T08:07:17.194043+0000","last_active":"2023-11-24T08:07:17.200313+0000","last_peered":"2023-11-24T08:07:17.200313+0000","last_clean":"2023-11-24T08:07:17.200313+0000","last_became_active":"2023-11-24T08:07:17.193750+0000","last_became_peered":"2023-11-24T08:07:17.193750+0000","last_unstale":"2023-11-24T08:07:17.200313+0000","last_undegraded":"2023-11-24T08:07:17.200313+0000","last_fullsized":"2023-11-24T08:07:17.200313+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:14:51.871767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188669+0000","last_change":"2023-11-24T08:07:17.199275+0000","last_active":"2023-11-24T08:07:18.188669+0000","last_peered":"2023-11-24T08:07:18.188669+0000","last_clean":"2023-11-24T08:07:18.188669+0000","last_became_active":"2023-11-24T08:07:17.199000+0000","last_became_peered":"2023-11-24T08:07:17.199000+0000","last_unstale":"2023-11-24T08:07:18.188669+0000","last_undegraded":"2023-11-24T08:07:18.188669+0000","last_fullsized":"2023-11-24T08:07:18.188669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:40.760439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189316+0000","last_change":"2023-11-24T08:07:17.190049+0000","last_active":"2023-11-24T08:07:18.189316+0000","last_peered":"2023-11-24T08:07:18.189316+0000","last_clean":"2023-11-24T08:07:18.189316+0000","last_became_active":"2023-11-24T08:07:17.189806+0000","last_became_peered":"2023-11-24T08:07:17.189806+0000","last_unstale":"2023-11-24T08:07:18.189316+0000","last_undegraded":"2023-11-24T08:07:18.189316+0000","last_fullsized":"2023-11-24T08:07:18.189316+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:20.792379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.207941+0000","last_change":"2023-11-24T08:07:17.205410+0000","last_active":"2023-11-24T08:07:17.207941+0000","last_peered":"2023-11-24T08:07:17.207941+0000","last_clean":"2023-11-24T08:07:17.207941+0000","last_became_active":"2023-11-24T08:07:17.204847+0000","last_became_peered":"2023-11-24T08:07:17.204847+0000","last_unstale":"2023-11-24T08:07:17.207941+0000","last_undegraded":"2023-11-24T08:07:17.207941+0000","last_fullsized":"2023-11-24T08:07:17.207941+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:38.869591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.190065+0000","last_change":"2023-11-24T08:07:17.196920+0000","last_active":"2023-11-24T08:07:18.190065+0000","last_peered":"2023-11-24T08:07:18.190065+0000","last_clean":"2023-11-24T08:07:18.190065+0000","last_became_active":"2023-11-24T08:07:17.196650+0000","last_became_peered":"2023-11-24T08:07:17.196650+0000","last_unstale":"2023-11-24T08:07:18.190065+0000","last_undegraded":"2023-11-24T08:07:18.190065+0000","last_fullsized":"2023-11-24T08:07:18.190065+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:04.463252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.203346+0000","last_change":"2023-11-24T08:07:17.191041+0000","last_active":"2023-11-24T08:07:17.203346+0000","last_peered":"2023-11-24T08:07:17.203346+0000","last_clean":"2023-11-24T08:07:17.203346+0000","last_became_active":"2023-11-24T08:07:17.190785+0000","last_became_peered":"2023-11-24T08:07:17.190785+0000","last_unstale":"2023-11-24T08:07:17.203346+0000","last_undegraded":"2023-11-24T08:07:17.203346+0000","last_fullsized":"2023-11-24T08:07:17.203346+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:46.246053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.211640+0000","last_change":"2023-11-24T08:07:17.207106+0000","last_active":"2023-11-24T08:07:17.211640+0000","last_peered":"2023-11-24T08:07:17.211640+0000","last_clean":"2023-11-24T08:07:17.211640+0000","last_became_active":"2023-11-24T08:07:17.206817+0000","last_became_peered":"2023-11-24T08:07:17.206817+0000","last_unstale":"2023-11-24T08:07:17.211640+0000","last_undegraded":"2023-11-24T08:07:17.211640+0000","last_fullsized":"2023-11-24T08:07:17.211640+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:30.783303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208075+0000","last_change":"2023-11-24T08:07:17.187544+0000","last_active":"2023-11-24T08:07:19.208075+0000","last_peered":"2023-11-24T08:07:19.208075+0000","last_clean":"2023-11-24T08:07:19.208075+0000","last_became_active":"2023-11-24T08:07:17.187258+0000","last_became_peered":"2023-11-24T08:07:17.187258+0000","last_unstale":"2023-11-24T08:07:19.208075+0000","last_undegraded":"2023-11-24T08:07:19.208075+0000","last_fullsized":"2023-11-24T08:07:19.208075+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:24.288792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206462+0000","last_change":"2023-11-24T08:07:17.193544+0000","last_active":"2023-11-24T08:07:18.206462+0000","last_peered":"2023-11-24T08:07:18.206462+0000","last_clean":"2023-11-24T08:07:18.206462+0000","last_became_active":"2023-11-24T08:07:17.193154+0000","last_became_peered":"2023-11-24T08:07:17.193154+0000","last_unstale":"2023-11-24T08:07:18.206462+0000","last_undegraded":"2023-11-24T08:07:18.206462+0000","last_fullsized":"2023-11-24T08:07:18.206462+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:38.225244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189547+0000","last_change":"2023-11-24T08:07:17.196815+0000","last_active":"2023-11-24T08:07:18.189547+0000","last_peered":"2023-11-24T08:07:18.189547+0000","last_clean":"2023-11-24T08:07:18.189547+0000","last_became_active":"2023-11-24T08:07:17.196512+0000","last_became_peered":"2023-11-24T08:07:17.196512+0000","last_unstale":"2023-11-24T08:07:18.189547+0000","last_undegraded":"2023-11-24T08:07:18.189547+0000","last_fullsized":"2023-11-24T08:07:18.189547+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:18.667181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189367+0000","last_change":"2023-11-24T08:07:17.190518+0000","last_active":"2023-11-24T08:07:18.189367+0000","last_peered":"2023-11-24T08:07:18.189367+0000","last_clean":"2023-11-24T08:07:18.189367+0000","last_became_active":"2023-11-24T08:07:17.190263+0000","last_became_peered":"2023-11-24T08:07:17.190263+0000","last_unstale":"2023-11-24T08:07:18.189367+0000","last_undegraded":"2023-11-24T08:07:18.189367+0000","last_fullsized":"2023-11-24T08:07:18.189367+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:40:47.719972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188549+0000","last_change":"2023-11-24T08:07:17.193665+0000","last_active":"2023-11-24T08:07:18.188549+0000","last_peered":"2023-11-24T08:07:18.188549+0000","last_clean":"2023-11-24T08:07:18.188549+0000","last_became_active":"2023-11-24T08:07:17.193341+0000","last_became_peered":"2023-11-24T08:07:17.193341+0000","last_unstale":"2023-11-24T08:07:18.188549+0000","last_undegraded":"2023-11-24T08:07:18.188549+0000","last_fullsized":"2023-11-24T08:07:18.188549+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:20:27.189383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.209524+0000","last_change":"2023-11-24T08:07:17.206696+0000","last_active":"2023-11-24T08:07:17.209524+0000","last_peered":"2023-11-24T08:07:17.209524+0000","last_clean":"2023-11-24T08:07:17.209524+0000","last_became_active":"2023-11-24T08:07:17.206419+0000","last_became_peered":"2023-11-24T08:07:17.206419+0000","last_unstale":"2023-11-24T08:07:17.209524+0000","last_undegraded":"2023-11-24T08:07:17.209524+0000","last_fullsized":"2023-11-24T08:07:17.209524+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:07:09.020680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804470+0000","last_change":"2023-11-24T08:07:17.197464+0000","last_active":"2023-11-24T08:07:18.804470+0000","last_peered":"2023-11-24T08:07:18.804470+0000","last_clean":"2023-11-24T08:07:18.804470+0000","last_became_active":"2023-11-24T08:07:17.197082+0000","last_became_peered":"2023-11-24T08:07:17.197082+0000","last_unstale":"2023-11-24T08:07:18.804470+0000","last_undegraded":"2023-11-24T08:07:18.804470+0000","last_fullsized":"2023-11-24T08:07:18.804470+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:27.801456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.212416+0000","last_change":"2023-11-24T08:07:17.207499+0000","last_active":"2023-11-24T08:07:17.212416+0000","last_peered":"2023-11-24T08:07:17.212416+0000","last_clean":"2023-11-24T08:07:17.212416+0000","last_became_active":"2023-11-24T08:07:17.207197+0000","last_became_peered":"2023-11-24T08:07:17.207197+0000","last_unstale":"2023-11-24T08:07:17.212416+0000","last_undegraded":"2023-11-24T08:07:17.212416+0000","last_fullsized":"2023-11-24T08:07:17.212416+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:41:06.957211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.207897+0000","last_change":"2023-11-24T08:07:17.204353+0000","last_active":"2023-11-24T08:07:17.207897+0000","last_peered":"2023-11-24T08:07:17.207897+0000","last_clean":"2023-11-24T08:07:17.207897+0000","last_became_active":"2023-11-24T08:07:17.204083+0000","last_became_peered":"2023-11-24T08:07:17.204083+0000","last_unstale":"2023-11-24T08:07:17.207897+0000","last_undegraded":"2023-11-24T08:07:17.207897+0000","last_fullsized":"2023-11-24T08:07:17.207897+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:24.288792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804072+0000","last_change":"2023-11-24T08:07:17.185420+0000","last_active":"2023-11-24T08:07:18.804072+0000","last_peered":"2023-11-24T08:07:18.804072+0000","last_clean":"2023-11-24T08:07:18.804072+0000","last_became_active":"2023-11-24T08:07:17.185048+0000","last_became_peered":"2023-11-24T08:07:17.185048+0000","last_unstale":"2023-11-24T08:07:18.804072+0000","last_undegraded":"2023-11-24T08:07:18.804072+0000","last_fullsized":"2023-11-24T08:07:18.804072+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:40.760439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.207324+0000","last_change":"2023-11-24T08:07:17.199086+0000","last_active":"2023-11-24T08:07:17.207324+0000","last_peered":"2023-11-24T08:07:17.207324+0000","last_clean":"2023-11-24T08:07:17.207324+0000","last_became_active":"2023-11-24T08:07:17.198741+0000","last_became_peered":"2023-11-24T08:07:17.198741+0000","last_unstale":"2023-11-24T08:07:17.207324+0000","last_undegraded":"2023-11-24T08:07:17.207324+0000","last_fullsized":"2023-11-24T08:07:17.207324+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:27:18.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804202+0000","last_change":"2023-11-24T08:07:17.201344+0000","last_active":"2023-11-24T08:07:18.804202+0000","last_peered":"2023-11-24T08:07:18.804202+0000","last_clean":"2023-11-24T08:07:18.804202+0000","last_became_active":"2023-11-24T08:07:17.201114+0000","last_became_peered":"2023-11-24T08:07:17.201114+0000","last_unstale":"2023-11-24T08:07:18.804202+0000","last_undegraded":"2023-11-24T08:07:18.804202+0000","last_fullsized":"2023-11-24T08:07:18.804202+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:27:18.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206389+0000","last_change":"2023-11-24T08:07:17.193520+0000","last_active":"2023-11-24T08:07:18.206389+0000","last_peered":"2023-11-24T08:07:18.206389+0000","last_clean":"2023-11-24T08:07:18.206389+0000","last_became_active":"2023-11-24T08:07:17.193260+0000","last_became_peered":"2023-11-24T08:07:17.193260+0000","last_unstale":"2023-11-24T08:07:18.206389+0000","last_undegraded":"2023-11-24T08:07:18.206389+0000","last_fullsized":"2023-11-24T08:07:18.206389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:12:09.300685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.206977+0000","last_change":"2023-11-24T08:07:17.203324+0000","last_active":"2023-11-24T08:07:17.206977+0000","last_peered":"2023-11-24T08:07:17.206977+0000","last_clean":"2023-11-24T08:07:17.206977+0000","last_became_active":"2023-11-24T08:07:17.203041+0000","last_became_peered":"2023-11-24T08:07:17.203041+0000","last_unstale":"2023-11-24T08:07:17.206977+0000","last_undegraded":"2023-11-24T08:07:17.206977+0000","last_fullsized":"2023-11-24T08:07:17.206977+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:22.135745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208047+0000","last_change":"2023-11-24T08:07:17.188171+0000","last_active":"2023-11-24T08:07:19.208047+0000","last_peered":"2023-11-24T08:07:19.208047+0000","last_clean":"2023-11-24T08:07:19.208047+0000","last_became_active":"2023-11-24T08:07:17.187868+0000","last_became_peered":"2023-11-24T08:07:17.187868+0000","last_unstale":"2023-11-24T08:07:19.208047+0000","last_undegraded":"2023-11-24T08:07:19.208047+0000","last_fullsized":"2023-11-24T08:07:19.208047+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:27.801456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188775+0000","last_change":"2023-11-24T08:07:17.193603+0000","last_active":"2023-11-24T08:07:18.188775+0000","last_peered":"2023-11-24T08:07:18.188775+0000","last_clean":"2023-11-24T08:07:18.188775+0000","last_became_active":"2023-11-24T08:07:17.193317+0000","last_became_peered":"2023-11-24T08:07:17.193317+0000","last_unstale":"2023-11-24T08:07:18.188775+0000","last_undegraded":"2023-11-24T08:07:18.188775+0000","last_fullsized":"2023-11-24T08:07:18.188775+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:27:18.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.203318+0000","last_change":"2023-11-24T08:07:17.198118+0000","last_active":"2023-11-24T08:07:17.203318+0000","last_peered":"2023-11-24T08:07:17.203318+0000","last_clean":"2023-11-24T08:07:17.203318+0000","last_became_active":"2023-11-24T08:07:17.197795+0000","last_became_peered":"2023-11-24T08:07:17.197795+0000","last_unstale":"2023-11-24T08:07:17.203318+0000","last_undegraded":"2023-11-24T08:07:17.203318+0000","last_fullsized":"2023-11-24T08:07:17.203318+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:38.620452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.208141+0000","last_change":"2023-11-24T08:07:17.204123+0000","last_active":"2023-11-24T08:07:17.208141+0000","last_peered":"2023-11-24T08:07:17.208141+0000","last_clean":"2023-11-24T08:07:17.208141+0000","last_became_active":"2023-11-24T08:07:17.203834+0000","last_became_peered":"2023-11-24T08:07:17.203834+0000","last_unstale":"2023-11-24T08:07:17.208141+0000","last_undegraded":"2023-11-24T08:07:17.208141+0000","last_fullsized":"2023-11-24T08:07:17.208141+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:06.401104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804147+0000","last_change":"2023-11-24T08:07:17.189911+0000","last_active":"2023-11-24T08:07:18.804147+0000","last_peered":"2023-11-24T08:07:18.804147+0000","last_clean":"2023-11-24T08:07:18.804147+0000","last_became_active":"2023-11-24T08:07:17.189630+0000","last_became_peered":"2023-11-24T08:07:17.189630+0000","last_unstale":"2023-11-24T08:07:18.804147+0000","last_undegraded":"2023-11-24T08:07:18.804147+0000","last_fullsized":"2023-11-24T08:07:18.804147+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:12:18.638091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.200726+0000","last_change":"2023-11-24T08:07:17.194793+0000","last_active":"2023-11-24T08:07:17.200726+0000","last_peered":"2023-11-24T08:07:17.200726+0000","last_clean":"2023-11-24T08:07:17.200726+0000","last_became_active":"2023-11-24T08:07:17.194542+0000","last_became_peered":"2023-11-24T08:07:17.194542+0000","last_unstale":"2023-11-24T08:07:17.200726+0000","last_undegraded":"2023-11-24T08:07:17.200726+0000","last_fullsized":"2023-11-24T08:07:17.200726+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:48:51.601434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188593+0000","last_change":"2023-11-24T08:07:17.206142+0000","last_active":"2023-11-24T08:07:18.188593+0000","last_peered":"2023-11-24T08:07:18.188593+0000","last_clean":"2023-11-24T08:07:18.188593+0000","last_became_active":"2023-11-24T08:07:17.205826+0000","last_became_peered":"2023-11-24T08:07:17.205826+0000","last_unstale":"2023-11-24T08:07:18.188593+0000","last_undegraded":"2023-11-24T08:07:18.188593+0000","last_fullsized":"2023-11-24T08:07:18.188593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:02.597084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188931+0000","last_change":"2023-11-24T08:07:17.199047+0000","last_active":"2023-11-24T08:07:18.188931+0000","last_peered":"2023-11-24T08:07:18.188931+0000","last_clean":"2023-11-24T08:07:18.188931+0000","last_became_active":"2023-11-24T08:07:17.198143+0000","last_became_peered":"2023-11-24T08:07:17.198143+0000","last_unstale":"2023-11-24T08:07:18.188931+0000","last_undegraded":"2023-11-24T08:07:18.188931+0000","last_fullsized":"2023-11-24T08:07:18.188931+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:38.869591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"55'4","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189024+0000","last_change":"2023-11-24T08:07:16.191958+0000","last_active":"2023-11-24T08:07:18.189024+0000","last_peered":"2023-11-24T08:07:18.189024+0000","last_clean":"2023-11-24T08:07:18.189024+0000","last_became_active":"2023-11-24T08:07:16.191668+0000","last_became_peered":"2023-11-24T08:07:16.191668+0000","last_unstale":"2023-11-24T08:07:18.189024+0000","last_undegraded":"2023-11-24T08:07:18.189024+0000","last_fullsized":"2023-11-24T08:07:18.189024+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:40:46.718141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.209108+0000","last_change":"2023-11-24T08:07:17.201426+0000","last_active":"2023-11-24T08:07:17.209108+0000","last_peered":"2023-11-24T08:07:17.209108+0000","last_clean":"2023-11-24T08:07:17.209108+0000","last_became_active":"2023-11-24T08:07:17.201204+0000","last_became_peered":"2023-11-24T08:07:17.201204+0000","last_unstale":"2023-11-24T08:07:17.209108+0000","last_undegraded":"2023-11-24T08:07:17.209108+0000","last_fullsized":"2023-11-24T08:07:17.209108+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:00:59.648114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"55'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.206107+0000","last_change":"2023-11-24T08:07:16.186030+0000","last_active":"2023-11-24T08:07:17.206107+0000","last_peered":"2023-11-24T08:07:17.206107+0000","last_clean":"2023-11-24T08:07:17.206107+0000","last_became_active":"2023-11-24T08:07:16.185741+0000","last_became_peered":"2023-11-24T08:07:16.185741+0000","last_unstale":"2023-11-24T08:07:17.206107+0000","last_undegraded":"2023-11-24T08:07:17.206107+0000","last_fullsized":"2023-11-24T08:07:17.206107+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:27.915371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188932+0000","last_change":"2023-11-24T08:07:17.204222+0000","last_active":"2023-11-24T08:07:18.188932+0000","last_peered":"2023-11-24T08:07:18.188932+0000","last_clean":"2023-11-24T08:07:18.188932+0000","last_became_active":"2023-11-24T08:07:17.203937+0000","last_became_peered":"2023-11-24T08:07:17.203937+0000","last_unstale":"2023-11-24T08:07:18.188932+0000","last_undegraded":"2023-11-24T08:07:18.188932+0000","last_fullsized":"2023-11-24T08:07:18.188932+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:09.339405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189016+0000","last_change":"2023-11-24T08:07:16.190759+0000","last_active":"2023-11-24T08:07:18.189016+0000","last_peered":"2023-11-24T08:07:18.189016+0000","last_clean":"2023-11-24T08:07:18.189016+0000","last_became_active":"2023-11-24T08:07:16.190431+0000","last_became_peered":"2023-11-24T08:07:16.190431+0000","last_unstale":"2023-11-24T08:07:18.189016+0000","last_undegraded":"2023-11-24T08:07:18.189016+0000","last_fullsized":"2023-11-24T08:07:18.189016+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:04.126257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188923+0000","last_change":"2023-11-24T08:07:17.198207+0000","last_active":"2023-11-24T08:07:18.188923+0000","last_peered":"2023-11-24T08:07:18.188923+0000","last_clean":"2023-11-24T08:07:18.188923+0000","last_became_active":"2023-11-24T08:07:17.197912+0000","last_became_peered":"2023-11-24T08:07:17.197912+0000","last_unstale":"2023-11-24T08:07:18.188923+0000","last_undegraded":"2023-11-24T08:07:18.188923+0000","last_fullsized":"2023-11-24T08:07:18.188923+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:35.365864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207880+0000","last_change":"2023-11-24T08:07:16.188390+0000","last_active":"2023-11-24T08:07:19.207880+0000","last_peered":"2023-11-24T08:07:19.207880+0000","last_clean":"2023-11-24T08:07:19.207880+0000","last_became_active":"2023-11-24T08:07:16.188106+0000","last_became_peered":"2023-11-24T08:07:16.188106+0000","last_unstale":"2023-11-24T08:07:19.207880+0000","last_undegraded":"2023-11-24T08:07:19.207880+0000","last_fullsized":"2023-11-24T08:07:19.207880+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:01.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.206700+0000","last_change":"2023-11-24T08:07:17.197427+0000","last_active":"2023-11-24T08:07:17.206700+0000","last_peered":"2023-11-24T08:07:17.206700+0000","last_clean":"2023-11-24T08:07:17.206700+0000","last_became_active":"2023-11-24T08:07:17.197067+0000","last_became_peered":"2023-11-24T08:07:17.197067+0000","last_unstale":"2023-11-24T08:07:17.206700+0000","last_undegraded":"2023-11-24T08:07:17.206700+0000","last_fullsized":"2023-11-24T08:07:17.206700+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:12:18.638091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189413+0000","last_change":"2023-11-24T08:07:16.188707+0000","last_active":"2023-11-24T08:07:18.189413+0000","last_peered":"2023-11-24T08:07:18.189413+0000","last_clean":"2023-11-24T08:07:18.189413+0000","last_became_active":"2023-11-24T08:07:16.188435+0000","last_became_peered":"2023-11-24T08:07:16.188435+0000","last_unstale":"2023-11-24T08:07:18.189413+0000","last_undegraded":"2023-11-24T08:07:18.189413+0000","last_fullsized":"2023-11-24T08:07:18.189413+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:16:02.069798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.209422+0000","last_change":"2023-11-24T08:07:17.206338+0000","last_active":"2023-11-24T08:07:17.209422+0000","last_peered":"2023-11-24T08:07:17.209422+0000","last_clean":"2023-11-24T08:07:17.209422+0000","last_became_active":"2023-11-24T08:07:17.203765+0000","last_became_peered":"2023-11-24T08:07:17.203765+0000","last_unstale":"2023-11-24T08:07:17.209422+0000","last_undegraded":"2023-11-24T08:07:17.209422+0000","last_fullsized":"2023-11-24T08:07:17.209422+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:27.801456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189020+0000","last_change":"2023-11-24T08:07:16.187166+0000","last_active":"2023-11-24T08:07:18.189020+0000","last_peered":"2023-11-24T08:07:18.189020+0000","last_clean":"2023-11-24T08:07:18.189020+0000","last_became_active":"2023-11-24T08:07:16.186788+0000","last_became_peered":"2023-11-24T08:07:16.186788+0000","last_unstale":"2023-11-24T08:07:18.189020+0000","last_undegraded":"2023-11-24T08:07:18.189020+0000","last_fullsized":"2023-11-24T08:07:18.189020+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:33.543544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206377+0000","last_change":"2023-11-24T08:07:17.194780+0000","last_active":"2023-11-24T08:07:18.206377+0000","last_peered":"2023-11-24T08:07:18.206377+0000","last_clean":"2023-11-24T08:07:18.206377+0000","last_became_active":"2023-11-24T08:07:17.194363+0000","last_became_peered":"2023-11-24T08:07:17.194363+0000","last_unstale":"2023-11-24T08:07:18.206377+0000","last_undegraded":"2023-11-24T08:07:18.206377+0000","last_fullsized":"2023-11-24T08:07:18.206377+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:24.061349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207641+0000","last_change":"2023-11-24T08:07:16.192409+0000","last_active":"2023-11-24T08:07:19.207641+0000","last_peered":"2023-11-24T08:07:19.207641+0000","last_clean":"2023-11-24T08:07:19.207641+0000","last_became_active":"2023-11-24T08:07:16.192149+0000","last_became_peered":"2023-11-24T08:07:16.192149+0000","last_unstale":"2023-11-24T08:07:19.207641+0000","last_undegraded":"2023-11-24T08:07:19.207641+0000","last_fullsized":"2023-11-24T08:07:19.207641+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:03.658086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.207375+0000","last_change":"2023-11-24T08:07:17.201531+0000","last_active":"2023-11-24T08:07:17.207375+0000","last_peered":"2023-11-24T08:07:17.207375+0000","last_clean":"2023-11-24T08:07:17.207375+0000","last_became_active":"2023-11-24T08:07:17.201361+0000","last_became_peered":"2023-11-24T08:07:17.201361+0000","last_unstale":"2023-11-24T08:07:17.207375+0000","last_undegraded":"2023-11-24T08:07:17.207375+0000","last_fullsized":"2023-11-24T08:07:17.207375+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:35.365864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189413+0000","last_change":"2023-11-24T08:07:16.190913+0000","last_active":"2023-11-24T08:07:18.189413+0000","last_peered":"2023-11-24T08:07:18.189413+0000","last_clean":"2023-11-24T08:07:18.189413+0000","last_became_active":"2023-11-24T08:07:16.190618+0000","last_became_peered":"2023-11-24T08:07:16.190618+0000","last_unstale":"2023-11-24T08:07:18.189413+0000","last_undegraded":"2023-11-24T08:07:18.189413+0000","last_fullsized":"2023-11-24T08:07:18.189413+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:05:17.781694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189936+0000","last_change":"2023-11-24T08:07:17.187816+0000","last_active":"2023-11-24T08:07:18.189936+0000","last_peered":"2023-11-24T08:07:18.189936+0000","last_clean":"2023-11-24T08:07:18.189936+0000","last_became_active":"2023-11-24T08:07:17.187474+0000","last_became_peered":"2023-11-24T08:07:17.187474+0000","last_unstale":"2023-11-24T08:07:18.189936+0000","last_undegraded":"2023-11-24T08:07:18.189936+0000","last_fullsized":"2023-11-24T08:07:18.189936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:25.629866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804482+0000","last_change":"2023-11-24T08:07:16.188953+0000","last_active":"2023-11-24T08:07:18.804482+0000","last_peered":"2023-11-24T08:07:18.804482+0000","last_clean":"2023-11-24T08:07:18.804482+0000","last_became_active":"2023-11-24T08:07:16.188680+0000","last_became_peered":"2023-11-24T08:07:16.188680+0000","last_unstale":"2023-11-24T08:07:18.804482+0000","last_undegraded":"2023-11-24T08:07:18.804482+0000","last_fullsized":"2023-11-24T08:07:18.804482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:40:46.718141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804486+0000","last_change":"2023-11-24T08:07:17.192181+0000","last_active":"2023-11-24T08:07:18.804486+0000","last_peered":"2023-11-24T08:07:18.804486+0000","last_clean":"2023-11-24T08:07:18.804486+0000","last_became_active":"2023-11-24T08:07:17.191917+0000","last_became_peered":"2023-11-24T08:07:17.191917+0000","last_unstale":"2023-11-24T08:07:18.804486+0000","last_undegraded":"2023-11-24T08:07:18.804486+0000","last_fullsized":"2023-11-24T08:07:18.804486+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:06.401104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.194489+0000","last_change":"2023-11-24T08:07:16.186812+0000","last_active":"2023-11-24T08:07:17.194489+0000","last_peered":"2023-11-24T08:07:17.194489+0000","last_clean":"2023-11-24T08:07:17.194489+0000","last_became_active":"2023-11-24T08:07:16.186597+0000","last_became_peered":"2023-11-24T08:07:16.186597+0000","last_unstale":"2023-11-24T08:07:17.194489+0000","last_undegraded":"2023-11-24T08:07:17.194489+0000","last_fullsized":"2023-11-24T08:07:17.194489+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:29.628416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.202619+0000","last_change":"2023-11-24T08:07:17.188865+0000","last_active":"2023-11-24T08:07:17.202619+0000","last_peered":"2023-11-24T08:07:17.202619+0000","last_clean":"2023-11-24T08:07:17.202619+0000","last_became_active":"2023-11-24T08:07:17.187505+0000","last_became_peered":"2023-11-24T08:07:17.187505+0000","last_unstale":"2023-11-24T08:07:17.202619+0000","last_undegraded":"2023-11-24T08:07:17.202619+0000","last_fullsized":"2023-11-24T08:07:17.202619+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:21:18.772115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"55'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804518+0000","last_change":"2023-11-24T08:07:16.190858+0000","last_active":"2023-11-24T08:07:18.804518+0000","last_peered":"2023-11-24T08:07:18.804518+0000","last_clean":"2023-11-24T08:07:18.804518+0000","last_became_active":"2023-11-24T08:07:16.190524+0000","last_became_peered":"2023-11-24T08:07:16.190524+0000","last_unstale":"2023-11-24T08:07:18.804518+0000","last_undegraded":"2023-11-24T08:07:18.804518+0000","last_fullsized":"2023-11-24T08:07:18.804518+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:04.126257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804392+0000","last_change":"2023-11-24T08:07:17.191966+0000","last_active":"2023-11-24T08:07:18.804392+0000","last_peered":"2023-11-24T08:07:18.804392+0000","last_clean":"2023-11-24T08:07:18.804392+0000","last_became_active":"2023-11-24T08:07:17.191689+0000","last_became_peered":"2023-11-24T08:07:17.191689+0000","last_unstale":"2023-11-24T08:07:18.804392+0000","last_undegraded":"2023-11-24T08:07:18.804392+0000","last_fullsized":"2023-11-24T08:07:18.804392+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:09.339405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'6","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189848+0000","last_change":"2023-11-24T08:07:16.189704+0000","last_active":"2023-11-24T08:07:18.189848+0000","last_peered":"2023-11-24T08:07:18.189848+0000","last_clean":"2023-11-24T08:07:18.189848+0000","last_became_active":"2023-11-24T08:07:16.189366+0000","last_became_peered":"2023-11-24T08:07:16.189366+0000","last_unstale":"2023-11-24T08:07:18.189848+0000","last_undegraded":"2023-11-24T08:07:18.189848+0000","last_fullsized":"2023-11-24T08:07:18.189848+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:06:12.223817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207716+0000","last_change":"2023-11-24T08:07:17.186838+0000","last_active":"2023-11-24T08:07:19.207716+0000","last_peered":"2023-11-24T08:07:19.207716+0000","last_clean":"2023-11-24T08:07:19.207716+0000","last_became_active":"2023-11-24T08:07:17.186088+0000","last_became_peered":"2023-11-24T08:07:17.186088+0000","last_unstale":"2023-11-24T08:07:19.207716+0000","last_undegraded":"2023-11-24T08:07:19.207716+0000","last_fullsized":"2023-11-24T08:07:19.207716+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:35.365864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.208094+0000","last_change":"2023-11-24T08:07:16.183695+0000","last_active":"2023-11-24T08:07:17.208094+0000","last_peered":"2023-11-24T08:07:17.208094+0000","last_clean":"2023-11-24T08:07:17.208094+0000","last_became_active":"2023-11-24T08:07:16.183417+0000","last_became_peered":"2023-11-24T08:07:16.183417+0000","last_unstale":"2023-11-24T08:07:17.208094+0000","last_undegraded":"2023-11-24T08:07:17.208094+0000","last_fullsized":"2023-11-24T08:07:17.208094+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:17.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804069+0000","last_change":"2023-11-24T08:07:17.185883+0000","last_active":"2023-11-24T08:07:18.804069+0000","last_peered":"2023-11-24T08:07:18.804069+0000","last_clean":"2023-11-24T08:07:18.804069+0000","last_became_active":"2023-11-24T08:07:17.185665+0000","last_became_peered":"2023-11-24T08:07:17.185665+0000","last_unstale":"2023-11-24T08:07:18.804069+0000","last_undegraded":"2023-11-24T08:07:18.804069+0000","last_fullsized":"2023-11-24T08:07:18.804069+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:02.597084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206537+0000","last_change":"2023-11-24T08:07:16.186374+0000","last_active":"2023-11-24T08:07:18.206537+0000","last_peered":"2023-11-24T08:07:18.206537+0000","last_clean":"2023-11-24T08:07:18.206537+0000","last_became_active":"2023-11-24T08:07:16.185991+0000","last_became_peered":"2023-11-24T08:07:16.185991+0000","last_unstale":"2023-11-24T08:07:18.206537+0000","last_undegraded":"2023-11-24T08:07:18.206537+0000","last_fullsized":"2023-11-24T08:07:18.206537+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:45.244221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189317+0000","last_change":"2023-11-24T08:07:17.196173+0000","last_active":"2023-11-24T08:07:18.189317+0000","last_peered":"2023-11-24T08:07:18.189317+0000","last_clean":"2023-11-24T08:07:18.189317+0000","last_became_active":"2023-11-24T08:07:17.195895+0000","last_became_peered":"2023-11-24T08:07:17.195895+0000","last_unstale":"2023-11-24T08:07:18.189317+0000","last_undegraded":"2023-11-24T08:07:18.189317+0000","last_fullsized":"2023-11-24T08:07:18.189317+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:15.211019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207641+0000","last_change":"2023-11-24T08:07:16.188423+0000","last_active":"2023-11-24T08:07:19.207641+0000","last_peered":"2023-11-24T08:07:19.207641+0000","last_clean":"2023-11-24T08:07:19.207641+0000","last_became_active":"2023-11-24T08:07:16.187930+0000","last_became_peered":"2023-11-24T08:07:16.187930+0000","last_unstale":"2023-11-24T08:07:19.207641+0000","last_undegraded":"2023-11-24T08:07:19.207641+0000","last_fullsized":"2023-11-24T08:07:19.207641+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:58:40.127886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804044+0000","last_change":"2023-11-24T08:07:17.201398+0000","last_active":"2023-11-24T08:07:18.804044+0000","last_peered":"2023-11-24T08:07:18.804044+0000","last_clean":"2023-11-24T08:07:18.804044+0000","last_became_active":"2023-11-24T08:07:17.201131+0000","last_became_peered":"2023-11-24T08:07:17.201131+0000","last_unstale":"2023-11-24T08:07:18.804044+0000","last_undegraded":"2023-11-24T08:07:18.804044+0000","last_fullsized":"2023-11-24T08:07:18.804044+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:20:27.189383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"55'8","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.803902+0000","last_change":"2023-11-24T08:07:16.188284+0000","last_active":"2023-11-24T08:07:18.803902+0000","last_peered":"2023-11-24T08:07:18.803902+0000","last_clean":"2023-11-24T08:07:18.803902+0000","last_became_active":"2023-11-24T08:07:16.188009+0000","last_became_peered":"2023-11-24T08:07:16.188009+0000","last_unstale":"2023-11-24T08:07:18.803902+0000","last_undegraded":"2023-11-24T08:07:18.803902+0000","last_fullsized":"2023-11-24T08:07:18.803902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:17.665349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804494+0000","last_change":"2023-11-24T08:07:17.191415+0000","last_active":"2023-11-24T08:07:18.804494+0000","last_peered":"2023-11-24T08:07:18.804494+0000","last_clean":"2023-11-24T08:07:18.804494+0000","last_became_active":"2023-11-24T08:07:17.191197+0000","last_became_peered":"2023-11-24T08:07:17.191197+0000","last_unstale":"2023-11-24T08:07:18.804494+0000","last_undegraded":"2023-11-24T08:07:18.804494+0000","last_fullsized":"2023-11-24T08:07:18.804494+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:14:25.777271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"55'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.206809+0000","last_change":"2023-11-24T08:07:16.183924+0000","last_active":"2023-11-24T08:07:17.206809+0000","last_peered":"2023-11-24T08:07:17.206809+0000","last_clean":"2023-11-24T08:07:17.206809+0000","last_became_active":"2023-11-24T08:07:16.183661+0000","last_became_peered":"2023-11-24T08:07:16.183661+0000","last_unstale":"2023-11-24T08:07:17.206809+0000","last_undegraded":"2023-11-24T08:07:17.206809+0000","last_fullsized":"2023-11-24T08:07:17.206809+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:16.531795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208061+0000","last_change":"2023-11-24T08:07:17.187802+0000","last_active":"2023-11-24T08:07:19.208061+0000","last_peered":"2023-11-24T08:07:19.208061+0000","last_clean":"2023-11-24T08:07:19.208061+0000","last_became_active":"2023-11-24T08:07:17.187480+0000","last_became_peered":"2023-11-24T08:07:17.187480+0000","last_unstale":"2023-11-24T08:07:19.208061+0000","last_undegraded":"2023-11-24T08:07:19.208061+0000","last_fullsized":"2023-11-24T08:07:19.208061+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:14:25.777271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188955+0000","last_change":"2023-11-24T08:07:16.185036+0000","last_active":"2023-11-24T08:07:18.188955+0000","last_peered":"2023-11-24T08:07:18.188955+0000","last_clean":"2023-11-24T08:07:18.188955+0000","last_became_active":"2023-11-24T08:07:16.184256+0000","last_became_peered":"2023-11-24T08:07:16.184256+0000","last_unstale":"2023-11-24T08:07:18.188955+0000","last_undegraded":"2023-11-24T08:07:18.188955+0000","last_fullsized":"2023-11-24T08:07:18.188955+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:03.461420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.207879+0000","last_change":"2023-11-24T08:07:17.204102+0000","last_active":"2023-11-24T08:07:17.207879+0000","last_peered":"2023-11-24T08:07:17.207879+0000","last_clean":"2023-11-24T08:07:17.207879+0000","last_became_active":"2023-11-24T08:07:17.203783+0000","last_became_peered":"2023-11-24T08:07:17.203783+0000","last_unstale":"2023-11-24T08:07:17.207879+0000","last_undegraded":"2023-11-24T08:07:17.207879+0000","last_fullsized":"2023-11-24T08:07:17.207879+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:14:25.777271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207971+0000","last_change":"2023-11-24T08:07:16.188743+0000","last_active":"2023-11-24T08:07:19.207971+0000","last_peered":"2023-11-24T08:07:19.207971+0000","last_clean":"2023-11-24T08:07:19.207971+0000","last_became_active":"2023-11-24T08:07:16.188194+0000","last_became_peered":"2023-11-24T08:07:16.188194+0000","last_unstale":"2023-11-24T08:07:19.207971+0000","last_undegraded":"2023-11-24T08:07:19.207971+0000","last_fullsized":"2023-11-24T08:07:19.207971+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:56.643741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804468+0000","last_change":"2023-11-24T08:07:17.203355+0000","last_active":"2023-11-24T08:07:18.804468+0000","last_peered":"2023-11-24T08:07:18.804468+0000","last_clean":"2023-11-24T08:07:18.804468+0000","last_became_active":"2023-11-24T08:07:17.203052+0000","last_became_peered":"2023-11-24T08:07:17.203052+0000","last_unstale":"2023-11-24T08:07:18.804468+0000","last_undegraded":"2023-11-24T08:07:18.804468+0000","last_fullsized":"2023-11-24T08:07:18.804468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:38.869591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188955+0000","last_change":"2023-11-24T08:07:16.189779+0000","last_active":"2023-11-24T08:07:18.188955+0000","last_peered":"2023-11-24T08:07:18.188955+0000","last_clean":"2023-11-24T08:07:18.188955+0000","last_became_active":"2023-11-24T08:07:16.189511+0000","last_became_peered":"2023-11-24T08:07:16.189511+0000","last_unstale":"2023-11-24T08:07:18.188955+0000","last_undegraded":"2023-11-24T08:07:18.188955+0000","last_fullsized":"2023-11-24T08:07:18.188955+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:11.555487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207727+0000","last_change":"2023-11-24T08:07:17.184803+0000","last_active":"2023-11-24T08:07:19.207727+0000","last_peered":"2023-11-24T08:07:19.207727+0000","last_clean":"2023-11-24T08:07:19.207727+0000","last_became_active":"2023-11-24T08:07:17.184452+0000","last_became_peered":"2023-11-24T08:07:17.184452+0000","last_unstale":"2023-11-24T08:07:19.207727+0000","last_undegraded":"2023-11-24T08:07:19.207727+0000","last_fullsized":"2023-11-24T08:07:19.207727+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:09.339405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"55'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.206915+0000","last_change":"2023-11-24T08:07:16.183810+0000","last_active":"2023-11-24T08:07:17.206915+0000","last_peered":"2023-11-24T08:07:17.206915+0000","last_clean":"2023-11-24T08:07:17.206915+0000","last_became_active":"2023-11-24T08:07:16.183401+0000","last_became_peered":"2023-11-24T08:07:16.183401+0000","last_unstale":"2023-11-24T08:07:17.206915+0000","last_undegraded":"2023-11-24T08:07:17.206915+0000","last_fullsized":"2023-11-24T08:07:17.206915+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:30.418602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188810+0000","last_change":"2023-11-24T08:07:17.194675+0000","last_active":"2023-11-24T08:07:18.188810+0000","last_peered":"2023-11-24T08:07:18.188810+0000","last_clean":"2023-11-24T08:07:18.188810+0000","last_became_active":"2023-11-24T08:07:17.193462+0000","last_became_peered":"2023-11-24T08:07:17.193462+0000","last_unstale":"2023-11-24T08:07:18.188810+0000","last_undegraded":"2023-11-24T08:07:18.188810+0000","last_fullsized":"2023-11-24T08:07:18.188810+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:14.418374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.183139+0000","last_change":"2023-11-24T08:07:16.184028+0000","last_active":"2023-11-24T08:07:17.183139+0000","last_peered":"2023-11-24T08:07:17.183139+0000","last_clean":"2023-11-24T08:07:17.183139+0000","last_became_active":"2023-11-24T08:07:16.183141+0000","last_became_peered":"2023-11-24T08:07:16.183141+0000","last_unstale":"2023-11-24T08:07:17.183139+0000","last_undegraded":"2023-11-24T08:07:17.183139+0000","last_fullsized":"2023-11-24T08:07:17.183139+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:12:08.298853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188701+0000","last_change":"2023-11-24T08:07:17.197022+0000","last_active":"2023-11-24T08:07:18.188701+0000","last_peered":"2023-11-24T08:07:18.188701+0000","last_clean":"2023-11-24T08:07:18.188701+0000","last_became_active":"2023-11-24T08:07:17.196692+0000","last_became_peered":"2023-11-24T08:07:17.196692+0000","last_unstale":"2023-11-24T08:07:18.188701+0000","last_undegraded":"2023-11-24T08:07:18.188701+0000","last_fullsized":"2023-11-24T08:07:18.188701+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:12:18.638091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207643+0000","last_change":"2023-11-24T08:07:16.191153+0000","last_active":"2023-11-24T08:07:19.207643+0000","last_peered":"2023-11-24T08:07:19.207643+0000","last_clean":"2023-11-24T08:07:19.207643+0000","last_became_active":"2023-11-24T08:07:16.190708+0000","last_became_peered":"2023-11-24T08:07:16.190708+0000","last_unstale":"2023-11-24T08:07:19.207643+0000","last_undegraded":"2023-11-24T08:07:19.207643+0000","last_fullsized":"2023-11-24T08:07:19.207643+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:04.126257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208057+0000","last_change":"2023-11-24T08:07:17.196220+0000","last_active":"2023-11-24T08:07:19.208057+0000","last_peered":"2023-11-24T08:07:19.208057+0000","last_clean":"2023-11-24T08:07:19.208057+0000","last_became_active":"2023-11-24T08:07:17.195957+0000","last_became_peered":"2023-11-24T08:07:17.195957+0000","last_unstale":"2023-11-24T08:07:19.208057+0000","last_undegraded":"2023-11-24T08:07:19.208057+0000","last_fullsized":"2023-11-24T08:07:19.208057+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:06.401104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"55'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.208320+0000","last_change":"2023-11-24T08:07:16.187486+0000","last_active":"2023-11-24T08:07:17.208320+0000","last_peered":"2023-11-24T08:07:17.208320+0000","last_clean":"2023-11-24T08:07:17.208320+0000","last_became_active":"2023-11-24T08:07:16.187189+0000","last_became_peered":"2023-11-24T08:07:16.187189+0000","last_unstale":"2023-11-24T08:07:17.208320+0000","last_undegraded":"2023-11-24T08:07:17.208320+0000","last_fullsized":"2023-11-24T08:07:17.208320+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:37.223412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208142+0000","last_change":"2023-11-24T08:07:17.188247+0000","last_active":"2023-11-24T08:07:19.208142+0000","last_peered":"2023-11-24T08:07:19.208142+0000","last_clean":"2023-11-24T08:07:19.208142+0000","last_became_active":"2023-11-24T08:07:17.187906+0000","last_became_peered":"2023-11-24T08:07:17.187906+0000","last_unstale":"2023-11-24T08:07:19.208142+0000","last_undegraded":"2023-11-24T08:07:19.208142+0000","last_fullsized":"2023-11-24T08:07:19.208142+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:07:09.020680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189010+0000","last_change":"2023-11-24T08:07:16.186426+0000","last_active":"2023-11-24T08:07:18.189010+0000","last_peered":"2023-11-24T08:07:18.189010+0000","last_clean":"2023-11-24T08:07:18.189010+0000","last_became_active":"2023-11-24T08:07:16.186169+0000","last_became_peered":"2023-11-24T08:07:16.186169+0000","last_unstale":"2023-11-24T08:07:18.189010+0000","last_undegraded":"2023-11-24T08:07:18.189010+0000","last_fullsized":"2023-11-24T08:07:18.189010+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:42.024368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.202593+0000","last_change":"2023-11-24T08:07:17.188756+0000","last_active":"2023-11-24T08:07:17.202593+0000","last_peered":"2023-11-24T08:07:17.202593+0000","last_clean":"2023-11-24T08:07:17.202593+0000","last_became_active":"2023-11-24T08:07:17.187474+0000","last_became_peered":"2023-11-24T08:07:17.187474+0000","last_unstale":"2023-11-24T08:07:17.202593+0000","last_undegraded":"2023-11-24T08:07:17.202593+0000","last_fullsized":"2023-11-24T08:07:17.202593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:36.715235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206549+0000","last_change":"2023-11-24T08:07:16.186393+0000","last_active":"2023-11-24T08:07:18.206549+0000","last_peered":"2023-11-24T08:07:18.206549+0000","last_clean":"2023-11-24T08:07:18.206549+0000","last_became_active":"2023-11-24T08:07:16.186039+0000","last_became_peered":"2023-11-24T08:07:16.186039+0000","last_unstale":"2023-11-24T08:07:18.206549+0000","last_undegraded":"2023-11-24T08:07:18.206549+0000","last_fullsized":"2023-11-24T08:07:18.206549+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:21:17.770283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189138+0000","last_change":"2023-11-24T08:07:17.192983+0000","last_active":"2023-11-24T08:07:18.189138+0000","last_peered":"2023-11-24T08:07:18.189138+0000","last_clean":"2023-11-24T08:07:18.189138+0000","last_became_active":"2023-11-24T08:07:17.192689+0000","last_became_peered":"2023-11-24T08:07:17.192689+0000","last_unstale":"2023-11-24T08:07:18.189138+0000","last_undegraded":"2023-11-24T08:07:18.189138+0000","last_fullsized":"2023-11-24T08:07:18.189138+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:27.801456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208098+0000","last_change":"2023-11-24T08:07:16.191883+0000","last_active":"2023-11-24T08:07:19.208098+0000","last_peered":"2023-11-24T08:07:19.208098+0000","last_clean":"2023-11-24T08:07:19.208098+0000","last_became_active":"2023-11-24T08:07:16.191618+0000","last_became_peered":"2023-11-24T08:07:16.191618+0000","last_unstale":"2023-11-24T08:07:19.208098+0000","last_undegraded":"2023-11-24T08:07:19.208098+0000","last_fullsized":"2023-11-24T08:07:19.208098+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:39.758608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.207732+0000","last_change":"2023-11-24T08:07:17.204056+0000","last_active":"2023-11-24T08:07:17.207732+0000","last_peered":"2023-11-24T08:07:17.207732+0000","last_clean":"2023-11-24T08:07:17.207732+0000","last_became_active":"2023-11-24T08:07:17.203806+0000","last_became_peered":"2023-11-24T08:07:17.203806+0000","last_unstale":"2023-11-24T08:07:17.207732+0000","last_undegraded":"2023-11-24T08:07:17.207732+0000","last_fullsized":"2023-11-24T08:07:17.207732+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:40.760439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.182374+0000","last_change":"2023-11-24T08:07:16.188255+0000","last_active":"2023-11-24T08:07:17.182374+0000","last_peered":"2023-11-24T08:07:17.182374+0000","last_clean":"2023-11-24T08:07:17.182374+0000","last_became_active":"2023-11-24T08:07:16.188023+0000","last_became_peered":"2023-11-24T08:07:16.188023+0000","last_unstale":"2023-11-24T08:07:17.182374+0000","last_undegraded":"2023-11-24T08:07:17.182374+0000","last_fullsized":"2023-11-24T08:07:17.182374+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:23.059518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804288+0000","last_change":"2023-11-24T08:07:17.205660+0000","last_active":"2023-11-24T08:07:18.804288+0000","last_peered":"2023-11-24T08:07:18.804288+0000","last_clean":"2023-11-24T08:07:18.804288+0000","last_became_active":"2023-11-24T08:07:17.205464+0000","last_became_peered":"2023-11-24T08:07:17.205464+0000","last_unstale":"2023-11-24T08:07:18.804288+0000","last_undegraded":"2023-11-24T08:07:18.804288+0000","last_fullsized":"2023-11-24T08:07:18.804288+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:14.418374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189588+0000","last_change":"2023-11-24T08:07:16.189666+0000","last_active":"2023-11-24T08:07:18.189588+0000","last_peered":"2023-11-24T08:07:18.189588+0000","last_clean":"2023-11-24T08:07:18.189588+0000","last_became_active":"2023-11-24T08:07:16.189352+0000","last_became_peered":"2023-11-24T08:07:16.189352+0000","last_unstale":"2023-11-24T08:07:18.189588+0000","last_undegraded":"2023-11-24T08:07:18.189588+0000","last_fullsized":"2023-11-24T08:07:18.189588+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:07.597709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.203316+0000","last_change":"2023-11-24T08:07:17.190380+0000","last_active":"2023-11-24T08:07:17.203316+0000","last_peered":"2023-11-24T08:07:17.203316+0000","last_clean":"2023-11-24T08:07:17.203316+0000","last_became_active":"2023-11-24T08:07:17.190072+0000","last_became_peered":"2023-11-24T08:07:17.190072+0000","last_unstale":"2023-11-24T08:07:17.203316+0000","last_undegraded":"2023-11-24T08:07:17.203316+0000","last_fullsized":"2023-11-24T08:07:17.203316+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:46.278491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.182352+0000","last_change":"2023-11-24T08:07:16.183771+0000","last_active":"2023-11-24T08:07:17.182352+0000","last_peered":"2023-11-24T08:07:17.182352+0000","last_clean":"2023-11-24T08:07:17.182352+0000","last_became_active":"2023-11-24T08:07:16.183520+0000","last_became_peered":"2023-11-24T08:07:16.183520+0000","last_unstale":"2023-11-24T08:07:17.182352+0000","last_undegraded":"2023-11-24T08:07:17.182352+0000","last_fullsized":"2023-11-24T08:07:17.182352+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:31.500908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.207355+0000","last_change":"2023-11-24T08:07:17.200497+0000","last_active":"2023-11-24T08:07:17.207355+0000","last_peered":"2023-11-24T08:07:17.207355+0000","last_clean":"2023-11-24T08:07:17.207355+0000","last_became_active":"2023-11-24T08:07:17.200246+0000","last_became_peered":"2023-11-24T08:07:17.200246+0000","last_unstale":"2023-11-24T08:07:17.207355+0000","last_undegraded":"2023-11-24T08:07:17.207355+0000","last_fullsized":"2023-11-24T08:07:17.207355+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:14.418374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.194377+0000","last_change":"2023-11-24T08:07:16.190699+0000","last_active":"2023-11-24T08:07:17.194377+0000","last_peered":"2023-11-24T08:07:17.194377+0000","last_clean":"2023-11-24T08:07:17.194377+0000","last_became_active":"2023-11-24T08:07:16.190329+0000","last_became_peered":"2023-11-24T08:07:16.190329+0000","last_unstale":"2023-11-24T08:07:17.194377+0000","last_undegraded":"2023-11-24T08:07:17.194377+0000","last_fullsized":"2023-11-24T08:07:17.194377+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:17:07.065898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.207924+0000","last_change":"2023-11-24T08:07:17.205230+0000","last_active":"2023-11-24T08:07:17.207924+0000","last_peered":"2023-11-24T08:07:17.207924+0000","last_clean":"2023-11-24T08:07:17.207924+0000","last_became_active":"2023-11-24T08:07:17.204508+0000","last_became_peered":"2023-11-24T08:07:17.204508+0000","last_unstale":"2023-11-24T08:07:17.207924+0000","last_undegraded":"2023-11-24T08:07:17.207924+0000","last_fullsized":"2023-11-24T08:07:17.207924+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:09.339405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206321+0000","last_change":"2023-11-24T08:07:16.188316+0000","last_active":"2023-11-24T08:07:18.206321+0000","last_peered":"2023-11-24T08:07:18.206321+0000","last_clean":"2023-11-24T08:07:18.206321+0000","last_became_active":"2023-11-24T08:07:16.188025+0000","last_became_peered":"2023-11-24T08:07:16.188025+0000","last_unstale":"2023-11-24T08:07:18.206321+0000","last_undegraded":"2023-11-24T08:07:18.206321+0000","last_fullsized":"2023-11-24T08:07:18.206321+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:29.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.177856+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:07:17.177856+0000","last_peered":"2023-11-24T08:07:17.177856+0000","last_clean":"2023-11-24T08:07:17.177856+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:07:17.177856+0000","last_undegraded":"2023-11-24T08:07:17.177856+0000","last_fullsized":"2023-11-24T08:07:17.177856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1273856,"data_stored":868487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72199999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.073,"15min":1.073},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.33200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.434},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.47499999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.35699999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":277959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":10.285,"15min":10.285},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46200000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.745,"5min":2.089,"15min":2.089},"last":0.44},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68400000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.503},{"interface":"front","average":{"1min":0.629,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.747,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":271749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.249},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.27100000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28599999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33300000000000002,"15min":0.31900000000000001},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.30299999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.626,"15min":0.626},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.5,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60699999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1659999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1277952,"data_stored":869502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.255}]},{"osd":2,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.625,"5min":1.343,"15min":1.343},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61299999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.374}]},{"osd":4,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78600000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.622}]},{"osd":5,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.60399999999999998,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.93200000000000005,"15min":1.0720000000000001},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82499999999999996,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.032,"15min":1.204},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":4,"15min":4},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":271715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.316,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.497,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.44,"15min":0.47199999999999998},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.26500000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53600000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61799999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.30199999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.59099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":5.673,"15min":5.673},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":1.216,"15min":1.216},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.246,"15min":1.246},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.82699999999999996},"min":{"1min":0.503,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.82999999999999996},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82099999999999995,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.758,"15min":5.758},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.89000000000000001},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":5.726,"15min":5.726},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.499,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.80300000000000005,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89400000000000002,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.94899999999999995},"min":{"1min":0.52000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99399999999999999,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.58599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":271715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.39600000000000002},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.59699999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58799999999999997,"5min":1.351,"15min":1.351},"last":0.375}]},{"osd":1,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40100000000000002,"15min":0.42699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.503,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.745,"5min":1.621,"15min":1.621},"last":0.435}]},{"osd":2,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.439},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63900000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45800000000000002,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64500000000000002,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80500000000000005,"5min":1.389,"15min":1.389},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90700000000000003,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.675,"15min":1.675},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":1.417,"15min":1.417},"last":0.502},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.67100000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95899999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.42299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":279571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.5},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.629},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77100000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":1.101,"15min":1.101},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.53500000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":1.476,"15min":1.476},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.751,"5min":1.556,"15min":1.556},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":278611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.753}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.443},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":1,"15min":1},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.622}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.77300000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":0.752},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.83399999999999996}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:25.848 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:25.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.979+0000 7f88e3e7e700 1 Processor -- start 2023-11-24T08:07:25.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.979+0000 7f88e3e7e700 1 -- start start 2023-11-24T08:07:25.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.980+0000 7f88e3e7e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc0af4d0 0x7f88dc0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.980+0000 7f88e3e7e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc0ae430 con 0x7f88dc06c710 2023-11-24T08:07:25.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.980+0000 7f88e3e7e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc0ae710 con 0x7f88dc15e080 2023-11-24T08:07:25.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.980+0000 7f88e3e7e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0af0b0 con 0x7f88dc0af4d0 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.980+0000 7f88e1419700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f88dc06c710 0x7f88dc06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45722/0 (socket says 172.21.15.153:45722) 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.980+0000 7f88e1419700 1 -- 172.21.15.153:0/2384972747 learned_addr learned my addr 172.21.15.153:0/2384972747 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.980+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575047566 0 0) 0x7f88dc0ae430 con 0x7f88dc06c710 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.980+0000 7f88e241b700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc0af4d0 0x7f88dc0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.980+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88c80035b0 con 0x7f88dc06c710 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3338975861 0 0) 0x7f88c80035b0 con 0x7f88dc06c710 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc0af4d0 msgr2=0x7f88dc0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc0af4d0 0x7f88dc0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 >> v1:172.21.15.164:6789/0 conn(0x7f88dc15e080 legacy=0x7f88dc06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0ae9f0 con 0x7f88dc06c710 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f88d8001670 con 0x7f88dc06c710 2023-11-24T08:07:25.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e241b700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc0af4d0 0x7f88dc0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:25.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 >> v1:172.21.15.153:6789/0 conn(0x7f88dc06c710 legacy=0x7f88dc06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88c8003a30 0x7f88c8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 0x7f88c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc0af4d0 0x7f88c8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0af0b0 con 0x7f88c8004850 2023-11-24T08:07:25.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c800bb10 con 0x7f88c8003a30 2023-11-24T08:07:25.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c800bcd0 con 0x7f88dc0af4d0 2023-11-24T08:07:25.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e1419700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 0x7f88c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e241b700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc0af4d0 0x7f88c8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e1c1a700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88c8003a30 0x7f88c8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e1419700 1 -- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc0af4d0 msgr2=0x7f88c8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e1419700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc0af4d0 0x7f88c8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e1419700 1 -- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88c8003a30 msgr2=0x7f88c8003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e1419700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88c8003a30 0x7f88c8003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e1419700 1 -- 172.21.15.153:0/2384972747 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80035b0 con 0x7f88c8004850 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e1419700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 0x7f88c8004cd0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f88d800c240 tx=0x7f88c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4435d3bf432639f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.981+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8007c10 con 0x7f88c8004850 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.982+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d800ce00 con 0x7f88c8004850 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.982+0000 7f88e0c18700 1 -- 172.21.15.153:0/2384972747 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8005ba0 con 0x7f88c8004850 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.982+0000 7f88e3e7e700 1 -- 172.21.15.153:0/2384972747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 msgr2=0x7f88c8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.982+0000 7f88e3e7e700 1 --2- 172.21.15.153:0/2384972747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 0x7f88c8004cd0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f88d800c240 tx=0x7f88c8005880 comp rx=0 tx=0).stop 2023-11-24T08:07:25.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.982+0000 7f88e241b700 1 -- 172.21.15.153:0/2384972747 reap_dead start 2023-11-24T08:07:25.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.982+0000 7f88e3e7e700 1 -- 172.21.15.153:0/2384972747 shutdown_connections 2023-11-24T08:07:25.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.982+0000 7f88e3e7e700 1 -- 172.21.15.153:0/2384972747 >> 172.21.15.153:0/2384972747 conn(0x7f88dc071b90 msgr2=0x7f88dc071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:25.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.982+0000 7f88e3e7e700 1 -- 172.21.15.153:0/2384972747 shutdown_connections 2023-11-24T08:07:25.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.982+0000 7f88e3e7e700 1 -- 172.21.15.153:0/2384972747 wait complete. 2023-11-24T08:07:25.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.983+0000 7f88e3e7e700 1 Processor -- start 2023-11-24T08:07:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.983+0000 7f88e3e7e700 1 -- start start 2023-11-24T08:07:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.984+0000 7f88e3e7e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 0x7f88dc160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.984+0000 7f88e3e7e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc1478a0 0x7f88dc0ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.984+0000 7f88e3e7e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88dc0b0720 0x7f88dc0b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.984+0000 7f88e3e7e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0ce870 con 0x7f88c8004850 2023-11-24T08:07:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.984+0000 7f88e3e7e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0b10e0 con 0x7f88dc0b0720 2023-11-24T08:07:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.984+0000 7f88e3e7e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0cf630 con 0x7f88dc1478a0 2023-11-24T08:07:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.984+0000 7f88e1c1a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 0x7f88dc160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.984+0000 7f88e1c1a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 0x7f88dc160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39630/0 (socket says 172.21.15.153:39630) 2023-11-24T08:07:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.984+0000 7f88e1c1a700 1 -- 172.21.15.153:0/1934640495 learned_addr learned my addr 172.21.15.153:0/1934640495 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.984+0000 7f88e1419700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc1478a0 0x7f88dc0ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.984+0000 7f88e241b700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88dc0b0720 0x7f88dc0b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88e1c1a700 1 -- 172.21.15.153:0/1934640495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc1478a0 msgr2=0x7f88dc0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88e1c1a700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc1478a0 0x7f88dc0ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88e1c1a700 1 -- 172.21.15.153:0/1934640495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88dc0b0720 msgr2=0x7f88dc0b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88e1c1a700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88dc0b0720 0x7f88dc0b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88e1c1a700 1 -- 172.21.15.153:0/1934640495 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0cf910 con 0x7f88c8004850 2023-11-24T08:07:25.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88e241b700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88dc0b0720 0x7f88dc0b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:25.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88e1c1a700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 0x7f88dc160fa0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00f7f0 tx=0x7f88cc00fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88d27fc700 1 -- 172.21.15.153:0/1934640495 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0052e0 con 0x7f88c8004850 2023-11-24T08:07:25.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88d27fc700 1 -- 172.21.15.153:0/1934640495 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc005440 con 0x7f88c8004850 2023-11-24T08:07:25.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88e3e7e700 1 -- 172.21.15.153:0/1934640495 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc0cfbf0 con 0x7f88c8004850 2023-11-24T08:07:25.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88d27fc700 1 -- 172.21.15.153:0/1934640495 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0038c0 con 0x7f88c8004850 2023-11-24T08:07:25.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.985+0000 7f88e3e7e700 1 -- 172.21.15.153:0/1934640495 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc0d01b0 con 0x7f88c8004850 2023-11-24T08:07:25.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.986+0000 7f88e3e7e700 1 -- 172.21.15.153:0/1934640495 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc0d0370 con 0x7f88c8004850 2023-11-24T08:07:25.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.986+0000 7f88d27fc700 1 -- 172.21.15.153:0/1934640495 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f88cc003a20 con 0x7f88c8004850 2023-11-24T08:07:25.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.987+0000 7f88d27fc700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f88c006b080 0x7f88c006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.987+0000 7f88d27fc700 1 -- 172.21.15.153:0/1934640495 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88cc089620 con 0x7f88c8004850 2023-11-24T08:07:25.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.987+0000 7f88e1419700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f88c006b080 0x7f88c006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.987+0000 7f88e1419700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f88c006b080 0x7f88c006d540 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f88dc15a0a0 tx=0x7f88d8007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:25.991+0000 7f88d27fc700 1 -- 172.21.15.153:0/1934640495 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88cc0544e0 con 0x7f88c8004850 2023-11-24T08:07:26.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.178+0000 7f88e3e7e700 1 -- 172.21.15.153:0/1934640495 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88dc0b05a0 con 0x7f88c006b080 2023-11-24T08:07:26.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.186+0000 7f88d27fc700 1 -- 172.21.15.153:0/1934640495 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289112 (secure 0 0 0) 0x7f88d8023070 con 0x7f88c006b080 2023-11-24T08:07:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:26.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 -- 172.21.15.153:0/1934640495 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f88c006b080 msgr2=0x7f88c006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f88c006b080 0x7f88c006d540 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f88dc15a0a0 tx=0x7f88d8007000 comp rx=0 tx=0).stop 2023-11-24T08:07:26.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 -- 172.21.15.153:0/1934640495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 msgr2=0x7f88dc160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 0x7f88dc160fa0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00f7f0 tx=0x7f88cc00fb00 comp rx=0 tx=0).stop 2023-11-24T08:07:26.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 -- 172.21.15.153:0/1934640495 shutdown_connections 2023-11-24T08:07:26.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88dc0b0720 0x7f88dc0b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f88c006b080 0x7f88c006d540 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8004850 0x7f88dc160fa0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 --2- 172.21.15.153:0/1934640495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88dc1478a0 0x7f88dc0ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 -- 172.21.15.153:0/1934640495 >> 172.21.15.153:0/1934640495 conn(0x7f88dc071b90 msgr2=0x7f88dc0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:26.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 -- 172.21.15.153:0/1934640495 shutdown_connections 2023-11-24T08:07:26.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.189+0000 7f88e3e7e700 1 -- 172.21.15.153:0/1934640495 wait complete. 2023-11-24T08:07:26.196 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:07:26.203 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2023-11-24T08:07:26.083388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222652,"kb_used_data":6468,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752068,"statfs":{"total":773094113280,"available":772866117632,"internally_reserved":0,"allocated":6623232,"data_stored":3408209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.910240"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.208492+0000","last_change":"2023-11-24T08:07:17.207652+0000","last_active":"2023-11-24T08:07:20.208492+0000","last_peered":"2023-11-24T08:07:20.208492+0000","last_clean":"2023-11-24T08:07:20.208492+0000","last_became_active":"2023-11-24T08:07:17.207303+0000","last_became_peered":"2023-11-24T08:07:17.207303+0000","last_unstale":"2023-11-24T08:07:20.208492+0000","last_undegraded":"2023-11-24T08:07:20.208492+0000","last_fullsized":"2023-11-24T08:07:20.208492+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:24:14.423040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.202754+0000","last_change":"2023-11-24T08:07:17.208978+0000","last_active":"2023-11-24T08:07:20.202754+0000","last_peered":"2023-11-24T08:07:20.202754+0000","last_clean":"2023-11-24T08:07:20.202754+0000","last_became_active":"2023-11-24T08:07:17.208688+0000","last_became_peered":"2023-11-24T08:07:17.208688+0000","last_unstale":"2023-11-24T08:07:20.202754+0000","last_undegraded":"2023-11-24T08:07:20.202754+0000","last_fullsized":"2023-11-24T08:07:20.202754+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:20.165710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804293+0000","last_change":"2023-11-24T08:07:17.189819+0000","last_active":"2023-11-24T08:07:18.804293+0000","last_peered":"2023-11-24T08:07:18.804293+0000","last_clean":"2023-11-24T08:07:18.804293+0000","last_became_active":"2023-11-24T08:07:17.189536+0000","last_became_peered":"2023-11-24T08:07:17.189536+0000","last_unstale":"2023-11-24T08:07:18.804293+0000","last_undegraded":"2023-11-24T08:07:18.804293+0000","last_fullsized":"2023-11-24T08:07:18.804293+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:35.365864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207862+0000","last_change":"2023-11-24T08:07:17.195442+0000","last_active":"2023-11-24T08:07:19.207862+0000","last_peered":"2023-11-24T08:07:19.207862+0000","last_clean":"2023-11-24T08:07:19.207862+0000","last_became_active":"2023-11-24T08:07:17.195138+0000","last_became_peered":"2023-11-24T08:07:17.195138+0000","last_unstale":"2023-11-24T08:07:19.207862+0000","last_undegraded":"2023-11-24T08:07:19.207862+0000","last_fullsized":"2023-11-24T08:07:19.207862+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:38.869591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.208185+0000","last_change":"2023-11-24T08:07:17.194043+0000","last_active":"2023-11-24T08:07:20.208185+0000","last_peered":"2023-11-24T08:07:20.208185+0000","last_clean":"2023-11-24T08:07:20.208185+0000","last_became_active":"2023-11-24T08:07:17.193750+0000","last_became_peered":"2023-11-24T08:07:17.193750+0000","last_unstale":"2023-11-24T08:07:20.208185+0000","last_undegraded":"2023-11-24T08:07:20.208185+0000","last_fullsized":"2023-11-24T08:07:20.208185+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:48:24.305042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188669+0000","last_change":"2023-11-24T08:07:17.199275+0000","last_active":"2023-11-24T08:07:18.188669+0000","last_peered":"2023-11-24T08:07:18.188669+0000","last_clean":"2023-11-24T08:07:18.188669+0000","last_became_active":"2023-11-24T08:07:17.199000+0000","last_became_peered":"2023-11-24T08:07:17.199000+0000","last_unstale":"2023-11-24T08:07:18.188669+0000","last_undegraded":"2023-11-24T08:07:18.188669+0000","last_fullsized":"2023-11-24T08:07:18.188669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:40.760439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189316+0000","last_change":"2023-11-24T08:07:17.190049+0000","last_active":"2023-11-24T08:07:18.189316+0000","last_peered":"2023-11-24T08:07:18.189316+0000","last_clean":"2023-11-24T08:07:18.189316+0000","last_became_active":"2023-11-24T08:07:17.189806+0000","last_became_peered":"2023-11-24T08:07:17.189806+0000","last_unstale":"2023-11-24T08:07:18.189316+0000","last_undegraded":"2023-11-24T08:07:18.189316+0000","last_fullsized":"2023-11-24T08:07:18.189316+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:20.792379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.202560+0000","last_change":"2023-11-24T08:07:17.205410+0000","last_active":"2023-11-24T08:07:20.202560+0000","last_peered":"2023-11-24T08:07:20.202560+0000","last_clean":"2023-11-24T08:07:20.202560+0000","last_became_active":"2023-11-24T08:07:17.204847+0000","last_became_peered":"2023-11-24T08:07:17.204847+0000","last_unstale":"2023-11-24T08:07:20.202560+0000","last_undegraded":"2023-11-24T08:07:20.202560+0000","last_fullsized":"2023-11-24T08:07:20.202560+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:59:39.764307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.190065+0000","last_change":"2023-11-24T08:07:17.196920+0000","last_active":"2023-11-24T08:07:18.190065+0000","last_peered":"2023-11-24T08:07:18.190065+0000","last_clean":"2023-11-24T08:07:18.190065+0000","last_became_active":"2023-11-24T08:07:17.196650+0000","last_became_peered":"2023-11-24T08:07:17.196650+0000","last_unstale":"2023-11-24T08:07:18.190065+0000","last_undegraded":"2023-11-24T08:07:18.190065+0000","last_fullsized":"2023-11-24T08:07:18.190065+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:04.463252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.208468+0000","last_change":"2023-11-24T08:07:17.191041+0000","last_active":"2023-11-24T08:07:20.208468+0000","last_peered":"2023-11-24T08:07:20.208468+0000","last_clean":"2023-11-24T08:07:20.208468+0000","last_became_active":"2023-11-24T08:07:17.190785+0000","last_became_peered":"2023-11-24T08:07:17.190785+0000","last_unstale":"2023-11-24T08:07:20.208468+0000","last_undegraded":"2023-11-24T08:07:20.208468+0000","last_fullsized":"2023-11-24T08:07:20.208468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:08:31.816367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.208771+0000","last_change":"2023-11-24T08:07:17.207106+0000","last_active":"2023-11-24T08:07:20.208771+0000","last_peered":"2023-11-24T08:07:20.208771+0000","last_clean":"2023-11-24T08:07:20.208771+0000","last_became_active":"2023-11-24T08:07:17.206817+0000","last_became_peered":"2023-11-24T08:07:17.206817+0000","last_unstale":"2023-11-24T08:07:20.208771+0000","last_undegraded":"2023-11-24T08:07:20.208771+0000","last_fullsized":"2023-11-24T08:07:20.208771+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:39:32.891742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208075+0000","last_change":"2023-11-24T08:07:17.187544+0000","last_active":"2023-11-24T08:07:19.208075+0000","last_peered":"2023-11-24T08:07:19.208075+0000","last_clean":"2023-11-24T08:07:19.208075+0000","last_became_active":"2023-11-24T08:07:17.187258+0000","last_became_peered":"2023-11-24T08:07:17.187258+0000","last_unstale":"2023-11-24T08:07:19.208075+0000","last_undegraded":"2023-11-24T08:07:19.208075+0000","last_fullsized":"2023-11-24T08:07:19.208075+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:24.288792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206462+0000","last_change":"2023-11-24T08:07:17.193544+0000","last_active":"2023-11-24T08:07:18.206462+0000","last_peered":"2023-11-24T08:07:18.206462+0000","last_clean":"2023-11-24T08:07:18.206462+0000","last_became_active":"2023-11-24T08:07:17.193154+0000","last_became_peered":"2023-11-24T08:07:17.193154+0000","last_unstale":"2023-11-24T08:07:18.206462+0000","last_undegraded":"2023-11-24T08:07:18.206462+0000","last_fullsized":"2023-11-24T08:07:18.206462+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:38.225244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189547+0000","last_change":"2023-11-24T08:07:17.196815+0000","last_active":"2023-11-24T08:07:18.189547+0000","last_peered":"2023-11-24T08:07:18.189547+0000","last_clean":"2023-11-24T08:07:18.189547+0000","last_became_active":"2023-11-24T08:07:17.196512+0000","last_became_peered":"2023-11-24T08:07:17.196512+0000","last_unstale":"2023-11-24T08:07:18.189547+0000","last_undegraded":"2023-11-24T08:07:18.189547+0000","last_fullsized":"2023-11-24T08:07:18.189547+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:18.667181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189367+0000","last_change":"2023-11-24T08:07:17.190518+0000","last_active":"2023-11-24T08:07:18.189367+0000","last_peered":"2023-11-24T08:07:18.189367+0000","last_clean":"2023-11-24T08:07:18.189367+0000","last_became_active":"2023-11-24T08:07:17.190263+0000","last_became_peered":"2023-11-24T08:07:17.190263+0000","last_unstale":"2023-11-24T08:07:18.189367+0000","last_undegraded":"2023-11-24T08:07:18.189367+0000","last_fullsized":"2023-11-24T08:07:18.189367+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:40:47.719972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188549+0000","last_change":"2023-11-24T08:07:17.193665+0000","last_active":"2023-11-24T08:07:18.188549+0000","last_peered":"2023-11-24T08:07:18.188549+0000","last_clean":"2023-11-24T08:07:18.188549+0000","last_became_active":"2023-11-24T08:07:17.193341+0000","last_became_peered":"2023-11-24T08:07:17.193341+0000","last_unstale":"2023-11-24T08:07:18.188549+0000","last_undegraded":"2023-11-24T08:07:18.188549+0000","last_fullsized":"2023-11-24T08:07:18.188549+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:20:27.189383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.203076+0000","last_change":"2023-11-24T08:07:17.206696+0000","last_active":"2023-11-24T08:07:20.203076+0000","last_peered":"2023-11-24T08:07:20.203076+0000","last_clean":"2023-11-24T08:07:20.203076+0000","last_became_active":"2023-11-24T08:07:17.206419+0000","last_became_peered":"2023-11-24T08:07:17.206419+0000","last_unstale":"2023-11-24T08:07:20.203076+0000","last_undegraded":"2023-11-24T08:07:20.203076+0000","last_fullsized":"2023-11-24T08:07:20.203076+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:00:22.639832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804470+0000","last_change":"2023-11-24T08:07:17.197464+0000","last_active":"2023-11-24T08:07:18.804470+0000","last_peered":"2023-11-24T08:07:18.804470+0000","last_clean":"2023-11-24T08:07:18.804470+0000","last_became_active":"2023-11-24T08:07:17.197082+0000","last_became_peered":"2023-11-24T08:07:17.197082+0000","last_unstale":"2023-11-24T08:07:18.804470+0000","last_undegraded":"2023-11-24T08:07:18.804470+0000","last_fullsized":"2023-11-24T08:07:18.804470+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:27.801456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.208212+0000","last_change":"2023-11-24T08:07:17.207499+0000","last_active":"2023-11-24T08:07:20.208212+0000","last_peered":"2023-11-24T08:07:20.208212+0000","last_clean":"2023-11-24T08:07:20.208212+0000","last_became_active":"2023-11-24T08:07:17.207197+0000","last_became_peered":"2023-11-24T08:07:17.207197+0000","last_unstale":"2023-11-24T08:07:20.208212+0000","last_undegraded":"2023-11-24T08:07:20.208212+0000","last_fullsized":"2023-11-24T08:07:20.208212+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:19:12.591442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.202789+0000","last_change":"2023-11-24T08:07:17.204353+0000","last_active":"2023-11-24T08:07:20.202789+0000","last_peered":"2023-11-24T08:07:20.202789+0000","last_clean":"2023-11-24T08:07:20.202789+0000","last_became_active":"2023-11-24T08:07:17.204083+0000","last_became_peered":"2023-11-24T08:07:17.204083+0000","last_unstale":"2023-11-24T08:07:20.202789+0000","last_undegraded":"2023-11-24T08:07:20.202789+0000","last_fullsized":"2023-11-24T08:07:20.202789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:08.633449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804072+0000","last_change":"2023-11-24T08:07:17.185420+0000","last_active":"2023-11-24T08:07:18.804072+0000","last_peered":"2023-11-24T08:07:18.804072+0000","last_clean":"2023-11-24T08:07:18.804072+0000","last_became_active":"2023-11-24T08:07:17.185048+0000","last_became_peered":"2023-11-24T08:07:17.185048+0000","last_unstale":"2023-11-24T08:07:18.804072+0000","last_undegraded":"2023-11-24T08:07:18.804072+0000","last_fullsized":"2023-11-24T08:07:18.804072+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:40.760439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.202544+0000","last_change":"2023-11-24T08:07:17.199086+0000","last_active":"2023-11-24T08:07:20.202544+0000","last_peered":"2023-11-24T08:07:20.202544+0000","last_clean":"2023-11-24T08:07:20.202544+0000","last_became_active":"2023-11-24T08:07:17.198741+0000","last_became_peered":"2023-11-24T08:07:17.198741+0000","last_unstale":"2023-11-24T08:07:20.202544+0000","last_undegraded":"2023-11-24T08:07:20.202544+0000","last_fullsized":"2023-11-24T08:07:20.202544+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:55:37.310997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804202+0000","last_change":"2023-11-24T08:07:17.201344+0000","last_active":"2023-11-24T08:07:18.804202+0000","last_peered":"2023-11-24T08:07:18.804202+0000","last_clean":"2023-11-24T08:07:18.804202+0000","last_became_active":"2023-11-24T08:07:17.201114+0000","last_became_peered":"2023-11-24T08:07:17.201114+0000","last_unstale":"2023-11-24T08:07:18.804202+0000","last_undegraded":"2023-11-24T08:07:18.804202+0000","last_fullsized":"2023-11-24T08:07:18.804202+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:27:18.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206389+0000","last_change":"2023-11-24T08:07:17.193520+0000","last_active":"2023-11-24T08:07:18.206389+0000","last_peered":"2023-11-24T08:07:18.206389+0000","last_clean":"2023-11-24T08:07:18.206389+0000","last_became_active":"2023-11-24T08:07:17.193260+0000","last_became_peered":"2023-11-24T08:07:17.193260+0000","last_unstale":"2023-11-24T08:07:18.206389+0000","last_undegraded":"2023-11-24T08:07:18.206389+0000","last_fullsized":"2023-11-24T08:07:18.206389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:12:09.300685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.208607+0000","last_change":"2023-11-24T08:07:17.203324+0000","last_active":"2023-11-24T08:07:20.208607+0000","last_peered":"2023-11-24T08:07:20.208607+0000","last_clean":"2023-11-24T08:07:20.208607+0000","last_became_active":"2023-11-24T08:07:17.203041+0000","last_became_peered":"2023-11-24T08:07:17.203041+0000","last_unstale":"2023-11-24T08:07:20.208607+0000","last_undegraded":"2023-11-24T08:07:20.208607+0000","last_fullsized":"2023-11-24T08:07:20.208607+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:28:26.582796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208047+0000","last_change":"2023-11-24T08:07:17.188171+0000","last_active":"2023-11-24T08:07:19.208047+0000","last_peered":"2023-11-24T08:07:19.208047+0000","last_clean":"2023-11-24T08:07:19.208047+0000","last_became_active":"2023-11-24T08:07:17.187868+0000","last_became_peered":"2023-11-24T08:07:17.187868+0000","last_unstale":"2023-11-24T08:07:19.208047+0000","last_undegraded":"2023-11-24T08:07:19.208047+0000","last_fullsized":"2023-11-24T08:07:19.208047+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:27.801456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188775+0000","last_change":"2023-11-24T08:07:17.193603+0000","last_active":"2023-11-24T08:07:18.188775+0000","last_peered":"2023-11-24T08:07:18.188775+0000","last_clean":"2023-11-24T08:07:18.188775+0000","last_became_active":"2023-11-24T08:07:17.193317+0000","last_became_peered":"2023-11-24T08:07:17.193317+0000","last_unstale":"2023-11-24T08:07:18.188775+0000","last_undegraded":"2023-11-24T08:07:18.188775+0000","last_fullsized":"2023-11-24T08:07:18.188775+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:27:18.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.208485+0000","last_change":"2023-11-24T08:07:17.198118+0000","last_active":"2023-11-24T08:07:20.208485+0000","last_peered":"2023-11-24T08:07:20.208485+0000","last_clean":"2023-11-24T08:07:20.208485+0000","last_became_active":"2023-11-24T08:07:17.197795+0000","last_became_peered":"2023-11-24T08:07:17.197795+0000","last_unstale":"2023-11-24T08:07:20.208485+0000","last_undegraded":"2023-11-24T08:07:20.208485+0000","last_fullsized":"2023-11-24T08:07:20.208485+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:52:14.038751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.202648+0000","last_change":"2023-11-24T08:07:17.204123+0000","last_active":"2023-11-24T08:07:20.202648+0000","last_peered":"2023-11-24T08:07:20.202648+0000","last_clean":"2023-11-24T08:07:20.202648+0000","last_became_active":"2023-11-24T08:07:17.203834+0000","last_became_peered":"2023-11-24T08:07:17.203834+0000","last_unstale":"2023-11-24T08:07:20.202648+0000","last_undegraded":"2023-11-24T08:07:20.202648+0000","last_fullsized":"2023-11-24T08:07:20.202648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:09.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804147+0000","last_change":"2023-11-24T08:07:17.189911+0000","last_active":"2023-11-24T08:07:18.804147+0000","last_peered":"2023-11-24T08:07:18.804147+0000","last_clean":"2023-11-24T08:07:18.804147+0000","last_became_active":"2023-11-24T08:07:17.189630+0000","last_became_peered":"2023-11-24T08:07:17.189630+0000","last_unstale":"2023-11-24T08:07:18.804147+0000","last_undegraded":"2023-11-24T08:07:18.804147+0000","last_fullsized":"2023-11-24T08:07:18.804147+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:12:18.638091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.208121+0000","last_change":"2023-11-24T08:07:17.194793+0000","last_active":"2023-11-24T08:07:20.208121+0000","last_peered":"2023-11-24T08:07:20.208121+0000","last_clean":"2023-11-24T08:07:20.208121+0000","last_became_active":"2023-11-24T08:07:17.194542+0000","last_became_peered":"2023-11-24T08:07:17.194542+0000","last_unstale":"2023-11-24T08:07:20.208121+0000","last_undegraded":"2023-11-24T08:07:20.208121+0000","last_fullsized":"2023-11-24T08:07:20.208121+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:15:02.553222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188593+0000","last_change":"2023-11-24T08:07:17.206142+0000","last_active":"2023-11-24T08:07:18.188593+0000","last_peered":"2023-11-24T08:07:18.188593+0000","last_clean":"2023-11-24T08:07:18.188593+0000","last_became_active":"2023-11-24T08:07:17.205826+0000","last_became_peered":"2023-11-24T08:07:17.205826+0000","last_unstale":"2023-11-24T08:07:18.188593+0000","last_undegraded":"2023-11-24T08:07:18.188593+0000","last_fullsized":"2023-11-24T08:07:18.188593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:02.597084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188931+0000","last_change":"2023-11-24T08:07:17.199047+0000","last_active":"2023-11-24T08:07:18.188931+0000","last_peered":"2023-11-24T08:07:18.188931+0000","last_clean":"2023-11-24T08:07:18.188931+0000","last_became_active":"2023-11-24T08:07:17.198143+0000","last_became_peered":"2023-11-24T08:07:17.198143+0000","last_unstale":"2023-11-24T08:07:18.188931+0000","last_undegraded":"2023-11-24T08:07:18.188931+0000","last_fullsized":"2023-11-24T08:07:18.188931+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:38.869591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"55'4","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189024+0000","last_change":"2023-11-24T08:07:16.191958+0000","last_active":"2023-11-24T08:07:18.189024+0000","last_peered":"2023-11-24T08:07:18.189024+0000","last_clean":"2023-11-24T08:07:18.189024+0000","last_became_active":"2023-11-24T08:07:16.191668+0000","last_became_peered":"2023-11-24T08:07:16.191668+0000","last_unstale":"2023-11-24T08:07:18.189024+0000","last_undegraded":"2023-11-24T08:07:18.189024+0000","last_fullsized":"2023-11-24T08:07:18.189024+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:40:46.718141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.208754+0000","last_change":"2023-11-24T08:07:17.201426+0000","last_active":"2023-11-24T08:07:20.208754+0000","last_peered":"2023-11-24T08:07:20.208754+0000","last_clean":"2023-11-24T08:07:20.208754+0000","last_became_active":"2023-11-24T08:07:17.201204+0000","last_became_peered":"2023-11-24T08:07:17.201204+0000","last_unstale":"2023-11-24T08:07:20.208754+0000","last_undegraded":"2023-11-24T08:07:20.208754+0000","last_fullsized":"2023-11-24T08:07:20.208754+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:49.821904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"55'1","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.150342+0000","last_change":"2023-11-24T08:07:16.186030+0000","last_active":"2023-11-24T08:07:20.150342+0000","last_peered":"2023-11-24T08:07:20.150342+0000","last_clean":"2023-11-24T08:07:20.150342+0000","last_became_active":"2023-11-24T08:07:16.185741+0000","last_became_peered":"2023-11-24T08:07:16.185741+0000","last_unstale":"2023-11-24T08:07:20.150342+0000","last_undegraded":"2023-11-24T08:07:20.150342+0000","last_fullsized":"2023-11-24T08:07:20.150342+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:27.915371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188932+0000","last_change":"2023-11-24T08:07:17.204222+0000","last_active":"2023-11-24T08:07:18.188932+0000","last_peered":"2023-11-24T08:07:18.188932+0000","last_clean":"2023-11-24T08:07:18.188932+0000","last_became_active":"2023-11-24T08:07:17.203937+0000","last_became_peered":"2023-11-24T08:07:17.203937+0000","last_unstale":"2023-11-24T08:07:18.188932+0000","last_undegraded":"2023-11-24T08:07:18.188932+0000","last_fullsized":"2023-11-24T08:07:18.188932+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:09.339405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189016+0000","last_change":"2023-11-24T08:07:16.190759+0000","last_active":"2023-11-24T08:07:18.189016+0000","last_peered":"2023-11-24T08:07:18.189016+0000","last_clean":"2023-11-24T08:07:18.189016+0000","last_became_active":"2023-11-24T08:07:16.190431+0000","last_became_peered":"2023-11-24T08:07:16.190431+0000","last_unstale":"2023-11-24T08:07:18.189016+0000","last_undegraded":"2023-11-24T08:07:18.189016+0000","last_fullsized":"2023-11-24T08:07:18.189016+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:04.126257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188923+0000","last_change":"2023-11-24T08:07:17.198207+0000","last_active":"2023-11-24T08:07:18.188923+0000","last_peered":"2023-11-24T08:07:18.188923+0000","last_clean":"2023-11-24T08:07:18.188923+0000","last_became_active":"2023-11-24T08:07:17.197912+0000","last_became_peered":"2023-11-24T08:07:17.197912+0000","last_unstale":"2023-11-24T08:07:18.188923+0000","last_undegraded":"2023-11-24T08:07:18.188923+0000","last_fullsized":"2023-11-24T08:07:18.188923+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:35.365864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207880+0000","last_change":"2023-11-24T08:07:16.188390+0000","last_active":"2023-11-24T08:07:19.207880+0000","last_peered":"2023-11-24T08:07:19.207880+0000","last_clean":"2023-11-24T08:07:19.207880+0000","last_became_active":"2023-11-24T08:07:16.188106+0000","last_became_peered":"2023-11-24T08:07:16.188106+0000","last_unstale":"2023-11-24T08:07:19.207880+0000","last_undegraded":"2023-11-24T08:07:19.207880+0000","last_fullsized":"2023-11-24T08:07:19.207880+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:01.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.202719+0000","last_change":"2023-11-24T08:07:17.197427+0000","last_active":"2023-11-24T08:07:20.202719+0000","last_peered":"2023-11-24T08:07:20.202719+0000","last_clean":"2023-11-24T08:07:20.202719+0000","last_became_active":"2023-11-24T08:07:17.197067+0000","last_became_peered":"2023-11-24T08:07:17.197067+0000","last_unstale":"2023-11-24T08:07:20.202719+0000","last_undegraded":"2023-11-24T08:07:20.202719+0000","last_fullsized":"2023-11-24T08:07:20.202719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:15:22.200314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189413+0000","last_change":"2023-11-24T08:07:16.188707+0000","last_active":"2023-11-24T08:07:18.189413+0000","last_peered":"2023-11-24T08:07:18.189413+0000","last_clean":"2023-11-24T08:07:18.189413+0000","last_became_active":"2023-11-24T08:07:16.188435+0000","last_became_peered":"2023-11-24T08:07:16.188435+0000","last_unstale":"2023-11-24T08:07:18.189413+0000","last_undegraded":"2023-11-24T08:07:18.189413+0000","last_fullsized":"2023-11-24T08:07:18.189413+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:16:02.069798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.202672+0000","last_change":"2023-11-24T08:07:17.206338+0000","last_active":"2023-11-24T08:07:20.202672+0000","last_peered":"2023-11-24T08:07:20.202672+0000","last_clean":"2023-11-24T08:07:20.202672+0000","last_became_active":"2023-11-24T08:07:17.203765+0000","last_became_peered":"2023-11-24T08:07:17.203765+0000","last_unstale":"2023-11-24T08:07:20.202672+0000","last_undegraded":"2023-11-24T08:07:20.202672+0000","last_fullsized":"2023-11-24T08:07:20.202672+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:47:22.832540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189020+0000","last_change":"2023-11-24T08:07:16.187166+0000","last_active":"2023-11-24T08:07:18.189020+0000","last_peered":"2023-11-24T08:07:18.189020+0000","last_clean":"2023-11-24T08:07:18.189020+0000","last_became_active":"2023-11-24T08:07:16.186788+0000","last_became_peered":"2023-11-24T08:07:16.186788+0000","last_unstale":"2023-11-24T08:07:18.189020+0000","last_undegraded":"2023-11-24T08:07:18.189020+0000","last_fullsized":"2023-11-24T08:07:18.189020+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:33.543544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206377+0000","last_change":"2023-11-24T08:07:17.194780+0000","last_active":"2023-11-24T08:07:18.206377+0000","last_peered":"2023-11-24T08:07:18.206377+0000","last_clean":"2023-11-24T08:07:18.206377+0000","last_became_active":"2023-11-24T08:07:17.194363+0000","last_became_peered":"2023-11-24T08:07:17.194363+0000","last_unstale":"2023-11-24T08:07:18.206377+0000","last_undegraded":"2023-11-24T08:07:18.206377+0000","last_fullsized":"2023-11-24T08:07:18.206377+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:24.061349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207641+0000","last_change":"2023-11-24T08:07:16.192409+0000","last_active":"2023-11-24T08:07:19.207641+0000","last_peered":"2023-11-24T08:07:19.207641+0000","last_clean":"2023-11-24T08:07:19.207641+0000","last_became_active":"2023-11-24T08:07:16.192149+0000","last_became_peered":"2023-11-24T08:07:16.192149+0000","last_unstale":"2023-11-24T08:07:19.207641+0000","last_undegraded":"2023-11-24T08:07:19.207641+0000","last_fullsized":"2023-11-24T08:07:19.207641+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:03.658086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.202605+0000","last_change":"2023-11-24T08:07:17.201531+0000","last_active":"2023-11-24T08:07:20.202605+0000","last_peered":"2023-11-24T08:07:20.202605+0000","last_clean":"2023-11-24T08:07:20.202605+0000","last_became_active":"2023-11-24T08:07:17.201361+0000","last_became_peered":"2023-11-24T08:07:17.201361+0000","last_unstale":"2023-11-24T08:07:20.202605+0000","last_undegraded":"2023-11-24T08:07:20.202605+0000","last_fullsized":"2023-11-24T08:07:20.202605+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:55:20.176157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189413+0000","last_change":"2023-11-24T08:07:16.190913+0000","last_active":"2023-11-24T08:07:18.189413+0000","last_peered":"2023-11-24T08:07:18.189413+0000","last_clean":"2023-11-24T08:07:18.189413+0000","last_became_active":"2023-11-24T08:07:16.190618+0000","last_became_peered":"2023-11-24T08:07:16.190618+0000","last_unstale":"2023-11-24T08:07:18.189413+0000","last_undegraded":"2023-11-24T08:07:18.189413+0000","last_fullsized":"2023-11-24T08:07:18.189413+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:05:17.781694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189936+0000","last_change":"2023-11-24T08:07:17.187816+0000","last_active":"2023-11-24T08:07:18.189936+0000","last_peered":"2023-11-24T08:07:18.189936+0000","last_clean":"2023-11-24T08:07:18.189936+0000","last_became_active":"2023-11-24T08:07:17.187474+0000","last_became_peered":"2023-11-24T08:07:17.187474+0000","last_unstale":"2023-11-24T08:07:18.189936+0000","last_undegraded":"2023-11-24T08:07:18.189936+0000","last_fullsized":"2023-11-24T08:07:18.189936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:25.629866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804482+0000","last_change":"2023-11-24T08:07:16.188953+0000","last_active":"2023-11-24T08:07:18.804482+0000","last_peered":"2023-11-24T08:07:18.804482+0000","last_clean":"2023-11-24T08:07:18.804482+0000","last_became_active":"2023-11-24T08:07:16.188680+0000","last_became_peered":"2023-11-24T08:07:16.188680+0000","last_unstale":"2023-11-24T08:07:18.804482+0000","last_undegraded":"2023-11-24T08:07:18.804482+0000","last_fullsized":"2023-11-24T08:07:18.804482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:40:46.718141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804486+0000","last_change":"2023-11-24T08:07:17.192181+0000","last_active":"2023-11-24T08:07:18.804486+0000","last_peered":"2023-11-24T08:07:18.804486+0000","last_clean":"2023-11-24T08:07:18.804486+0000","last_became_active":"2023-11-24T08:07:17.191917+0000","last_became_peered":"2023-11-24T08:07:17.191917+0000","last_unstale":"2023-11-24T08:07:18.804486+0000","last_undegraded":"2023-11-24T08:07:18.804486+0000","last_fullsized":"2023-11-24T08:07:18.804486+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:06.401104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.150353+0000","last_change":"2023-11-24T08:07:16.186812+0000","last_active":"2023-11-24T08:07:20.150353+0000","last_peered":"2023-11-24T08:07:20.150353+0000","last_clean":"2023-11-24T08:07:20.150353+0000","last_became_active":"2023-11-24T08:07:16.186597+0000","last_became_peered":"2023-11-24T08:07:16.186597+0000","last_unstale":"2023-11-24T08:07:20.150353+0000","last_undegraded":"2023-11-24T08:07:20.150353+0000","last_fullsized":"2023-11-24T08:07:20.150353+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:29.628416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.208305+0000","last_change":"2023-11-24T08:07:17.188865+0000","last_active":"2023-11-24T08:07:20.208305+0000","last_peered":"2023-11-24T08:07:20.208305+0000","last_clean":"2023-11-24T08:07:20.208305+0000","last_became_active":"2023-11-24T08:07:17.187505+0000","last_became_peered":"2023-11-24T08:07:17.187505+0000","last_unstale":"2023-11-24T08:07:20.208305+0000","last_undegraded":"2023-11-24T08:07:20.208305+0000","last_fullsized":"2023-11-24T08:07:20.208305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:20:22.657955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"55'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804518+0000","last_change":"2023-11-24T08:07:16.190858+0000","last_active":"2023-11-24T08:07:18.804518+0000","last_peered":"2023-11-24T08:07:18.804518+0000","last_clean":"2023-11-24T08:07:18.804518+0000","last_became_active":"2023-11-24T08:07:16.190524+0000","last_became_peered":"2023-11-24T08:07:16.190524+0000","last_unstale":"2023-11-24T08:07:18.804518+0000","last_undegraded":"2023-11-24T08:07:18.804518+0000","last_fullsized":"2023-11-24T08:07:18.804518+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:04.126257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804392+0000","last_change":"2023-11-24T08:07:17.191966+0000","last_active":"2023-11-24T08:07:18.804392+0000","last_peered":"2023-11-24T08:07:18.804392+0000","last_clean":"2023-11-24T08:07:18.804392+0000","last_became_active":"2023-11-24T08:07:17.191689+0000","last_became_peered":"2023-11-24T08:07:17.191689+0000","last_unstale":"2023-11-24T08:07:18.804392+0000","last_undegraded":"2023-11-24T08:07:18.804392+0000","last_fullsized":"2023-11-24T08:07:18.804392+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:09.339405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'6","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189848+0000","last_change":"2023-11-24T08:07:16.189704+0000","last_active":"2023-11-24T08:07:18.189848+0000","last_peered":"2023-11-24T08:07:18.189848+0000","last_clean":"2023-11-24T08:07:18.189848+0000","last_became_active":"2023-11-24T08:07:16.189366+0000","last_became_peered":"2023-11-24T08:07:16.189366+0000","last_unstale":"2023-11-24T08:07:18.189848+0000","last_undegraded":"2023-11-24T08:07:18.189848+0000","last_fullsized":"2023-11-24T08:07:18.189848+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:06:12.223817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207716+0000","last_change":"2023-11-24T08:07:17.186838+0000","last_active":"2023-11-24T08:07:19.207716+0000","last_peered":"2023-11-24T08:07:19.207716+0000","last_clean":"2023-11-24T08:07:19.207716+0000","last_became_active":"2023-11-24T08:07:17.186088+0000","last_became_peered":"2023-11-24T08:07:17.186088+0000","last_unstale":"2023-11-24T08:07:19.207716+0000","last_undegraded":"2023-11-24T08:07:19.207716+0000","last_fullsized":"2023-11-24T08:07:19.207716+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:35.365864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.150290+0000","last_change":"2023-11-24T08:07:16.183695+0000","last_active":"2023-11-24T08:07:20.150290+0000","last_peered":"2023-11-24T08:07:20.150290+0000","last_clean":"2023-11-24T08:07:20.150290+0000","last_became_active":"2023-11-24T08:07:16.183417+0000","last_became_peered":"2023-11-24T08:07:16.183417+0000","last_unstale":"2023-11-24T08:07:20.150290+0000","last_undegraded":"2023-11-24T08:07:20.150290+0000","last_fullsized":"2023-11-24T08:07:20.150290+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:17.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804069+0000","last_change":"2023-11-24T08:07:17.185883+0000","last_active":"2023-11-24T08:07:18.804069+0000","last_peered":"2023-11-24T08:07:18.804069+0000","last_clean":"2023-11-24T08:07:18.804069+0000","last_became_active":"2023-11-24T08:07:17.185665+0000","last_became_peered":"2023-11-24T08:07:17.185665+0000","last_unstale":"2023-11-24T08:07:18.804069+0000","last_undegraded":"2023-11-24T08:07:18.804069+0000","last_fullsized":"2023-11-24T08:07:18.804069+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:02.597084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206537+0000","last_change":"2023-11-24T08:07:16.186374+0000","last_active":"2023-11-24T08:07:18.206537+0000","last_peered":"2023-11-24T08:07:18.206537+0000","last_clean":"2023-11-24T08:07:18.206537+0000","last_became_active":"2023-11-24T08:07:16.185991+0000","last_became_peered":"2023-11-24T08:07:16.185991+0000","last_unstale":"2023-11-24T08:07:18.206537+0000","last_undegraded":"2023-11-24T08:07:18.206537+0000","last_fullsized":"2023-11-24T08:07:18.206537+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:45.244221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189317+0000","last_change":"2023-11-24T08:07:17.196173+0000","last_active":"2023-11-24T08:07:18.189317+0000","last_peered":"2023-11-24T08:07:18.189317+0000","last_clean":"2023-11-24T08:07:18.189317+0000","last_became_active":"2023-11-24T08:07:17.195895+0000","last_became_peered":"2023-11-24T08:07:17.195895+0000","last_unstale":"2023-11-24T08:07:18.189317+0000","last_undegraded":"2023-11-24T08:07:18.189317+0000","last_fullsized":"2023-11-24T08:07:18.189317+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:15.211019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207641+0000","last_change":"2023-11-24T08:07:16.188423+0000","last_active":"2023-11-24T08:07:19.207641+0000","last_peered":"2023-11-24T08:07:19.207641+0000","last_clean":"2023-11-24T08:07:19.207641+0000","last_became_active":"2023-11-24T08:07:16.187930+0000","last_became_peered":"2023-11-24T08:07:16.187930+0000","last_unstale":"2023-11-24T08:07:19.207641+0000","last_undegraded":"2023-11-24T08:07:19.207641+0000","last_fullsized":"2023-11-24T08:07:19.207641+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:58:40.127886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804044+0000","last_change":"2023-11-24T08:07:17.201398+0000","last_active":"2023-11-24T08:07:18.804044+0000","last_peered":"2023-11-24T08:07:18.804044+0000","last_clean":"2023-11-24T08:07:18.804044+0000","last_became_active":"2023-11-24T08:07:17.201131+0000","last_became_peered":"2023-11-24T08:07:17.201131+0000","last_unstale":"2023-11-24T08:07:18.804044+0000","last_undegraded":"2023-11-24T08:07:18.804044+0000","last_fullsized":"2023-11-24T08:07:18.804044+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:20:27.189383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"55'8","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.803902+0000","last_change":"2023-11-24T08:07:16.188284+0000","last_active":"2023-11-24T08:07:18.803902+0000","last_peered":"2023-11-24T08:07:18.803902+0000","last_clean":"2023-11-24T08:07:18.803902+0000","last_became_active":"2023-11-24T08:07:16.188009+0000","last_became_peered":"2023-11-24T08:07:16.188009+0000","last_unstale":"2023-11-24T08:07:18.803902+0000","last_undegraded":"2023-11-24T08:07:18.803902+0000","last_fullsized":"2023-11-24T08:07:18.803902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:17.665349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804494+0000","last_change":"2023-11-24T08:07:17.191415+0000","last_active":"2023-11-24T08:07:18.804494+0000","last_peered":"2023-11-24T08:07:18.804494+0000","last_clean":"2023-11-24T08:07:18.804494+0000","last_became_active":"2023-11-24T08:07:17.191197+0000","last_became_peered":"2023-11-24T08:07:17.191197+0000","last_unstale":"2023-11-24T08:07:18.804494+0000","last_undegraded":"2023-11-24T08:07:18.804494+0000","last_fullsized":"2023-11-24T08:07:18.804494+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:14:25.777271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"55'1","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.150391+0000","last_change":"2023-11-24T08:07:16.183924+0000","last_active":"2023-11-24T08:07:20.150391+0000","last_peered":"2023-11-24T08:07:20.150391+0000","last_clean":"2023-11-24T08:07:20.150391+0000","last_became_active":"2023-11-24T08:07:16.183661+0000","last_became_peered":"2023-11-24T08:07:16.183661+0000","last_unstale":"2023-11-24T08:07:20.150391+0000","last_undegraded":"2023-11-24T08:07:20.150391+0000","last_fullsized":"2023-11-24T08:07:20.150391+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:16.531795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208061+0000","last_change":"2023-11-24T08:07:17.187802+0000","last_active":"2023-11-24T08:07:19.208061+0000","last_peered":"2023-11-24T08:07:19.208061+0000","last_clean":"2023-11-24T08:07:19.208061+0000","last_became_active":"2023-11-24T08:07:17.187480+0000","last_became_peered":"2023-11-24T08:07:17.187480+0000","last_unstale":"2023-11-24T08:07:19.208061+0000","last_undegraded":"2023-11-24T08:07:19.208061+0000","last_fullsized":"2023-11-24T08:07:19.208061+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:14:25.777271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188955+0000","last_change":"2023-11-24T08:07:16.185036+0000","last_active":"2023-11-24T08:07:18.188955+0000","last_peered":"2023-11-24T08:07:18.188955+0000","last_clean":"2023-11-24T08:07:18.188955+0000","last_became_active":"2023-11-24T08:07:16.184256+0000","last_became_peered":"2023-11-24T08:07:16.184256+0000","last_unstale":"2023-11-24T08:07:18.188955+0000","last_undegraded":"2023-11-24T08:07:18.188955+0000","last_fullsized":"2023-11-24T08:07:18.188955+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:03.461420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.202909+0000","last_change":"2023-11-24T08:07:17.204102+0000","last_active":"2023-11-24T08:07:20.202909+0000","last_peered":"2023-11-24T08:07:20.202909+0000","last_clean":"2023-11-24T08:07:20.202909+0000","last_became_active":"2023-11-24T08:07:17.203783+0000","last_became_peered":"2023-11-24T08:07:17.203783+0000","last_unstale":"2023-11-24T08:07:20.202909+0000","last_undegraded":"2023-11-24T08:07:20.202909+0000","last_fullsized":"2023-11-24T08:07:20.202909+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:56:47.429030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207971+0000","last_change":"2023-11-24T08:07:16.188743+0000","last_active":"2023-11-24T08:07:19.207971+0000","last_peered":"2023-11-24T08:07:19.207971+0000","last_clean":"2023-11-24T08:07:19.207971+0000","last_became_active":"2023-11-24T08:07:16.188194+0000","last_became_peered":"2023-11-24T08:07:16.188194+0000","last_unstale":"2023-11-24T08:07:19.207971+0000","last_undegraded":"2023-11-24T08:07:19.207971+0000","last_fullsized":"2023-11-24T08:07:19.207971+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:56.643741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804468+0000","last_change":"2023-11-24T08:07:17.203355+0000","last_active":"2023-11-24T08:07:18.804468+0000","last_peered":"2023-11-24T08:07:18.804468+0000","last_clean":"2023-11-24T08:07:18.804468+0000","last_became_active":"2023-11-24T08:07:17.203052+0000","last_became_peered":"2023-11-24T08:07:17.203052+0000","last_unstale":"2023-11-24T08:07:18.804468+0000","last_undegraded":"2023-11-24T08:07:18.804468+0000","last_fullsized":"2023-11-24T08:07:18.804468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:38.869591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188955+0000","last_change":"2023-11-24T08:07:16.189779+0000","last_active":"2023-11-24T08:07:18.188955+0000","last_peered":"2023-11-24T08:07:18.188955+0000","last_clean":"2023-11-24T08:07:18.188955+0000","last_became_active":"2023-11-24T08:07:16.189511+0000","last_became_peered":"2023-11-24T08:07:16.189511+0000","last_unstale":"2023-11-24T08:07:18.188955+0000","last_undegraded":"2023-11-24T08:07:18.188955+0000","last_fullsized":"2023-11-24T08:07:18.188955+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:11.555487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207727+0000","last_change":"2023-11-24T08:07:17.184803+0000","last_active":"2023-11-24T08:07:19.207727+0000","last_peered":"2023-11-24T08:07:19.207727+0000","last_clean":"2023-11-24T08:07:19.207727+0000","last_became_active":"2023-11-24T08:07:17.184452+0000","last_became_peered":"2023-11-24T08:07:17.184452+0000","last_unstale":"2023-11-24T08:07:19.207727+0000","last_undegraded":"2023-11-24T08:07:19.207727+0000","last_fullsized":"2023-11-24T08:07:19.207727+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:09.339405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"55'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.150301+0000","last_change":"2023-11-24T08:07:16.183810+0000","last_active":"2023-11-24T08:07:20.150301+0000","last_peered":"2023-11-24T08:07:20.150301+0000","last_clean":"2023-11-24T08:07:20.150301+0000","last_became_active":"2023-11-24T08:07:16.183401+0000","last_became_peered":"2023-11-24T08:07:16.183401+0000","last_unstale":"2023-11-24T08:07:20.150301+0000","last_undegraded":"2023-11-24T08:07:20.150301+0000","last_fullsized":"2023-11-24T08:07:20.150301+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:30.418602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188810+0000","last_change":"2023-11-24T08:07:17.194675+0000","last_active":"2023-11-24T08:07:18.188810+0000","last_peered":"2023-11-24T08:07:18.188810+0000","last_clean":"2023-11-24T08:07:18.188810+0000","last_became_active":"2023-11-24T08:07:17.193462+0000","last_became_peered":"2023-11-24T08:07:17.193462+0000","last_unstale":"2023-11-24T08:07:18.188810+0000","last_undegraded":"2023-11-24T08:07:18.188810+0000","last_fullsized":"2023-11-24T08:07:18.188810+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:14.418374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.152338+0000","last_change":"2023-11-24T08:07:16.184028+0000","last_active":"2023-11-24T08:07:20.152338+0000","last_peered":"2023-11-24T08:07:20.152338+0000","last_clean":"2023-11-24T08:07:20.152338+0000","last_became_active":"2023-11-24T08:07:16.183141+0000","last_became_peered":"2023-11-24T08:07:16.183141+0000","last_unstale":"2023-11-24T08:07:20.152338+0000","last_undegraded":"2023-11-24T08:07:20.152338+0000","last_fullsized":"2023-11-24T08:07:20.152338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:12:08.298853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.188701+0000","last_change":"2023-11-24T08:07:17.197022+0000","last_active":"2023-11-24T08:07:18.188701+0000","last_peered":"2023-11-24T08:07:18.188701+0000","last_clean":"2023-11-24T08:07:18.188701+0000","last_became_active":"2023-11-24T08:07:17.196692+0000","last_became_peered":"2023-11-24T08:07:17.196692+0000","last_unstale":"2023-11-24T08:07:18.188701+0000","last_undegraded":"2023-11-24T08:07:18.188701+0000","last_fullsized":"2023-11-24T08:07:18.188701+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:12:18.638091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.207643+0000","last_change":"2023-11-24T08:07:16.191153+0000","last_active":"2023-11-24T08:07:19.207643+0000","last_peered":"2023-11-24T08:07:19.207643+0000","last_clean":"2023-11-24T08:07:19.207643+0000","last_became_active":"2023-11-24T08:07:16.190708+0000","last_became_peered":"2023-11-24T08:07:16.190708+0000","last_unstale":"2023-11-24T08:07:19.207643+0000","last_undegraded":"2023-11-24T08:07:19.207643+0000","last_fullsized":"2023-11-24T08:07:19.207643+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:04.126257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208057+0000","last_change":"2023-11-24T08:07:17.196220+0000","last_active":"2023-11-24T08:07:19.208057+0000","last_peered":"2023-11-24T08:07:19.208057+0000","last_clean":"2023-11-24T08:07:19.208057+0000","last_became_active":"2023-11-24T08:07:17.195957+0000","last_became_peered":"2023-11-24T08:07:17.195957+0000","last_unstale":"2023-11-24T08:07:19.208057+0000","last_undegraded":"2023-11-24T08:07:19.208057+0000","last_fullsized":"2023-11-24T08:07:19.208057+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:06.401104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"55'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.152460+0000","last_change":"2023-11-24T08:07:16.187486+0000","last_active":"2023-11-24T08:07:20.152460+0000","last_peered":"2023-11-24T08:07:20.152460+0000","last_clean":"2023-11-24T08:07:20.152460+0000","last_became_active":"2023-11-24T08:07:16.187189+0000","last_became_peered":"2023-11-24T08:07:16.187189+0000","last_unstale":"2023-11-24T08:07:20.152460+0000","last_undegraded":"2023-11-24T08:07:20.152460+0000","last_fullsized":"2023-11-24T08:07:20.152460+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:37.223412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208142+0000","last_change":"2023-11-24T08:07:17.188247+0000","last_active":"2023-11-24T08:07:19.208142+0000","last_peered":"2023-11-24T08:07:19.208142+0000","last_clean":"2023-11-24T08:07:19.208142+0000","last_became_active":"2023-11-24T08:07:17.187906+0000","last_became_peered":"2023-11-24T08:07:17.187906+0000","last_unstale":"2023-11-24T08:07:19.208142+0000","last_undegraded":"2023-11-24T08:07:19.208142+0000","last_fullsized":"2023-11-24T08:07:19.208142+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:07:09.020680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.150161+0000","last_change":"2023-11-24T08:07:16.186426+0000","last_active":"2023-11-24T08:07:20.150161+0000","last_peered":"2023-11-24T08:07:20.150161+0000","last_clean":"2023-11-24T08:07:20.150161+0000","last_became_active":"2023-11-24T08:07:16.186169+0000","last_became_peered":"2023-11-24T08:07:16.186169+0000","last_unstale":"2023-11-24T08:07:20.150161+0000","last_undegraded":"2023-11-24T08:07:20.150161+0000","last_fullsized":"2023-11-24T08:07:20.150161+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:42.024368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.208441+0000","last_change":"2023-11-24T08:07:17.188756+0000","last_active":"2023-11-24T08:07:20.208441+0000","last_peered":"2023-11-24T08:07:20.208441+0000","last_clean":"2023-11-24T08:07:20.208441+0000","last_became_active":"2023-11-24T08:07:17.187474+0000","last_became_peered":"2023-11-24T08:07:17.187474+0000","last_unstale":"2023-11-24T08:07:20.208441+0000","last_undegraded":"2023-11-24T08:07:20.208441+0000","last_fullsized":"2023-11-24T08:07:20.208441+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:59:07.612678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206549+0000","last_change":"2023-11-24T08:07:16.186393+0000","last_active":"2023-11-24T08:07:18.206549+0000","last_peered":"2023-11-24T08:07:18.206549+0000","last_clean":"2023-11-24T08:07:18.206549+0000","last_became_active":"2023-11-24T08:07:16.186039+0000","last_became_peered":"2023-11-24T08:07:16.186039+0000","last_unstale":"2023-11-24T08:07:18.206549+0000","last_undegraded":"2023-11-24T08:07:18.206549+0000","last_fullsized":"2023-11-24T08:07:18.206549+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:21:17.770283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189138+0000","last_change":"2023-11-24T08:07:17.192983+0000","last_active":"2023-11-24T08:07:18.189138+0000","last_peered":"2023-11-24T08:07:18.189138+0000","last_clean":"2023-11-24T08:07:18.189138+0000","last_became_active":"2023-11-24T08:07:17.192689+0000","last_became_peered":"2023-11-24T08:07:17.192689+0000","last_unstale":"2023-11-24T08:07:18.189138+0000","last_undegraded":"2023-11-24T08:07:18.189138+0000","last_fullsized":"2023-11-24T08:07:18.189138+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:27.801456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:19.208098+0000","last_change":"2023-11-24T08:07:16.191883+0000","last_active":"2023-11-24T08:07:19.208098+0000","last_peered":"2023-11-24T08:07:19.208098+0000","last_clean":"2023-11-24T08:07:19.208098+0000","last_became_active":"2023-11-24T08:07:16.191618+0000","last_became_peered":"2023-11-24T08:07:16.191618+0000","last_unstale":"2023-11-24T08:07:19.208098+0000","last_undegraded":"2023-11-24T08:07:19.208098+0000","last_fullsized":"2023-11-24T08:07:19.208098+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:39.758608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.202705+0000","last_change":"2023-11-24T08:07:17.204056+0000","last_active":"2023-11-24T08:07:20.202705+0000","last_peered":"2023-11-24T08:07:20.202705+0000","last_clean":"2023-11-24T08:07:20.202705+0000","last_became_active":"2023-11-24T08:07:17.203806+0000","last_became_peered":"2023-11-24T08:07:17.203806+0000","last_unstale":"2023-11-24T08:07:20.202705+0000","last_undegraded":"2023-11-24T08:07:20.202705+0000","last_fullsized":"2023-11-24T08:07:20.202705+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:04.730056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.152348+0000","last_change":"2023-11-24T08:07:16.188255+0000","last_active":"2023-11-24T08:07:20.152348+0000","last_peered":"2023-11-24T08:07:20.152348+0000","last_clean":"2023-11-24T08:07:20.152348+0000","last_became_active":"2023-11-24T08:07:16.188023+0000","last_became_peered":"2023-11-24T08:07:16.188023+0000","last_unstale":"2023-11-24T08:07:20.152348+0000","last_undegraded":"2023-11-24T08:07:20.152348+0000","last_fullsized":"2023-11-24T08:07:20.152348+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:23.059518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.804288+0000","last_change":"2023-11-24T08:07:17.205660+0000","last_active":"2023-11-24T08:07:18.804288+0000","last_peered":"2023-11-24T08:07:18.804288+0000","last_clean":"2023-11-24T08:07:18.804288+0000","last_became_active":"2023-11-24T08:07:17.205464+0000","last_became_peered":"2023-11-24T08:07:17.205464+0000","last_unstale":"2023-11-24T08:07:18.804288+0000","last_undegraded":"2023-11-24T08:07:18.804288+0000","last_fullsized":"2023-11-24T08:07:18.804288+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:14.418374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.189588+0000","last_change":"2023-11-24T08:07:16.189666+0000","last_active":"2023-11-24T08:07:18.189588+0000","last_peered":"2023-11-24T08:07:18.189588+0000","last_clean":"2023-11-24T08:07:18.189588+0000","last_became_active":"2023-11-24T08:07:16.189352+0000","last_became_peered":"2023-11-24T08:07:16.189352+0000","last_unstale":"2023-11-24T08:07:18.189588+0000","last_undegraded":"2023-11-24T08:07:18.189588+0000","last_fullsized":"2023-11-24T08:07:18.189588+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:07.597709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.207930+0000","last_change":"2023-11-24T08:07:17.190380+0000","last_active":"2023-11-24T08:07:20.207930+0000","last_peered":"2023-11-24T08:07:20.207930+0000","last_clean":"2023-11-24T08:07:20.207930+0000","last_became_active":"2023-11-24T08:07:17.190072+0000","last_became_peered":"2023-11-24T08:07:17.190072+0000","last_unstale":"2023-11-24T08:07:20.207930+0000","last_undegraded":"2023-11-24T08:07:20.207930+0000","last_fullsized":"2023-11-24T08:07:20.207930+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:58:06.203735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.152326+0000","last_change":"2023-11-24T08:07:16.183771+0000","last_active":"2023-11-24T08:07:20.152326+0000","last_peered":"2023-11-24T08:07:20.152326+0000","last_clean":"2023-11-24T08:07:20.152326+0000","last_became_active":"2023-11-24T08:07:16.183520+0000","last_became_peered":"2023-11-24T08:07:16.183520+0000","last_unstale":"2023-11-24T08:07:20.152326+0000","last_undegraded":"2023-11-24T08:07:20.152326+0000","last_fullsized":"2023-11-24T08:07:20.152326+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:31.500908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.202612+0000","last_change":"2023-11-24T08:07:17.200497+0000","last_active":"2023-11-24T08:07:20.202612+0000","last_peered":"2023-11-24T08:07:20.202612+0000","last_clean":"2023-11-24T08:07:20.202612+0000","last_became_active":"2023-11-24T08:07:17.200246+0000","last_became_peered":"2023-11-24T08:07:17.200246+0000","last_unstale":"2023-11-24T08:07:20.202612+0000","last_undegraded":"2023-11-24T08:07:20.202612+0000","last_fullsized":"2023-11-24T08:07:20.202612+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:47:25.806945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.150147+0000","last_change":"2023-11-24T08:07:16.190699+0000","last_active":"2023-11-24T08:07:20.150147+0000","last_peered":"2023-11-24T08:07:20.150147+0000","last_clean":"2023-11-24T08:07:20.150147+0000","last_became_active":"2023-11-24T08:07:16.190329+0000","last_became_peered":"2023-11-24T08:07:16.190329+0000","last_unstale":"2023-11-24T08:07:20.150147+0000","last_undegraded":"2023-11-24T08:07:20.150147+0000","last_fullsized":"2023-11-24T08:07:20.150147+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:17:07.065898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:20.203321+0000","last_change":"2023-11-24T08:07:17.205230+0000","last_active":"2023-11-24T08:07:20.203321+0000","last_peered":"2023-11-24T08:07:20.203321+0000","last_clean":"2023-11-24T08:07:20.203321+0000","last_became_active":"2023-11-24T08:07:17.204508+0000","last_became_peered":"2023-11-24T08:07:17.204508+0000","last_unstale":"2023-11-24T08:07:20.203321+0000","last_undegraded":"2023-11-24T08:07:20.203321+0000","last_fullsized":"2023-11-24T08:07:20.203321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:16.163949+0000","last_clean_scrub_stamp":"2023-11-24T08:07:16.163949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:54:10.718982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-24T08:07:18.206321+0000","last_change":"2023-11-24T08:07:16.188316+0000","last_active":"2023-11-24T08:07:18.206321+0000","last_peered":"2023-11-24T08:07:18.206321+0000","last_clean":"2023-11-24T08:07:18.206321+0000","last_became_active":"2023-11-24T08:07:16.188025+0000","last_became_peered":"2023-11-24T08:07:16.188025+0000","last_unstale":"2023-11-24T08:07:18.206321+0000","last_undegraded":"2023-11-24T08:07:18.206321+0000","last_fullsized":"2023-11-24T08:07:18.206321+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:15.162118+0000","last_clean_scrub_stamp":"2023-11-24T08:07:15.162118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:29.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.177856+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:07:17.177856+0000","last_peered":"2023-11-24T08:07:17.177856+0000","last_clean":"2023-11-24T08:07:17.177856+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:07:17.177856+0000","last_undegraded":"2023-11-24T08:07:17.177856+0000","last_fullsized":"2023-11-24T08:07:17.177856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1273856,"data_stored":868487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72199999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.073,"15min":1.073},"last":0.753}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.33200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.629}]},{"osd":5,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":277959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":10.285,"15min":10.285},"last":0.434}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.307},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.745,"5min":2.089,"15min":2.089},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68400000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.497}]},{"osd":4,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.747,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.59199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":675840,"data_stored":278049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.27100000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33300000000000002,"15min":0.31900000000000001},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.314},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.39500000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.626,"15min":0.626},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.5,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60699999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1659999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.754}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1277952,"data_stored":869502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.251},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.625,"5min":1.343,"15min":1.343},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61299999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.35099999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.33600000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78600000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.60399999999999998,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.93200000000000005,"15min":1.0720000000000001},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82499999999999996,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.032,"15min":1.204},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":4,"15min":4},"last":0.54800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":278015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.316,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.497,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.44,"15min":0.47199999999999998},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.51700000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53600000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.5},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61799999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.435}]},{"osd":3,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.59099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":5.673,"15min":5.673},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":1.216,"15min":1.216},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.246,"15min":1.246},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.82699999999999996},"min":{"1min":0.503,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.82999999999999996},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82099999999999995,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.758,"15min":5.758},"last":0.752}]},{"osd":6,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.89000000000000001},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":5.726,"15min":5.726},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.499,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.80300000000000005,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89400000000000002,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.94899999999999995},"min":{"1min":0.52000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99399999999999999,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":278015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.39600000000000002},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.59699999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58799999999999997,"5min":1.351,"15min":1.351},"last":0.36199999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40100000000000002,"15min":0.42699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.503,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.745,"5min":1.621,"15min":1.621},"last":0.307}]},{"osd":2,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.439},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63900000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.379},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45800000000000002,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64500000000000002,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80500000000000005,"5min":1.389,"15min":1.389},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90700000000000003,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.88},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.675,"15min":1.675},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":1.417,"15min":1.417},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.67100000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.84299999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95899999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":279571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.5},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.95099999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77100000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.81799999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":1.101,"15min":1.101},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.93100000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.90200000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":1.476,"15min":1.476},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.751,"5min":1.556,"15min":1.556},"last":1.0089999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":278611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.76700000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":1,"15min":1},"last":0.80900000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.82999999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.77300000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":0.752},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.96099999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.92200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:26.208 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:07:26.208 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T08:07:26.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.370+0000 7f28b5fe6700 1 Processor -- start 2023-11-24T08:07:26.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.370+0000 7f28b5fe6700 1 -- start start 2023-11-24T08:07:26.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28b5fe6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28b01587f0 0x7f28b006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28b5fe6700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f28b015b370 0x7f28b015b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28b5fe6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28b00b3c60 0x7f28b00b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28b5fe6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b00b4610 con 0x7f28b00b3c60 2023-11-24T08:07:26.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28b5fe6700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b006b530 con 0x7f28b015b370 2023-11-24T08:07:26.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28b5fe6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00ae5e0 con 0x7f28b01587f0 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28affff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28b00b3c60 0x7f28b00b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28affff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28b00b3c60 0x7f28b00b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39642/0 (socket says 172.21.15.153:39642) 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28affff700 1 -- 172.21.15.153:0/1967991505 learned_addr learned my addr 172.21.15.153:0/1967991505 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28aeffd700 1 --2- 172.21.15.153:0/1967991505 >> v2:172.21.15.164:3300/0 conn(0x7f28b015b370 0x7f28b015b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28af7fe700 1 --2- 172.21.15.153:0/1967991505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28b01587f0 0x7f28b006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28affff700 1 -- 172.21.15.153:0/1967991505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28b01587f0 msgr2=0x7f28b006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28affff700 1 --2- 172.21.15.153:0/1967991505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28b01587f0 0x7f28b006aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28affff700 1 -- 172.21.15.153:0/1967991505 >> v2:172.21.15.164:3300/0 conn(0x7f28b015b370 msgr2=0x7f28b015b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28affff700 1 --2- 172.21.15.153:0/1967991505 >> v2:172.21.15.164:3300/0 conn(0x7f28b015b370 0x7f28b015b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28affff700 1 -- 172.21.15.153:0/1967991505 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b015be30 con 0x7f28b00b3c60 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28af7fe700 1 --2- 172.21.15.153:0/1967991505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28b01587f0 0x7f28b006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:26.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28affff700 1 --2- 172.21.15.153:0/1967991505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b00b3c60 0x7f28b00b40d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f28b0072e10 tx=0x7f28a800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7005bdc75202253 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28ae7fc700 1 -- 172.21.15.153:0/1967991505 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a8010070 con 0x7f28b00b3c60 2023-11-24T08:07:26.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28ae7fc700 1 -- 172.21.15.153:0/1967991505 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a800dd90 con 0x7f28b00b3c60 2023-11-24T08:07:26.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.371+0000 7f28ae7fc700 1 -- 172.21.15.153:0/1967991505 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800b310 con 0x7f28b00b3c60 2023-11-24T08:07:26.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.372+0000 7f28b5fe6700 1 -- 172.21.15.153:0/1967991505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b00b3c60 msgr2=0x7f28b00b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.372+0000 7f28b5fe6700 1 --2- 172.21.15.153:0/1967991505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b00b3c60 0x7f28b00b40d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f28b0072e10 tx=0x7f28a800d430 comp rx=0 tx=0).stop 2023-11-24T08:07:26.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.372+0000 7f28b5fe6700 1 -- 172.21.15.153:0/1967991505 shutdown_connections 2023-11-24T08:07:26.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.372+0000 7f28b5fe6700 1 --2- 172.21.15.153:0/1967991505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b00b3c60 0x7f28b00b40d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.372+0000 7f28b5fe6700 1 --2- 172.21.15.153:0/1967991505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28b01587f0 0x7f28b006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.372+0000 7f28b5fe6700 1 --2- 172.21.15.153:0/1967991505 >> v2:172.21.15.164:3300/0 conn(0x7f28b015b370 0x7f28b015b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.372+0000 7f28b5fe6700 1 -- 172.21.15.153:0/1967991505 >> 172.21.15.153:0/1967991505 conn(0x7f28b00d0bf0 msgr2=0x7f28b00d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:26.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.372+0000 7f28b5fe6700 1 -- 172.21.15.153:0/1967991505 shutdown_connections 2023-11-24T08:07:26.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.372+0000 7f28b5fe6700 1 -- 172.21.15.153:0/1967991505 wait complete. 2023-11-24T08:07:26.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.373+0000 7f28b5fe6700 1 Processor -- start 2023-11-24T08:07:26.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.374+0000 7f28b5fe6700 1 -- start start 2023-11-24T08:07:26.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28b5fe6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28b00b3c60 0x7f28b009c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28b5fe6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b01587f0 0x7f28b01ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28b5fe6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28b015b370 0x7f28b00aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28b5fe6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00b0900 con 0x7f28b01587f0 2023-11-24T08:07:26.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28b5fe6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00b0310 con 0x7f28b00b3c60 2023-11-24T08:07:26.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28b5fe6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b01f0100 con 0x7f28b015b370 2023-11-24T08:07:26.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28aeffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b01587f0 0x7f28b01ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28aeffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b01587f0 0x7f28b01ef5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39646/0 (socket says 172.21.15.153:39646) 2023-11-24T08:07:26.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28aeffd700 1 -- 172.21.15.153:0/4034120008 learned_addr learned my addr 172.21.15.153:0/4034120008 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:26.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28af7fe700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28b00b3c60 0x7f28b009c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28affff700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28b015b370 0x7f28b00aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28aeffd700 1 -- 172.21.15.153:0/4034120008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28b015b370 msgr2=0x7f28b00aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28aeffd700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28b015b370 0x7f28b00aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28aeffd700 1 -- 172.21.15.153:0/4034120008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28b00b3c60 msgr2=0x7f28b009c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28aeffd700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28b00b3c60 0x7f28b009c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28aeffd700 1 -- 172.21.15.153:0/4034120008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a800bd40 con 0x7f28b01587f0 2023-11-24T08:07:26.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28aeffd700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b01587f0 0x7f28b01ef5f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f28a400d800 tx=0x7f28a400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f2897fff700 1 -- 172.21.15.153:0/4034120008 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a40125f0 con 0x7f28b01587f0 2023-11-24T08:07:26.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f2897fff700 1 -- 172.21.15.153:0/4034120008 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a4012750 con 0x7f28b01587f0 2023-11-24T08:07:26.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28b5fe6700 1 -- 172.21.15.153:0/4034120008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b01f03e0 con 0x7f28b01587f0 2023-11-24T08:07:26.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f2897fff700 1 -- 172.21.15.153:0/4034120008 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4012b00 con 0x7f28b01587f0 2023-11-24T08:07:26.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.375+0000 7f28b5fe6700 1 -- 172.21.15.153:0/4034120008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b0074cf0 con 0x7f28b01587f0 2023-11-24T08:07:26.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.376+0000 7f28b5fe6700 1 -- 172.21.15.153:0/4034120008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b0068fb0 con 0x7f28b01587f0 2023-11-24T08:07:26.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.377+0000 7f2897fff700 1 -- 172.21.15.153:0/4034120008 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f28a4012c60 con 0x7f28b01587f0 2023-11-24T08:07:26.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.377+0000 7f2897fff700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f289c06b080 0x7f289c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.377+0000 7f2897fff700 1 -- 172.21.15.153:0/4034120008 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28a4089890 con 0x7f28b01587f0 2023-11-24T08:07:26.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.377+0000 7f28af7fe700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f289c06b080 0x7f289c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.378+0000 7f28af7fe700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f289c06b080 0x7f289c06d540 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f28a0006fd0 tx=0x7f28a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.382+0000 7f2897fff700 1 -- 172.21.15.153:0/4034120008 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28a4054750 con 0x7f28b01587f0 2023-11-24T08:07:26.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.649+0000 7f28b5fe6700 1 -- 172.21.15.153:0/4034120008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f28b00b00f0 con 0x7f28b01587f0 2023-11-24T08:07:26.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.651+0000 7f2897fff700 1 -- 172.21.15.153:0/4034120008 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f28a4057d70 con 0x7f28b01587f0 2023-11-24T08:07:26.653 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2023-11-24T08:07:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDIWGBlu28wOBAATnuO3XTplxrcn9JD3ta5XQ== 2023-11-24T08:07:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: caps mds = "allow" 2023-11-24T08:07:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: caps mon = "allow r" 2023-11-24T08:07:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T08:07:26.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.653+0000 7f28b5fe6700 1 -- 172.21.15.153:0/4034120008 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f289c06b080 msgr2=0x7f289c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.653+0000 7f28b5fe6700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f289c06b080 0x7f289c06d540 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f28a0006fd0 tx=0x7f28a0008040 comp rx=0 tx=0).stop 2023-11-24T08:07:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.653+0000 7f28b5fe6700 1 -- 172.21.15.153:0/4034120008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b01587f0 msgr2=0x7f28b01ef5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.653+0000 7f28b5fe6700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b01587f0 0x7f28b01ef5f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f28a400d800 tx=0x7f28a400db10 comp rx=0 tx=0).stop 2023-11-24T08:07:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.654+0000 7f28b5fe6700 1 -- 172.21.15.153:0/4034120008 shutdown_connections 2023-11-24T08:07:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.654+0000 7f28b5fe6700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28b015b370 0x7f28b00aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.654+0000 7f28b5fe6700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28b00b3c60 0x7f28b009c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.654+0000 7f28b5fe6700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f289c06b080 0x7f289c06d540 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.654+0000 7f28b5fe6700 1 --2- 172.21.15.153:0/4034120008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b01587f0 0x7f28b01ef5f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.654+0000 7f28b5fe6700 1 -- 172.21.15.153:0/4034120008 >> 172.21.15.153:0/4034120008 conn(0x7f28b00d0bf0 msgr2=0x7f28b00cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.654+0000 7f28b5fe6700 1 -- 172.21.15.153:0/4034120008 shutdown_connections 2023-11-24T08:07:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.654+0000 7f28b5fe6700 1 -- 172.21.15.153:0/4034120008 wait complete. 2023-11-24T08:07:26.657 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-11-24T08:07:26.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:26.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.786+0000 7f6fd5570700 1 Processor -- start 2023-11-24T08:07:26.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.786+0000 7f6fd5570700 1 -- start start 2023-11-24T08:07:26.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fd5570700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6fd015e0f0 0x7f6fd00b9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fd5570700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6fd00cf2a0 0x7f6fd00d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fd5570700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd006bc00 con 0x7f6fd00b2b60 2023-11-24T08:07:26.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fd5570700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd015e4d0 con 0x7f6fd015e0f0 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fd5570700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd006aff0 con 0x7f6fd00cf2a0 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fceffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6fd015e0f0 0x7f6fd00b9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fce7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6fd00b2b60 0x7f6fd00ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45758/0 (socket says 172.21.15.153:45758) 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fce7fc700 1 -- 172.21.15.153:0/261993741 learned_addr learned my addr 172.21.15.153:0/261993741 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fcf7fe700 1 --2- 172.21.15.153:0/261993741 >> v2:172.21.15.164:3300/0 conn(0x7f6fd00cf2a0 0x7f6fd00d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fceffd700 1 -- 172.21.15.153:0/261993741 >> v2:172.21.15.164:3300/0 conn(0x7f6fd00cf2a0 msgr2=0x7f6fd00d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fceffd700 1 --2- 172.21.15.153:0/261993741 >> v2:172.21.15.164:3300/0 conn(0x7f6fd00cf2a0 0x7f6fd00d1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fceffd700 1 -- 172.21.15.153:0/261993741 >> v1:172.21.15.153:6789/0 conn(0x7f6fd00b2b60 legacy=0x7f6fd00ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fceffd700 1 -- 172.21.15.153:0/261993741 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd006b2d0 con 0x7f6fd015e0f0 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fcdffb700 1 -- 172.21.15.153:0/261993741 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834808523 0 0) 0x7f6fd006bc00 con 0x7f6fd00b2b60 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fcf7fe700 1 --2- 172.21.15.153:0/261993741 >> v2:172.21.15.164:3300/0 conn(0x7f6fd00cf2a0 0x7f6fd00d1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.787+0000 7f6fceffd700 1 --2- 172.21.15.153:0/261993741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fd015e0f0 0x7f6fd00b9700 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00b2fe0 tx=0x7f6fc4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8651c7452c9e3e44 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.788+0000 7f6fcdffb700 1 -- 172.21.15.153:0/261993741 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4011830 con 0x7f6fd015e0f0 2023-11-24T08:07:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.788+0000 7f6fcdffb700 1 -- 172.21.15.153:0/261993741 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc4011990 con 0x7f6fd015e0f0 2023-11-24T08:07:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.788+0000 7f6fcdffb700 1 -- 172.21.15.153:0/261993741 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4011d20 con 0x7f6fd015e0f0 2023-11-24T08:07:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.788+0000 7f6fd5570700 1 -- 172.21.15.153:0/261993741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fd015e0f0 msgr2=0x7f6fd00b9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.788+0000 7f6fd5570700 1 --2- 172.21.15.153:0/261993741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fd015e0f0 0x7f6fd00b9700 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00b2fe0 tx=0x7f6fc4009b20 comp rx=0 tx=0).stop 2023-11-24T08:07:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.788+0000 7f6fd5570700 1 -- 172.21.15.153:0/261993741 shutdown_connections 2023-11-24T08:07:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.788+0000 7f6fd5570700 1 --2- 172.21.15.153:0/261993741 >> v2:172.21.15.164:3300/0 conn(0x7f6fd00cf2a0 0x7f6fd00d1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.788+0000 7f6fd5570700 1 --2- 172.21.15.153:0/261993741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fd015e0f0 0x7f6fd00b9700 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.788+0000 7f6fd5570700 1 -- 172.21.15.153:0/261993741 >> 172.21.15.153:0/261993741 conn(0x7f6fd00b5ce0 msgr2=0x7f6fd00b60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.788+0000 7f6fd5570700 1 -- 172.21.15.153:0/261993741 shutdown_connections 2023-11-24T08:07:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.788+0000 7f6fd5570700 1 -- 172.21.15.153:0/261993741 wait complete. 2023-11-24T08:07:26.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.789+0000 7f6fd5570700 1 Processor -- start 2023-11-24T08:07:26.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.789+0000 7f6fd5570700 1 -- start start 2023-11-24T08:07:26.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.790+0000 7f6fd5570700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd00b2b60 0x7f6fd0151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.790+0000 7f6fd5570700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fd00cf2a0 0x7f6fd00c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.790+0000 7f6fd5570700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fd015e0f0 0x7f6fd00b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.790+0000 7f6fd5570700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd015f3c0 con 0x7f6fd00cf2a0 2023-11-24T08:07:26.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.790+0000 7f6fd5570700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd015f6a0 con 0x7f6fd015e0f0 2023-11-24T08:07:26.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.790+0000 7f6fd5570700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd015f980 con 0x7f6fd00b2b60 2023-11-24T08:07:26.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.790+0000 7f6fce7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fd00cf2a0 0x7f6fd00c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.790+0000 7f6fce7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fd00cf2a0 0x7f6fd00c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39660/0 (socket says 172.21.15.153:39660) 2023-11-24T08:07:26.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.790+0000 7f6fce7fc700 1 -- 172.21.15.153:0/1472905968 learned_addr learned my addr 172.21.15.153:0/1472905968 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:26.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.791+0000 7f6fce7fc700 1 -- 172.21.15.153:0/1472905968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd00b2b60 msgr2=0x7f6fd0151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.791+0000 7f6fce7fc700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd00b2b60 0x7f6fd0151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.791+0000 7f6fce7fc700 1 -- 172.21.15.153:0/1472905968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fd015e0f0 msgr2=0x7f6fd00b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.791+0000 7f6fce7fc700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fd015e0f0 0x7f6fd00b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.791+0000 7f6fce7fc700 1 -- 172.21.15.153:0/1472905968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc40094a0 con 0x7f6fd00cf2a0 2023-11-24T08:07:26.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.791+0000 7f6fce7fc700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fd00cf2a0 0x7f6fd00c93f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00011e0 tx=0x7f6fc000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.791+0000 7f6fb77fe700 1 -- 172.21.15.153:0/1472905968 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0004c80 con 0x7f6fd00cf2a0 2023-11-24T08:07:26.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.791+0000 7f6fb77fe700 1 -- 172.21.15.153:0/1472905968 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc0004e00 con 0x7f6fd00cf2a0 2023-11-24T08:07:26.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.791+0000 7f6fb77fe700 1 -- 172.21.15.153:0/1472905968 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0007310 con 0x7f6fd00cf2a0 2023-11-24T08:07:26.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.791+0000 7f6fd5570700 1 -- 172.21.15.153:0/1472905968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd015fc60 con 0x7f6fd00cf2a0 2023-11-24T08:07:26.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.791+0000 7f6fd5570700 1 -- 172.21.15.153:0/1472905968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd0160460 con 0x7f6fd00cf2a0 2023-11-24T08:07:26.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.792+0000 7f6fd5570700 1 -- 172.21.15.153:0/1472905968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd00751e0 con 0x7f6fd00cf2a0 2023-11-24T08:07:26.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.792+0000 7f6fb77fe700 1 -- 172.21.15.153:0/1472905968 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6fc0007470 con 0x7f6fd00cf2a0 2023-11-24T08:07:26.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.792+0000 7f6fb77fe700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6fbc06b080 0x7f6fbc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.793+0000 7f6fb77fe700 1 -- 172.21.15.153:0/1472905968 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fc00896a0 con 0x7f6fd00cf2a0 2023-11-24T08:07:26.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.793+0000 7f6fceffd700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6fbc06b080 0x7f6fbc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.793+0000 7f6fceffd700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6fbc06b080 0x7f6fbc06d540 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00c9380 tx=0x7f6fc4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:26.797+0000 7f6fb77fe700 1 -- 172.21.15.153:0/1472905968 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6fc00544d0 con 0x7f6fd00cf2a0 2023-11-24T08:07:27.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.033+0000 7f6fd5570700 1 -- 172.21.15.153:0/1472905968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fd00683f0 con 0x7f6fd00cf2a0 2023-11-24T08:07:27.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.033+0000 7f6fb77fe700 1 -- 172.21.15.153:0/1472905968 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f6fc0057af0 con 0x7f6fd00cf2a0 2023-11-24T08:07:27.035 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:27.035 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3525215026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3525215026},{"type":"v1","addr":"172.21.15.153:6837","nonce":3525215026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5318,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/946995567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":946995567},{"type":"v1","addr":"172.21.15.164:6834","nonce":946995567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6075,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/3002476497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3002476497},{"type":"v1","addr":"172.21.15.153:6836","nonce":3002476497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:16.566591+0000","modified":"2023-11-24T08:07:19.587429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6090":{"gid":6090,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/3019873912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3019873912},{"type":"v1","addr":"172.21.15.164:6835","nonce":3019873912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 -- 172.21.15.153:0/1472905968 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6fbc06b080 msgr2=0x7f6fbc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6fbc06b080 0x7f6fbc06d540 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00c9380 tx=0x7f6fc4010000 comp rx=0 tx=0).stop 2023-11-24T08:07:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 -- 172.21.15.153:0/1472905968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fd00cf2a0 msgr2=0x7f6fd00c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fd00cf2a0 0x7f6fd00c93f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00011e0 tx=0x7f6fc000cae0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 -- 172.21.15.153:0/1472905968 shutdown_connections 2023-11-24T08:07:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fd015e0f0 0x7f6fd00b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd00b2b60 0x7f6fd0151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f6fbc06b080 0x7f6fbc06d540 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 --2- 172.21.15.153:0/1472905968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fd00cf2a0 0x7f6fd00c93f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 -- 172.21.15.153:0/1472905968 >> 172.21.15.153:0/1472905968 conn(0x7f6fd00b5ce0 msgr2=0x7f6fd00d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 -- 172.21.15.153:0/1472905968 shutdown_connections 2023-11-24T08:07:27.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.036+0000 7f6fd5570700 1 -- 172.21.15.153:0/1472905968 wait complete. 2023-11-24T08:07:27.039 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 36 2023-11-24T08:07:27.453 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:07:16.566591+0000', 'modified': '2023-11-24T08:07:19.587429+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6090}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6090': {'gid': 6090, 'name': 'd', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.164:6835/3019873912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6833', 'nonce': 3019873912}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 3019873912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:07:27.453 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:07:27.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-24T08:07:27.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.574+0000 7f37ee330700 1 Processor -- start 2023-11-24T08:07:27.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.574+0000 7f37ee330700 1 -- start start 2023-11-24T08:07:27.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.575+0000 7f37ee330700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f37e80b0ba0 0x7f37e80af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.575+0000 7f37ee330700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e815ee90 0x7f37e815b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.575+0000 7f37ee330700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e80b2bd0 con 0x7f37e80b0f80 2023-11-24T08:07:27.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.575+0000 7f37ee330700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e80b1fc0 con 0x7f37e80b0ba0 2023-11-24T08:07:27.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.575+0000 7f37ee330700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80b22a0 con 0x7f37e815ee90 2023-11-24T08:07:27.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.575+0000 7f37ec8cd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e815ee90 0x7f37e815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.575+0000 7f37e7fff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f37e80b0ba0 0x7f37e80af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.575+0000 7f37ec8cd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e815ee90 0x7f37e815b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:51740/0 (socket says 172.21.15.153:51740) 2023-11-24T08:07:27.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.575+0000 7f37e77fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f37e80b0f80 0x7f37e80cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:53454/0 (socket says 172.21.15.153:53454) 2023-11-24T08:07:27.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.575+0000 7f37e7fff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f37e80b0ba0 0x7f37e80af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:33020/0 (socket says 172.21.15.153:33020) 2023-11-24T08:07:27.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.575+0000 7f37ec8cd700 1 -- 172.21.15.153:0/1783557223 learned_addr learned my addr 172.21.15.153:0/1783557223 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:27.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37e6ffd700 1 -- 172.21.15.153:0/1783557223 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503388285 0 0) 0x7f37e80b2bd0 con 0x7f37e80b0f80 2023-11-24T08:07:27.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37e6ffd700 1 -- 172.21.15.153:0/1783557223 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37d40035b0 con 0x7f37e80b0f80 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37e7fff700 1 -- 172.21.15.153:0/1783557223 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e815ee90 msgr2=0x7f37e815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37e7fff700 1 --2- 172.21.15.153:0/1783557223 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e815ee90 0x7f37e815b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37e7fff700 1 -- 172.21.15.153:0/1783557223 >> v1:172.21.15.164:6789/0 conn(0x7f37e80b0f80 legacy=0x7f37e80cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37e7fff700 1 -- 172.21.15.153:0/1783557223 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e80b2580 con 0x7f37e80b0ba0 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/1783557223 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e815ee90 0x7f37e815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37e7fff700 1 --2- 172.21.15.153:0/1783557223 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37e80b0ba0 0x7f37e80af5c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009840 tx=0x7f37d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=948714d40eb726e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37e6ffd700 1 -- 172.21.15.153:0/1783557223 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0011830 con 0x7f37e80b0ba0 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37e6ffd700 1 -- 172.21.15.153:0/1783557223 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d0011990 con 0x7f37e80b0ba0 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37e6ffd700 1 -- 172.21.15.153:0/1783557223 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0011d00 con 0x7f37e80b0ba0 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.576+0000 7f37ee330700 1 -- 172.21.15.153:0/1783557223 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37e80b0ba0 msgr2=0x7f37e80af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.577+0000 7f37ee330700 1 --2- 172.21.15.153:0/1783557223 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37e80b0ba0 0x7f37e80af5c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009840 tx=0x7f37d0009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:27.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.577+0000 7f37ee330700 1 -- 172.21.15.153:0/1783557223 shutdown_connections 2023-11-24T08:07:27.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.577+0000 7f37ee330700 1 --2- 172.21.15.153:0/1783557223 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e815ee90 0x7f37e815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.577+0000 7f37ee330700 1 --2- 172.21.15.153:0/1783557223 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37e80b0ba0 0x7f37e80af5c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.577+0000 7f37ee330700 1 -- 172.21.15.153:0/1783557223 >> 172.21.15.153:0/1783557223 conn(0x7f37e80b57b0 msgr2=0x7f37e80b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.577+0000 7f37ee330700 1 -- 172.21.15.153:0/1783557223 shutdown_connections 2023-11-24T08:07:27.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.577+0000 7f37ee330700 1 -- 172.21.15.153:0/1783557223 wait complete. 2023-11-24T08:07:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.578+0000 7f37ee330700 1 Processor -- start 2023-11-24T08:07:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.578+0000 7f37ee330700 1 -- start start 2023-11-24T08:07:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.579+0000 7f37ee330700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e80b0ba0 0x7f37e81f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.579+0000 7f37ee330700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e80b0f80 0x7f37e8156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.579+0000 7f37ee330700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37e815ee90 0x7f37e80cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.579+0000 7f37ee330700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e81f4220 con 0x7f37e80b0f80 2023-11-24T08:07:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.579+0000 7f37ee330700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80adc10 con 0x7f37e815ee90 2023-11-24T08:07:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.579+0000 7f37ee330700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80ad9b0 con 0x7f37e80b0ba0 2023-11-24T08:07:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.579+0000 7f37e77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e80b0f80 0x7f37e8156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.579+0000 7f37e77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e80b0f80 0x7f37e8156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39674/0 (socket says 172.21.15.153:39674) 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.579+0000 7f37e77fe700 1 -- 172.21.15.153:0/1250137228 learned_addr learned my addr 172.21.15.153:0/1250137228 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37e7fff700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e80b0ba0 0x7f37e81f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37e815ee90 0x7f37e80cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37e77fe700 1 -- 172.21.15.153:0/1250137228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e80b0ba0 msgr2=0x7f37e81f3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37e77fe700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e80b0ba0 0x7f37e81f3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37e77fe700 1 -- 172.21.15.153:0/1250137228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37e815ee90 msgr2=0x7f37e80cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37e77fe700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37e815ee90 0x7f37e80cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37e77fe700 1 -- 172.21.15.153:0/1250137228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0009b30 con 0x7f37e80b0f80 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37e815ee90 0x7f37e80cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37e77fe700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e80b0f80 0x7f37e8156730 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c500 tx=0x7f37d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37e4ff9700 1 -- 172.21.15.153:0/1250137228 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8005cb0 con 0x7f37e80b0f80 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37e4ff9700 1 -- 172.21.15.153:0/1250137228 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d8005e10 con 0x7f37e80b0f80 2023-11-24T08:07:27.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37ee330700 1 -- 172.21.15.153:0/1250137228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d00094a0 con 0x7f37e80b0f80 2023-11-24T08:07:27.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37e4ff9700 1 -- 172.21.15.153:0/1250137228 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8007310 con 0x7f37e80b0f80 2023-11-24T08:07:27.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.580+0000 7f37ee330700 1 -- 172.21.15.153:0/1250137228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e80ade60 con 0x7f37e80b0f80 2023-11-24T08:07:27.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.581+0000 7f37e4ff9700 1 -- 172.21.15.153:0/1250137228 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f37d8007470 con 0x7f37e80b0f80 2023-11-24T08:07:27.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.582+0000 7f37e4ff9700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37c806b080 0x7f37c806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.582+0000 7f37e7fff700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37c806b080 0x7f37c806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.582+0000 7f37e4ff9700 1 -- 172.21.15.153:0/1250137228 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37d8088de0 con 0x7f37e80b0f80 2023-11-24T08:07:27.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.582+0000 7f37e7fff700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37c806b080 0x7f37c806d540 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f37d0000c00 tx=0x7f37d001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.584+0000 7f37fa529b80 1 Processor -- start 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.584+0000 7f37fa529b80 1 -- start start 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c97d5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c97f0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c97ede00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37fa529b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c971e770 con 0x5586c97f1ab0 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37fa529b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9705750 con 0x5586c97d5060 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37fa529b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586c9703070 con 0x5586c97f0ac0 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37e77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c97f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37e77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c97f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39682/0 (socket says 172.21.15.153:39682) 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37e77fe700 1 -- 172.21.15.153:0/1821880652 learned_addr learned my addr 172.21.15.153:0/1821880652 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/1821880652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c97ede00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37e7fff700 1 --2- 172.21.15.153:0/1821880652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c97d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37e77fe700 1 -- 172.21.15.153:0/1821880652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 msgr2=0x5586c97ede00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37e77fe700 1 --2- 172.21.15.153:0/1821880652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c97ede00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37e77fe700 1 -- 172.21.15.153:0/1821880652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 msgr2=0x5586c97d5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37e77fe700 1 --2- 172.21.15.153:0/1821880652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c97d5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37e77fe700 1 -- 172.21.15.153:0/1821880652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586c957b5e0 con 0x5586c97f1ab0 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37e77fe700 1 --2- 172.21.15.153:0/1821880652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c97f0580 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f37d800ccc0 tx=0x7f37d8057400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f983238e3b307b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37ddffb700 1 -- 172.21.15.153:0/1821880652 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d80577f0 con 0x5586c97f1ab0 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37ddffb700 1 -- 172.21.15.153:0/1821880652 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d8057a20 con 0x5586c97f1ab0 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.585+0000 7f37ddffb700 1 -- 172.21.15.153:0/1821880652 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8057110 con 0x5586c97f1ab0 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.586+0000 7f37fa529b80 1 -- 172.21.15.153:0/1821880652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 msgr2=0x5586c97f0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.586+0000 7f37fa529b80 1 --2- 172.21.15.153:0/1821880652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c97f0580 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f37d800ccc0 tx=0x7f37d8057400 comp rx=0 tx=0).stop 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.586+0000 7f37fa529b80 1 -- 172.21.15.153:0/1821880652 shutdown_connections 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.586+0000 7f37fa529b80 1 --2- 172.21.15.153:0/1821880652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c97ede00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.586+0000 7f37fa529b80 1 --2- 172.21.15.153:0/1821880652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c97d5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.586+0000 7f37fa529b80 1 --2- 172.21.15.153:0/1821880652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c97f0580 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.586+0000 7f37fa529b80 1 -- 172.21.15.153:0/1821880652 >> 172.21.15.153:0/1821880652 conn(0x5586c96d9310 msgr2=0x5586c97efe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.586+0000 7f37fa529b80 1 -- 172.21.15.153:0/1821880652 shutdown_connections 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.586+0000 7f37fa529b80 1 -- 172.21.15.153:0/1821880652 wait complete. 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.586+0000 7f37fa529b80 1 -- start start 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.587+0000 7f37fa529b80 1 Processor -- start 2023-11-24T08:07:27.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.587+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c97f4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.587+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c9807150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.587+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c9807690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37fa529b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c96fe960 con 0x5586c97f1ab0 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37fa529b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c96b8510 con 0x5586c97d5060 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37fa529b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586c96b81b0 con 0x5586c97f0ac0 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37fa529b80 10 client.0 _ll_register_callbacks cb 0x5586c95e3a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37ec8cd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c9807690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37ec8cd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c9807690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39690/0 (socket says 172.21.15.153:39690) 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37ec8cd700 1 -- 172.21.15.153:0/3744564371 learned_addr learned my addr 172.21.15.153:0/3744564371 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37e77fe700 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c9807150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37e7fff700 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c97f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37ec8cd700 1 -- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 msgr2=0x5586c9807150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c9807150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37ec8cd700 1 -- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 msgr2=0x5586c97f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c97f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37ec8cd700 1 -- 172.21.15.153:0/3744564371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e80ade60 con 0x5586c97f1ab0 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37e7fff700 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c97f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c9807690 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f37e0007a50 tx=0x7f37e0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcff8656639eee27 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37c6ffd700 1 -- 172.21.15.153:0/3744564371 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0011910 con 0x5586c97f1ab0 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37c6ffd700 1 -- 172.21.15.153:0/3744564371 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37e0011a70 con 0x5586c97f1ab0 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37fa529b80 1 -- 172.21.15.153:0/3744564371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586c979da40 con 0x5586c97f1ab0 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37c6ffd700 1 -- 172.21.15.153:0/3744564371 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37e0011c30 con 0x5586c97f1ab0 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37fa529b80 10 client.6240 fetch_fsmap learned FSMap version 36 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37fa529b80 1 -- 172.21.15.153:0/3744564371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5586c9527d90 con 0x5586c97f1ab0 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.588+0000 7f37c6ffd700 1 -- 172.21.15.153:0/3744564371 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586c979da40 con 0x5586c97f1ab0 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.589+0000 7f37c6ffd700 1 -- 172.21.15.153:0/3744564371 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f37e001d060 con 0x5586c97f1ab0 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.589+0000 7f37fa529b80 10 client.6240 fetch_fsmap finished waiting for FSMap version 36 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.589+0000 7f37fa529b80 10 client.6240 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.589+0000 7f37fa529b80 20 client.6240 populate_metadata read hostname 'smithi153' 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.589+0000 7f37fa529b80 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:6833/3019873912,v1:172.21.15.164:6835/3019873912] conn(0x5586c97d82a0 0x5586c97a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.589+0000 7f37fa529b80 4 client.6240 mds_command: new command op to 6090 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.589+0000 7f37fa529b80 1 -- 172.21.15.153:0/3744564371 --> [v2:172.21.15.164:6833/3019873912,v1:172.21.15.164:6835/3019873912] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586c9779840 con 0x5586c97d82a0 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.589+0000 7f37e7fff700 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:6833/3019873912,v1:172.21.15.164:6835/3019873912] conn(0x5586c97d82a0 0x5586c97a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.589+0000 7f37c6ffd700 10 client.6240 ms_handle_connect on v2:172.21.15.164:6833/3019873912 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.589+0000 7f37e7fff700 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:6833/3019873912,v1:172.21.15.164:6835/3019873912] conn(0x5586c97d82a0 0x5586c97a9dc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a8f8711ff9d9ae0 server_cookie=a28619a199e5096 in_seq=0 out_seq=0 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37c6ffd700 1 -- 172.21.15.153:0/3744564371 <== mds.0 v2:172.21.15.164:6833/3019873912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5586c9779840 con 0x5586c97d82a0 2023-11-24T08:07:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37c6ffd700 10 client.6240 handle_command_reply: tid=0 2023-11-24T08:07:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 1 client.6240 shutdown 2023-11-24T08:07:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 1 -- 172.21.15.153:0/3744564371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 msgr2=0x5586c9807690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c9807690 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f37e0007a50 tx=0x7f37e0007e10 comp rx=0 tx=0).stop 2023-11-24T08:07:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 1 -- 172.21.15.153:0/3744564371 shutdown_connections 2023-11-24T08:07:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c9807690 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:6833/3019873912,v1:172.21.15.164:6835/3019873912] conn(0x5586c97d82a0 0x5586c97a9dc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c97f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37c6ffd700 0 client.6240 ms_handle_reset on v2:172.21.15.164:6833/3019873912 2023-11-24T08:07:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 1 --2- 172.21.15.153:0/3744564371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c9807150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 1 -- 172.21.15.153:0/3744564371 >> 172.21.15.153:0/3744564371 conn(0x5586c96d9310 msgr2=0x5586c979f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 1 -- 172.21.15.153:0/3744564371 shutdown_connections 2023-11-24T08:07:27.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 1 -- 172.21.15.153:0/3744564371 wait complete. 2023-11-24T08:07:27.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.590+0000 7f37fa529b80 20 client.6240 trim_cache size 0 max 16384 2023-11-24T08:07:27.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.608+0000 7f37fa529b80 1 Processor -- start 2023-11-24T08:07:27.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.608+0000 7f37fa529b80 1 -- start start 2023-11-24T08:07:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97d5060 0x5586c97d5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f0ac0 0x5586c97d5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97f1ab0 0x5586c979ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37fa529b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c957d8d0 con 0x5586c97f0ac0 2023-11-24T08:07:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37fa529b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c97aab50 con 0x5586c97f1ab0 2023-11-24T08:07:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37fa529b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586c97ed710 con 0x5586c97d5060 2023-11-24T08:07:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37e77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f0ac0 0x5586c97d5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37e77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f0ac0 0x5586c97d5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39696/0 (socket says 172.21.15.153:39696) 2023-11-24T08:07:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37e77fe700 1 -- 172.21.15.153:0/1589695567 learned_addr learned my addr 172.21.15.153:0/1589695567 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/1589695567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97f1ab0 0x5586c979ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37e77fe700 1 -- 172.21.15.153:0/1589695567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97d5060 msgr2=0x5586c97d5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37e7fff700 1 --2- 172.21.15.153:0/1589695567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97d5060 0x5586c97d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37e77fe700 1 --2- 172.21.15.153:0/1589695567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97d5060 0x5586c97d5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37e77fe700 1 -- 172.21.15.153:0/1589695567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97f1ab0 msgr2=0x5586c979ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37e77fe700 1 --2- 172.21.15.153:0/1589695567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97f1ab0 0x5586c979ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37e77fe700 1 -- 172.21.15.153:0/1589695567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586c9510c10 con 0x5586c97f0ac0 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37e7fff700 1 --2- 172.21.15.153:0/1589695567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97d5060 0x5586c97d5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/1589695567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97f1ab0 0x5586c979ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.609+0000 7f37e77fe700 1 --2- 172.21.15.153:0/1589695567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f0ac0 0x5586c97d5980 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f37d8053f20 tx=0x7f37d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7d0a3b78653cd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37de7fc700 1 -- 172.21.15.153:0/1589695567 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d80762d0 con 0x5586c97f0ac0 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37de7fc700 1 -- 172.21.15.153:0/1589695567 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d805bb70 con 0x5586c97f0ac0 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37de7fc700 1 -- 172.21.15.153:0/1589695567 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d805fd20 con 0x5586c97f0ac0 2023-11-24T08:07:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37fa529b80 1 -- 172.21.15.153:0/1589695567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f0ac0 msgr2=0x5586c97d5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37fa529b80 1 --2- 172.21.15.153:0/1589695567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f0ac0 0x5586c97d5980 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f37d8053f20 tx=0x7f37d8017000 comp rx=0 tx=0).stop 2023-11-24T08:07:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37fa529b80 1 -- 172.21.15.153:0/1589695567 shutdown_connections 2023-11-24T08:07:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37fa529b80 1 --2- 172.21.15.153:0/1589695567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97f1ab0 0x5586c979ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37fa529b80 1 --2- 172.21.15.153:0/1589695567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97d5060 0x5586c97d5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37fa529b80 1 --2- 172.21.15.153:0/1589695567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f0ac0 0x5586c97d5980 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37fa529b80 1 -- 172.21.15.153:0/1589695567 >> 172.21.15.153:0/1589695567 conn(0x5586c96d9310 msgr2=0x5586c97efe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37fa529b80 1 -- 172.21.15.153:0/1589695567 shutdown_connections 2023-11-24T08:07:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.610+0000 7f37fa529b80 1 -- 172.21.15.153:0/1589695567 wait complete. 2023-11-24T08:07:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.611+0000 7f37fa529b80 1 -- start start 2023-11-24T08:07:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.611+0000 7f37fa529b80 1 Processor -- start 2023-11-24T08:07:27.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.612+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c985c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.612+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c979ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.612+0000 7f37fa529b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c979f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.612+0000 7f37fa529b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c97f8b50 con 0x5586c97f1ab0 2023-11-24T08:07:27.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.612+0000 7f37fa529b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c97f5de0 con 0x5586c97d5060 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.612+0000 7f37fa529b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586c97d5570 con 0x5586c97f0ac0 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.612+0000 7f37fa529b80 10 client.0 _ll_register_callbacks cb 0x5586c95e3a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.612+0000 7f37ec8cd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c979f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.612+0000 7f37ec8cd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c979f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39704/0 (socket says 172.21.15.153:39704) 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.612+0000 7f37ec8cd700 1 -- 172.21.15.153:0/632655416 learned_addr learned my addr 172.21.15.153:0/632655416 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37e77fe700 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c979ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37e7fff700 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c985c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37ec8cd700 1 -- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 msgr2=0x5586c979ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c979ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37ec8cd700 1 -- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 msgr2=0x5586c985c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c985c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37ec8cd700 1 -- 172.21.15.153:0/632655416 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586c957b5e0 con 0x5586c97f1ab0 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37e7fff700 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c985c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37ec8cd700 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c979f1f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f37e000b010 tx=0x7f37e0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d98c1a9d943b1ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37c6ffd700 1 -- 172.21.15.153:0/632655416 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0016980 con 0x5586c97f1ab0 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37c6ffd700 1 -- 172.21.15.153:0/632655416 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37e0016ae0 con 0x5586c97f1ab0 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37fa529b80 1 -- 172.21.15.153:0/632655416 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37d8057a20 con 0x5586c97f1ab0 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37c6ffd700 1 -- 172.21.15.153:0/632655416 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37e0009790 con 0x5586c97f1ab0 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37fa529b80 10 client.6246 fetch_fsmap learned FSMap version 36 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37fa529b80 1 -- 172.21.15.153:0/632655416 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5586c954e200 con 0x5586c97f1ab0 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37c6ffd700 1 -- 172.21.15.153:0/632655416 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d8057a20 con 0x5586c97f1ab0 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37c6ffd700 1 -- 172.21.15.153:0/632655416 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f37e0014070 con 0x5586c97f1ab0 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37fa529b80 10 client.6246 fetch_fsmap finished waiting for FSMap version 36 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37fa529b80 10 client.6246 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:07:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37fa529b80 20 client.6246 populate_metadata read hostname 'smithi153' 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37fa529b80 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:6833/3019873912,v1:172.21.15.164:6835/3019873912] conn(0x5586c97d5c60 0x5586c97d6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37fa529b80 4 client.6246 mds_command: new command op to 6090 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.613+0000 7f37fa529b80 1 -- 172.21.15.153:0/632655416 --> [v2:172.21.15.164:6833/3019873912,v1:172.21.15.164:6835/3019873912] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5586c96c4f80 con 0x5586c97d5c60 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37e7fff700 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:6833/3019873912,v1:172.21.15.164:6835/3019873912] conn(0x5586c97d5c60 0x5586c97d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37c6ffd700 10 client.6246 ms_handle_connect on v2:172.21.15.164:6833/3019873912 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37e7fff700 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:6833/3019873912,v1:172.21.15.164:6835/3019873912] conn(0x5586c97d5c60 0x5586c97d6040 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b7cecd7ff4fae58 server_cookie=4442e7d1f7f8c552 in_seq=0 out_seq=0 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37c6ffd700 1 -- 172.21.15.153:0/632655416 <== mds.0 v2:172.21.15.164:6833/3019873912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5586c96c4f80 con 0x5586c97d5c60 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37c6ffd700 10 client.6246 handle_command_reply: tid=0 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37fa529b80 1 client.6246 shutdown 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37fa529b80 1 -- 172.21.15.153:0/632655416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 msgr2=0x5586c979f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37fa529b80 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c979f1f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f37e000b010 tx=0x7f37e0014000 comp rx=0 tx=0).stop 2023-11-24T08:07:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37fa529b80 1 -- 172.21.15.153:0/632655416 shutdown_connections 2023-11-24T08:07:27.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37fa529b80 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586c97f1ab0 0x5586c979f1f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37fa529b80 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:6833/3019873912,v1:172.21.15.164:6835/3019873912] conn(0x5586c97d5c60 0x5586c97d6040 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37fa529b80 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5586c97d5060 0x5586c985c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37fa529b80 1 --2- 172.21.15.153:0/632655416 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5586c97f0ac0 0x5586c979ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37c6ffd700 0 client.6246 ms_handle_reset on v2:172.21.15.164:6833/3019873912 2023-11-24T08:07:27.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.614+0000 7f37fa529b80 1 -- 172.21.15.153:0/632655416 >> 172.21.15.153:0/632655416 conn(0x5586c96d9310 msgr2=0x5586c9815750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37fa529b80 1 -- 172.21.15.153:0/632655416 shutdown_connections 2023-11-24T08:07:27.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37fa529b80 1 -- 172.21.15.153:0/632655416 wait complete. 2023-11-24T08:07:27.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37fa529b80 20 client.6246 trim_cache size 0 max 16384 2023-11-24T08:07:27.623 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "a594d4d2-de60-4a04-bb93-76779d526986", 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 6090, 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 10.444507250999999, 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 36, 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 56, 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 56, 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 15.543902591 2023-11-24T08:07:27.624 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:07:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 -- 172.21.15.153:0/1250137228 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37c806b080 msgr2=0x7f37c806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37c806b080 0x7f37c806d540 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f37d0000c00 tx=0x7f37d001c040 comp rx=0 tx=0).stop 2023-11-24T08:07:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 -- 172.21.15.153:0/1250137228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e80b0f80 msgr2=0x7f37e8156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e80b0f80 0x7f37e8156730 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c500 tx=0x7f37d800c8c0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 -- 172.21.15.153:0/1250137228 shutdown_connections 2023-11-24T08:07:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37e815ee90 0x7f37e80cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37e80b0ba0 0x7f37e81f3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f37c806b080 0x7f37c806d540 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 --2- 172.21.15.153:0/1250137228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e80b0f80 0x7f37e8156730 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 -- 172.21.15.153:0/1250137228 >> 172.21.15.153:0/1250137228 conn(0x7f37e80b57b0 msgr2=0x7f37e8157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 -- 172.21.15.153:0/1250137228 shutdown_connections 2023-11-24T08:07:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.615+0000 7f37ee330700 1 -- 172.21.15.153:0/1250137228 wait complete. 2023-11-24T08:07:27.629 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:07:27.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.749+0000 7f54d7206700 1 Processor -- start 2023-11-24T08:07:27.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.749+0000 7f54d7206700 1 -- start start 2023-11-24T08:07:27.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.749+0000 7f54d7206700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54d015e080 0x7f54d00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.749+0000 7f54d7206700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f54d00af4d0 0x7f54d00afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.749+0000 7f54d7206700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f54d006c000 0x7f54d006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.749+0000 7f54d7206700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d00af0b0 con 0x7f54d006c000 2023-11-24T08:07:27.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.749+0000 7f54d7206700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d006c9f0 con 0x7f54d00af4d0 2023-11-24T08:07:27.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.749+0000 7f54d7206700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00b05a0 con 0x7f54d015e080 2023-11-24T08:07:27.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.749+0000 7f54d57a3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f54d006c000 0x7f54d006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54d57a3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f54d006c000 0x7f54d006c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39712/0 (socket says 172.21.15.153:39712) 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54d57a3700 1 -- 172.21.15.153:0/2043966904 learned_addr learned my addr 172.21.15.153:0/2043966904 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54d4fa2700 1 --2- 172.21.15.153:0/2043966904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54d015e080 0x7f54d00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54cffff700 1 --2- 172.21.15.153:0/2043966904 >> v2:172.21.15.164:3300/0 conn(0x7f54d00af4d0 0x7f54d00afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54d57a3700 1 -- 172.21.15.153:0/2043966904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54d015e080 msgr2=0x7f54d00b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54d57a3700 1 --2- 172.21.15.153:0/2043966904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54d015e080 0x7f54d00b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54d57a3700 1 -- 172.21.15.153:0/2043966904 >> v2:172.21.15.164:3300/0 conn(0x7f54d00af4d0 msgr2=0x7f54d00afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54d57a3700 1 --2- 172.21.15.153:0/2043966904 >> v2:172.21.15.164:3300/0 conn(0x7f54d00af4d0 0x7f54d00afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54d57a3700 1 -- 172.21.15.153:0/2043966904 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d00ae430 con 0x7f54d006c000 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54d57a3700 1 --2- 172.21.15.153:0/2043966904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d006c000 0x7f54d006c4b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f54d006d380 tx=0x7f54c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c579b0ffdac34367 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54cf7fe700 1 -- 172.21.15.153:0/2043966904 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c800e070 con 0x7f54d006c000 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54cf7fe700 1 -- 172.21.15.153:0/2043966904 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c800b980 con 0x7f54d006c000 2023-11-24T08:07:27.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.750+0000 7f54cf7fe700 1 -- 172.21.15.153:0/2043966904 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c800bd30 con 0x7f54d006c000 2023-11-24T08:07:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.751+0000 7f54d7206700 1 -- 172.21.15.153:0/2043966904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d006c000 msgr2=0x7f54d006c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.751+0000 7f54d7206700 1 --2- 172.21.15.153:0/2043966904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d006c000 0x7f54d006c4b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f54d006d380 tx=0x7f54c800b330 comp rx=0 tx=0).stop 2023-11-24T08:07:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.751+0000 7f54d7206700 1 -- 172.21.15.153:0/2043966904 shutdown_connections 2023-11-24T08:07:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.751+0000 7f54d7206700 1 --2- 172.21.15.153:0/2043966904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d006c000 0x7f54d006c4b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.751+0000 7f54d7206700 1 --2- 172.21.15.153:0/2043966904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54d015e080 0x7f54d00b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.751+0000 7f54d7206700 1 --2- 172.21.15.153:0/2043966904 >> v2:172.21.15.164:3300/0 conn(0x7f54d00af4d0 0x7f54d00afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.751+0000 7f54d7206700 1 -- 172.21.15.153:0/2043966904 >> 172.21.15.153:0/2043966904 conn(0x7f54d0071b90 msgr2=0x7f54d0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.751+0000 7f54d7206700 1 -- 172.21.15.153:0/2043966904 shutdown_connections 2023-11-24T08:07:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.751+0000 7f54d7206700 1 -- 172.21.15.153:0/2043966904 wait complete. 2023-11-24T08:07:27.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.752+0000 7f54d7206700 1 Processor -- start 2023-11-24T08:07:27.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.752+0000 7f54d7206700 1 -- start start 2023-11-24T08:07:27.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.753+0000 7f54d7206700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d006c000 0x7f54d0157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.753+0000 7f54d7206700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d00af4d0 0x7f54d015ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.753+0000 7f54d7206700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54d015e080 0x7f54d01604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.753+0000 7f54d7206700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0158950 con 0x7f54d006c000 2023-11-24T08:07:27.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.753+0000 7f54d7206700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0157cd0 con 0x7f54d00af4d0 2023-11-24T08:07:27.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.753+0000 7f54d7206700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0157fb0 con 0x7f54d015e080 2023-11-24T08:07:27.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d4fa2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d006c000 0x7f54d0157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d4fa2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d006c000 0x7f54d0157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39714/0 (socket says 172.21.15.153:39714) 2023-11-24T08:07:27.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d4fa2700 1 -- 172.21.15.153:0/3787446689 learned_addr learned my addr 172.21.15.153:0/3787446689 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:27.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54cffff700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d00af4d0 0x7f54d015ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d57a3700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54d015e080 0x7f54d01604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d4fa2700 1 -- 172.21.15.153:0/3787446689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54d015e080 msgr2=0x7f54d01604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d4fa2700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54d015e080 0x7f54d01604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d4fa2700 1 -- 172.21.15.153:0/3787446689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d00af4d0 msgr2=0x7f54d015ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d4fa2700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d00af4d0 0x7f54d015ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d4fa2700 1 -- 172.21.15.153:0/3787446689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c8009b30 con 0x7f54d006c000 2023-11-24T08:07:27.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d4fa2700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d006c000 0x7f54d0157250 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f54c400d800 tx=0x7f54c400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54cd7fa700 1 -- 172.21.15.153:0/3787446689 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40125f0 con 0x7f54d006c000 2023-11-24T08:07:27.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54cd7fa700 1 -- 172.21.15.153:0/3787446689 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c4012750 con 0x7f54d006c000 2023-11-24T08:07:27.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d7206700 1 -- 172.21.15.153:0/3787446689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d0158290 con 0x7f54d006c000 2023-11-24T08:07:27.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54cd7fa700 1 -- 172.21.15.153:0/3787446689 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4012b00 con 0x7f54d006c000 2023-11-24T08:07:27.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.754+0000 7f54d7206700 1 -- 172.21.15.153:0/3787446689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d0156a00 con 0x7f54d006c000 2023-11-24T08:07:27.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.755+0000 7f54d7206700 1 -- 172.21.15.153:0/3787446689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d00753f0 con 0x7f54d006c000 2023-11-24T08:07:27.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.756+0000 7f54cd7fa700 1 -- 172.21.15.153:0/3787446689 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f54c4012c60 con 0x7f54d006c000 2023-11-24T08:07:27.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.756+0000 7f54cd7fa700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54b406b080 0x7f54b406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.756+0000 7f54cffff700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54b406b080 0x7f54b406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.756+0000 7f54cd7fa700 1 -- 172.21.15.153:0/3787446689 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54c4089860 con 0x7f54d006c000 2023-11-24T08:07:27.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.756+0000 7f54cffff700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54b406b080 0x7f54b406d540 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f54d015a250 tx=0x7f54bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.761+0000 7f54cd7fa700 1 -- 172.21.15.153:0/3787446689 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f54c4054720 con 0x7f54d006c000 2023-11-24T08:07:27.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.995+0000 7f54d7206700 1 -- 172.21.15.153:0/3787446689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f54d0067f60 con 0x7f54d006c000 2023-11-24T08:07:27.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.995+0000 7f54cd7fa700 1 -- 172.21.15.153:0/3787446689 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f54c4057d40 con 0x7f54d006c000 2023-11-24T08:07:27.997 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:07:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 -- 172.21.15.153:0/3787446689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54b406b080 msgr2=0x7f54b406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54b406b080 0x7f54b406d540 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f54d015a250 tx=0x7f54bc008040 comp rx=0 tx=0).stop 2023-11-24T08:07:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 -- 172.21.15.153:0/3787446689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d006c000 msgr2=0x7f54d0157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d006c000 0x7f54d0157250 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f54c400d800 tx=0x7f54c400db10 comp rx=0 tx=0).stop 2023-11-24T08:07:28.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 -- 172.21.15.153:0/3787446689 shutdown_connections 2023-11-24T08:07:28.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54d015e080 0x7f54d01604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f54b406b080 0x7f54b406d540 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d006c000 0x7f54d0157250 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 --2- 172.21.15.153:0/3787446689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d00af4d0 0x7f54d015ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 -- 172.21.15.153:0/3787446689 >> 172.21.15.153:0/3787446689 conn(0x7f54d0071b90 msgr2=0x7f54d00b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:28.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 -- 172.21.15.153:0/3787446689 shutdown_connections 2023-11-24T08:07:28.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:27.997+0000 7f54d7206700 1 -- 172.21.15.153:0/3787446689 wait complete. 2023-11-24T08:07:28.011 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:07:28.011 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:07:28.011 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-11-24T08:07:28.011 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:07:28.011 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:28.011 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:07:28.012 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:07:28.012 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:07:28.012 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:07:28.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:28.012 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-11-24T08:07:28.029 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:28.030 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:28.030 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:28.030 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:28.030 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:28.030 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:28.030 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:28.030 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:28.031 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:28.031 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:28.031 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:28.031 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:28.031 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:07:28.031 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:28.032 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:07:28.032 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42225sec preferred_lft 42225sec 2023-11-24T08:07:28.032 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e4cb:ff36:bdaf:3e03/64 scope link noprefixroute 2023-11-24T08:07:28.032 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:28.033 INFO:teuthology.orchestra.run.smithi153.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:07:28.033 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 9e:57:11:a0:a0:4b brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:28.033 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:07:28.033 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:28.033 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e4cd:e0ff:fe37:cdab/64 scope link 2023-11-24T08:07:28.034 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:28.034 INFO:teuthology.orchestra.run.smithi153.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:07:28.034 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 9e:57:11:a0:a0:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:28.034 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::9c57:11ff:fea0:a04b/64 scope link 2023-11-24T08:07:28.034 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:28.034 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:07:28.035 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether f6:b2:5a:65:17:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:07:28.035 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::f4b2:5aff:fe65:174f/64 scope link 2023-11-24T08:07:28.035 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:28.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:28.035 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:07:28.094 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-11-24T08:07:28.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:28.096 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-11-24T08:07:28.155 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-11-24T08:07:28.155 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:07:28.155 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:07:28.156 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:07:28.156 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:07:28.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:28.156 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-11-24T08:07:28.156 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-11-24T08:07:28.157 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:07:28.157 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:07:28.157 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:07:28.157 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-11-24T08:07:28.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:28.261 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-11-24T08:07:28.278 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:07:28.278 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:07:28.279 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:07:28.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:28.279 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-11-24T08:07:28.345 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:28.345 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:28.402 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:07:28.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:28.403 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:28.459 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T08:07:28.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:28.459 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:07:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:07:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:07:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:07:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:07:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:07:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:07:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:07:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:07:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T08:07:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T08:07:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2023-11-24T08:07:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:07:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:07:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-11-24T08:07:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-11-24T08:07:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a594d4d2-de60-4a04-bb93-76779d526986" will pass to kernel 2023-11-24T08:07:28.597 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:07:28.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:28.597 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:28.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:28.630 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:07:28.724 INFO:teuthology.orchestra.run.smithi153.stdout:client5794 2023-11-24T08:07:28.724 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:07:28.724 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:28.741 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:07:28.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.899+0000 7fef60309700 1 Processor -- start 2023-11-24T08:07:28.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.899+0000 7fef60309700 1 -- start start 2023-11-24T08:07:28.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.900+0000 7fef60309700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fef580b0ba0 0x7fef580af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.900+0000 7fef60309700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5815ee90 0x7fef5815b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.900+0000 7fef60309700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef580b2bd0 con 0x7fef580b0f80 2023-11-24T08:07:28.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.900+0000 7fef60309700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef580b1fc0 con 0x7fef580b0ba0 2023-11-24T08:07:28.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.900+0000 7fef60309700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef580b22a0 con 0x7fef5815ee90 2023-11-24T08:07:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5e0a5700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fef580b0ba0 0x7fef580af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5e8a6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5815ee90 0x7fef5815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5d8a4700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fef580b0f80 0x7fef580cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:53514/0 (socket says 172.21.15.153:53514) 2023-11-24T08:07:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5d8a4700 1 -- 172.21.15.153:0/1372945725 learned_addr learned my addr 172.21.15.153:0/1372945725 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5d0a3700 1 -- 172.21.15.153:0/1372945725 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286635409 0 0) 0x7fef580b2bd0 con 0x7fef580b0f80 2023-11-24T08:07:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5d0a3700 1 -- 172.21.15.153:0/1372945725 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef440035b0 con 0x7fef580b0f80 2023-11-24T08:07:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5e0a5700 1 -- 172.21.15.153:0/1372945725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5815ee90 msgr2=0x7fef5815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5e0a5700 1 --2- 172.21.15.153:0/1372945725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5815ee90 0x7fef5815b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5e0a5700 1 -- 172.21.15.153:0/1372945725 >> v1:172.21.15.164:6789/0 conn(0x7fef580b0f80 legacy=0x7fef580cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5e0a5700 1 -- 172.21.15.153:0/1372945725 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580b2580 con 0x7fef580b0ba0 2023-11-24T08:07:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5e8a6700 1 --2- 172.21.15.153:0/1372945725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5815ee90 0x7fef5815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:28.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.901+0000 7fef5e0a5700 1 --2- 172.21.15.153:0/1372945725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef580b0ba0 0x7fef580af5c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fef48009840 tx=0x7fef48009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=551b8dedb3992ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.902+0000 7fef5d0a3700 1 -- 172.21.15.153:0/1372945725 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48011830 con 0x7fef580b0ba0 2023-11-24T08:07:28.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.902+0000 7fef5d0a3700 1 -- 172.21.15.153:0/1372945725 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48011990 con 0x7fef580b0ba0 2023-11-24T08:07:28.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.902+0000 7fef5d0a3700 1 -- 172.21.15.153:0/1372945725 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48011d20 con 0x7fef580b0ba0 2023-11-24T08:07:28.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.902+0000 7fef60309700 1 -- 172.21.15.153:0/1372945725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef580b0ba0 msgr2=0x7fef580af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.902+0000 7fef60309700 1 --2- 172.21.15.153:0/1372945725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef580b0ba0 0x7fef580af5c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fef48009840 tx=0x7fef48009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.902+0000 7fef60309700 1 -- 172.21.15.153:0/1372945725 shutdown_connections 2023-11-24T08:07:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.902+0000 7fef60309700 1 --2- 172.21.15.153:0/1372945725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5815ee90 0x7fef5815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.902+0000 7fef60309700 1 --2- 172.21.15.153:0/1372945725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef580b0ba0 0x7fef580af5c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.902+0000 7fef60309700 1 -- 172.21.15.153:0/1372945725 >> 172.21.15.153:0/1372945725 conn(0x7fef580b57b0 msgr2=0x7fef580b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.902+0000 7fef60309700 1 -- 172.21.15.153:0/1372945725 shutdown_connections 2023-11-24T08:07:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.902+0000 7fef60309700 1 -- 172.21.15.153:0/1372945725 wait complete. 2023-11-24T08:07:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.903+0000 7fef60309700 1 Processor -- start 2023-11-24T08:07:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.903+0000 7fef60309700 1 -- start start 2023-11-24T08:07:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.904+0000 7fef60309700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef580b0ba0 0x7fef581510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.904+0000 7fef60309700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef580b0f80 0x7fef580cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.904+0000 7fef60309700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef5815ee90 0x7fef580ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.904+0000 7fef60309700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580aeca0 con 0x7fef5815ee90 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.904+0000 7fef60309700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580ae020 con 0x7fef580b0ba0 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.904+0000 7fef60309700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef580ae300 con 0x7fef580b0f80 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.904+0000 7fef5e8a6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef5815ee90 0x7fef580ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.904+0000 7fef5e8a6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef5815ee90 0x7fef580ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39736/0 (socket says 172.21.15.153:39736) 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.904+0000 7fef5e8a6700 1 -- 172.21.15.153:0/2501084409 learned_addr learned my addr 172.21.15.153:0/2501084409 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.904+0000 7fef5e0a5700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef580b0ba0 0x7fef581510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.904+0000 7fef5d8a4700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef580b0f80 0x7fef580cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef5e8a6700 1 -- 172.21.15.153:0/2501084409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef580b0f80 msgr2=0x7fef580cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef5e8a6700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef580b0f80 0x7fef580cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef5e8a6700 1 -- 172.21.15.153:0/2501084409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef580b0ba0 msgr2=0x7fef581510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef5e8a6700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef580b0ba0 0x7fef581510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef5e8a6700 1 -- 172.21.15.153:0/2501084409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50009a70 con 0x7fef5815ee90 2023-11-24T08:07:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef5e0a5700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef580b0ba0 0x7fef581510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef5d8a4700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef580b0f80 0x7fef580cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef5e8a6700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef5815ee90 0x7fef580ccef0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fef5000efc0 tx=0x7fef5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef4effd700 1 -- 172.21.15.153:0/2501084409 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50009cd0 con 0x7fef5815ee90 2023-11-24T08:07:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef4effd700 1 -- 172.21.15.153:0/2501084409 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5000f040 con 0x7fef5815ee90 2023-11-24T08:07:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef60309700 1 -- 172.21.15.153:0/2501084409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef480094a0 con 0x7fef5815ee90 2023-11-24T08:07:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef4effd700 1 -- 172.21.15.153:0/2501084409 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5000cd60 con 0x7fef5815ee90 2023-11-24T08:07:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.905+0000 7fef60309700 1 -- 172.21.15.153:0/2501084409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef580ae8c0 con 0x7fef5815ee90 2023-11-24T08:07:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.906+0000 7fef60309700 1 -- 172.21.15.153:0/2501084409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef580aede0 con 0x7fef5815ee90 2023-11-24T08:07:28.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.907+0000 7fef4effd700 1 -- 172.21.15.153:0/2501084409 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fef50003a20 con 0x7fef5815ee90 2023-11-24T08:07:28.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.907+0000 7fef4effd700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fef3c06b080 0x7fef3c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.907+0000 7fef4effd700 1 -- 172.21.15.153:0/2501084409 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef5008aaf0 con 0x7fef5815ee90 2023-11-24T08:07:28.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.907+0000 7fef5e0a5700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fef3c06b080 0x7fef3c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.908+0000 7fef5e0a5700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fef3c06b080 0x7fef3c06d540 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fef480090b0 tx=0x7fef48008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:28.911+0000 7fef4effd700 1 -- 172.21.15.153:0/2501084409 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef50055780 con 0x7fef5815ee90 2023-11-24T08:07:29.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.149+0000 7fef60309700 1 -- 172.21.15.153:0/2501084409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fef580aede0 con 0x7fef5815ee90 2023-11-24T08:07:29.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.149+0000 7fef4effd700 1 -- 172.21.15.153:0/2501084409 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7fef580aede0 con 0x7fef5815ee90 2023-11-24T08:07:29.151 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:07:29.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.151+0000 7fef60309700 1 -- 172.21.15.153:0/2501084409 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fef3c06b080 msgr2=0x7fef3c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.151+0000 7fef60309700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fef3c06b080 0x7fef3c06d540 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fef480090b0 tx=0x7fef48008030 comp rx=0 tx=0).stop 2023-11-24T08:07:29.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.151+0000 7fef60309700 1 -- 172.21.15.153:0/2501084409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef5815ee90 msgr2=0x7fef580ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.151+0000 7fef60309700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef5815ee90 0x7fef580ccef0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fef5000efc0 tx=0x7fef5000c3a0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.151+0000 7fef60309700 1 -- 172.21.15.153:0/2501084409 shutdown_connections 2023-11-24T08:07:29.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.151+0000 7fef60309700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fef3c06b080 0x7fef3c06d540 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.151+0000 7fef60309700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef5815ee90 0x7fef580ccef0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.151+0000 7fef60309700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef580b0ba0 0x7fef581510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.151+0000 7fef60309700 1 --2- 172.21.15.153:0/2501084409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef580b0f80 0x7fef580cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.151+0000 7fef60309700 1 -- 172.21.15.153:0/2501084409 >> 172.21.15.153:0/2501084409 conn(0x7fef580b57b0 msgr2=0x7fef581593a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:29.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.151+0000 7fef60309700 1 -- 172.21.15.153:0/2501084409 shutdown_connections 2023-11-24T08:07:29.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:29.152+0000 7fef60309700 1 -- 172.21.15.153:0/2501084409 wait complete. 2023-11-24T08:07:29.165 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:07:29.165 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:07:29.165 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-11-24T08:07:29.166 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:07:29.166 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:29.166 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:07:29.166 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:07:29.166 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:07:29.166 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:07:29.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:29.167 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-11-24T08:07:29.188 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:29.188 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:29.188 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:29.188 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:29.188 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:29.188 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:29.189 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:29.189 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:29.189 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:29.189 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:29.189 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:29.189 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:29.189 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:07:29.189 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:29.190 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:07:29.190 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42230sec preferred_lft 42230sec 2023-11-24T08:07:29.190 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c3a:c9d4:b907:ae22/64 scope link noprefixroute 2023-11-24T08:07:29.190 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:29.190 INFO:teuthology.orchestra.run.smithi164.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:07:29.190 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 2a:59:a8:c3:97:84 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:29.190 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:07:29.190 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:29.190 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::743c:f9ff:fe03:c5d2/64 scope link 2023-11-24T08:07:29.191 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:29.191 INFO:teuthology.orchestra.run.smithi164.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:07:29.191 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 2a:59:a8:c3:97:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:29.191 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::2859:a8ff:fec3:9784/64 scope link 2023-11-24T08:07:29.191 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:29.191 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:07:29.191 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether b6:1c:9d:ac:a8:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:07:29.191 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::b41c:9dff:feac:a8c8/64 scope link 2023-11-24T08:07:29.191 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:29.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:29.192 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:07:29.259 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-11-24T08:07:29.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:29.261 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-11-24T08:07:29.322 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-11-24T08:07:29.323 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:07:29.323 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:07:29.323 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:07:29.323 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:07:29.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:29.324 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-11-24T08:07:29.324 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-11-24T08:07:29.324 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:07:29.325 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:07:29.325 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:07:29.325 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-11-24T08:07:29.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:29.434 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-11-24T08:07:29.452 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:07:29.452 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:07:29.452 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:07:29.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:29.452 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-11-24T08:07:29.518 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:29.519 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:29.575 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:07:29.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:29.575 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:29.632 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T08:07:29.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:29.632 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:07:29.717 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:07:29.717 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:07:29.717 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:07:29.726 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:07:29.726 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:07:29.726 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:07:29.726 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:07:29.726 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:07:29.801 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T08:07:29.801 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T08:07:29.801 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-11-24T08:07:29.801 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-11-24T08:07:29.801 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T08:07:29.802 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-11-24T08:07:29.802 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-11-24T08:07:29.802 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a594d4d2-de60-4a04-bb93-76779d526986" will pass to kernel 2023-11-24T08:07:29.803 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:07:29.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:29.804 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:29.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:29.831 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:07:29.902 INFO:teuthology.orchestra.run.smithi164.stdout:client6258 2023-11-24T08:07:29.903 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:07:29.903 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:29.959 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T08:07:30.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.096+0000 7fa64c31d700 1 Processor -- start 2023-11-24T08:07:30.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.096+0000 7fa64c31d700 1 -- start start 2023-11-24T08:07:30.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.097+0000 7fa64c31d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440cf040 0x7fa64406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.097+0000 7fa64c31d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa6440d21c0 0x7fa6440af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.097+0000 7fa64c31d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6440d01c0 con 0x7fa6440702e0 2023-11-24T08:07:30.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.097+0000 7fa64c31d700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa644070910 con 0x7fa6440d21c0 2023-11-24T08:07:30.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.097+0000 7fa64c31d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa644070bf0 con 0x7fa6440cf040 2023-11-24T08:07:30.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.097+0000 7fa6498b8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa6440702e0 0x7fa6440d1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45844/0 (socket says 172.21.15.153:45844) 2023-11-24T08:07:30.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.097+0000 7fa6498b8700 1 -- 172.21.15.153:0/489737353 learned_addr learned my addr 172.21.15.153:0/489737353 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:30.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.097+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308269270 0 0) 0x7fa6440d01c0 con 0x7fa6440702e0 2023-11-24T08:07:30.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6300035b0 con 0x7fa6440702e0 2023-11-24T08:07:30.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa64a8ba700 1 --2- 172.21.15.153:0/489737353 >> v2:172.21.15.164:3300/0 conn(0x7fa6440d21c0 0x7fa6440af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa64a0b9700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440cf040 0x7fa64406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3973821948 0 0) 0x7fa6300035b0 con 0x7fa6440702e0 2023-11-24T08:07:30.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440cf040 msgr2=0x7fa64406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:30.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440cf040 0x7fa64406fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 >> v2:172.21.15.164:3300/0 conn(0x7fa6440d21c0 msgr2=0x7fa6440af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:30.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 --2- 172.21.15.153:0/489737353 >> v2:172.21.15.164:3300/0 conn(0x7fa6440d21c0 0x7fa6440af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6440aebb0 con 0x7fa6440702e0 2023-11-24T08:07:30.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fa640001670 con 0x7fa6440702e0 2023-11-24T08:07:30.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 >> v1:172.21.15.153:6789/0 conn(0x7fa6440702e0 legacy=0x7fa6440d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440cf040 0x7fa630003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa630003f80 0x7fa630004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 0x7fa630005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644070910 con 0x7fa630004d90 2023-11-24T08:07:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644070bf0 con 0x7fa630003f80 2023-11-24T08:07:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63000ba10 con 0x7fa6440cf040 2023-11-24T08:07:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa64a8ba700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 0x7fa630005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa64a0b9700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440cf040 0x7fa630003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa6498b8700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa630003f80 0x7fa630004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa64a8ba700 1 -- 172.21.15.153:0/489737353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440cf040 msgr2=0x7fa630003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa64a8ba700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440cf040 0x7fa630003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa64a8ba700 1 -- 172.21.15.153:0/489737353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa630003f80 msgr2=0x7fa630004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa64a8ba700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa630003f80 0x7fa630004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa64a8ba700 1 -- 172.21.15.153:0/489737353 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6300035b0 con 0x7fa630004d90 2023-11-24T08:07:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.098+0000 7fa64a8ba700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 0x7fa630005210 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009fc0 tx=0x7fa630005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a969db7e27bb19 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.099+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00ebd0 con 0x7fa630004d90 2023-11-24T08:07:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.099+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00f040 con 0x7fa630004d90 2023-11-24T08:07:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.099+0000 7fa6490b7700 1 -- 172.21.15.153:0/489737353 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c014480 con 0x7fa630004d90 2023-11-24T08:07:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.099+0000 7fa64c31d700 1 -- 172.21.15.153:0/489737353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 msgr2=0x7fa630005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.099+0000 7fa64c31d700 1 --2- 172.21.15.153:0/489737353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 0x7fa630005210 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009fc0 tx=0x7fa630005880 comp rx=0 tx=0).stop 2023-11-24T08:07:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.099+0000 7fa64a8ba700 1 -- 172.21.15.153:0/489737353 reap_dead start 2023-11-24T08:07:30.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.099+0000 7fa64c31d700 1 -- 172.21.15.153:0/489737353 shutdown_connections 2023-11-24T08:07:30.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.099+0000 7fa64c31d700 1 -- 172.21.15.153:0/489737353 >> 172.21.15.153:0/489737353 conn(0x7fa64409aa00 msgr2=0x7fa64409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:30.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.099+0000 7fa64c31d700 1 -- 172.21.15.153:0/489737353 shutdown_connections 2023-11-24T08:07:30.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.099+0000 7fa64c31d700 1 -- 172.21.15.153:0/489737353 wait complete. 2023-11-24T08:07:30.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.101+0000 7fa64c31d700 1 Processor -- start 2023-11-24T08:07:30.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.101+0000 7fa64c31d700 1 -- start start 2023-11-24T08:07:30.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64c31d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 0x7fa64406c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64c31d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6440c6ad0 0x7fa64415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64c31d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440c7400 0x7fa6440c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64c31d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6441f4870 con 0x7fa630004d90 2023-11-24T08:07:30.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64c31d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440c7dd0 con 0x7fa6440c6ad0 2023-11-24T08:07:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64c31d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6441f3c30 con 0x7fa6440c7400 2023-11-24T08:07:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64a0b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 0x7fa64406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64a0b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 0x7fa64406c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39754/0 (socket says 172.21.15.153:39754) 2023-11-24T08:07:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64a0b9700 1 -- 172.21.15.153:0/1918340878 learned_addr learned my addr 172.21.15.153:0/1918340878 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64a8ba700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440c7400 0x7fa6440c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa6498b8700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6440c6ad0 0x7fa64415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64a0b9700 1 -- 172.21.15.153:0/1918340878 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440c7400 msgr2=0x7fa6440c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64a0b9700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440c7400 0x7fa6440c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64a0b9700 1 -- 172.21.15.153:0/1918340878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6440c6ad0 msgr2=0x7fa64415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64a0b9700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6440c6ad0 0x7fa64415ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64a0b9700 1 -- 172.21.15.153:0/1918340878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6441f3ed0 con 0x7fa630004d90 2023-11-24T08:07:30.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa64a0b9700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 0x7fa64406c760 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa634011aa0 tx=0x7fa634011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.102+0000 7fa63affd700 1 -- 172.21.15.153:0/1918340878 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634011ee0 con 0x7fa630004d90 2023-11-24T08:07:30.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.103+0000 7fa63affd700 1 -- 172.21.15.153:0/1918340878 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63400f940 con 0x7fa630004d90 2023-11-24T08:07:30.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.103+0000 7fa64c31d700 1 -- 172.21.15.153:0/1918340878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6441f41b0 con 0x7fa630004d90 2023-11-24T08:07:30.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.103+0000 7fa63affd700 1 -- 172.21.15.153:0/1918340878 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63400fcf0 con 0x7fa630004d90 2023-11-24T08:07:30.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.103+0000 7fa64c31d700 1 -- 172.21.15.153:0/1918340878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64406cca0 con 0x7fa630004d90 2023-11-24T08:07:30.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.104+0000 7fa64c31d700 1 -- 172.21.15.153:0/1918340878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6440751e0 con 0x7fa630004d90 2023-11-24T08:07:30.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.104+0000 7fa63affd700 1 -- 172.21.15.153:0/1918340878 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa634014440 con 0x7fa630004d90 2023-11-24T08:07:30.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.104+0000 7fa63affd700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa62806b080 0x7fa62806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.105+0000 7fa63affd700 1 -- 172.21.15.153:0/1918340878 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa634089fd0 con 0x7fa630004d90 2023-11-24T08:07:30.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.105+0000 7fa6498b8700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa62806b080 0x7fa62806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.105+0000 7fa6498b8700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa62806b080 0x7fa62806d540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa6440c6f10 tx=0x7fa640007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.109+0000 7fa63affd700 1 -- 172.21.15.153:0/1918340878 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa634054ec0 con 0x7fa630004d90 2023-11-24T08:07:30.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:30.348+0000 7fa64c31d700 1 -- 172.21.15.153:0/1918340878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa644067f60 con 0x7fa630004d90 2023-11-24T08:07:31.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.223+0000 7fa63affd700 1 -- 172.21.15.153:0/1918340878 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 136+0+0 (secure 0 0 0) 0x7fa6340584e0 con 0x7fa630004d90 2023-11-24T08:07:31.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 -- 172.21.15.153:0/1918340878 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa62806b080 msgr2=0x7fa62806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa62806b080 0x7fa62806d540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa6440c6f10 tx=0x7fa640007980 comp rx=0 tx=0).stop 2023-11-24T08:07:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 -- 172.21.15.153:0/1918340878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 msgr2=0x7fa64406c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 0x7fa64406c760 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa634011aa0 tx=0x7fa634011db0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 -- 172.21.15.153:0/1918340878 shutdown_connections 2023-11-24T08:07:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6440c7400 0x7fa6440c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa62806b080 0x7fa62806d540 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa630004d90 0x7fa64406c760 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 --2- 172.21.15.153:0/1918340878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6440c6ad0 0x7fa64415ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 -- 172.21.15.153:0/1918340878 >> 172.21.15.153:0/1918340878 conn(0x7fa64409aa00 msgr2=0x7fa6440af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 -- 172.21.15.153:0/1918340878 shutdown_connections 2023-11-24T08:07:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.227+0000 7fa64c31d700 1 -- 172.21.15.153:0/1918340878 wait complete. 2023-11-24T08:07:31.245 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T08:07:31.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.373+0000 7fe242aae700 1 Processor -- start 2023-11-24T08:07:31.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.373+0000 7fe242aae700 1 -- start start 2023-11-24T08:07:31.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe242aae700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe23c0adf00 0x7fe23c06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe242aae700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe23c06c540 0x7fe23c0b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe242aae700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c0af950 con 0x7fe23c1446a0 2023-11-24T08:07:31.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe242aae700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23c06c9f0 con 0x7fe23c06c540 2023-11-24T08:07:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe242aae700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23c144a80 con 0x7fe23c0adf00 2023-11-24T08:07:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe24104b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe23c06c540 0x7fe23c0b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe24104b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe23c06c540 0x7fe23c0b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39764/0 (socket says 172.21.15.153:39764) 2023-11-24T08:07:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe24104b700 1 -- 172.21.15.153:0/1632120646 learned_addr learned my addr 172.21.15.153:0/1632120646 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe23bfff700 1 --2- 172.21.15.153:0/1632120646 >> v2:172.21.15.164:3300/0 conn(0x7fe23c0adf00 0x7fe23c06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe24104b700 1 -- 172.21.15.153:0/1632120646 >> v2:172.21.15.164:3300/0 conn(0x7fe23c0adf00 msgr2=0x7fe23c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe24104b700 1 --2- 172.21.15.153:0/1632120646 >> v2:172.21.15.164:3300/0 conn(0x7fe23c0adf00 0x7fe23c06c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe24104b700 1 -- 172.21.15.153:0/1632120646 >> v1:172.21.15.164:6789/0 conn(0x7fe23c1446a0 legacy=0x7fe23c0b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe24104b700 1 -- 172.21.15.153:0/1632120646 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c0afc30 con 0x7fe23c06c540 2023-11-24T08:07:31.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.374+0000 7fe24104b700 1 --2- 172.21.15.153:0/1632120646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23c06c540 0x7fe23c0b3d40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe23c09f030 tx=0x7fe23400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4576da0165ead523 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.375+0000 7fe23b7fe700 1 -- 172.21.15.153:0/1632120646 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400e070 con 0x7fe23c06c540 2023-11-24T08:07:31.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.375+0000 7fe23b7fe700 1 -- 172.21.15.153:0/1632120646 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe234003a20 con 0x7fe23c06c540 2023-11-24T08:07:31.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.375+0000 7fe23b7fe700 1 -- 172.21.15.153:0/1632120646 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234003dd0 con 0x7fe23c06c540 2023-11-24T08:07:31.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.375+0000 7fe242aae700 1 -- 172.21.15.153:0/1632120646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23c06c540 msgr2=0x7fe23c0b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.375+0000 7fe242aae700 1 --2- 172.21.15.153:0/1632120646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23c06c540 0x7fe23c0b3d40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe23c09f030 tx=0x7fe23400b330 comp rx=0 tx=0).stop 2023-11-24T08:07:31.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.375+0000 7fe242aae700 1 -- 172.21.15.153:0/1632120646 shutdown_connections 2023-11-24T08:07:31.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.375+0000 7fe242aae700 1 --2- 172.21.15.153:0/1632120646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23c06c540 0x7fe23c0b3d40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.375+0000 7fe242aae700 1 --2- 172.21.15.153:0/1632120646 >> v2:172.21.15.164:3300/0 conn(0x7fe23c0adf00 0x7fe23c06c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.375+0000 7fe242aae700 1 -- 172.21.15.153:0/1632120646 >> 172.21.15.153:0/1632120646 conn(0x7fe23c071b90 msgr2=0x7fe23c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.375+0000 7fe242aae700 1 -- 172.21.15.153:0/1632120646 shutdown_connections 2023-11-24T08:07:31.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.375+0000 7fe242aae700 1 -- 172.21.15.153:0/1632120646 wait complete. 2023-11-24T08:07:31.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.376+0000 7fe242aae700 1 Processor -- start 2023-11-24T08:07:31.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.376+0000 7fe242aae700 1 -- start start 2023-11-24T08:07:31.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.377+0000 7fe242aae700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe23c06c540 0x7fe23c15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.377+0000 7fe242aae700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe23c0adf00 0x7fe23c158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.377+0000 7fe242aae700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23c1446a0 0x7fe23c15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.377+0000 7fe242aae700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c15bd70 con 0x7fe23c1446a0 2023-11-24T08:07:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.377+0000 7fe242aae700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c15c050 con 0x7fe23c0adf00 2023-11-24T08:07:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.377+0000 7fe242aae700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c15c330 con 0x7fe23c06c540 2023-11-24T08:07:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.377+0000 7fe24104b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23c1446a0 0x7fe23c15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.377+0000 7fe24104b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23c1446a0 0x7fe23c15b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39770/0 (socket says 172.21.15.153:39770) 2023-11-24T08:07:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.377+0000 7fe24104b700 1 -- 172.21.15.153:0/55711197 learned_addr learned my addr 172.21.15.153:0/55711197 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe23bfff700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe23c0adf00 0x7fe23c158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe24104b700 1 -- 172.21.15.153:0/55711197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe23c06c540 msgr2=0x7fe23c15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe24084a700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe23c06c540 0x7fe23c15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe24104b700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe23c06c540 0x7fe23c15ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe24104b700 1 -- 172.21.15.153:0/55711197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe23c0adf00 msgr2=0x7fe23c158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe24104b700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe23c0adf00 0x7fe23c158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe24104b700 1 -- 172.21.15.153:0/55711197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe234009b30 con 0x7fe23c1446a0 2023-11-24T08:07:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe23bfff700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe23c0adf00 0x7fe23c158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe24084a700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe23c06c540 0x7fe23c15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe24104b700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23c1446a0 0x7fe23c15b340 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe23400b730 tx=0x7fe234004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe2397fa700 1 -- 172.21.15.153:0/55711197 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234004440 con 0x7fe23c1446a0 2023-11-24T08:07:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe2397fa700 1 -- 172.21.15.153:0/55711197 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2340045a0 con 0x7fe23c1446a0 2023-11-24T08:07:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe242aae700 1 -- 172.21.15.153:0/55711197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23c15c610 con 0x7fe23c1446a0 2023-11-24T08:07:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe2397fa700 1 -- 172.21.15.153:0/55711197 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234004910 con 0x7fe23c1446a0 2023-11-24T08:07:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.378+0000 7fe242aae700 1 -- 172.21.15.153:0/55711197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23c13ccc0 con 0x7fe23c1446a0 2023-11-24T08:07:31.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.379+0000 7fe242aae700 1 -- 172.21.15.153:0/55711197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c13ce50 con 0x7fe23c1446a0 2023-11-24T08:07:31.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.379+0000 7fe2397fa700 1 -- 172.21.15.153:0/55711197 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe234019030 con 0x7fe23c1446a0 2023-11-24T08:07:31.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.380+0000 7fe2397fa700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe22006b080 0x7fe22006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.380+0000 7fe2397fa700 1 -- 172.21.15.153:0/55711197 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe23408add0 con 0x7fe23c1446a0 2023-11-24T08:07:31.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.380+0000 7fe24084a700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe22006b080 0x7fe22006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.380+0000 7fe24084a700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe22006b080 0x7fe22006d540 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe230006fd0 tx=0x7fe230008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.384+0000 7fe2397fa700 1 -- 172.21.15.153:0/55711197 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe234055b80 con 0x7fe23c1446a0 2023-11-24T08:07:31.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.602+0000 7fe242aae700 1 -- 172.21.15.153:0/55711197 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe23c15c1c0 con 0x7fe22006b080 2023-11-24T08:07:31.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.603+0000 7fe2397fa700 1 -- 172.21.15.153:0/55711197 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe23c15c1c0 con 0x7fe22006b080 2023-11-24T08:07:31.605 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-11-24T08:07:31.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-11-24T08:07:31.605 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "cephfs" 2023-11-24T08:07:31.605 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-11-24T08:07:31.605 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-11-24T08:07:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 -- 172.21.15.153:0/55711197 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe22006b080 msgr2=0x7fe22006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe22006b080 0x7fe22006d540 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe230006fd0 tx=0x7fe230008040 comp rx=0 tx=0).stop 2023-11-24T08:07:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 -- 172.21.15.153:0/55711197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23c1446a0 msgr2=0x7fe23c15b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23c1446a0 0x7fe23c15b340 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe23400b730 tx=0x7fe234004ad0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 -- 172.21.15.153:0/55711197 shutdown_connections 2023-11-24T08:07:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe22006b080 0x7fe22006d540 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe23c1446a0 0x7fe23c15b340 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe23c06c540 0x7fe23c15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 --2- 172.21.15.153:0/55711197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe23c0adf00 0x7fe23c158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 -- 172.21.15.153:0/55711197 >> 172.21.15.153:0/55711197 conn(0x7fe23c071b90 msgr2=0x7fe23c0b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 -- 172.21.15.153:0/55711197 shutdown_connections 2023-11-24T08:07:31.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.606+0000 7fe242aae700 1 -- 172.21.15.153:0/55711197 wait complete. 2023-11-24T08:07:31.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:07:31.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.742+0000 7f27d51cb700 1 Processor -- start 2023-11-24T08:07:31.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.742+0000 7f27d51cb700 1 -- start start 2023-11-24T08:07:31.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27d51cb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f27d006ef80 0x7f27d00ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27d51cb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d00cf550 con 0x7f27d015e2d0 2023-11-24T08:07:31.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27d51cb700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d00cc9b0 con 0x7f27d00b4230 2023-11-24T08:07:31.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27d51cb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d015e6b0 con 0x7f27d006ef80 2023-11-24T08:07:31.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27cf59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f27d006ef80 0x7f27d00ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27ced9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f27d015e2d0 0x7f27d00ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45878/0 (socket says 172.21.15.153:45878) 2023-11-24T08:07:31.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27ced9d700 1 -- 172.21.15.153:0/3233521066 learned_addr learned my addr 172.21.15.153:0/3233521066 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:31.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27cf59e700 1 -- 172.21.15.153:0/3233521066 >> v1:172.21.15.164:6789/0 conn(0x7f27d00b4230 legacy=0x7f27d00cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:31.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27cf59e700 1 -- 172.21.15.153:0/3233521066 >> v1:172.21.15.153:6789/0 conn(0x7f27d015e2d0 legacy=0x7f27d00ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27cf59e700 1 -- 172.21.15.153:0/3233521066 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00cf270 con 0x7f27d006ef80 2023-11-24T08:07:31.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27cf59e700 1 --2- 172.21.15.153:0/3233521066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d006ef80 0x7f27d00ceb70 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009d90 tx=0x7f27c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e828a1e7e6adf72 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.743+0000 7f27cdd9b700 1 -- 172.21.15.153:0/3233521066 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800e070 con 0x7f27d006ef80 2023-11-24T08:07:31.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.744+0000 7f27cdd9b700 1 -- 172.21.15.153:0/3233521066 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c800bb90 con 0x7f27d006ef80 2023-11-24T08:07:31.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.744+0000 7f27cdd9b700 1 -- 172.21.15.153:0/3233521066 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8003a20 con 0x7f27d006ef80 2023-11-24T08:07:31.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.744+0000 7f27d51cb700 1 -- 172.21.15.153:0/3233521066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d006ef80 msgr2=0x7f27d00ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.744+0000 7f27d51cb700 1 --2- 172.21.15.153:0/3233521066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d006ef80 0x7f27d00ceb70 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009d90 tx=0x7f27c800b330 comp rx=0 tx=0).stop 2023-11-24T08:07:31.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.744+0000 7f27d51cb700 1 -- 172.21.15.153:0/3233521066 shutdown_connections 2023-11-24T08:07:31.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.744+0000 7f27d51cb700 1 --2- 172.21.15.153:0/3233521066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d006ef80 0x7f27d00ceb70 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.744+0000 7f27d51cb700 1 -- 172.21.15.153:0/3233521066 >> 172.21.15.153:0/3233521066 conn(0x7f27d00b3710 msgr2=0x7f27d00b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.744+0000 7f27d51cb700 1 -- 172.21.15.153:0/3233521066 shutdown_connections 2023-11-24T08:07:31.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.744+0000 7f27d51cb700 1 -- 172.21.15.153:0/3233521066 wait complete. 2023-11-24T08:07:31.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.746+0000 7f27d51cb700 1 Processor -- start 2023-11-24T08:07:31.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.746+0000 7f27d51cb700 1 -- start start 2023-11-24T08:07:31.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27d51cb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d006ef80 0x7f27d0155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27d51cb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d00b4230 0x7f27d00b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27d51cb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d015e2d0 0x7f27d00b6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27d51cb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00c9020 con 0x7f27d006ef80 2023-11-24T08:07:31.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27d51cb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00c9300 con 0x7f27d00b4230 2023-11-24T08:07:31.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27d51cb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00c95e0 con 0x7f27d015e2d0 2023-11-24T08:07:31.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27ced9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d006ef80 0x7f27d0155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27ced9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d006ef80 0x7f27d0155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39780/0 (socket says 172.21.15.153:39780) 2023-11-24T08:07:31.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27ced9d700 1 -- 172.21.15.153:0/2684932404 learned_addr learned my addr 172.21.15.153:0/2684932404 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:31.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27ce59c700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d00b4230 0x7f27d00b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27cf59e700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d015e2d0 0x7f27d00b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27ced9d700 1 -- 172.21.15.153:0/2684932404 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d015e2d0 msgr2=0x7f27d00b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27ced9d700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d015e2d0 0x7f27d00b6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27ced9d700 1 -- 172.21.15.153:0/2684932404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d00b4230 msgr2=0x7f27d00b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27ced9d700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d00b4230 0x7f27d00b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27ced9d700 1 -- 172.21.15.153:0/2684932404 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c8009a70 con 0x7f27d006ef80 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27ce59c700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d00b4230 0x7f27d00b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.747+0000 7f27ced9d700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d006ef80 0x7f27d0155c70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c430 tx=0x7f27c400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.748+0000 7f27b77fe700 1 -- 172.21.15.153:0/2684932404 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4005d70 con 0x7f27d006ef80 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.748+0000 7f27b77fe700 1 -- 172.21.15.153:0/2684932404 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c40070d0 con 0x7f27d006ef80 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.748+0000 7f27d51cb700 1 -- 172.21.15.153:0/2684932404 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d00c98c0 con 0x7f27d006ef80 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.748+0000 7f27b77fe700 1 -- 172.21.15.153:0/2684932404 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4007460 con 0x7f27d006ef80 2023-11-24T08:07:31.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.748+0000 7f27d51cb700 1 -- 172.21.15.153:0/2684932404 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d006c130 con 0x7f27d006ef80 2023-11-24T08:07:31.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.749+0000 7f27d51cb700 1 -- 172.21.15.153:0/2684932404 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d0068fb0 con 0x7f27d006ef80 2023-11-24T08:07:31.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.749+0000 7f27b77fe700 1 -- 172.21.15.153:0/2684932404 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f27c40075c0 con 0x7f27d006ef80 2023-11-24T08:07:31.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.749+0000 7f27b77fe700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27bc06b080 0x7f27bc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.749+0000 7f27b77fe700 1 -- 172.21.15.153:0/2684932404 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27c4088d50 con 0x7f27d006ef80 2023-11-24T08:07:31.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.750+0000 7f27ce59c700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27bc06b080 0x7f27bc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.750+0000 7f27ce59c700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27bc06b080 0x7f27bc06d540 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f27d006cd50 tx=0x7f27c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.754+0000 7f27b77fe700 1 -- 172.21.15.153:0/2684932404 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f27c408c030 con 0x7f27d006ef80 2023-11-24T08:07:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.946+0000 7f27d51cb700 1 -- 172.21.15.153:0/2684932404 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f27d00c9ab0 con 0x7f27d006ef80 2023-11-24T08:07:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.947+0000 7f27b77fe700 1 -- 172.21.15.153:0/2684932404 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f27c4017020 con 0x7f27d006ef80 2023-11-24T08:07:31.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 -- 172.21.15.153:0/2684932404 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27bc06b080 msgr2=0x7f27bc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27bc06b080 0x7f27bc06d540 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f27d006cd50 tx=0x7f27c0009040 comp rx=0 tx=0).stop 2023-11-24T08:07:31.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 -- 172.21.15.153:0/2684932404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d006ef80 msgr2=0x7f27d0155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d006ef80 0x7f27d0155c70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c430 tx=0x7f27c400c7f0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 -- 172.21.15.153:0/2684932404 shutdown_connections 2023-11-24T08:07:31.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d015e2d0 0x7f27d00b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27bc06b080 0x7f27bc06d540 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d006ef80 0x7f27d0155c70 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 --2- 172.21.15.153:0/2684932404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d00b4230 0x7f27d00b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 -- 172.21.15.153:0/2684932404 >> 172.21.15.153:0/2684932404 conn(0x7f27d00b3710 msgr2=0x7f27d00b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 -- 172.21.15.153:0/2684932404 shutdown_connections 2023-11-24T08:07:31.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:31.949+0000 7f27d51cb700 1 -- 172.21.15.153:0/2684932404 wait complete. 2023-11-24T08:07:31.963 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:07:31.963 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:32.006 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:32.061 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:07:32.061 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:07:32.061 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:32.079 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:07:32.079 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:32.137 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:32.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.296+0000 7f514cc18700 1 Processor -- start 2023-11-24T08:07:32.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.296+0000 7f514cc18700 1 -- start start 2023-11-24T08:07:32.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.297+0000 7f514cc18700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f514815bdd0 0x7f51481604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.297+0000 7f514cc18700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51480b3370 0x7f51480b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.297+0000 7f514cc18700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51480b2030 con 0x7f51480d1c70 2023-11-24T08:07:32.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.297+0000 7f514cc18700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51480b2f50 con 0x7f514815bdd0 2023-11-24T08:07:32.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.297+0000 7f514cc18700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51480b22d0 con 0x7f51480b3370 2023-11-24T08:07:32.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f514659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f514815bdd0 0x7f51481604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f514659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f514815bdd0 0x7f51481604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39788/0 (socket says 172.21.15.153:39788) 2023-11-24T08:07:32.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f514659c700 1 -- 172.21.15.153:0/3185611221 learned_addr learned my addr 172.21.15.153:0/3185611221 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:32.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f5145d9b700 1 --2- 172.21.15.153:0/3185611221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51480b3370 0x7f51480b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f514659c700 1 -- 172.21.15.153:0/3185611221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51480b3370 msgr2=0x7f51480b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f514659c700 1 --2- 172.21.15.153:0/3185611221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51480b3370 0x7f51480b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f514659c700 1 -- 172.21.15.153:0/3185611221 >> v1:172.21.15.164:6789/0 conn(0x7f51480d1c70 legacy=0x7f51480ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f514659c700 1 -- 172.21.15.153:0/3185611221 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51480b25b0 con 0x7f514815bdd0 2023-11-24T08:07:32.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f514659c700 1 --2- 172.21.15.153:0/3185611221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815bdd0 0x7f51481604e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f513c0098f0 tx=0x7f513c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480162d005f85095 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f514559a700 1 -- 172.21.15.153:0/3185611221 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00b8a0 con 0x7f514815bdd0 2023-11-24T08:07:32.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f514559a700 1 -- 172.21.15.153:0/3185611221 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c00ba00 con 0x7f514815bdd0 2023-11-24T08:07:32.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.298+0000 7f514559a700 1 -- 172.21.15.153:0/3185611221 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00bd90 con 0x7f514815bdd0 2023-11-24T08:07:32.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.299+0000 7f514cc18700 1 -- 172.21.15.153:0/3185611221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815bdd0 msgr2=0x7f51481604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.299+0000 7f514cc18700 1 --2- 172.21.15.153:0/3185611221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815bdd0 0x7f51481604e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f513c0098f0 tx=0x7f513c009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:32.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.299+0000 7f514cc18700 1 -- 172.21.15.153:0/3185611221 shutdown_connections 2023-11-24T08:07:32.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.299+0000 7f514cc18700 1 --2- 172.21.15.153:0/3185611221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815bdd0 0x7f51481604e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.299+0000 7f514cc18700 1 --2- 172.21.15.153:0/3185611221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51480b3370 0x7f51480b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.299+0000 7f514cc18700 1 -- 172.21.15.153:0/3185611221 >> 172.21.15.153:0/3185611221 conn(0x7f51480731a0 msgr2=0x7f514809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.299+0000 7f514cc18700 1 -- 172.21.15.153:0/3185611221 shutdown_connections 2023-11-24T08:07:32.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.299+0000 7f514cc18700 1 -- 172.21.15.153:0/3185611221 wait complete. 2023-11-24T08:07:32.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.301+0000 7f514cc18700 1 Processor -- start 2023-11-24T08:07:32.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.301+0000 7f514cc18700 1 -- start start 2023-11-24T08:07:32.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.301+0000 7f514cc18700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51480b3370 0x7f5148157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.301+0000 7f514cc18700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51480d1c70 0x7f51480c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.301+0000 7f514cc18700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815bdd0 0x7f51480ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f514cc18700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51480caaf0 con 0x7f514815bdd0 2023-11-24T08:07:32.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f514cc18700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51480cadd0 con 0x7f51480d1c70 2023-11-24T08:07:32.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f514cc18700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51480cb0b0 con 0x7f51480b3370 2023-11-24T08:07:32.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5146d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815bdd0 0x7f51480ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5146d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815bdd0 0x7f51480ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39796/0 (socket says 172.21.15.153:39796) 2023-11-24T08:07:32.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5146d9d700 1 -- 172.21.15.153:0/3469995996 learned_addr learned my addr 172.21.15.153:0/3469995996 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:32.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f514659c700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51480b3370 0x7f5148157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5145d9b700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51480d1c70 0x7f51480c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5146d9d700 1 -- 172.21.15.153:0/3469995996 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51480b3370 msgr2=0x7f5148157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5146d9d700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51480b3370 0x7f5148157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5146d9d700 1 -- 172.21.15.153:0/3469995996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51480d1c70 msgr2=0x7f51480c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5146d9d700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51480d1c70 0x7f51480c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5146d9d700 1 -- 172.21.15.153:0/3469995996 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c009550 con 0x7f514815bdd0 2023-11-24T08:07:32.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5146d9d700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815bdd0 0x7f51480ca4c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f514000cc50 tx=0x7f514000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5136ffd700 1 -- 172.21.15.153:0/3469995996 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140003c00 con 0x7f514815bdd0 2023-11-24T08:07:32.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5136ffd700 1 -- 172.21.15.153:0/3469995996 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5140003d60 con 0x7f514815bdd0 2023-11-24T08:07:32.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f514cc18700 1 -- 172.21.15.153:0/3469995996 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51480cb390 con 0x7f514815bdd0 2023-11-24T08:07:32.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f5136ffd700 1 -- 172.21.15.153:0/3469995996 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514000aab0 con 0x7f514815bdd0 2023-11-24T08:07:32.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.302+0000 7f514cc18700 1 -- 172.21.15.153:0/3469995996 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51480b7490 con 0x7f514815bdd0 2023-11-24T08:07:32.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.303+0000 7f514cc18700 1 -- 172.21.15.153:0/3469995996 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5148067f60 con 0x7f514815bdd0 2023-11-24T08:07:32.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.304+0000 7f5136ffd700 1 -- 172.21.15.153:0/3469995996 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f514000ac10 con 0x7f514815bdd0 2023-11-24T08:07:32.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.304+0000 7f5136ffd700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f512806b080 0x7f512806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.304+0000 7f514659c700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f512806b080 0x7f512806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.304+0000 7f5136ffd700 1 -- 172.21.15.153:0/3469995996 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51400898d0 con 0x7f514815bdd0 2023-11-24T08:07:32.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.305+0000 7f514659c700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f512806b080 0x7f512806d540 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f513c014040 tx=0x7f513c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.309+0000 7f5136ffd700 1 -- 172.21.15.153:0/3469995996 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5140054700 con 0x7f514815bdd0 2023-11-24T08:07:32.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.502+0000 7f514cc18700 1 -- 172.21.15.153:0/3469995996 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51480b7c60 con 0x7f514815bdd0 2023-11-24T08:07:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.504+0000 7f5136ffd700 1 -- 172.21.15.153:0/3469995996 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16601 (secure 0 0 0) 0x7f5140057d20 con 0x7f514815bdd0 2023-11-24T08:07:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:32.506 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":56,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:07:18.180030+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:14.800746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:15.529815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:32.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 -- 172.21.15.153:0/3469995996 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f512806b080 msgr2=0x7f512806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f512806b080 0x7f512806d540 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f513c014040 tx=0x7f513c008030 comp rx=0 tx=0).stop 2023-11-24T08:07:32.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 -- 172.21.15.153:0/3469995996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815bdd0 msgr2=0x7f51480ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815bdd0 0x7f51480ca4c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f514000cc50 tx=0x7f514000cf60 comp rx=0 tx=0).stop 2023-11-24T08:07:32.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 -- 172.21.15.153:0/3469995996 shutdown_connections 2023-11-24T08:07:32.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f512806b080 0x7f512806d540 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815bdd0 0x7f51480ca4c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51480b3370 0x7f5148157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 --2- 172.21.15.153:0/3469995996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51480d1c70 0x7f51480c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 -- 172.21.15.153:0/3469995996 >> 172.21.15.153:0/3469995996 conn(0x7f51480731a0 msgr2=0x7f514815f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 -- 172.21.15.153:0/3469995996 shutdown_connections 2023-11-24T08:07:32.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.505+0000 7f514cc18700 1 -- 172.21.15.153:0/3469995996 wait complete. 2023-11-24T08:07:32.522 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:07:14.800746+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:07:15.529815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:32.523 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.644+0000 7fe69ab95700 1 Processor -- start 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.644+0000 7fe69ab95700 1 -- start start 2023-11-24T08:07:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.645+0000 7fe69ab95700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe69415b370 0x7fe69415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.645+0000 7fe69ab95700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6940ae5e0 con 0x7fe6941587f0 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.645+0000 7fe69ab95700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69415be30 con 0x7fe6940b3c60 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.645+0000 7fe69ab95700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69415c110 con 0x7fe69415b370 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.645+0000 7fe698931700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe6941587f0 0x7fe69406aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45904/0 (socket says 172.21.15.153:45904) 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.645+0000 7fe698931700 1 -- 172.21.15.153:0/28895238 learned_addr learned my addr 172.21.15.153:0/28895238 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe693fff700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe69415b370 0x7fe69415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028552266 0 0) 0x7fe6940ae5e0 con 0x7fe6941587f0 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6840035b0 con 0x7fe6941587f0 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59194019 0 0) 0x7fe6840035b0 con 0x7fe6941587f0 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe69415b370 msgr2=0x7fe69415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe69415b370 0x7fe69415b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 >> v1:172.21.15.164:6789/0 conn(0x7fe6940b3c60 legacy=0x7fe6940af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6940ae860 con 0x7fe6941587f0 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fe688001670 con 0x7fe6941587f0 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 >> v1:172.21.15.153:6789/0 conn(0x7fe6941587f0 legacy=0x7fe69406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe684003a30 0x7fe684003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe69415b370 0x7fe684004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe684004d90 0x7fe684005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69415c110 con 0x7fe684004d90 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68400ba10 con 0x7fe684003a30 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68400bbd0 con 0x7fe69415b370 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe699132700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe684004d90 0x7fe684005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe698931700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe684003a30 0x7fe684003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe693fff700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe69415b370 0x7fe684004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe699132700 1 -- 172.21.15.153:0/28895238 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe69415b370 msgr2=0x7fe684004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe699132700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe69415b370 0x7fe684004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe699132700 1 -- 172.21.15.153:0/28895238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe684003a30 msgr2=0x7fe684003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.646+0000 7fe699132700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe684003a30 0x7fe684003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe699132700 1 -- 172.21.15.153:0/28895238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6840035b0 con 0x7fe684004d90 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe699132700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe684004d90 0x7fe684005210 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c290 tx=0x7fe684005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b9c41fef0fc78e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c001e70 con 0x7fe684004d90 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c00ce50 con 0x7fe684004d90 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe6937fe700 1 -- 172.21.15.153:0/28895238 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c012660 con 0x7fe684004d90 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe69ab95700 1 -- 172.21.15.153:0/28895238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe684004d90 msgr2=0x7fe684005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe69ab95700 1 --2- 172.21.15.153:0/28895238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe684004d90 0x7fe684005210 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c290 tx=0x7fe684005880 comp rx=0 tx=0).stop 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe699132700 1 -- 172.21.15.153:0/28895238 reap_dead start 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe69ab95700 1 -- 172.21.15.153:0/28895238 shutdown_connections 2023-11-24T08:07:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe69ab95700 1 -- 172.21.15.153:0/28895238 >> 172.21.15.153:0/28895238 conn(0x7fe6940d0bf0 msgr2=0x7fe6940d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe69ab95700 1 -- 172.21.15.153:0/28895238 shutdown_connections 2023-11-24T08:07:32.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.647+0000 7fe69ab95700 1 -- 172.21.15.153:0/28895238 wait complete. 2023-11-24T08:07:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.649+0000 7fe69ab95700 1 Processor -- start 2023-11-24T08:07:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.649+0000 7fe69ab95700 1 -- start start 2023-11-24T08:07:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.649+0000 7fe69ab95700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6941448d0 0x7fe694147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.649+0000 7fe69ab95700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe694144cb0 0x7fe6941451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.649+0000 7fe69ab95700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe694146a30 0x7fe6940b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.649+0000 7fe69ab95700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6941456f0 con 0x7fe694146a30 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.649+0000 7fe69ab95700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe694145990 con 0x7fe694144cb0 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.649+0000 7fe69ab95700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe694145c70 con 0x7fe6941448d0 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe699132700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe694146a30 0x7fe6940b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe699132700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe694146a30 0x7fe6940b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39816/0 (socket says 172.21.15.153:39816) 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe699132700 1 -- 172.21.15.153:0/2282429270 learned_addr learned my addr 172.21.15.153:0/2282429270 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe698931700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6941448d0 0x7fe694147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe693fff700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe694144cb0 0x7fe6941451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe699132700 1 -- 172.21.15.153:0/2282429270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6941448d0 msgr2=0x7fe694147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe699132700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6941448d0 0x7fe694147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe699132700 1 -- 172.21.15.153:0/2282429270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe694144cb0 msgr2=0x7fe6941451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe699132700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe694144cb0 0x7fe6941451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe699132700 1 -- 172.21.15.153:0/2282429270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe694145f50 con 0x7fe694146a30 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe699132700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe694146a30 0x7fe6940b1170 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe68c013000 tx=0x7fe68c0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe6917fa700 1 -- 172.21.15.153:0/2282429270 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c003c00 con 0x7fe694146a30 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe6917fa700 1 -- 172.21.15.153:0/2282429270 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c020070 con 0x7fe694146a30 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe6917fa700 1 -- 172.21.15.153:0/2282429270 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c0050c0 con 0x7fe694146a30 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe69ab95700 1 -- 172.21.15.153:0/2282429270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe694146230 con 0x7fe694146a30 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.650+0000 7fe69ab95700 1 -- 172.21.15.153:0/2282429270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe694146ec0 con 0x7fe694146a30 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.651+0000 7fe69ab95700 1 -- 172.21.15.153:0/2282429270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe694147050 con 0x7fe694146a30 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.652+0000 7fe6917fa700 1 -- 172.21.15.153:0/2282429270 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe68c022030 con 0x7fe694146a30 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.652+0000 7fe6917fa700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe67806b080 0x7fe67806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.652+0000 7fe6917fa700 1 -- 172.21.15.153:0/2282429270 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe68c08a110 con 0x7fe694146a30 2023-11-24T08:07:32.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.652+0000 7fe698931700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe67806b080 0x7fe67806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.652+0000 7fe698931700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe67806b080 0x7fe67806d540 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe688001eb0 tx=0x7fe688000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.656+0000 7fe6917fa700 1 -- 172.21.15.153:0/2282429270 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe68c0551b0 con 0x7fe694146a30 2023-11-24T08:07:32.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.845+0000 7fe69ab95700 1 -- 172.21.15.153:0/2282429270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe694068fb0 con 0x7fe694146a30 2023-11-24T08:07:32.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.846+0000 7fe6917fa700 1 -- 172.21.15.153:0/2282429270 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe68c0587d0 con 0x7fe694146a30 2023-11-24T08:07:32.849 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:07:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 -- 172.21.15.153:0/2282429270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe67806b080 msgr2=0x7fe67806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe67806b080 0x7fe67806d540 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe688001eb0 tx=0x7fe688000bc0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 -- 172.21.15.153:0/2282429270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe694146a30 msgr2=0x7fe6940b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe694146a30 0x7fe6940b1170 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe68c013000 tx=0x7fe68c0015b0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 -- 172.21.15.153:0/2282429270 shutdown_connections 2023-11-24T08:07:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe67806b080 0x7fe67806d540 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe694146a30 0x7fe6940b1170 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6941448d0 0x7fe694147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 --2- 172.21.15.153:0/2282429270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe694144cb0 0x7fe6941451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 -- 172.21.15.153:0/2282429270 >> 172.21.15.153:0/2282429270 conn(0x7fe6940d0bf0 msgr2=0x7fe69406be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 -- 172.21.15.153:0/2282429270 shutdown_connections 2023-11-24T08:07:32.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.848+0000 7fe69ab95700 1 -- 172.21.15.153:0/2282429270 wait complete. 2023-11-24T08:07:32.863 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:32.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.985+0000 7f5df1a64700 1 Processor -- start 2023-11-24T08:07:32.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.985+0000 7f5df1a64700 1 -- start start 2023-11-24T08:07:32.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.985+0000 7f5df1a64700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5dec0746a0 0x7f5dec0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.985+0000 7f5df1a64700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dec0afc90 0x7f5dec06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.985+0000 7f5df1a64700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec0b3c60 con 0x7f5dec15e160 2023-11-24T08:07:32.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.985+0000 7f5df1a64700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec0b4500 con 0x7f5dec0746a0 2023-11-24T08:07:32.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.985+0000 7f5df1a64700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0b58c0 con 0x7f5dec0afc90 2023-11-24T08:07:32.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5deaffd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5dec0746a0 0x7f5dec0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5debfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dec0afc90 0x7f5dec06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5deb7fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f5dec15e160 0x7f5dec073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:53606/0 (socket says 172.21.15.153:53606) 2023-11-24T08:07:32.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5deb7fe700 1 -- 172.21.15.153:0/3357662442 learned_addr learned my addr 172.21.15.153:0/3357662442 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:32.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5dea7fc700 1 -- 172.21.15.153:0/3357662442 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001878927 0 0) 0x7f5dec0b3c60 con 0x7f5dec15e160 2023-11-24T08:07:32.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5dea7fc700 1 -- 172.21.15.153:0/3357662442 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd40035b0 con 0x7f5dec15e160 2023-11-24T08:07:32.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5debfff700 1 -- 172.21.15.153:0/3357662442 >> v2:172.21.15.164:3300/0 conn(0x7f5dec0746a0 msgr2=0x7f5dec0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5debfff700 1 --2- 172.21.15.153:0/3357662442 >> v2:172.21.15.164:3300/0 conn(0x7f5dec0746a0 0x7f5dec0b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5debfff700 1 -- 172.21.15.153:0/3357662442 >> v1:172.21.15.164:6789/0 conn(0x7f5dec15e160 legacy=0x7f5dec073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5debfff700 1 -- 172.21.15.153:0/3357662442 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0b0120 con 0x7f5dec0afc90 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5deaffd700 1 --2- 172.21.15.153:0/3357662442 >> v2:172.21.15.164:3300/0 conn(0x7f5dec0746a0 0x7f5dec0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.986+0000 7f5debfff700 1 --2- 172.21.15.153:0/3357662442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dec0afc90 0x7f5dec06d930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009d90 tx=0x7f5de400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14b585c5dfed5421 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.987+0000 7f5dea7fc700 1 -- 172.21.15.153:0/3357662442 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de400e070 con 0x7f5dec0afc90 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.987+0000 7f5dea7fc700 1 -- 172.21.15.153:0/3357662442 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de400bb20 con 0x7f5dec0afc90 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.987+0000 7f5dea7fc700 1 -- 172.21.15.153:0/3357662442 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de400be90 con 0x7f5dec0afc90 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.987+0000 7f5df1a64700 1 -- 172.21.15.153:0/3357662442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dec0afc90 msgr2=0x7f5dec06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.987+0000 7f5df1a64700 1 --2- 172.21.15.153:0/3357662442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dec0afc90 0x7f5dec06d930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009d90 tx=0x7f5de400b330 comp rx=0 tx=0).stop 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.987+0000 7f5df1a64700 1 -- 172.21.15.153:0/3357662442 shutdown_connections 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.987+0000 7f5df1a64700 1 --2- 172.21.15.153:0/3357662442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dec0afc90 0x7f5dec06d930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.987+0000 7f5df1a64700 1 --2- 172.21.15.153:0/3357662442 >> v2:172.21.15.164:3300/0 conn(0x7f5dec0746a0 0x7f5dec0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.987+0000 7f5df1a64700 1 -- 172.21.15.153:0/3357662442 >> 172.21.15.153:0/3357662442 conn(0x7f5dec0d0bf0 msgr2=0x7f5dec0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.987+0000 7f5df1a64700 1 -- 172.21.15.153:0/3357662442 shutdown_connections 2023-11-24T08:07:32.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.987+0000 7f5df1a64700 1 -- 172.21.15.153:0/3357662442 wait complete. 2023-11-24T08:07:32.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.989+0000 7f5df1a64700 1 Processor -- start 2023-11-24T08:07:32.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.989+0000 7f5df1a64700 1 -- start start 2023-11-24T08:07:32.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.989+0000 7f5df1a64700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dec0746a0 0x7f5dec160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.989+0000 7f5df1a64700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0afc90 0x7f5dec158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5df1a64700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dec15e160 0x7f5dec1f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5df1a64700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec1602a0 con 0x7f5dec0afc90 2023-11-24T08:07:32.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5df1a64700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec161620 con 0x7f5dec0746a0 2023-11-24T08:07:32.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5df1a64700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec15f200 con 0x7f5dec15e160 2023-11-24T08:07:32.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5deaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0afc90 0x7f5dec158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5deaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0afc90 0x7f5dec158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39826/0 (socket says 172.21.15.153:39826) 2023-11-24T08:07:32.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5deaffd700 1 -- 172.21.15.153:0/2094853624 learned_addr learned my addr 172.21.15.153:0/2094853624 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:32.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5debfff700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dec15e160 0x7f5dec1f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5deb7fe700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dec0746a0 0x7f5dec160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5deaffd700 1 -- 172.21.15.153:0/2094853624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dec15e160 msgr2=0x7f5dec1f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5deaffd700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dec15e160 0x7f5dec1f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5deaffd700 1 -- 172.21.15.153:0/2094853624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dec0746a0 msgr2=0x7f5dec160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5deaffd700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dec0746a0 0x7f5dec160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5deaffd700 1 -- 172.21.15.153:0/2094853624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0094a0 con 0x7f5dec0afc90 2023-11-24T08:07:32.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5deaffd700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0afc90 0x7f5dec158120 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00ebe0 tx=0x7f5ddc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5dd3fff700 1 -- 172.21.15.153:0/2094853624 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00c850 con 0x7f5dec0afc90 2023-11-24T08:07:33.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5dd3fff700 1 -- 172.21.15.153:0/2094853624 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc00c9b0 con 0x7f5dec0afc90 2023-11-24T08:07:33.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5dd3fff700 1 -- 172.21.15.153:0/2094853624 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00cd40 con 0x7f5dec0afc90 2023-11-24T08:07:33.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5df1a64700 1 -- 172.21.15.153:0/2094853624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de4009a70 con 0x7f5dec0afc90 2023-11-24T08:07:33.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5df1a64700 1 -- 172.21.15.153:0/2094853624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec15f7c0 con 0x7f5dec0afc90 2023-11-24T08:07:33.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.991+0000 7f5df1a64700 1 -- 172.21.15.153:0/2094853624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dec0b4640 con 0x7f5dec0afc90 2023-11-24T08:07:33.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.992+0000 7f5dd3fff700 1 -- 172.21.15.153:0/2094853624 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5ddc013470 con 0x7f5dec0afc90 2023-11-24T08:07:33.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.992+0000 7f5dd3fff700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5dd806b080 0x7f5dd806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.992+0000 7f5dd3fff700 1 -- 172.21.15.153:0/2094853624 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ddc089920 con 0x7f5dec0afc90 2023-11-24T08:07:33.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.992+0000 7f5deb7fe700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5dd806b080 0x7f5dd806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.993+0000 7f5deb7fe700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5dd806b080 0x7f5dd806d540 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5de0007fd0 tx=0x7f5de0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:32.997+0000 7f5dd3fff700 1 -- 172.21.15.153:0/2094853624 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ddc0547e0 con 0x7f5dec0afc90 2023-11-24T08:07:33.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.186+0000 7f5df1a64700 1 -- 172.21.15.153:0/2094853624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5dec068fb0 con 0x7f5dec0afc90 2023-11-24T08:07:33.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.187+0000 7f5dd3fff700 1 -- 172.21.15.153:0/2094853624 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ddc00cea0 con 0x7f5dec0afc90 2023-11-24T08:07:33.190 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:07:33.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 -- 172.21.15.153:0/2094853624 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5dd806b080 msgr2=0x7f5dd806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5dd806b080 0x7f5dd806d540 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5de0007fd0 tx=0x7f5de0009040 comp rx=0 tx=0).stop 2023-11-24T08:07:33.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 -- 172.21.15.153:0/2094853624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0afc90 msgr2=0x7f5dec158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0afc90 0x7f5dec158120 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00ebe0 tx=0x7f5ddc00eef0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 -- 172.21.15.153:0/2094853624 shutdown_connections 2023-11-24T08:07:33.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dec15e160 0x7f5dec1f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dec0746a0 0x7f5dec160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5dd806b080 0x7f5dd806d540 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 --2- 172.21.15.153:0/2094853624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0afc90 0x7f5dec158120 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 -- 172.21.15.153:0/2094853624 >> 172.21.15.153:0/2094853624 conn(0x7f5dec0d0bf0 msgr2=0x7f5dec06d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 -- 172.21.15.153:0/2094853624 shutdown_connections 2023-11-24T08:07:33.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.189+0000 7f5df1a64700 1 -- 172.21.15.153:0/2094853624 wait complete. 2023-11-24T08:07:33.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:33.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.326+0000 7f737f4b3700 1 Processor -- start 2023-11-24T08:07:33.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.326+0000 7f737f4b3700 1 -- start start 2023-11-24T08:07:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.327+0000 7f737f4b3700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f73780746a0 0x7f73780b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.327+0000 7f737f4b3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73780afc90 0x7f737806d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.327+0000 7f737f4b3700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73780b3c60 con 0x7f737815e160 2023-11-24T08:07:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.327+0000 7f737f4b3700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73780b4500 con 0x7f73780746a0 2023-11-24T08:07:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.327+0000 7f737f4b3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73780b58c0 con 0x7f73780afc90 2023-11-24T08:07:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f737ca4e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f73780746a0 0x7f73780b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f737da50700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73780afc90 0x7f737806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f737d24f700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f737815e160 0x7f7378073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:53620/0 (socket says 172.21.15.153:53620) 2023-11-24T08:07:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f737d24f700 1 -- 172.21.15.153:0/644696010 learned_addr learned my addr 172.21.15.153:0/644696010 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:33.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f737da50700 1 -- 172.21.15.153:0/644696010 >> v2:172.21.15.164:3300/0 conn(0x7f73780746a0 msgr2=0x7f73780b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:33.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f737da50700 1 --2- 172.21.15.153:0/644696010 >> v2:172.21.15.164:3300/0 conn(0x7f73780746a0 0x7f73780b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f737da50700 1 -- 172.21.15.153:0/644696010 >> v1:172.21.15.164:6789/0 conn(0x7f737815e160 legacy=0x7f7378073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f737da50700 1 -- 172.21.15.153:0/644696010 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73780b0120 con 0x7f73780afc90 2023-11-24T08:07:33.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f737ca4e700 1 --2- 172.21.15.153:0/644696010 >> v2:172.21.15.164:3300/0 conn(0x7f73780746a0 0x7f73780b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:33.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f737da50700 1 --2- 172.21.15.153:0/644696010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73780afc90 0x7f737806d930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7370009d90 tx=0x7f737000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e8588f047ad5a0a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f736ffff700 1 -- 172.21.15.153:0/644696010 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737000e070 con 0x7f73780afc90 2023-11-24T08:07:33.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f736ffff700 1 -- 172.21.15.153:0/644696010 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737000bb20 con 0x7f73780afc90 2023-11-24T08:07:33.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.328+0000 7f736ffff700 1 -- 172.21.15.153:0/644696010 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370012430 con 0x7f73780afc90 2023-11-24T08:07:33.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.329+0000 7f737f4b3700 1 -- 172.21.15.153:0/644696010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73780afc90 msgr2=0x7f737806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.329+0000 7f737f4b3700 1 --2- 172.21.15.153:0/644696010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73780afc90 0x7f737806d930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7370009d90 tx=0x7f737000b330 comp rx=0 tx=0).stop 2023-11-24T08:07:33.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.329+0000 7f737f4b3700 1 -- 172.21.15.153:0/644696010 shutdown_connections 2023-11-24T08:07:33.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.329+0000 7f737f4b3700 1 --2- 172.21.15.153:0/644696010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73780afc90 0x7f737806d930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.329+0000 7f737f4b3700 1 --2- 172.21.15.153:0/644696010 >> v2:172.21.15.164:3300/0 conn(0x7f73780746a0 0x7f73780b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.329+0000 7f737f4b3700 1 -- 172.21.15.153:0/644696010 >> 172.21.15.153:0/644696010 conn(0x7f73780d0bf0 msgr2=0x7f73780d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.329+0000 7f737f4b3700 1 -- 172.21.15.153:0/644696010 shutdown_connections 2023-11-24T08:07:33.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.329+0000 7f737f4b3700 1 -- 172.21.15.153:0/644696010 wait complete. 2023-11-24T08:07:33.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.330+0000 7f737f4b3700 1 Processor -- start 2023-11-24T08:07:33.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.330+0000 7f737f4b3700 1 -- start start 2023-11-24T08:07:33.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737f4b3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73780746a0 0x7f7378160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737f4b3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73780afc90 0x7f7378145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737f4b3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f737815e160 0x7f7378154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737f4b3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73781535d0 con 0x7f73780afc90 2023-11-24T08:07:33.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737f4b3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73781538b0 con 0x7f737815e160 2023-11-24T08:07:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737f4b3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7378153b90 con 0x7f73780746a0 2023-11-24T08:07:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737ca4e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73780afc90 0x7f7378145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737ca4e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73780afc90 0x7f7378145350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39842/0 (socket says 172.21.15.153:39842) 2023-11-24T08:07:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737ca4e700 1 -- 172.21.15.153:0/2475648677 learned_addr learned my addr 172.21.15.153:0/2475648677 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737da50700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f737815e160 0x7f7378154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737d24f700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73780746a0 0x7f7378160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737ca4e700 1 -- 172.21.15.153:0/2475648677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73780746a0 msgr2=0x7f7378160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737ca4e700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73780746a0 0x7f7378160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737ca4e700 1 -- 172.21.15.153:0/2475648677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f737815e160 msgr2=0x7f7378154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737ca4e700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f737815e160 0x7f7378154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.331+0000 7f737ca4e700 1 -- 172.21.15.153:0/2475648677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73740094a0 con 0x7f73780afc90 2023-11-24T08:07:33.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.332+0000 7f737ca4e700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73780afc90 0x7f7378145350 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f737400ebe0 tx=0x7f737400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.332+0000 7f736dffb700 1 -- 172.21.15.153:0/2475648677 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737400c850 con 0x7f73780afc90 2023-11-24T08:07:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.332+0000 7f736dffb700 1 -- 172.21.15.153:0/2475648677 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737400c9b0 con 0x7f73780afc90 2023-11-24T08:07:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.332+0000 7f737f4b3700 1 -- 172.21.15.153:0/2475648677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7370009a70 con 0x7f73780afc90 2023-11-24T08:07:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.332+0000 7f736dffb700 1 -- 172.21.15.153:0/2475648677 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737400cd40 con 0x7f73780afc90 2023-11-24T08:07:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.332+0000 7f737f4b3700 1 -- 172.21.15.153:0/2475648677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7378154150 con 0x7f73780afc90 2023-11-24T08:07:33.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.333+0000 7f737f4b3700 1 -- 172.21.15.153:0/2475648677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7378068fb0 con 0x7f73780afc90 2023-11-24T08:07:33.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.333+0000 7f736dffb700 1 -- 172.21.15.153:0/2475648677 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7374013470 con 0x7f73780afc90 2023-11-24T08:07:33.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.334+0000 7f736dffb700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f735c06b080 0x7f735c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.334+0000 7f736dffb700 1 -- 172.21.15.153:0/2475648677 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7374089a50 con 0x7f73780afc90 2023-11-24T08:07:33.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.334+0000 7f737d24f700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f735c06b080 0x7f735c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.334+0000 7f737d24f700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f735c06b080 0x7f735c06d540 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7368005910 tx=0x7f7368009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.339+0000 7f736dffb700 1 -- 172.21.15.153:0/2475648677 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7374054800 con 0x7f73780afc90 2023-11-24T08:07:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.528+0000 7f737f4b3700 1 -- 172.21.15.153:0/2475648677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f737806c140 con 0x7f73780afc90 2023-11-24T08:07:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.529+0000 7f736dffb700 1 -- 172.21.15.153:0/2475648677 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f737400cea0 con 0x7f73780afc90 2023-11-24T08:07:33.532 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:07:33.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 -- 172.21.15.153:0/2475648677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f735c06b080 msgr2=0x7f735c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f735c06b080 0x7f735c06d540 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7368005910 tx=0x7f7368009040 comp rx=0 tx=0).stop 2023-11-24T08:07:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 -- 172.21.15.153:0/2475648677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73780afc90 msgr2=0x7f7378145350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73780afc90 0x7f7378145350 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f737400ebe0 tx=0x7f737400eef0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 -- 172.21.15.153:0/2475648677 shutdown_connections 2023-11-24T08:07:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f737815e160 0x7f7378154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73780746a0 0x7f7378160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f735c06b080 0x7f735c06d540 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 --2- 172.21.15.153:0/2475648677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73780afc90 0x7f7378145350 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 -- 172.21.15.153:0/2475648677 >> 172.21.15.153:0/2475648677 conn(0x7f73780d0bf0 msgr2=0x7f737815d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 -- 172.21.15.153:0/2475648677 shutdown_connections 2023-11-24T08:07:33.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.531+0000 7f737f4b3700 1 -- 172.21.15.153:0/2475648677 wait complete. 2023-11-24T08:07:33.546 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:33.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b80c6700 1 Processor -- start 2023-11-24T08:07:33.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b80c6700 1 -- start start 2023-11-24T08:07:33.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b80c6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f03b006c710 0x7f03b00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b80c6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b00af4d0 0x7f03b00afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b80c6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b00ae430 con 0x7f03b015e080 2023-11-24T08:07:33.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b80c6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b00af0b0 con 0x7f03b006c710 2023-11-24T08:07:33.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b80c6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b00b05a0 con 0x7f03b00af4d0 2023-11-24T08:07:33.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b5661700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f03b006c710 0x7f03b00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b5e62700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f03b015e080 0x7f03b006c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45952/0 (socket says 172.21.15.153:45952) 2023-11-24T08:07:33.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b5e62700 1 -- 172.21.15.153:0/3276687951 learned_addr learned my addr 172.21.15.153:0/3276687951 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:33.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b6663700 1 --2- 172.21.15.153:0/3276687951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b00af4d0 0x7f03b00afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b5661700 1 -- 172.21.15.153:0/3276687951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b00af4d0 msgr2=0x7f03b00afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:33.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b5661700 1 --2- 172.21.15.153:0/3276687951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b00af4d0 0x7f03b00afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b5661700 1 -- 172.21.15.153:0/3276687951 >> v1:172.21.15.153:6789/0 conn(0x7f03b015e080 legacy=0x7f03b006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b5661700 1 -- 172.21.15.153:0/3276687951 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b00ae710 con 0x7f03b006c710 2023-11-24T08:07:33.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b4e60700 1 -- 172.21.15.153:0/3276687951 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735729185 0 0) 0x7f03b00ae430 con 0x7f03b015e080 2023-11-24T08:07:33.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b6663700 1 --2- 172.21.15.153:0/3276687951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b00af4d0 0x7f03b00afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:33.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b5661700 1 --2- 172.21.15.153:0/3276687951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b006c710 0x7f03b00b5050 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009840 tx=0x7f03a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd08041c5e9a7f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.666+0000 7f03b4e60700 1 -- 172.21.15.153:0/3276687951 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0011830 con 0x7f03b006c710 2023-11-24T08:07:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.667+0000 7f03b4e60700 1 -- 172.21.15.153:0/3276687951 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a0011990 con 0x7f03b006c710 2023-11-24T08:07:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.667+0000 7f03b4e60700 1 -- 172.21.15.153:0/3276687951 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0011d20 con 0x7f03b006c710 2023-11-24T08:07:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.667+0000 7f03b80c6700 1 -- 172.21.15.153:0/3276687951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b006c710 msgr2=0x7f03b00b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.667+0000 7f03b80c6700 1 --2- 172.21.15.153:0/3276687951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b006c710 0x7f03b00b5050 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009840 tx=0x7f03a0009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.667+0000 7f03b80c6700 1 -- 172.21.15.153:0/3276687951 shutdown_connections 2023-11-24T08:07:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.667+0000 7f03b80c6700 1 --2- 172.21.15.153:0/3276687951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b00af4d0 0x7f03b00afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.667+0000 7f03b80c6700 1 --2- 172.21.15.153:0/3276687951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b006c710 0x7f03b00b5050 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.667+0000 7f03b80c6700 1 -- 172.21.15.153:0/3276687951 >> 172.21.15.153:0/3276687951 conn(0x7f03b0071b90 msgr2=0x7f03b0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.667+0000 7f03b80c6700 1 -- 172.21.15.153:0/3276687951 shutdown_connections 2023-11-24T08:07:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.667+0000 7f03b80c6700 1 -- 172.21.15.153:0/3276687951 wait complete. 2023-11-24T08:07:33.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.668+0000 7f03b80c6700 1 Processor -- start 2023-11-24T08:07:33.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.668+0000 7f03b80c6700 1 -- start start 2023-11-24T08:07:33.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b80c6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03b006c710 0x7f03b00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b80c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b00af4d0 0x7f03b015ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b80c6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b015e080 0x7f03b0160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b80c6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b015fae0 con 0x7f03b00af4d0 2023-11-24T08:07:33.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b80c6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b00d07e0 con 0x7f03b006c710 2023-11-24T08:07:33.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b80c6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b015f460 con 0x7f03b015e080 2023-11-24T08:07:33.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b5661700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b00af4d0 0x7f03b015ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b5661700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b00af4d0 0x7f03b015ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39854/0 (socket says 172.21.15.153:39854) 2023-11-24T08:07:33.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b5661700 1 -- 172.21.15.153:0/3513883913 learned_addr learned my addr 172.21.15.153:0/3513883913 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:33.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b5e62700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03b006c710 0x7f03b00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b6663700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b015e080 0x7f03b0160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b5661700 1 -- 172.21.15.153:0/3513883913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b015e080 msgr2=0x7f03b0160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b5661700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b015e080 0x7f03b0160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b5661700 1 -- 172.21.15.153:0/3513883913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03b006c710 msgr2=0x7f03b00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b5661700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03b006c710 0x7f03b00d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b5661700 1 -- 172.21.15.153:0/3513883913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a00094a0 con 0x7f03b00af4d0 2023-11-24T08:07:33.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.669+0000 7f03b5e62700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03b006c710 0x7f03b00d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:33.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.670+0000 7f03b5661700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b00af4d0 0x7f03b015ff00 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f03a00090b0 tx=0x7f03a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.670+0000 7f03a67fc700 1 -- 172.21.15.153:0/3513883913 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00038a0 con 0x7f03b00af4d0 2023-11-24T08:07:33.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.670+0000 7f03a67fc700 1 -- 172.21.15.153:0/3513883913 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a001f070 con 0x7f03b00af4d0 2023-11-24T08:07:33.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.670+0000 7f03b80c6700 1 -- 172.21.15.153:0/3513883913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b0156590 con 0x7f03b00af4d0 2023-11-24T08:07:33.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.670+0000 7f03a67fc700 1 -- 172.21.15.153:0/3513883913 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0003c60 con 0x7f03b00af4d0 2023-11-24T08:07:33.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.670+0000 7f03b80c6700 1 -- 172.21.15.153:0/3513883913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b0156870 con 0x7f03b00af4d0 2023-11-24T08:07:33.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.671+0000 7f03b80c6700 1 -- 172.21.15.153:0/3513883913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b00753f0 con 0x7f03b00af4d0 2023-11-24T08:07:33.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.671+0000 7f03a67fc700 1 -- 172.21.15.153:0/3513883913 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f03a001a430 con 0x7f03b00af4d0 2023-11-24T08:07:33.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.671+0000 7f03a67fc700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f039406b080 0x7f039406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.672+0000 7f03a67fc700 1 -- 172.21.15.153:0/3513883913 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03a0021070 con 0x7f03b00af4d0 2023-11-24T08:07:33.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.672+0000 7f03b5e62700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f039406b080 0x7f039406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.672+0000 7f03b5e62700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f039406b080 0x7f039406d540 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f03ac000f60 tx=0x7f03ac007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.677+0000 7f03a67fc700 1 -- 172.21.15.153:0/3513883913 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03a0056220 con 0x7f03b00af4d0 2023-11-24T08:07:33.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.881+0000 7f03b80c6700 1 -- 172.21.15.153:0/3513883913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03b015fc20 con 0x7f03b00af4d0 2023-11-24T08:07:33.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.881+0000 7f03a67fc700 1 -- 172.21.15.153:0/3513883913 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f03b015fc20 con 0x7f03b00af4d0 2023-11-24T08:07:33.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 -- 172.21.15.153:0/3513883913 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f039406b080 msgr2=0x7f039406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f039406b080 0x7f039406d540 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f03ac000f60 tx=0x7f03ac007d30 comp rx=0 tx=0).stop 2023-11-24T08:07:33.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 -- 172.21.15.153:0/3513883913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b00af4d0 msgr2=0x7f03b015ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b00af4d0 0x7f03b015ff00 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f03a00090b0 tx=0x7f03a0004750 comp rx=0 tx=0).stop 2023-11-24T08:07:33.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 -- 172.21.15.153:0/3513883913 shutdown_connections 2023-11-24T08:07:33.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b015e080 0x7f03b0160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03b006c710 0x7f03b00d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f039406b080 0x7f039406d540 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 --2- 172.21.15.153:0/3513883913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b00af4d0 0x7f03b015ff00 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 -- 172.21.15.153:0/3513883913 >> 172.21.15.153:0/3513883913 conn(0x7f03b0071b90 msgr2=0x7f03b00b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 -- 172.21.15.153:0/3513883913 shutdown_connections 2023-11-24T08:07:33.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:33.885+0000 7f03b80c6700 1 -- 172.21.15.153:0/3513883913 wait complete. 2023-11-24T08:07:33.890 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2023-11-24T08:07:33.899 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T08:07:33.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:33.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:33.942 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:07:33.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:33.943 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:07:33.999 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:07:33.999 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:34.021 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:07:34.021 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:34.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:34.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.202+0000 7f9254157700 1 Processor -- start 2023-11-24T08:07:34.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.202+0000 7f9254157700 1 -- start start 2023-11-24T08:07:34.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f9254157700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f924c06c710 0x7f924c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f9254157700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f924c0af4d0 0x7f924c0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f9254157700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924c0ae430 con 0x7f924c15e080 2023-11-24T08:07:34.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f9254157700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c0af0b0 con 0x7f924c06c710 2023-11-24T08:07:34.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f9254157700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c0b05a0 con 0x7f924c0af4d0 2023-11-24T08:07:34.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f92516f2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f924c06c710 0x7f924c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f92516f2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f924c06c710 0x7f924c0b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39864/0 (socket says 172.21.15.153:39864) 2023-11-24T08:07:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f92516f2700 1 -- 172.21.15.153:0/683780119 learned_addr learned my addr 172.21.15.153:0/683780119 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f92516f2700 1 -- 172.21.15.153:0/683780119 >> v2:172.21.15.164:3300/0 conn(0x7f924c0af4d0 msgr2=0x7f924c0afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f92526f4700 1 --2- 172.21.15.153:0/683780119 >> v2:172.21.15.164:3300/0 conn(0x7f924c0af4d0 0x7f924c0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f92516f2700 1 --2- 172.21.15.153:0/683780119 >> v2:172.21.15.164:3300/0 conn(0x7f924c0af4d0 0x7f924c0afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f9250ef1700 1 -- 172.21.15.153:0/683780119 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199767551 0 0) 0x7f924c0ae430 con 0x7f924c15e080 2023-11-24T08:07:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f92516f2700 1 -- 172.21.15.153:0/683780119 >> v1:172.21.15.153:6789/0 conn(0x7f924c15e080 legacy=0x7f924c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f92516f2700 1 -- 172.21.15.153:0/683780119 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c0ae710 con 0x7f924c06c710 2023-11-24T08:07:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.203+0000 7f92516f2700 1 --2- 172.21.15.153:0/683780119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f924c06c710 0x7f924c0b5050 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f924c09eea0 tx=0x7f923c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e587a6c0c40fb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.204+0000 7f9250ef1700 1 -- 172.21.15.153:0/683780119 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c00b860 con 0x7f924c06c710 2023-11-24T08:07:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.204+0000 7f9250ef1700 1 -- 172.21.15.153:0/683780119 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c00b9c0 con 0x7f924c06c710 2023-11-24T08:07:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.204+0000 7f9250ef1700 1 -- 172.21.15.153:0/683780119 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c00bd50 con 0x7f924c06c710 2023-11-24T08:07:34.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.204+0000 7f9254157700 1 -- 172.21.15.153:0/683780119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f924c06c710 msgr2=0x7f924c0b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.204+0000 7f9254157700 1 --2- 172.21.15.153:0/683780119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f924c06c710 0x7f924c0b5050 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f924c09eea0 tx=0x7f923c009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:34.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.204+0000 7f9254157700 1 -- 172.21.15.153:0/683780119 shutdown_connections 2023-11-24T08:07:34.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.204+0000 7f9254157700 1 --2- 172.21.15.153:0/683780119 >> v2:172.21.15.164:3300/0 conn(0x7f924c0af4d0 0x7f924c0afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.204+0000 7f9254157700 1 --2- 172.21.15.153:0/683780119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f924c06c710 0x7f924c0b5050 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.204+0000 7f9254157700 1 -- 172.21.15.153:0/683780119 >> 172.21.15.153:0/683780119 conn(0x7f924c071b90 msgr2=0x7f924c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:34.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.204+0000 7f9254157700 1 -- 172.21.15.153:0/683780119 shutdown_connections 2023-11-24T08:07:34.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.204+0000 7f9254157700 1 -- 172.21.15.153:0/683780119 wait complete. 2023-11-24T08:07:34.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.205+0000 7f9254157700 1 Processor -- start 2023-11-24T08:07:34.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.206+0000 7f9254157700 1 -- start start 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.206+0000 7f9254157700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f924c06c710 0x7f924c142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.206+0000 7f9254157700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f924c0af4d0 0x7f924c1417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.206+0000 7f9254157700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f924c15e080 0x7f924c1521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.206+0000 7f9254157700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c1f4880 con 0x7f924c0af4d0 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.206+0000 7f9254157700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c155ec0 con 0x7f924c06c710 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.206+0000 7f9254157700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c155560 con 0x7f924c15e080 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.206+0000 7f92516f2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f924c0af4d0 0x7f924c1417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.206+0000 7f92516f2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f924c0af4d0 0x7f924c1417b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39870/0 (socket says 172.21.15.153:39870) 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.206+0000 7f92516f2700 1 -- 172.21.15.153:0/798751907 learned_addr learned my addr 172.21.15.153:0/798751907 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.207+0000 7f92516f2700 1 -- 172.21.15.153:0/798751907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f924c15e080 msgr2=0x7f924c1521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.207+0000 7f92516f2700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f924c15e080 0x7f924c1521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.207+0000 7f92516f2700 1 -- 172.21.15.153:0/798751907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f924c06c710 msgr2=0x7f924c142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.207+0000 7f92516f2700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f924c06c710 0x7f924c142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.207+0000 7f92516f2700 1 -- 172.21.15.153:0/798751907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c009550 con 0x7f924c0af4d0 2023-11-24T08:07:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.207+0000 7f92516f2700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f924c0af4d0 0x7f924c1417b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f923c009c40 tx=0x7f923c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.207+0000 7f92427fc700 1 -- 172.21.15.153:0/798751907 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c0044f0 con 0x7f924c0af4d0 2023-11-24T08:07:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.207+0000 7f92427fc700 1 -- 172.21.15.153:0/798751907 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c01f070 con 0x7f924c0af4d0 2023-11-24T08:07:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.207+0000 7f9254157700 1 -- 172.21.15.153:0/798751907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c1f45a0 con 0x7f924c0af4d0 2023-11-24T08:07:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.207+0000 7f92427fc700 1 -- 172.21.15.153:0/798751907 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c0038a0 con 0x7f924c0af4d0 2023-11-24T08:07:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.207+0000 7f9254157700 1 -- 172.21.15.153:0/798751907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c155ae0 con 0x7f924c0af4d0 2023-11-24T08:07:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.208+0000 7f9254157700 1 -- 172.21.15.153:0/798751907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c0753f0 con 0x7f924c0af4d0 2023-11-24T08:07:34.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.208+0000 7f92427fc700 1 -- 172.21.15.153:0/798751907 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f923c021030 con 0x7f924c0af4d0 2023-11-24T08:07:34.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.209+0000 7f92427fc700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f923006b080 0x7f923006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.209+0000 7f9251ef3700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f923006b080 0x7f923006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.209+0000 7f92427fc700 1 -- 172.21.15.153:0/798751907 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f923c08ad60 con 0x7f924c0af4d0 2023-11-24T08:07:34.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.209+0000 7f9251ef3700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f923006b080 0x7f923006d540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9248001600 tx=0x7f92480079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.213+0000 7f92427fc700 1 -- 172.21.15.153:0/798751907 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f923c055c20 con 0x7f924c0af4d0 2023-11-24T08:07:34.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.407+0000 7f9254157700 1 -- 172.21.15.153:0/798751907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f924c156000 con 0x7f924c0af4d0 2023-11-24T08:07:34.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.408+0000 7f92427fc700 1 -- 172.21.15.153:0/798751907 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16601 (secure 0 0 0) 0x7f924c156000 con 0x7f924c0af4d0 2023-11-24T08:07:34.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:34.410 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":56,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:07:18.180030+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:14.800746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:15.529815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:34.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 -- 172.21.15.153:0/798751907 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f923006b080 msgr2=0x7f923006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f923006b080 0x7f923006d540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9248001600 tx=0x7f92480079c0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 -- 172.21.15.153:0/798751907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f924c0af4d0 msgr2=0x7f924c1417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f924c0af4d0 0x7f924c1417b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f923c009c40 tx=0x7f923c004750 comp rx=0 tx=0).stop 2023-11-24T08:07:34.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 -- 172.21.15.153:0/798751907 shutdown_connections 2023-11-24T08:07:34.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f924c15e080 0x7f924c1521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f924c06c710 0x7f924c142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f923006b080 0x7f923006d540 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 --2- 172.21.15.153:0/798751907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f924c0af4d0 0x7f924c1417b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 -- 172.21.15.153:0/798751907 >> 172.21.15.153:0/798751907 conn(0x7f924c071b90 msgr2=0x7f924c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:34.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 -- 172.21.15.153:0/798751907 shutdown_connections 2023-11-24T08:07:34.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.410+0000 7f9254157700 1 -- 172.21.15.153:0/798751907 wait complete. 2023-11-24T08:07:34.426 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:07:14.800746+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:07:15.529815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:34.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:34.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.548+0000 7fc023691700 1 Processor -- start 2023-11-24T08:07:34.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.549+0000 7fc023691700 1 -- start start 2023-11-24T08:07:34.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.549+0000 7fc023691700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1587f0 0x7fc01c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.549+0000 7fc023691700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc01c15b370 0x7fc01c15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.549+0000 7fc023691700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c06b530 con 0x7fc01c0b3c60 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.549+0000 7fc023691700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c0ae5e0 con 0x7fc01c15b370 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.549+0000 7fc023691700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15be30 con 0x7fc01c1587f0 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc021c2e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc01c0b3c60 0x7fc01c0af060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45982/0 (socket says 172.21.15.153:45982) 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc021c2e700 1 -- 172.21.15.153:0/335799948 learned_addr learned my addr 172.21.15.153:0/335799948 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc02142d700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1587f0 0x7fc01c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc020c2c700 1 --2- 172.21.15.153:0/335799948 >> v2:172.21.15.164:3300/0 conn(0x7fc01c15b370 0x7fc01c15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009305498 0 0) 0x7fc01c06b530 con 0x7fc01c0b3c60 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0080035b0 con 0x7fc01c0b3c60 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 715659275 0 0) 0x7fc0080035b0 con 0x7fc01c0b3c60 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1587f0 msgr2=0x7fc01c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1587f0 0x7fc01c06aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 >> v2:172.21.15.164:3300/0 conn(0x7fc01c15b370 msgr2=0x7fc01c15b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 --2- 172.21.15.153:0/335799948 >> v2:172.21.15.164:3300/0 conn(0x7fc01c15b370 0x7fc01c15b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c15c110 con 0x7fc01c0b3c60 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fc0140019f0 con 0x7fc01c0b3c60 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 >> v1:172.21.15.153:6789/0 conn(0x7fc01c0b3c60 legacy=0x7fc01c0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1587f0 0x7fc008003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc008003f80 0x7fc008004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc008004d90 0x7fc008005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0ae5e0 con 0x7fc008004d90 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15be30 con 0x7fc008003f80 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00800ba10 con 0x7fc01c1587f0 2023-11-24T08:07:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc021c2e700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc008004d90 0x7fc008005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc02142d700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1587f0 0x7fc008003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.550+0000 7fc020c2c700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc008003f80 0x7fc008004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc021c2e700 1 -- 172.21.15.153:0/335799948 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1587f0 msgr2=0x7fc008003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc021c2e700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1587f0 0x7fc008003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc021c2e700 1 -- 172.21.15.153:0/335799948 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc008003f80 msgr2=0x7fc008004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc021c2e700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc008003f80 0x7fc008004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc021c2e700 1 -- 172.21.15.153:0/335799948 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080035b0 con 0x7fc008004d90 2023-11-24T08:07:34.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc021c2e700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc008004d90 0x7fc008005210 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc01400a8d0 tx=0x7fc008005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f283f05e9e27a1b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01400a340 con 0x7fc008004d90 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc014012600 con 0x7fc008004d90 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc013fff700 1 -- 172.21.15.153:0/335799948 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0140129b0 con 0x7fc008004d90 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc023691700 1 -- 172.21.15.153:0/335799948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc008004d90 msgr2=0x7fc008005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc023691700 1 --2- 172.21.15.153:0/335799948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc008004d90 0x7fc008005210 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc01400a8d0 tx=0x7fc008005880 comp rx=0 tx=0).stop 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc021c2e700 1 -- 172.21.15.153:0/335799948 reap_dead start 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc023691700 1 -- 172.21.15.153:0/335799948 shutdown_connections 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc023691700 1 -- 172.21.15.153:0/335799948 >> 172.21.15.153:0/335799948 conn(0x7fc01c0d0bf0 msgr2=0x7fc01c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.551+0000 7fc023691700 1 -- 172.21.15.153:0/335799948 shutdown_connections 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.552+0000 7fc023691700 1 -- 172.21.15.153:0/335799948 wait complete. 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.553+0000 7fc023691700 1 Processor -- start 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.553+0000 7fc023691700 1 -- start start 2023-11-24T08:07:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.553+0000 7fc023691700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01c1eeff0 0x7fc01c145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.553+0000 7fc023691700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc01c1521e0 0x7fc01c151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.553+0000 7fc023691700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1546c0 0x7fc01c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.553+0000 7fc023691700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c155090 con 0x7fc01c1eeff0 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.553+0000 7fc023691700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c151e10 con 0x7fc01c1521e0 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.553+0000 7fc023691700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15adf0 con 0x7fc01c1546c0 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.553+0000 7fc02142d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01c1eeff0 0x7fc01c145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.553+0000 7fc02142d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01c1eeff0 0x7fc01c145160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39886/0 (socket says 172.21.15.153:39886) 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.553+0000 7fc02142d700 1 -- 172.21.15.153:0/313554276 learned_addr learned my addr 172.21.15.153:0/313554276 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc020c2c700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc01c1521e0 0x7fc01c151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc021c2e700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1546c0 0x7fc01c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc02142d700 1 -- 172.21.15.153:0/313554276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1546c0 msgr2=0x7fc01c154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc02142d700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1546c0 0x7fc01c154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc02142d700 1 -- 172.21.15.153:0/313554276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc01c1521e0 msgr2=0x7fc01c151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc02142d700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc01c1521e0 0x7fc01c151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc02142d700 1 -- 172.21.15.153:0/313554276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c1ef3d0 con 0x7fc01c1eeff0 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc02142d700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01c1eeff0 0x7fc01c145160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc00c011ad0 tx=0x7fc00c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc011ffb700 1 -- 172.21.15.153:0/313554276 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00f9a0 con 0x7fc01c1eeff0 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc011ffb700 1 -- 172.21.15.153:0/313554276 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00fb00 con 0x7fc01c1eeff0 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc023691700 1 -- 172.21.15.153:0/313554276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c151850 con 0x7fc01c1eeff0 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc011ffb700 1 -- 172.21.15.153:0/313554276 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00feb0 con 0x7fc01c1eeff0 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.554+0000 7fc023691700 1 -- 172.21.15.153:0/313554276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c15a830 con 0x7fc01c1eeff0 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.555+0000 7fc023691700 1 -- 172.21.15.153:0/313554276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c150cd0 con 0x7fc01c1eeff0 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.556+0000 7fc011ffb700 1 -- 172.21.15.153:0/313554276 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc00c014440 con 0x7fc01c1eeff0 2023-11-24T08:07:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.556+0000 7fc011ffb700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc00006b0b0 0x7fc00006d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.556+0000 7fc011ffb700 1 -- 172.21.15.153:0/313554276 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc00c089fc0 con 0x7fc01c1eeff0 2023-11-24T08:07:34.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.556+0000 7fc020c2c700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc00006b0b0 0x7fc00006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.557+0000 7fc020c2c700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc00006b0b0 0x7fc00006d570 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc018009c20 tx=0x7fc018008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.561+0000 7fc011ffb700 1 -- 172.21.15.153:0/313554276 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc00c0bce90 con 0x7fc01c1eeff0 2023-11-24T08:07:34.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.750+0000 7fc023691700 1 -- 172.21.15.153:0/313554276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc01c068fb0 con 0x7fc01c1eeff0 2023-11-24T08:07:34.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.751+0000 7fc011ffb700 1 -- 172.21.15.153:0/313554276 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc00c054f40 con 0x7fc01c1eeff0 2023-11-24T08:07:34.753 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:07:34.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 -- 172.21.15.153:0/313554276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc00006b0b0 msgr2=0x7fc00006d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc00006b0b0 0x7fc00006d570 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc018009c20 tx=0x7fc018008040 comp rx=0 tx=0).stop 2023-11-24T08:07:34.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 -- 172.21.15.153:0/313554276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01c1eeff0 msgr2=0x7fc01c145160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01c1eeff0 0x7fc01c145160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc00c011ad0 tx=0x7fc00c011e90 comp rx=0 tx=0).stop 2023-11-24T08:07:34.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 -- 172.21.15.153:0/313554276 shutdown_connections 2023-11-24T08:07:34.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc01c1546c0 0x7fc01c154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc00006b0b0 0x7fc00006d570 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01c1eeff0 0x7fc01c145160 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 --2- 172.21.15.153:0/313554276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc01c1521e0 0x7fc01c151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 -- 172.21.15.153:0/313554276 >> 172.21.15.153:0/313554276 conn(0x7fc01c0d0bf0 msgr2=0x7fc01c155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:34.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 -- 172.21.15.153:0/313554276 shutdown_connections 2023-11-24T08:07:34.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.753+0000 7fc023691700 1 -- 172.21.15.153:0/313554276 wait complete. 2023-11-24T08:07:34.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:34.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.924+0000 7f998a549700 1 Processor -- start 2023-11-24T08:07:34.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.924+0000 7f998a549700 1 -- start start 2023-11-24T08:07:34.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f998a549700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f998415a620 0x7f99840ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f998a549700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99840cc540 0x7f998406e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f998a549700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f998406eb20 0x7f998406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f998a549700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998406efb0 con 0x7f998415a620 2023-11-24T08:07:34.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f998a549700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99840b2f20 con 0x7f998406eb20 2023-11-24T08:07:34.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f998a549700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99840ce690 con 0x7f99840cc540 2023-11-24T08:07:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9983fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f998415a620 0x7f99840ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9983fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f998415a620 0x7f99840ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39894/0 (socket says 172.21.15.153:39894) 2023-11-24T08:07:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9983fff700 1 -- 172.21.15.153:0/3591686029 learned_addr learned my addr 172.21.15.153:0/3591686029 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9988ae6700 1 --2- 172.21.15.153:0/3591686029 >> v2:172.21.15.164:3300/0 conn(0x7f998406eb20 0x7f998406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f99837fe700 1 --2- 172.21.15.153:0/3591686029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99840cc540 0x7f998406e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9983fff700 1 -- 172.21.15.153:0/3591686029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99840cc540 msgr2=0x7f998406e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9983fff700 1 --2- 172.21.15.153:0/3591686029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99840cc540 0x7f998406e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9983fff700 1 -- 172.21.15.153:0/3591686029 >> v2:172.21.15.164:3300/0 conn(0x7f998406eb20 msgr2=0x7f998406d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9983fff700 1 --2- 172.21.15.153:0/3591686029 >> v2:172.21.15.164:3300/0 conn(0x7f998406eb20 0x7f998406d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9983fff700 1 -- 172.21.15.153:0/3591686029 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998415aa00 con 0x7f998415a620 2023-11-24T08:07:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f99837fe700 1 --2- 172.21.15.153:0/3591686029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99840cc540 0x7f998406e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9983fff700 1 --2- 172.21.15.153:0/3591686029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f998415a620 0x7f99840ce150 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f99840aff60 tx=0x7f997400ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc70c7f6cef09498 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9982ffd700 1 -- 172.21.15.153:0/3591686029 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997400cb70 con 0x7f998415a620 2023-11-24T08:07:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9982ffd700 1 -- 172.21.15.153:0/3591686029 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997400ccd0 con 0x7f998415a620 2023-11-24T08:07:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.925+0000 7f9982ffd700 1 -- 172.21.15.153:0/3591686029 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974018620 con 0x7f998415a620 2023-11-24T08:07:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.926+0000 7f998a549700 1 -- 172.21.15.153:0/3591686029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f998415a620 msgr2=0x7f99840ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.926+0000 7f998a549700 1 --2- 172.21.15.153:0/3591686029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f998415a620 0x7f99840ce150 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f99840aff60 tx=0x7f997400ad70 comp rx=0 tx=0).stop 2023-11-24T08:07:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.926+0000 7f998a549700 1 -- 172.21.15.153:0/3591686029 shutdown_connections 2023-11-24T08:07:34.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.926+0000 7f998a549700 1 --2- 172.21.15.153:0/3591686029 >> v2:172.21.15.164:3300/0 conn(0x7f998406eb20 0x7f998406d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.926+0000 7f998a549700 1 --2- 172.21.15.153:0/3591686029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f998415a620 0x7f99840ce150 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.926+0000 7f998a549700 1 --2- 172.21.15.153:0/3591686029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99840cc540 0x7f998406e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.926+0000 7f998a549700 1 -- 172.21.15.153:0/3591686029 >> 172.21.15.153:0/3591686029 conn(0x7f99840b2050 msgr2=0x7f99840b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:34.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.926+0000 7f998a549700 1 -- 172.21.15.153:0/3591686029 shutdown_connections 2023-11-24T08:07:34.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.926+0000 7f998a549700 1 -- 172.21.15.153:0/3591686029 wait complete. 2023-11-24T08:07:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.927+0000 7f998a549700 1 Processor -- start 2023-11-24T08:07:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.927+0000 7f998a549700 1 -- start start 2023-11-24T08:07:34.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.928+0000 7f998a549700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f998406eb20 0x7f9984155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.928+0000 7f998a549700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99840cc540 0x7f99840c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.928+0000 7f998a549700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9984158500 0x7f99840c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.928+0000 7f998a549700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99841555c0 con 0x7f9984158500 2023-11-24T08:07:34.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.928+0000 7f998a549700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99840ae3a0 con 0x7f99840cc540 2023-11-24T08:07:34.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.928+0000 7f998a549700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99841589c0 con 0x7f998406eb20 2023-11-24T08:07:34.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.928+0000 7f9988ae6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9984158500 0x7f99840c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.928+0000 7f9988ae6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9984158500 0x7f99840c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39902/0 (socket says 172.21.15.153:39902) 2023-11-24T08:07:34.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.928+0000 7f9988ae6700 1 -- 172.21.15.153:0/4078347389 learned_addr learned my addr 172.21.15.153:0/4078347389 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:34.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.928+0000 7f99837fe700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99840cc540 0x7f99840c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.928+0000 7f9983fff700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f998406eb20 0x7f9984155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.929+0000 7f9988ae6700 1 -- 172.21.15.153:0/4078347389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f998406eb20 msgr2=0x7f9984155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.929+0000 7f9988ae6700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f998406eb20 0x7f9984155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.929+0000 7f9988ae6700 1 -- 172.21.15.153:0/4078347389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99840cc540 msgr2=0x7f99840c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.929+0000 7f9988ae6700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99840cc540 0x7f99840c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.929+0000 7f9988ae6700 1 -- 172.21.15.153:0/4078347389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997400a6f0 con 0x7f9984158500 2023-11-24T08:07:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.929+0000 7f9988ae6700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9984158500 0x7f99840c52c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f997c00eed0 tx=0x7f997c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.929+0000 7f9980ff9700 1 -- 172.21.15.153:0/4078347389 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c010040 con 0x7f9984158500 2023-11-24T08:07:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.929+0000 7f9980ff9700 1 -- 172.21.15.153:0/4078347389 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c00bc80 con 0x7f9984158500 2023-11-24T08:07:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.929+0000 7f998a549700 1 -- 172.21.15.153:0/4078347389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9984158ca0 con 0x7f9984158500 2023-11-24T08:07:34.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.929+0000 7f9980ff9700 1 -- 172.21.15.153:0/4078347389 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c009e40 con 0x7f9984158500 2023-11-24T08:07:34.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.929+0000 7f998a549700 1 -- 172.21.15.153:0/4078347389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9984159260 con 0x7f9984158500 2023-11-24T08:07:34.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.930+0000 7f998a549700 1 -- 172.21.15.153:0/4078347389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9984068d90 con 0x7f9984158500 2023-11-24T08:07:34.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.930+0000 7f9980ff9700 1 -- 172.21.15.153:0/4078347389 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f997c014400 con 0x7f9984158500 2023-11-24T08:07:34.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.931+0000 7f9980ff9700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f997006b080 0x7f997006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.931+0000 7f9980ff9700 1 -- 172.21.15.153:0/4078347389 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f997c089d70 con 0x7f9984158500 2023-11-24T08:07:34.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.931+0000 7f9983fff700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f997006b080 0x7f997006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.931+0000 7f9983fff700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f997006b080 0x7f997006d540 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9984070d70 tx=0x7f9974012000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:34.935+0000 7f9980ff9700 1 -- 172.21.15.153:0/4078347389 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f997c054a90 con 0x7f9984158500 2023-11-24T08:07:35.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.126+0000 7f998a549700 1 -- 172.21.15.153:0/4078347389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9984068fb0 con 0x7f9984158500 2023-11-24T08:07:35.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.126+0000 7f9980ff9700 1 -- 172.21.15.153:0/4078347389 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f997c018020 con 0x7f9984158500 2023-11-24T08:07:35.128 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:07:35.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 -- 172.21.15.153:0/4078347389 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f997006b080 msgr2=0x7f997006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f997006b080 0x7f997006d540 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9984070d70 tx=0x7f9974012000 comp rx=0 tx=0).stop 2023-11-24T08:07:35.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 -- 172.21.15.153:0/4078347389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9984158500 msgr2=0x7f99840c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9984158500 0x7f99840c52c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f997c00eed0 tx=0x7f997c00b390 comp rx=0 tx=0).stop 2023-11-24T08:07:35.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 -- 172.21.15.153:0/4078347389 shutdown_connections 2023-11-24T08:07:35.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f997006b080 0x7f997006d540 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9984158500 0x7f99840c52c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f998406eb20 0x7f9984155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 --2- 172.21.15.153:0/4078347389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99840cc540 0x7f99840c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 -- 172.21.15.153:0/4078347389 >> 172.21.15.153:0/4078347389 conn(0x7f99840b2050 msgr2=0x7f9984156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 -- 172.21.15.153:0/4078347389 shutdown_connections 2023-11-24T08:07:35.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.129+0000 7f998a549700 1 -- 172.21.15.153:0/4078347389 wait complete. 2023-11-24T08:07:35.143 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:35.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.266+0000 7f90079cb700 1 Processor -- start 2023-11-24T08:07:35.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.266+0000 7f90079cb700 1 -- start start 2023-11-24T08:07:35.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f90079cb700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f90000746a0 0x7f90000b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f90079cb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f90000afc90 0x7f900006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f90079cb700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90000b3c60 con 0x7f900015e160 2023-11-24T08:07:35.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f90079cb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90000b4500 con 0x7f90000afc90 2023-11-24T08:07:35.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f90079cb700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90000b58c0 con 0x7f90000746a0 2023-11-24T08:07:35.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f9005f68700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f90000afc90 0x7f900006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f9005f68700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f90000afc90 0x7f900006d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39910/0 (socket says 172.21.15.153:39910) 2023-11-24T08:07:35.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f9005f68700 1 -- 172.21.15.153:0/99083649 learned_addr learned my addr 172.21.15.153:0/99083649 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:35.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f9004f66700 1 --2- 172.21.15.153:0/99083649 >> v2:172.21.15.164:3300/0 conn(0x7f90000746a0 0x7f90000b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f9005f68700 1 -- 172.21.15.153:0/99083649 >> v2:172.21.15.164:3300/0 conn(0x7f90000746a0 msgr2=0x7f90000b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f9005f68700 1 --2- 172.21.15.153:0/99083649 >> v2:172.21.15.164:3300/0 conn(0x7f90000746a0 0x7f90000b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f9005f68700 1 -- 172.21.15.153:0/99083649 >> v1:172.21.15.164:6789/0 conn(0x7f900015e160 legacy=0x7f9000073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f9005f68700 1 -- 172.21.15.153:0/99083649 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900006bdc0 con 0x7f90000afc90 2023-11-24T08:07:35.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.267+0000 7f9004f66700 1 --2- 172.21.15.153:0/99083649 >> v2:172.21.15.164:3300/0 conn(0x7f90000746a0 0x7f90000b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:35.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f9005f68700 1 --2- 172.21.15.153:0/99083649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90000afc90 0x7f900006d930 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f90000d0880 tx=0x7f8ff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a00bb68441db691 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f8ff7fff700 1 -- 172.21.15.153:0/99083649 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff800e070 con 0x7f90000afc90 2023-11-24T08:07:35.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f8ff7fff700 1 -- 172.21.15.153:0/99083649 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff800b9c0 con 0x7f90000afc90 2023-11-24T08:07:35.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f8ff7fff700 1 -- 172.21.15.153:0/99083649 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff800bd70 con 0x7f90000afc90 2023-11-24T08:07:35.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f90079cb700 1 -- 172.21.15.153:0/99083649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90000afc90 msgr2=0x7f900006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f90079cb700 1 --2- 172.21.15.153:0/99083649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90000afc90 0x7f900006d930 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f90000d0880 tx=0x7f8ff800b330 comp rx=0 tx=0).stop 2023-11-24T08:07:35.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f90079cb700 1 -- 172.21.15.153:0/99083649 shutdown_connections 2023-11-24T08:07:35.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f90079cb700 1 --2- 172.21.15.153:0/99083649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90000afc90 0x7f900006d930 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f90079cb700 1 --2- 172.21.15.153:0/99083649 >> v2:172.21.15.164:3300/0 conn(0x7f90000746a0 0x7f90000b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f90079cb700 1 -- 172.21.15.153:0/99083649 >> 172.21.15.153:0/99083649 conn(0x7f90000d0bf0 msgr2=0x7f90000d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f90079cb700 1 -- 172.21.15.153:0/99083649 shutdown_connections 2023-11-24T08:07:35.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.268+0000 7f90079cb700 1 -- 172.21.15.153:0/99083649 wait complete. 2023-11-24T08:07:35.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.270+0000 7f90079cb700 1 Processor -- start 2023-11-24T08:07:35.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.270+0000 7f90079cb700 1 -- start start 2023-11-24T08:07:35.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.270+0000 7f90079cb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90000746a0 0x7f90001540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.270+0000 7f90079cb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90000afc90 0x7f90001445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.270+0000 7f90079cb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900015e160 0x7f90001530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.270+0000 7f90079cb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900015eed0 con 0x7f90000746a0 2023-11-24T08:07:35.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.270+0000 7f90079cb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9000154900 con 0x7f900015e160 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.270+0000 7f90079cb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900015e880 con 0x7f90000afc90 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.270+0000 7f9005767700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90000746a0 0x7f90001540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.270+0000 7f9005767700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90000746a0 0x7f90001540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39912/0 (socket says 172.21.15.153:39912) 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.270+0000 7f9005767700 1 -- 172.21.15.153:0/1656352549 learned_addr learned my addr 172.21.15.153:0/1656352549 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f9005f68700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900015e160 0x7f90001530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f9004f66700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90000afc90 0x7f90001445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f9005767700 1 -- 172.21.15.153:0/1656352549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90000afc90 msgr2=0x7f90001445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f9005767700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90000afc90 0x7f90001445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f9005767700 1 -- 172.21.15.153:0/1656352549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900015e160 msgr2=0x7f90001530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f9005767700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900015e160 0x7f90001530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f9005767700 1 -- 172.21.15.153:0/1656352549 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8009b30 con 0x7f90000746a0 2023-11-24T08:07:35.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f9005f68700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900015e160 0x7f90001530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f9005767700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90000746a0 0x7f90001540d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000c450 tx=0x7f8ff000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f8ff5ffb700 1 -- 172.21.15.153:0/1656352549 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff00052d0 con 0x7f90000746a0 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f8ff5ffb700 1 -- 172.21.15.153:0/1656352549 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0005430 con 0x7f90000746a0 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f90079cb700 1 -- 172.21.15.153:0/1656352549 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900015eb60 con 0x7f90000746a0 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f8ff5ffb700 1 -- 172.21.15.153:0/1656352549 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff00038c0 con 0x7f90000746a0 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.271+0000 7f90079cb700 1 -- 172.21.15.153:0/1656352549 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9000144b10 con 0x7f90000746a0 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.272+0000 7f90079cb700 1 -- 172.21.15.153:0/1656352549 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9000068fb0 con 0x7f90000746a0 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.273+0000 7f8ff5ffb700 1 -- 172.21.15.153:0/1656352549 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8ff0003a20 con 0x7f90000746a0 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.273+0000 7f8ff5ffb700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8fe406b080 0x7f8fe406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.273+0000 7f8ff5ffb700 1 -- 172.21.15.153:0/1656352549 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ff0088cc0 con 0x7f90000746a0 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.273+0000 7f9004f66700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8fe406b080 0x7f8fe406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.273+0000 7f9004f66700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8fe406b080 0x7f8fe406d540 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f90001f70e0 tx=0x7f8ffc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.277+0000 7f8ff5ffb700 1 -- 172.21.15.153:0/1656352549 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8ff0053b80 con 0x7f90000746a0 2023-11-24T08:07:35.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.471+0000 7f90079cb700 1 -- 172.21.15.153:0/1656352549 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f900006c140 con 0x7f90000746a0 2023-11-24T08:07:35.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.471+0000 7f8ff5ffb700 1 -- 172.21.15.153:0/1656352549 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ff0017020 con 0x7f90000746a0 2023-11-24T08:07:35.473 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:07:35.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.473+0000 7f90079cb700 1 -- 172.21.15.153:0/1656352549 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8fe406b080 msgr2=0x7f8fe406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.473+0000 7f90079cb700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8fe406b080 0x7f8fe406d540 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f90001f70e0 tx=0x7f8ffc008040 comp rx=0 tx=0).stop 2023-11-24T08:07:35.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.473+0000 7f90079cb700 1 -- 172.21.15.153:0/1656352549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90000746a0 msgr2=0x7f90001540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.473+0000 7f90079cb700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90000746a0 0x7f90001540d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000c450 tx=0x7f8ff000c810 comp rx=0 tx=0).stop 2023-11-24T08:07:35.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.473+0000 7f90079cb700 1 -- 172.21.15.153:0/1656352549 shutdown_connections 2023-11-24T08:07:35.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.473+0000 7f90079cb700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900015e160 0x7f90001530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.473+0000 7f90079cb700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f8fe406b080 0x7f8fe406d540 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.473+0000 7f90079cb700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90000746a0 0x7f90001540d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.473+0000 7f90079cb700 1 --2- 172.21.15.153:0/1656352549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90000afc90 0x7f90001445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.473+0000 7f90079cb700 1 -- 172.21.15.153:0/1656352549 >> 172.21.15.153:0/1656352549 conn(0x7f90000d0bf0 msgr2=0x7f900015d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.474+0000 7f90079cb700 1 -- 172.21.15.153:0/1656352549 shutdown_connections 2023-11-24T08:07:35.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.474+0000 7f90079cb700 1 -- 172.21.15.153:0/1656352549 wait complete. 2023-11-24T08:07:35.487 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:35.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.607+0000 7fc08346a700 1 Processor -- start 2023-11-24T08:07:35.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.607+0000 7fc08346a700 1 -- start start 2023-11-24T08:07:35.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc08346a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc07c15e080 0x7fc07c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc08346a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c0ae430 con 0x7fc07c0af4d0 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc08346a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c0ae710 con 0x7fc07c06c710 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc08346a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0af0b0 con 0x7fc07c15e080 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc080a05700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc07c0af4d0 0x7fc07c06c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46026/0 (socket says 172.21.15.153:46026) 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc080a05700 1 -- 172.21.15.153:0/4194725067 learned_addr learned my addr 172.21.15.153:0/4194725067 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc081206700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc07c15e080 0x7fc07c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270540942 0 0) 0x7fc07c0ae430 con 0x7fc07c0af4d0 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0680035b0 con 0x7fc07c0af4d0 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165393007 0 0) 0x7fc07c0ae710 con 0x7fc07c06c710 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc07c0ae430 con 0x7fc07c06c710 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1320901287 0 0) 0x7fc0680035b0 con 0x7fc07c0af4d0 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc07c15e080 msgr2=0x7fc07c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc073fff700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc07c15e080 0x7fc07c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 >> v1:172.21.15.164:6789/0 conn(0x7fc07c06c710 legacy=0x7fc07c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0ae9f0 con 0x7fc07c0af4d0 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.608+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fc06c001670 con 0x7fc07c0af4d0 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 >> v1:172.21.15.153:6789/0 conn(0x7fc07c0af4d0 legacy=0x7fc07c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc073fff700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc068003bc0 0x7fc068003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc073fff700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc068004850 0x7fc068004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc073fff700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc07c15e080 0x7fc068005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0af0b0 con 0x7fc068003bc0 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06800bac0 con 0x7fc068004850 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06800bc50 con 0x7fc07c15e080 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc081206700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc068003bc0 0x7fc068003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc080a05700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc068004850 0x7fc068004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc081a07700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc07c15e080 0x7fc068005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc081206700 1 -- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc07c15e080 msgr2=0x7fc068005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc081206700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc07c15e080 0x7fc068005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc081206700 1 -- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc068004850 msgr2=0x7fc068004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc081206700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc068004850 0x7fc068004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc081206700 1 -- 172.21.15.153:0/4194725067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0680035b0 con 0x7fc068003bc0 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc081a07700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc07c15e080 0x7fc068005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc081206700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc068003bc0 0x7fc068003fc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc078009b60 tx=0x7fc068005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab9b2db20361e25 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800e6c0 con 0x7fc068003bc0 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07800e820 con 0x7fc068003bc0 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.609+0000 7fc073fff700 1 -- 172.21.15.153:0/4194725067 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800eb90 con 0x7fc068003bc0 2023-11-24T08:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.610+0000 7fc08346a700 1 -- 172.21.15.153:0/4194725067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc068003bc0 msgr2=0x7fc068003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.610+0000 7fc08346a700 1 --2- 172.21.15.153:0/4194725067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc068003bc0 0x7fc068003fc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc078009b60 tx=0x7fc068005880 comp rx=0 tx=0).stop 2023-11-24T08:07:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.610+0000 7fc081a07700 1 -- 172.21.15.153:0/4194725067 reap_dead start 2023-11-24T08:07:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.610+0000 7fc08346a700 1 -- 172.21.15.153:0/4194725067 shutdown_connections 2023-11-24T08:07:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.610+0000 7fc08346a700 1 -- 172.21.15.153:0/4194725067 >> 172.21.15.153:0/4194725067 conn(0x7fc07c071b90 msgr2=0x7fc07c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.610+0000 7fc08346a700 1 -- 172.21.15.153:0/4194725067 shutdown_connections 2023-11-24T08:07:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.610+0000 7fc08346a700 1 -- 172.21.15.153:0/4194725067 wait complete. 2023-11-24T08:07:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.611+0000 7fc08346a700 1 Processor -- start 2023-11-24T08:07:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.611+0000 7fc08346a700 1 -- start start 2023-11-24T08:07:35.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc08346a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068003bc0 0x7fc07c157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc08346a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc07c1559e0 0x7fc07c14a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc08346a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c14aaf0 0x7fc07c14af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc08346a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c158330 con 0x7fc07c14aaf0 2023-11-24T08:07:35.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc08346a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c159130 con 0x7fc07c1559e0 2023-11-24T08:07:35.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc08346a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c14a8a0 con 0x7fc068003bc0 2023-11-24T08:07:35.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc081a07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c14aaf0 0x7fc07c14af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc081a07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c14aaf0 0x7fc07c14af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39936/0 (socket says 172.21.15.153:39936) 2023-11-24T08:07:35.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc081a07700 1 -- 172.21.15.153:0/936383432 learned_addr learned my addr 172.21.15.153:0/936383432 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:35.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc081206700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068003bc0 0x7fc07c157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc080a05700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc07c1559e0 0x7fc07c14a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc081a07700 1 -- 172.21.15.153:0/936383432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068003bc0 msgr2=0x7fc07c157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc081a07700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068003bc0 0x7fc07c157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc081a07700 1 -- 172.21.15.153:0/936383432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc07c1559e0 msgr2=0x7fc07c14a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc081a07700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc07c1559e0 0x7fc07c14a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc081a07700 1 -- 172.21.15.153:0/936383432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c158520 con 0x7fc07c14aaf0 2023-11-24T08:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc080a05700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc07c1559e0 0x7fc07c14a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc081a07700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c14aaf0 0x7fc07c14af70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc07c072a90 tx=0x7fc07400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.612+0000 7fc071ffb700 1 -- 172.21.15.153:0/936383432 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074003c10 con 0x7fc07c14aaf0 2023-11-24T08:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.613+0000 7fc071ffb700 1 -- 172.21.15.153:0/936383432 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074003d90 con 0x7fc07c14aaf0 2023-11-24T08:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.613+0000 7fc08346a700 1 -- 172.21.15.153:0/936383432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c158800 con 0x7fc07c14aaf0 2023-11-24T08:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.613+0000 7fc071ffb700 1 -- 172.21.15.153:0/936383432 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074005310 con 0x7fc07c14aaf0 2023-11-24T08:07:35.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.613+0000 7fc08346a700 1 -- 172.21.15.153:0/936383432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c158dc0 con 0x7fc07c14aaf0 2023-11-24T08:07:35.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.614+0000 7fc08346a700 1 -- 172.21.15.153:0/936383432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07c158f80 con 0x7fc07c14aaf0 2023-11-24T08:07:35.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.614+0000 7fc071ffb700 1 -- 172.21.15.153:0/936383432 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc074005470 con 0x7fc07c14aaf0 2023-11-24T08:07:35.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.614+0000 7fc071ffb700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc06006b080 0x7fc06006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.615+0000 7fc071ffb700 1 -- 172.21.15.153:0/936383432 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc074089870 con 0x7fc07c14aaf0 2023-11-24T08:07:35.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.615+0000 7fc081206700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc06006b080 0x7fc06006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.615+0000 7fc081206700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc06006b080 0x7fc06006d540 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc0780090b0 tx=0x7fc07801f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.619+0000 7fc071ffb700 1 -- 172.21.15.153:0/936383432 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc074054730 con 0x7fc07c14aaf0 2023-11-24T08:07:35.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.825+0000 7fc08346a700 1 -- 172.21.15.153:0/936383432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc07c0753f0 con 0x7fc07c14aaf0 2023-11-24T08:07:35.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.825+0000 7fc071ffb700 1 -- 172.21.15.153:0/936383432 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc074001ca0 con 0x7fc07c14aaf0 2023-11-24T08:07:35.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 -- 172.21.15.153:0/936383432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc06006b080 msgr2=0x7fc06006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc06006b080 0x7fc06006d540 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc0780090b0 tx=0x7fc07801f040 comp rx=0 tx=0).stop 2023-11-24T08:07:35.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 -- 172.21.15.153:0/936383432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c14aaf0 msgr2=0x7fc07c14af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c14aaf0 0x7fc07c14af70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc07c072a90 tx=0x7fc07400ee90 comp rx=0 tx=0).stop 2023-11-24T08:07:35.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 -- 172.21.15.153:0/936383432 shutdown_connections 2023-11-24T08:07:35.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc06006b080 0x7fc06006d540 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c14aaf0 0x7fc07c14af70 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068003bc0 0x7fc07c157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 --2- 172.21.15.153:0/936383432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc07c1559e0 0x7fc07c14a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 -- 172.21.15.153:0/936383432 >> 172.21.15.153:0/936383432 conn(0x7fc07c071b90 msgr2=0x7fc07c0af980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 -- 172.21.15.153:0/936383432 shutdown_connections 2023-11-24T08:07:35.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:35.827+0000 7fc08346a700 1 -- 172.21.15.153:0/936383432 wait complete. 2023-11-24T08:07:35.830 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2023-11-24T08:07:35.841 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T08:07:35.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:35.841 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:35.890 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:07:35.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:35.891 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:07:35.909 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:07:35.909 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:35.927 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3433 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T08:07:35.927 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:07:35.927 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:35.968 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=427 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T08:07:35.968 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.088+0000 7eff5aa25700 1 Processor -- start 2023-11-24T08:07:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.088+0000 7eff5aa25700 1 -- start start 2023-11-24T08:07:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.088+0000 7eff5aa25700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 0x7eff541604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.088+0000 7eff5aa25700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7eff540d1c70 0x7eff540d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.088+0000 7eff5aa25700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff540b22d0 con 0x7eff540b3370 2023-11-24T08:07:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.088+0000 7eff5aa25700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff540b2f50 con 0x7eff540d1c70 2023-11-24T08:07:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.088+0000 7eff5aa25700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff540d2640 con 0x7eff5415bdd0 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff53fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 0x7eff541604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff58fc2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7eff540d1c70 0x7eff540d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff58fc2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7eff540d1c70 0x7eff540d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:33298/0 (socket says 172.21.15.153:33298) 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff58fc2700 1 -- 172.21.15.153:0/977286177 learned_addr learned my addr 172.21.15.153:0/977286177 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff537fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7eff540b3370 0x7eff540b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.153:53726/0 (socket says 172.21.15.153:53726) 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff53fff700 1 --2- 172.21.15.153:0/977286177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 0x7eff541604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:52010/0 (socket says 172.21.15.153:52010) 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff53fff700 1 -- 172.21.15.153:0/977286177 >> v2:172.21.15.164:3300/0 conn(0x7eff540d1c70 msgr2=0x7eff540d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff53fff700 1 --2- 172.21.15.153:0/977286177 >> v2:172.21.15.164:3300/0 conn(0x7eff540d1c70 0x7eff540d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff53fff700 1 -- 172.21.15.153:0/977286177 >> v1:172.21.15.164:6789/0 conn(0x7eff540b3370 legacy=0x7eff540b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff53fff700 1 -- 172.21.15.153:0/977286177 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff540b25b0 con 0x7eff5415bdd0 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff58fc2700 1 --2- 172.21.15.153:0/977286177 >> v2:172.21.15.164:3300/0 conn(0x7eff540d1c70 0x7eff540d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.089+0000 7eff53fff700 1 --2- 172.21.15.153:0/977286177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 0x7eff541604e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff44009840 tx=0x7eff44009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fef797bde63bee97 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.090+0000 7eff52ffd700 1 -- 172.21.15.153:0/977286177 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44011830 con 0x7eff5415bdd0 2023-11-24T08:07:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.090+0000 7eff52ffd700 1 -- 172.21.15.153:0/977286177 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44011990 con 0x7eff5415bdd0 2023-11-24T08:07:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.090+0000 7eff52ffd700 1 -- 172.21.15.153:0/977286177 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44011d20 con 0x7eff5415bdd0 2023-11-24T08:07:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.090+0000 7eff5aa25700 1 -- 172.21.15.153:0/977286177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 msgr2=0x7eff541604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.090+0000 7eff5aa25700 1 --2- 172.21.15.153:0/977286177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 0x7eff541604e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff44009840 tx=0x7eff44009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.090+0000 7eff5aa25700 1 -- 172.21.15.153:0/977286177 shutdown_connections 2023-11-24T08:07:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.090+0000 7eff5aa25700 1 --2- 172.21.15.153:0/977286177 >> v2:172.21.15.164:3300/0 conn(0x7eff540d1c70 0x7eff540d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.090+0000 7eff5aa25700 1 --2- 172.21.15.153:0/977286177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 0x7eff541604e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.090+0000 7eff5aa25700 1 -- 172.21.15.153:0/977286177 >> 172.21.15.153:0/977286177 conn(0x7eff540731a0 msgr2=0x7eff5409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.090+0000 7eff5aa25700 1 -- 172.21.15.153:0/977286177 shutdown_connections 2023-11-24T08:07:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.090+0000 7eff5aa25700 1 -- 172.21.15.153:0/977286177 wait complete. 2023-11-24T08:07:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.091+0000 7eff5aa25700 1 Processor -- start 2023-11-24T08:07:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.092+0000 7eff5aa25700 1 -- start start 2023-11-24T08:07:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.092+0000 7eff5aa25700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff540b3370 0x7eff54156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.092+0000 7eff5aa25700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff540d1c70 0x7eff54159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.092+0000 7eff5aa25700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 0x7eff54158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.092+0000 7eff5aa25700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540ca740 con 0x7eff540d1c70 2023-11-24T08:07:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.092+0000 7eff5aa25700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540c9b30 con 0x7eff540b3370 2023-11-24T08:07:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.092+0000 7eff5aa25700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff540c9e10 con 0x7eff5415bdd0 2023-11-24T08:07:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff540d1c70 0x7eff54159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff540d1c70 0x7eff54159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39946/0 (socket says 172.21.15.153:39946) 2023-11-24T08:07:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff537fe700 1 -- 172.21.15.153:0/2919718803 learned_addr learned my addr 172.21.15.153:0/2919718803 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff53fff700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff540b3370 0x7eff54156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff58fc2700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 0x7eff54158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff537fe700 1 -- 172.21.15.153:0/2919718803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 msgr2=0x7eff54158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff537fe700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 0x7eff54158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff537fe700 1 -- 172.21.15.153:0/2919718803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff540b3370 msgr2=0x7eff54156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff537fe700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff540b3370 0x7eff54156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff537fe700 1 -- 172.21.15.153:0/2919718803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c009b30 con 0x7eff540d1c70 2023-11-24T08:07:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff53fff700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff540b3370 0x7eff54156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff58fc2700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 0x7eff54158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff537fe700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff540d1c70 0x7eff54159b50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c490 tx=0x7eff4800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff50ff9700 1 -- 172.21.15.153:0/2919718803 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48005cb0 con 0x7eff540d1c70 2023-11-24T08:07:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff50ff9700 1 -- 172.21.15.153:0/2919718803 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff48005e10 con 0x7eff540d1c70 2023-11-24T08:07:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff5aa25700 1 -- 172.21.15.153:0/2919718803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff440094a0 con 0x7eff540d1c70 2023-11-24T08:07:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff50ff9700 1 -- 172.21.15.153:0/2919718803 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff480072d0 con 0x7eff540d1c70 2023-11-24T08:07:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.093+0000 7eff5aa25700 1 -- 172.21.15.153:0/2919718803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff540ca3d0 con 0x7eff540d1c70 2023-11-24T08:07:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.094+0000 7eff5aa25700 1 -- 172.21.15.153:0/2919718803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff540ca8b0 con 0x7eff540d1c70 2023-11-24T08:07:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.095+0000 7eff50ff9700 1 -- 172.21.15.153:0/2919718803 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7eff48007430 con 0x7eff540d1c70 2023-11-24T08:07:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.095+0000 7eff50ff9700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7eff4006b080 0x7eff4006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.095+0000 7eff50ff9700 1 -- 172.21.15.153:0/2919718803 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff48088db0 con 0x7eff540d1c70 2023-11-24T08:07:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.095+0000 7eff53fff700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7eff4006b080 0x7eff4006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.096+0000 7eff53fff700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7eff4006b080 0x7eff4006d540 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7eff44000c00 tx=0x7eff4401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.100+0000 7eff50ff9700 1 -- 172.21.15.153:0/2919718803 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff4808d070 con 0x7eff540d1c70 2023-11-24T08:07:36.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.333+0000 7eff5aa25700 1 -- 172.21.15.153:0/2919718803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff54067f60 con 0x7eff540d1c70 2023-11-24T08:07:36.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.333+0000 7eff50ff9700 1 -- 172.21.15.153:0/2919718803 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4922 (secure 0 0 0) 0x7eff48017070 con 0x7eff540d1c70 2023-11-24T08:07:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:36.335 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3525215026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3525215026},{"type":"v1","addr":"172.21.15.153:6837","nonce":3525215026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5318,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/946995567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":946995567},{"type":"v1","addr":"172.21.15.164:6834","nonce":946995567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6075,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/3002476497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3002476497},{"type":"v1","addr":"172.21.15.153:6836","nonce":3002476497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:16.566591+0000","modified":"2023-11-24T08:07:19.587429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6090":{"gid":6090,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/3019873912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3019873912},{"type":"v1","addr":"172.21.15.164:6835","nonce":3019873912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:36.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.335+0000 7eff5aa25700 1 -- 172.21.15.153:0/2919718803 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7eff4006b080 msgr2=0x7eff4006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.335+0000 7eff5aa25700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7eff4006b080 0x7eff4006d540 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7eff44000c00 tx=0x7eff4401c040 comp rx=0 tx=0).stop 2023-11-24T08:07:36.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.335+0000 7eff5aa25700 1 -- 172.21.15.153:0/2919718803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff540d1c70 msgr2=0x7eff54159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.335+0000 7eff5aa25700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff540d1c70 0x7eff54159b50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c490 tx=0x7eff4800c850 comp rx=0 tx=0).stop 2023-11-24T08:07:36.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.335+0000 7eff5aa25700 1 -- 172.21.15.153:0/2919718803 shutdown_connections 2023-11-24T08:07:36.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.335+0000 7eff5aa25700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff5415bdd0 0x7eff54158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.335+0000 7eff5aa25700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff540b3370 0x7eff54156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.335+0000 7eff5aa25700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7eff4006b080 0x7eff4006d540 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.335+0000 7eff5aa25700 1 --2- 172.21.15.153:0/2919718803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff540d1c70 0x7eff54159b50 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.335+0000 7eff5aa25700 1 -- 172.21.15.153:0/2919718803 >> 172.21.15.153:0/2919718803 conn(0x7eff540731a0 msgr2=0x7eff540b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.336+0000 7eff5aa25700 1 -- 172.21.15.153:0/2919718803 shutdown_connections 2023-11-24T08:07:36.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.336+0000 7eff5aa25700 1 -- 172.21.15.153:0/2919718803 wait complete. 2023-11-24T08:07:36.339 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 37 2023-11-24T08:07:36.350 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.469+0000 7fade4e42700 1 Processor -- start 2023-11-24T08:07:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.469+0000 7fade4e42700 1 -- start start 2023-11-24T08:07:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.470+0000 7fade4e42700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fade015bdd0 0x7fade01604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.470+0000 7fade4e42700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fade00b3370 0x7fade00b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.470+0000 7fade4e42700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade00b2030 con 0x7fade00d1c70 2023-11-24T08:07:36.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.470+0000 7fade4e42700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade00b2f50 con 0x7fade015bdd0 2023-11-24T08:07:36.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.470+0000 7fade4e42700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade00b22d0 con 0x7fade00b3370 2023-11-24T08:07:36.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.470+0000 7fadde59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fade015bdd0 0x7fade01604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.470+0000 7fadded9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fade00d1c70 0x7fade00ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46062/0 (socket says 172.21.15.153:46062) 2023-11-24T08:07:36.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.470+0000 7fadde59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fade015bdd0 0x7fade01604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39954/0 (socket says 172.21.15.153:39954) 2023-11-24T08:07:36.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.470+0000 7fadded9d700 1 -- 172.21.15.153:0/4120898022 learned_addr learned my addr 172.21.15.153:0/4120898022 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:36.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7fadddd9b700 1 --2- 172.21.15.153:0/4120898022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fade00b3370 0x7fade00b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7fadde59c700 1 -- 172.21.15.153:0/4120898022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fade00b3370 msgr2=0x7fade00b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:36.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7fadde59c700 1 --2- 172.21.15.153:0/4120898022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fade00b3370 0x7fade00b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7fadde59c700 1 -- 172.21.15.153:0/4120898022 >> v1:172.21.15.153:6789/0 conn(0x7fade00d1c70 legacy=0x7fade00ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7faddd59a700 1 -- 172.21.15.153:0/4120898022 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042432640 0 0) 0x7fade00b2030 con 0x7fade00d1c70 2023-11-24T08:07:36.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7fadde59c700 1 -- 172.21.15.153:0/4120898022 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade00b25b0 con 0x7fade015bdd0 2023-11-24T08:07:36.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7fadde59c700 1 --2- 172.21.15.153:0/4120898022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fade015bdd0 0x7fade01604e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009840 tx=0x7fadd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40269ac9cc5f2325 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7faddd59a700 1 -- 172.21.15.153:0/4120898022 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4011830 con 0x7fade015bdd0 2023-11-24T08:07:36.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7faddd59a700 1 -- 172.21.15.153:0/4120898022 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd4011990 con 0x7fade015bdd0 2023-11-24T08:07:36.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7faddd59a700 1 -- 172.21.15.153:0/4120898022 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4011d20 con 0x7fade015bdd0 2023-11-24T08:07:36.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7fade4e42700 1 -- 172.21.15.153:0/4120898022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fade015bdd0 msgr2=0x7fade01604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.471+0000 7fade4e42700 1 --2- 172.21.15.153:0/4120898022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fade015bdd0 0x7fade01604e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009840 tx=0x7fadd4009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:36.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.472+0000 7fade4e42700 1 -- 172.21.15.153:0/4120898022 shutdown_connections 2023-11-24T08:07:36.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.472+0000 7fade4e42700 1 --2- 172.21.15.153:0/4120898022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fade015bdd0 0x7fade01604e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.472+0000 7fade4e42700 1 --2- 172.21.15.153:0/4120898022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fade00b3370 0x7fade00b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.472+0000 7fade4e42700 1 -- 172.21.15.153:0/4120898022 >> 172.21.15.153:0/4120898022 conn(0x7fade00731a0 msgr2=0x7fade009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.472+0000 7fade4e42700 1 -- 172.21.15.153:0/4120898022 shutdown_connections 2023-11-24T08:07:36.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.472+0000 7fade4e42700 1 -- 172.21.15.153:0/4120898022 wait complete. 2023-11-24T08:07:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.473+0000 7fade4e42700 1 Processor -- start 2023-11-24T08:07:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.473+0000 7fade4e42700 1 -- start start 2023-11-24T08:07:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fade4e42700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fade00b3370 0x7fade0154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fade4e42700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fade00d1c70 0x7fade01e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fade4e42700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fade015bdd0 0x7fade00c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fade4e42700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade01e77b0 con 0x7fade015bdd0 2023-11-24T08:07:36.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fade4e42700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade01e5760 con 0x7fade00d1c70 2023-11-24T08:07:36.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fade4e42700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade01e74d0 con 0x7fade00b3370 2023-11-24T08:07:36.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadded9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fade015bdd0 0x7fade00c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadded9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fade015bdd0 0x7fade00c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39964/0 (socket says 172.21.15.153:39964) 2023-11-24T08:07:36.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadded9d700 1 -- 172.21.15.153:0/1518579302 learned_addr learned my addr 172.21.15.153:0/1518579302 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:36.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadde59c700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fade00b3370 0x7fade0154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadddd9b700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fade00d1c70 0x7fade01e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadded9d700 1 -- 172.21.15.153:0/1518579302 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fade00b3370 msgr2=0x7fade0154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadded9d700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fade00b3370 0x7fade0154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadded9d700 1 -- 172.21.15.153:0/1518579302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fade00d1c70 msgr2=0x7fade01e6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadded9d700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fade00d1c70 0x7fade01e6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadded9d700 1 -- 172.21.15.153:0/1518579302 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd40094a0 con 0x7fade015bdd0 2023-11-24T08:07:36.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadddd9b700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fade00d1c70 0x7fade01e6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:36.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadded9d700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fade015bdd0 0x7fade00c79c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fadd8002230 tx=0x7fadd800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadceffd700 1 -- 172.21.15.153:0/1518579302 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800ab70 con 0x7fade015bdd0 2023-11-24T08:07:36.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadceffd700 1 -- 172.21.15.153:0/1518579302 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd800acf0 con 0x7fade015bdd0 2023-11-24T08:07:36.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fade4e42700 1 -- 172.21.15.153:0/1518579302 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade01e59b0 con 0x7fade015bdd0 2023-11-24T08:07:36.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.474+0000 7fadceffd700 1 -- 172.21.15.153:0/1518579302 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8007310 con 0x7fade015bdd0 2023-11-24T08:07:36.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.475+0000 7fade4e42700 1 -- 172.21.15.153:0/1518579302 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade01e5f70 con 0x7fade015bdd0 2023-11-24T08:07:36.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.475+0000 7fade4e42700 1 -- 172.21.15.153:0/1518579302 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade00d0520 con 0x7fade015bdd0 2023-11-24T08:07:36.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.476+0000 7fadceffd700 1 -- 172.21.15.153:0/1518579302 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fadd8007470 con 0x7fade015bdd0 2023-11-24T08:07:36.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.476+0000 7fadceffd700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fadc006b080 0x7fadc006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.476+0000 7fadde59c700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fadc006b080 0x7fadc006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.476+0000 7fadceffd700 1 -- 172.21.15.153:0/1518579302 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadd8089780 con 0x7fade015bdd0 2023-11-24T08:07:36.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.477+0000 7fadde59c700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fadc006b080 0x7fadc006d540 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fadd40090b0 tx=0x7fadd401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.481+0000 7fadceffd700 1 -- 172.21.15.153:0/1518579302 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fadd80545b0 con 0x7fade015bdd0 2023-11-24T08:07:36.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.672+0000 7fade4e42700 1 -- 172.21.15.153:0/1518579302 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fade01e6190 con 0x7fade015bdd0 2023-11-24T08:07:36.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.674+0000 7fadceffd700 1 -- 172.21.15.153:0/1518579302 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16601 (secure 0 0 0) 0x7fadd8018090 con 0x7fade015bdd0 2023-11-24T08:07:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:36.676 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":56,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:07:18.180030+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:14.800746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:15.529815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 -- 172.21.15.153:0/1518579302 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fadc006b080 msgr2=0x7fadc006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fadc006b080 0x7fadc006d540 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fadd40090b0 tx=0x7fadd401c040 comp rx=0 tx=0).stop 2023-11-24T08:07:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 -- 172.21.15.153:0/1518579302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fade015bdd0 msgr2=0x7fade00c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fade015bdd0 0x7fade00c79c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fadd8002230 tx=0x7fadd800cf50 comp rx=0 tx=0).stop 2023-11-24T08:07:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 -- 172.21.15.153:0/1518579302 shutdown_connections 2023-11-24T08:07:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fadc006b080 0x7fadc006d540 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fade015bdd0 0x7fade00c79c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fade00b3370 0x7fade0154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 --2- 172.21.15.153:0/1518579302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fade00d1c70 0x7fade01e6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 -- 172.21.15.153:0/1518579302 >> 172.21.15.153:0/1518579302 conn(0x7fade00731a0 msgr2=0x7fade00ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 -- 172.21.15.153:0/1518579302 shutdown_connections 2023-11-24T08:07:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.676+0000 7fade4e42700 1 -- 172.21.15.153:0/1518579302 wait complete. 2023-11-24T08:07:36.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:04:06.085280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:07:14.800746+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:07:15.529815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:36.690 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:36.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.812+0000 7fb85520f700 1 Processor -- start 2023-11-24T08:07:36.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.812+0000 7fb85520f700 1 -- start start 2023-11-24T08:07:36.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb85520f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb85006e370 0x7fb85015b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb85520f700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb85006b0f0 0x7fb85006b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb85520f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85015e9f0 con 0x7fb8500b49a0 2023-11-24T08:07:36.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb85520f700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85015ec90 con 0x7fb85006b0f0 2023-11-24T08:07:36.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb85520f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85015ef70 con 0x7fb85006e370 2023-11-24T08:07:36.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84ed9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb8500b49a0 0x7fb8500b4d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46072/0 (socket says 172.21.15.153:46072) 2023-11-24T08:07:36.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84ed9d700 1 -- 172.21.15.153:0/1677927010 learned_addr learned my addr 172.21.15.153:0/1677927010 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:36.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84f59e700 1 --2- 172.21.15.153:0/1677927010 >> v2:172.21.15.164:3300/0 conn(0x7fb85006b0f0 0x7fb85006b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84e59c700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb85006e370 0x7fb85015b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338073773 0 0) 0x7fb85015e9f0 con 0x7fb8500b49a0 2023-11-24T08:07:36.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8380057c0 con 0x7fb8500b49a0 2023-11-24T08:07:36.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2662241019 0 0) 0x7fb8380057c0 con 0x7fb8500b49a0 2023-11-24T08:07:36.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb85006e370 msgr2=0x7fb85015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:36.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb85006e370 0x7fb85015b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 >> v2:172.21.15.164:3300/0 conn(0x7fb85006b0f0 msgr2=0x7fb85006b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:36.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 --2- 172.21.15.153:0/1677927010 >> v2:172.21.15.164:3300/0 conn(0x7fb85006b0f0 0x7fb85006b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85015f250 con 0x7fb8500b49a0 2023-11-24T08:07:36.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fb844001670 con 0x7fb8500b49a0 2023-11-24T08:07:36.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 >> v1:172.21.15.153:6789/0 conn(0x7fb8500b49a0 legacy=0x7fb8500b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb838005c10 0x7fb838006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 0x7fb838006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb85006e370 0x7fb838007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85015ec90 con 0x7fb838006a60 2023-11-24T08:07:36.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85015ef70 con 0x7fb838005c10 2023-11-24T08:07:36.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.813+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83800dca0 con 0x7fb85006e370 2023-11-24T08:07:36.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84e59c700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 0x7fb838006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84f59e700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb85006e370 0x7fb838007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84ed9d700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb838005c10 0x7fb838006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84e59c700 1 -- 172.21.15.153:0/1677927010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb85006e370 msgr2=0x7fb838007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:36.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84e59c700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb85006e370 0x7fb838007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84e59c700 1 -- 172.21.15.153:0/1677927010 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb838005c10 msgr2=0x7fb838006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84e59c700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb838005c10 0x7fb838006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84e59c700 1 -- 172.21.15.153:0/1677927010 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8380057c0 con 0x7fb838006a60 2023-11-24T08:07:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84e59c700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 0x7fb838006ee0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb840009b30 tx=0x7fb838007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bc5efd4f0f82a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84000e6c0 con 0x7fb838006a60 2023-11-24T08:07:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84000e820 con 0x7fb838006a60 2023-11-24T08:07:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb84dd9b700 1 -- 172.21.15.153:0/1677927010 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84000eb90 con 0x7fb838006a60 2023-11-24T08:07:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb85520f700 1 -- 172.21.15.153:0/1677927010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 msgr2=0x7fb838006ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.814+0000 7fb85520f700 1 --2- 172.21.15.153:0/1677927010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 0x7fb838006ee0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb840009b30 tx=0x7fb838007a90 comp rx=0 tx=0).stop 2023-11-24T08:07:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.815+0000 7fb84f59e700 1 -- 172.21.15.153:0/1677927010 reap_dead start 2023-11-24T08:07:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.815+0000 7fb85520f700 1 -- 172.21.15.153:0/1677927010 shutdown_connections 2023-11-24T08:07:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.815+0000 7fb85520f700 1 -- 172.21.15.153:0/1677927010 >> 172.21.15.153:0/1677927010 conn(0x7fb8500b28f0 msgr2=0x7fb8500b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.815+0000 7fb85520f700 1 -- 172.21.15.153:0/1677927010 shutdown_connections 2023-11-24T08:07:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.815+0000 7fb85520f700 1 -- 172.21.15.153:0/1677927010 wait complete. 2023-11-24T08:07:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.816+0000 7fb85520f700 1 Processor -- start 2023-11-24T08:07:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.816+0000 7fb85520f700 1 -- start start 2023-11-24T08:07:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb85520f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 0x7fb850157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb85520f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8500ae4a0 0x7fb8500b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb85520f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb85006b660 0x7fb85006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb85520f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500ca810 con 0x7fb838006a60 2023-11-24T08:07:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb85520f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85006c020 con 0x7fb85006b660 2023-11-24T08:07:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb85520f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb850158360 con 0x7fb8500ae4a0 2023-11-24T08:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb84ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 0x7fb850157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb84ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 0x7fb850157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39980/0 (socket says 172.21.15.153:39980) 2023-11-24T08:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb84ed9d700 1 -- 172.21.15.153:0/3220340915 learned_addr learned my addr 172.21.15.153:0/3220340915 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb84f59e700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb85006b660 0x7fb85006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb84e59c700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8500ae4a0 0x7fb8500b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb84ed9d700 1 -- 172.21.15.153:0/3220340915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8500ae4a0 msgr2=0x7fb8500b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb84ed9d700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8500ae4a0 0x7fb8500b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb84ed9d700 1 -- 172.21.15.153:0/3220340915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb85006b660 msgr2=0x7fb85006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb84ed9d700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb85006b660 0x7fb85006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb84ed9d700 1 -- 172.21.15.153:0/3220340915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500b1c80 con 0x7fb838006a60 2023-11-24T08:07:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.817+0000 7fb84ed9d700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 0x7fb850157e20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb844007340 tx=0x7fb844007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.818+0000 7fb8377fe700 1 -- 172.21.15.153:0/3220340915 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84400f6c0 con 0x7fb838006a60 2023-11-24T08:07:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.818+0000 7fb8377fe700 1 -- 172.21.15.153:0/3220340915 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84400f820 con 0x7fb838006a60 2023-11-24T08:07:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.818+0000 7fb85520f700 1 -- 172.21.15.153:0/3220340915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8500b0e50 con 0x7fb838006a60 2023-11-24T08:07:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.818+0000 7fb8377fe700 1 -- 172.21.15.153:0/3220340915 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84400fbd0 con 0x7fb838006a60 2023-11-24T08:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.818+0000 7fb85520f700 1 -- 172.21.15.153:0/3220340915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8500b13e0 con 0x7fb838006a60 2023-11-24T08:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.819+0000 7fb85520f700 1 -- 172.21.15.153:0/3220340915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8500caab0 con 0x7fb838006a60 2023-11-24T08:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.819+0000 7fb8377fe700 1 -- 172.21.15.153:0/3220340915 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb84400fd30 con 0x7fb838006a60 2023-11-24T08:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.820+0000 7fb8377fe700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb83c06b0b0 0x7fb83c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.820+0000 7fb84e59c700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb83c06b0b0 0x7fb83c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.820+0000 7fb8377fe700 1 -- 172.21.15.153:0/3220340915 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb844089380 con 0x7fb838006a60 2023-11-24T08:07:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.820+0000 7fb84e59c700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb83c06b0b0 0x7fb83c06d570 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb8400090b0 tx=0x7fb84001f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:36.824+0000 7fb8377fe700 1 -- 172.21.15.153:0/3220340915 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8440541e0 con 0x7fb838006a60 2023-11-24T08:07:37.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.015+0000 7fb85520f700 1 -- 172.21.15.153:0/3220340915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb850068fb0 con 0x7fb838006a60 2023-11-24T08:07:37.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.016+0000 7fb8377fe700 1 -- 172.21.15.153:0/3220340915 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb84401a020 con 0x7fb838006a60 2023-11-24T08:07:37.018 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-11-24T08:07:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 -- 172.21.15.153:0/3220340915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb83c06b0b0 msgr2=0x7fb83c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb83c06b0b0 0x7fb83c06d570 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb8400090b0 tx=0x7fb84001f040 comp rx=0 tx=0).stop 2023-11-24T08:07:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 -- 172.21.15.153:0/3220340915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 msgr2=0x7fb850157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 0x7fb850157e20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb844007340 tx=0x7fb844007650 comp rx=0 tx=0).stop 2023-11-24T08:07:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 -- 172.21.15.153:0/3220340915 shutdown_connections 2023-11-24T08:07:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb85006b660 0x7fb85006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fb83c06b0b0 0x7fb83c06d570 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb838006a60 0x7fb850157e20 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 --2- 172.21.15.153:0/3220340915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8500ae4a0 0x7fb8500b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 -- 172.21.15.153:0/3220340915 >> 172.21.15.153:0/3220340915 conn(0x7fb8500b28f0 msgr2=0x7fb8500b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 -- 172.21.15.153:0/3220340915 shutdown_connections 2023-11-24T08:07:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.018+0000 7fb85520f700 1 -- 172.21.15.153:0/3220340915 wait complete. 2023-11-24T08:07:37.032 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.153+0000 7fa66048f700 1 Processor -- start 2023-11-24T08:07:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.153+0000 7fa66048f700 1 -- start start 2023-11-24T08:07:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.154+0000 7fa66048f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa65815bf50 0x7fa6580ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.154+0000 7fa66048f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6580ce830 0x7fa6580cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.154+0000 7fa66048f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6580d0140 con 0x7fa6580cf1f0 2023-11-24T08:07:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.154+0000 7fa66048f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65815c330 con 0x7fa65815bf50 2023-11-24T08:07:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.154+0000 7fa66048f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580d03e0 con 0x7fa6580ce830 2023-11-24T08:07:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65e22b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa65815bf50 0x7fa6580ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65e22b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa65815bf50 0x7fa6580ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39988/0 (socket says 172.21.15.153:39988) 2023-11-24T08:07:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65e22b700 1 -- 172.21.15.153:0/847318112 learned_addr learned my addr 172.21.15.153:0/847318112 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65da2a700 1 --2- 172.21.15.153:0/847318112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6580ce830 0x7fa6580cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65e22b700 1 -- 172.21.15.153:0/847318112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6580ce830 msgr2=0x7fa6580cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65e22b700 1 --2- 172.21.15.153:0/847318112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6580ce830 0x7fa6580cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65e22b700 1 -- 172.21.15.153:0/847318112 >> v1:172.21.15.164:6789/0 conn(0x7fa6580cf1f0 legacy=0x7fa6580c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65e22b700 1 -- 172.21.15.153:0/847318112 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6580d06c0 con 0x7fa65815bf50 2023-11-24T08:07:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65e22b700 1 --2- 172.21.15.153:0/847318112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65815bf50 0x7fa6580ce2f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa6480098f0 tx=0x7fa648009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a815724791da84 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65d229700 1 -- 172.21.15.153:0/847318112 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648011830 con 0x7fa65815bf50 2023-11-24T08:07:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65d229700 1 -- 172.21.15.153:0/847318112 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa648011990 con 0x7fa65815bf50 2023-11-24T08:07:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.155+0000 7fa65d229700 1 -- 172.21.15.153:0/847318112 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648011d20 con 0x7fa65815bf50 2023-11-24T08:07:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.156+0000 7fa66048f700 1 -- 172.21.15.153:0/847318112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65815bf50 msgr2=0x7fa6580ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.156+0000 7fa66048f700 1 --2- 172.21.15.153:0/847318112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65815bf50 0x7fa6580ce2f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa6480098f0 tx=0x7fa648009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.156+0000 7fa66048f700 1 -- 172.21.15.153:0/847318112 shutdown_connections 2023-11-24T08:07:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.156+0000 7fa66048f700 1 --2- 172.21.15.153:0/847318112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65815bf50 0x7fa6580ce2f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.156+0000 7fa66048f700 1 --2- 172.21.15.153:0/847318112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6580ce830 0x7fa6580cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.156+0000 7fa66048f700 1 -- 172.21.15.153:0/847318112 >> 172.21.15.153:0/847318112 conn(0x7fa6580b3780 msgr2=0x7fa6580b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.156+0000 7fa66048f700 1 -- 172.21.15.153:0/847318112 shutdown_connections 2023-11-24T08:07:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.156+0000 7fa66048f700 1 -- 172.21.15.153:0/847318112 wait complete. 2023-11-24T08:07:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.157+0000 7fa66048f700 1 Processor -- start 2023-11-24T08:07:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.157+0000 7fa66048f700 1 -- start start 2023-11-24T08:07:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa66048f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6580ce830 0x7fa65814bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa66048f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6580cf1f0 0x7fa65809bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa66048f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa65815bf50 0x7fa65809c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa66048f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65806b300 con 0x7fa6580cf1f0 2023-11-24T08:07:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa66048f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580b67d0 con 0x7fa6580ce830 2023-11-24T08:07:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa66048f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580b6ab0 con 0x7fa65815bf50 2023-11-24T08:07:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa65da2a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6580cf1f0 0x7fa65809bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa65da2a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6580cf1f0 0x7fa65809bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39996/0 (socket says 172.21.15.153:39996) 2023-11-24T08:07:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa65da2a700 1 -- 172.21.15.153:0/3142614751 learned_addr learned my addr 172.21.15.153:0/3142614751 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa65ea2c700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa65815bf50 0x7fa65809c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa65e22b700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6580ce830 0x7fa65814bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa65da2a700 1 -- 172.21.15.153:0/3142614751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa65815bf50 msgr2=0x7fa65809c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa65da2a700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa65815bf50 0x7fa65809c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa65da2a700 1 -- 172.21.15.153:0/3142614751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6580ce830 msgr2=0x7fa65814bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa65da2a700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6580ce830 0x7fa65814bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa65da2a700 1 -- 172.21.15.153:0/3142614751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa648009550 con 0x7fa6580cf1f0 2023-11-24T08:07:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.158+0000 7fa65da2a700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6580cf1f0 0x7fa65809bc00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa65400e9b0 tx=0x7fa65400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.159+0000 7fa64effd700 1 -- 172.21.15.153:0/3142614751 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654009710 con 0x7fa6580cf1f0 2023-11-24T08:07:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.159+0000 7fa64effd700 1 -- 172.21.15.153:0/3142614751 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65400c850 con 0x7fa6580cf1f0 2023-11-24T08:07:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.159+0000 7fa66048f700 1 -- 172.21.15.153:0/3142614751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6580b6d90 con 0x7fa6580cf1f0 2023-11-24T08:07:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.159+0000 7fa64effd700 1 -- 172.21.15.153:0/3142614751 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400cbc0 con 0x7fa6580cf1f0 2023-11-24T08:07:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.159+0000 7fa66048f700 1 -- 172.21.15.153:0/3142614751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65814c4c0 con 0x7fa6580cf1f0 2023-11-24T08:07:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.160+0000 7fa66048f700 1 -- 172.21.15.153:0/3142614751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65806b5a0 con 0x7fa6580cf1f0 2023-11-24T08:07:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.160+0000 7fa64effd700 1 -- 172.21.15.153:0/3142614751 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa65400cd20 con 0x7fa6580cf1f0 2023-11-24T08:07:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.160+0000 7fa64effd700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa63c06b080 0x7fa63c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.161+0000 7fa64effd700 1 -- 172.21.15.153:0/3142614751 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa654089a80 con 0x7fa6580cf1f0 2023-11-24T08:07:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.161+0000 7fa65e22b700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa63c06b080 0x7fa63c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.161+0000 7fa65e22b700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa63c06b080 0x7fa63c06d540 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa648014040 tx=0x7fa648008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.165+0000 7fa64effd700 1 -- 172.21.15.153:0/3142614751 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa654054820 con 0x7fa6580cf1f0 2023-11-24T08:07:37.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.358+0000 7fa66048f700 1 -- 172.21.15.153:0/3142614751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6580b72b0 con 0x7fa6580cf1f0 2023-11-24T08:07:37.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.358+0000 7fa64effd700 1 -- 172.21.15.153:0/3142614751 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6540210a0 con 0x7fa6580cf1f0 2023-11-24T08:07:37.360 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2023-11-24T08:07:37.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 -- 172.21.15.153:0/3142614751 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa63c06b080 msgr2=0x7fa63c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa63c06b080 0x7fa63c06d540 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa648014040 tx=0x7fa648008030 comp rx=0 tx=0).stop 2023-11-24T08:07:37.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 -- 172.21.15.153:0/3142614751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6580cf1f0 msgr2=0x7fa65809bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6580cf1f0 0x7fa65809bc00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa65400e9b0 tx=0x7fa65400ed70 comp rx=0 tx=0).stop 2023-11-24T08:07:37.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 -- 172.21.15.153:0/3142614751 shutdown_connections 2023-11-24T08:07:37.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa65815bf50 0x7fa65809c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6580ce830 0x7fa65814bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fa63c06b080 0x7fa63c06d540 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 --2- 172.21.15.153:0/3142614751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6580cf1f0 0x7fa65809bc00 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 -- 172.21.15.153:0/3142614751 >> 172.21.15.153:0/3142614751 conn(0x7fa6580b3780 msgr2=0x7fa6580c7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 -- 172.21.15.153:0/3142614751 shutdown_connections 2023-11-24T08:07:37.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.360+0000 7fa66048f700 1 -- 172.21.15.153:0/3142614751 wait complete. 2023-11-24T08:07:37.374 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:37.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.497+0000 7f272af6b700 1 Processor -- start 2023-11-24T08:07:37.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.497+0000 7f272af6b700 1 -- start start 2023-11-24T08:07:37.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f272af6b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f27241587f0 0x7f272406aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f272af6b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f272415b370 0x7f272415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f272af6b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272406b530 con 0x7f27240b3c60 2023-11-24T08:07:37.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f272af6b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27240ae5e0 con 0x7f27241587f0 2023-11-24T08:07:37.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f272af6b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272415be30 con 0x7f272415b370 2023-11-24T08:07:37.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f2728d07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f27241587f0 0x7f272406aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f2728d07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f27241587f0 0x7f272406aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40002/0 (socket says 172.21.15.153:40002) 2023-11-24T08:07:37.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f2728d07700 1 -- 172.21.15.153:0/3705776655 learned_addr learned my addr 172.21.15.153:0/3705776655 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:37.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f2728d07700 1 -- 172.21.15.153:0/3705776655 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f272415b370 msgr2=0x7f272415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f2728d07700 1 --2- 172.21.15.153:0/3705776655 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f272415b370 0x7f272415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f2728d07700 1 -- 172.21.15.153:0/3705776655 >> v1:172.21.15.164:6789/0 conn(0x7f27240b3c60 legacy=0x7f27240af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f2728d07700 1 -- 172.21.15.153:0/3705776655 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272415c110 con 0x7f27241587f0 2023-11-24T08:07:37.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.498+0000 7f2728d07700 1 --2- 172.21.15.153:0/3705776655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27241587f0 0x7f272406aff0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f27180098f0 tx=0x7f2718009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dd74926eae16bc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.499+0000 7f27237fe700 1 -- 172.21.15.153:0/3705776655 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718004230 con 0x7f27241587f0 2023-11-24T08:07:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.499+0000 7f27237fe700 1 -- 172.21.15.153:0/3705776655 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2718004390 con 0x7f27241587f0 2023-11-24T08:07:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.499+0000 7f27237fe700 1 -- 172.21.15.153:0/3705776655 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27180036a0 con 0x7f27241587f0 2023-11-24T08:07:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.499+0000 7f272af6b700 1 -- 172.21.15.153:0/3705776655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27241587f0 msgr2=0x7f272406aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.499+0000 7f272af6b700 1 --2- 172.21.15.153:0/3705776655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27241587f0 0x7f272406aff0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f27180098f0 tx=0x7f2718009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.499+0000 7f272af6b700 1 -- 172.21.15.153:0/3705776655 shutdown_connections 2023-11-24T08:07:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.499+0000 7f272af6b700 1 --2- 172.21.15.153:0/3705776655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27241587f0 0x7f272406aff0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.499+0000 7f272af6b700 1 --2- 172.21.15.153:0/3705776655 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f272415b370 0x7f272415b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.499+0000 7f272af6b700 1 -- 172.21.15.153:0/3705776655 >> 172.21.15.153:0/3705776655 conn(0x7f27240d0bf0 msgr2=0x7f27240d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.499+0000 7f272af6b700 1 -- 172.21.15.153:0/3705776655 shutdown_connections 2023-11-24T08:07:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.499+0000 7f272af6b700 1 -- 172.21.15.153:0/3705776655 wait complete. 2023-11-24T08:07:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.501+0000 7f272af6b700 1 Processor -- start 2023-11-24T08:07:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.501+0000 7f272af6b700 1 -- start start 2023-11-24T08:07:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f272af6b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27240b3c60 0x7f2724147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f272af6b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27241587f0 0x7f27240aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f272af6b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f272415b370 0x7f272414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f272af6b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2724147c40 con 0x7f27241587f0 2023-11-24T08:07:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f272af6b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27240b1470 con 0x7f272415b370 2023-11-24T08:07:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f272af6b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27240b08f0 con 0x7f27240b3c60 2023-11-24T08:07:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f2723fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27241587f0 0x7f27240aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f2723fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27241587f0 0x7f27240aff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40008/0 (socket says 172.21.15.153:40008) 2023-11-24T08:07:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f2723fff700 1 -- 172.21.15.153:0/757111692 learned_addr learned my addr 172.21.15.153:0/757111692 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f2729508700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f272415b370 0x7f272414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f2728d07700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27240b3c60 0x7f2724147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f2723fff700 1 -- 172.21.15.153:0/757111692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27240b3c60 msgr2=0x7f2724147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f2723fff700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27240b3c60 0x7f2724147700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f2723fff700 1 -- 172.21.15.153:0/757111692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f272415b370 msgr2=0x7f272414e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f2723fff700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f272415b370 0x7f272414e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f2723fff700 1 -- 172.21.15.153:0/757111692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718009550 con 0x7f27241587f0 2023-11-24T08:07:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.502+0000 7f2723fff700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27241587f0 0x7f27240aff50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f271000b4a0 tx=0x7f271000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.503+0000 7f27217fa700 1 -- 172.21.15.153:0/757111692 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710011830 con 0x7f27241587f0 2023-11-24T08:07:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.503+0000 7f27217fa700 1 -- 172.21.15.153:0/757111692 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710011990 con 0x7f27241587f0 2023-11-24T08:07:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.503+0000 7f272af6b700 1 -- 172.21.15.153:0/757111692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27240b0bd0 con 0x7f27241587f0 2023-11-24T08:07:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.503+0000 7f27217fa700 1 -- 172.21.15.153:0/757111692 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710011d40 con 0x7f27241587f0 2023-11-24T08:07:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.503+0000 7f272af6b700 1 -- 172.21.15.153:0/757111692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27240b1190 con 0x7f27241587f0 2023-11-24T08:07:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.504+0000 7f272af6b700 1 -- 172.21.15.153:0/757111692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27241f3d60 con 0x7f27241587f0 2023-11-24T08:07:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.504+0000 7f27217fa700 1 -- 172.21.15.153:0/757111692 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f271001a400 con 0x7f27241587f0 2023-11-24T08:07:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.504+0000 7f27217fa700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f270806b080 0x7f270806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.505+0000 7f2728d07700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f270806b080 0x7f270806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.505+0000 7f27217fa700 1 -- 172.21.15.153:0/757111692 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27100898f0 con 0x7f27241587f0 2023-11-24T08:07:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.505+0000 7f2728d07700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f270806b080 0x7f270806d540 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2718009c40 tx=0x7f2718008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.509+0000 7f27217fa700 1 -- 172.21.15.153:0/757111692 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2710054730 con 0x7f27241587f0 2023-11-24T08:07:37.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.699+0000 7f272af6b700 1 -- 172.21.15.153:0/757111692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2724068fb0 con 0x7f27241587f0 2023-11-24T08:07:37.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.699+0000 7f27217fa700 1 -- 172.21.15.153:0/757111692 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27100150a0 con 0x7f27241587f0 2023-11-24T08:07:37.701 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-11-24T08:07:37.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 -- 172.21.15.153:0/757111692 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f270806b080 msgr2=0x7f270806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f270806b080 0x7f270806d540 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2718009c40 tx=0x7f2718008030 comp rx=0 tx=0).stop 2023-11-24T08:07:37.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 -- 172.21.15.153:0/757111692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27241587f0 msgr2=0x7f27240aff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27241587f0 0x7f27240aff50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f271000b4a0 tx=0x7f271000b860 comp rx=0 tx=0).stop 2023-11-24T08:07:37.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 -- 172.21.15.153:0/757111692 shutdown_connections 2023-11-24T08:07:37.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f272415b370 0x7f272414e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27240b3c60 0x7f2724147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f270806b080 0x7f270806d540 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 --2- 172.21.15.153:0/757111692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27241587f0 0x7f27240aff50 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 -- 172.21.15.153:0/757111692 >> 172.21.15.153:0/757111692 conn(0x7f27240d0bf0 msgr2=0x7f272406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 -- 172.21.15.153:0/757111692 shutdown_connections 2023-11-24T08:07:37.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.702+0000 7f272af6b700 1 -- 172.21.15.153:0/757111692 wait complete. 2023-11-24T08:07:37.716 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:37.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.836+0000 7f3a2a8e6700 1 Processor -- start 2023-11-24T08:07:37.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.836+0000 7f3a2a8e6700 1 -- start start 2023-11-24T08:07:37.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a2a8e6700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3a240af4d0 0x7f3a240b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a2a8e6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a240ae430 con 0x7f3a2415e080 2023-11-24T08:07:37.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a2a8e6700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a240ae710 con 0x7f3a2406c710 2023-11-24T08:07:37.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a2a8e6700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a240af0b0 con 0x7f3a240af4d0 2023-11-24T08:07:37.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a23fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3a2415e080 0x7f3a2406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46118/0 (socket says 172.21.15.153:46118) 2023-11-24T08:07:37.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a23fff700 1 -- 172.21.15.153:0/2829049239 learned_addr learned my addr 172.21.15.153:0/2829049239 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a28e83700 1 --2- 172.21.15.153:0/2829049239 >> v2:172.21.15.164:3300/0 conn(0x7f3a240af4d0 0x7f3a240b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425189805 0 0) 0x7f3a240ae430 con 0x7f3a2415e080 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a0c0035b0 con 0x7f3a2415e080 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2588116565 0 0) 0x7f3a0c0035b0 con 0x7f3a2415e080 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 >> v2:172.21.15.164:3300/0 conn(0x7f3a240af4d0 msgr2=0x7f3a240b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 --2- 172.21.15.153:0/2829049239 >> v2:172.21.15.164:3300/0 conn(0x7f3a240af4d0 0x7f3a240b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 >> v1:172.21.15.164:6789/0 conn(0x7f3a2406c710 legacy=0x7f3a2406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a240ae9f0 con 0x7f3a2415e080 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f3a14001670 con 0x7f3a2415e080 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 >> v1:172.21.15.153:6789/0 conn(0x7f3a2415e080 legacy=0x7f3a2406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a0c003a00 0x7f3a0c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a0c004850 0x7f3a0c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0c005210 0x7f3a0c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240af0b0 con 0x7f3a0c005210 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c00c0b0 con 0x7f3a0c003a00 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c00c270 con 0x7f3a0c004850 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.837+0000 7f3a28e83700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0c005210 0x7f3a0c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a23fff700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a0c003a00 0x7f3a0c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a237fe700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a0c004850 0x7f3a0c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a28e83700 1 -- 172.21.15.153:0/2829049239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a0c004850 msgr2=0x7f3a0c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a28e83700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a0c004850 0x7f3a0c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a28e83700 1 -- 172.21.15.153:0/2829049239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a0c003a00 msgr2=0x7f3a0c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a28e83700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a0c003a00 0x7f3a0c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a28e83700 1 -- 172.21.15.153:0/2829049239 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0035b0 con 0x7f3a0c005210 2023-11-24T08:07:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a237fe700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a0c004850 0x7f3a0c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a28e83700 1 -- 172.21.15.153:0/2829049239 reap_dead start 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a28e83700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0c005210 0x7f3a0c00ba10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009fc0 tx=0x7f3a0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2bcf1805a8410 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c003a20 con 0x7f3a0c005210 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c00f040 con 0x7f3a0c005210 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a22ffd700 1 -- 172.21.15.153:0/2829049239 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c003de0 con 0x7f3a0c005210 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/2829049239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0c005210 msgr2=0x7f3a0c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.838+0000 7f3a2a8e6700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0c005210 0x7f3a0c00ba10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009fc0 tx=0x7f3a0c005880 comp rx=0 tx=0).stop 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.839+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/2829049239 shutdown_connections 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.839+0000 7f3a2a8e6700 1 --2- 172.21.15.153:0/2829049239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a0c005210 0x7f3a0c00ba10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.839+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/2829049239 >> 172.21.15.153:0/2829049239 conn(0x7f3a24071b90 msgr2=0x7f3a24071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.839+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/2829049239 shutdown_connections 2023-11-24T08:07:37.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.839+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/2829049239 wait complete. 2023-11-24T08:07:37.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.840+0000 7f3a2a8e6700 1 Processor -- start 2023-11-24T08:07:37.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.840+0000 7f3a2a8e6700 1 -- start start 2023-11-24T08:07:37.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a2a8e6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a0c005210 0x7f3a24151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a2a8e6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a241f41f0 0x7f3a2415f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a2a8e6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a240cf2a0 0x7f3a2406aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a2a8e6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240cd850 con 0x7f3a241f41f0 2023-11-24T08:07:37.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a2a8e6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24151bd0 con 0x7f3a0c005210 2023-11-24T08:07:37.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a2a8e6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2415faa0 con 0x7f3a240cf2a0 2023-11-24T08:07:37.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a241f41f0 0x7f3a2415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a241f41f0 0x7f3a2415f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40028/0 (socket says 172.21.15.153:40028) 2023-11-24T08:07:37.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a237fe700 1 -- 172.21.15.153:0/1513095616 learned_addr learned my addr 172.21.15.153:0/1513095616 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:37.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a23fff700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a0c005210 0x7f3a24151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a28e83700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a240cf2a0 0x7f3a2406aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a237fe700 1 -- 172.21.15.153:0/1513095616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a240cf2a0 msgr2=0x7f3a2406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a237fe700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a240cf2a0 0x7f3a2406aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a237fe700 1 -- 172.21.15.153:0/1513095616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a0c005210 msgr2=0x7f3a24151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a237fe700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a0c005210 0x7f3a24151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a237fe700 1 -- 172.21.15.153:0/1513095616 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a240cfaf0 con 0x7f3a241f41f0 2023-11-24T08:07:37.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a28e83700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a240cf2a0 0x7f3a2406aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:37.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a237fe700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a241f41f0 0x7f3a2415f560 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800e580 tx=0x7f3a1800e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a20ff9700 1 -- 172.21.15.153:0/1513095616 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a180052e0 con 0x7f3a241f41f0 2023-11-24T08:07:37.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a20ff9700 1 -- 172.21.15.153:0/1513095616 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a18005440 con 0x7f3a241f41f0 2023-11-24T08:07:37.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/1513095616 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a240cfdd0 con 0x7f3a241f41f0 2023-11-24T08:07:37.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.841+0000 7f3a20ff9700 1 -- 172.21.15.153:0/1513095616 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a180038c0 con 0x7f3a241f41f0 2023-11-24T08:07:37.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.842+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/1513095616 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a240d0390 con 0x7f3a241f41f0 2023-11-24T08:07:37.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.842+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/1513095616 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a240753f0 con 0x7f3a241f41f0 2023-11-24T08:07:37.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.843+0000 7f3a20ff9700 1 -- 172.21.15.153:0/1513095616 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3a18003a20 con 0x7f3a241f41f0 2023-11-24T08:07:37.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.843+0000 7f3a20ff9700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1006b080 0x7f3a1006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.843+0000 7f3a23fff700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1006b080 0x7f3a1006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.843+0000 7f3a20ff9700 1 -- 172.21.15.153:0/1513095616 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a18088fa0 con 0x7f3a241f41f0 2023-11-24T08:07:37.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.844+0000 7f3a23fff700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1006b080 0x7f3a1006d540 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3a241571e0 tx=0x7f3a14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:37.848+0000 7f3a20ff9700 1 -- 172.21.15.153:0/1513095616 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a18053e70 con 0x7f3a241f41f0 2023-11-24T08:07:38.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.079+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/1513095616 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a240cda00 con 0x7f3a241f41f0 2023-11-24T08:07:38.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.079+0000 7f3a20ff9700 1 -- 172.21.15.153:0/1513095616 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f3a240cda00 con 0x7f3a241f41f0 2023-11-24T08:07:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:38.082 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3525215026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3525215026},{"type":"v1","addr":"172.21.15.153:6837","nonce":3525215026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5318,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/946995567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":946995567},{"type":"v1","addr":"172.21.15.164:6834","nonce":946995567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6075,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/3002476497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3002476497},{"type":"v1","addr":"172.21.15.153:6836","nonce":3002476497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:16.566591+0000","modified":"2023-11-24T08:07:19.587429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6090":{"gid":6090,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/3019873912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3019873912},{"type":"v1","addr":"172.21.15.164:6835","nonce":3019873912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:38.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/1513095616 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1006b080 msgr2=0x7f3a1006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1006b080 0x7f3a1006d540 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3a241571e0 tx=0x7f3a14009040 comp rx=0 tx=0).stop 2023-11-24T08:07:38.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/1513095616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a241f41f0 msgr2=0x7f3a2415f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a241f41f0 0x7f3a2415f560 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800e580 tx=0x7f3a1800e940 comp rx=0 tx=0).stop 2023-11-24T08:07:38.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/1513095616 shutdown_connections 2023-11-24T08:07:38.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a240cf2a0 0x7f3a2406aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a0c005210 0x7f3a24151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f3a1006b080 0x7f3a1006d540 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 --2- 172.21.15.153:0/1513095616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a241f41f0 0x7f3a2415f560 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/1513095616 >> 172.21.15.153:0/1513095616 conn(0x7f3a24071b90 msgr2=0x7f3a240b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/1513095616 shutdown_connections 2023-11-24T08:07:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.082+0000 7f3a2a8e6700 1 -- 172.21.15.153:0/1513095616 wait complete. 2023-11-24T08:07:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 37 2023-11-24T08:07:38.096 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:38.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.215+0000 7fdaa1f88700 1 Processor -- start 2023-11-24T08:07:38.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.215+0000 7fdaa1f88700 1 -- start start 2023-11-24T08:07:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fdaa1f88700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda9c144700 0x7fda9c0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fdaa1f88700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fda9c0b52c0 0x7fda9c06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fdaa1f88700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0b44c0 con 0x7fda9c06c540 2023-11-24T08:07:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fdaa1f88700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c06c980 con 0x7fda9c144700 2023-11-24T08:07:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fdaa1f88700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c0b3bd0 con 0x7fda9c0b52c0 2023-11-24T08:07:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda9c144700 0x7fda9c0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fda9c06c540 0x7fda9c15b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46142/0 (socket says 172.21.15.153:46142) 2023-11-24T08:07:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9bfff700 1 -- 172.21.15.153:0/1490878034 learned_addr learned my addr 172.21.15.153:0/1490878034 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9affd700 1 --2- 172.21.15.153:0/1490878034 >> v2:172.21.15.164:3300/0 conn(0x7fda9c0b52c0 0x7fda9c06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9b7fe700 1 -- 172.21.15.153:0/1490878034 >> v2:172.21.15.164:3300/0 conn(0x7fda9c0b52c0 msgr2=0x7fda9c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9b7fe700 1 --2- 172.21.15.153:0/1490878034 >> v2:172.21.15.164:3300/0 conn(0x7fda9c0b52c0 0x7fda9c06c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9b7fe700 1 -- 172.21.15.153:0/1490878034 >> v1:172.21.15.153:6789/0 conn(0x7fda9c06c540 legacy=0x7fda9c15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9b7fe700 1 -- 172.21.15.153:0/1490878034 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c144ae0 con 0x7fda9c144700 2023-11-24T08:07:38.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9a7fc700 1 -- 172.21.15.153:0/1490878034 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368955741 0 0) 0x7fda9c0b44c0 con 0x7fda9c06c540 2023-11-24T08:07:38.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9b7fe700 1 --2- 172.21.15.153:0/1490878034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9c144700 0x7fda9c0b4d80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fda9c06faa0 tx=0x7fda8c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b09203e3c240d6c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9a7fc700 1 -- 172.21.15.153:0/1490878034 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c011830 con 0x7fda9c144700 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9a7fc700 1 -- 172.21.15.153:0/1490878034 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c011990 con 0x7fda9c144700 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.216+0000 7fda9a7fc700 1 -- 172.21.15.153:0/1490878034 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c011d20 con 0x7fda9c144700 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.217+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1490878034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9c144700 msgr2=0x7fda9c0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.217+0000 7fdaa1f88700 1 --2- 172.21.15.153:0/1490878034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9c144700 0x7fda9c0b4d80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fda9c06faa0 tx=0x7fda8c009b20 comp rx=0 tx=0).stop 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.217+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1490878034 shutdown_connections 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.217+0000 7fdaa1f88700 1 --2- 172.21.15.153:0/1490878034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9c144700 0x7fda9c0b4d80 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.217+0000 7fdaa1f88700 1 --2- 172.21.15.153:0/1490878034 >> v2:172.21.15.164:3300/0 conn(0x7fda9c0b52c0 0x7fda9c06c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.217+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1490878034 >> 172.21.15.153:0/1490878034 conn(0x7fda9c071a90 msgr2=0x7fda9c071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.217+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1490878034 shutdown_connections 2023-11-24T08:07:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.217+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1490878034 wait complete. 2023-11-24T08:07:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.218+0000 7fdaa1f88700 1 Processor -- start 2023-11-24T08:07:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.218+0000 7fdaa1f88700 1 -- start start 2023-11-24T08:07:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fdaa1f88700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9c06c540 0x7fda9c0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fdaa1f88700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c0b52c0 0x7fda9c0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fdaa1f88700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c144700 0x7fda9c13fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fdaa1f88700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c13beb0 con 0x7fda9c06c540 2023-11-24T08:07:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fdaa1f88700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1417b0 con 0x7fda9c0b52c0 2023-11-24T08:07:38.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fdaa1f88700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c140c30 con 0x7fda9c144700 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fda9b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9c06c540 0x7fda9c0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fda9b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9c06c540 0x7fda9c0c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40040/0 (socket says 172.21.15.153:40040) 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fda9b7fe700 1 -- 172.21.15.153:0/1027490140 learned_addr learned my addr 172.21.15.153:0/1027490140 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fda9affd700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c0b52c0 0x7fda9c0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fda9bfff700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c144700 0x7fda9c13fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fda9b7fe700 1 -- 172.21.15.153:0/1027490140 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c144700 msgr2=0x7fda9c13fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fda9b7fe700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c144700 0x7fda9c13fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fda9b7fe700 1 -- 172.21.15.153:0/1027490140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c0b52c0 msgr2=0x7fda9c0c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fda9b7fe700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c0b52c0 0x7fda9c0c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fda9b7fe700 1 -- 172.21.15.153:0/1027490140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0094a0 con 0x7fda9c06c540 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.219+0000 7fda9affd700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c0b52c0 0x7fda9c0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:38.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.220+0000 7fda9b7fe700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9c06c540 0x7fda9c0c7580 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fda8c014040 tx=0x7fda8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.220+0000 7fda83fff700 1 -- 172.21.15.153:0/1027490140 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0038a0 con 0x7fda9c06c540 2023-11-24T08:07:38.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.220+0000 7fda83fff700 1 -- 172.21.15.153:0/1027490140 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c01e070 con 0x7fda9c06c540 2023-11-24T08:07:38.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.220+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1027490140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c140f10 con 0x7fda9c06c540 2023-11-24T08:07:38.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.220+0000 7fda83fff700 1 -- 172.21.15.153:0/1027490140 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c003c20 con 0x7fda9c06c540 2023-11-24T08:07:38.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.220+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1027490140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c1414d0 con 0x7fda9c06c540 2023-11-24T08:07:38.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.221+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1027490140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c0751e0 con 0x7fda9c06c540 2023-11-24T08:07:38.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.221+0000 7fda83fff700 1 -- 172.21.15.153:0/1027490140 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fda8c02d450 con 0x7fda9c06c540 2023-11-24T08:07:38.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.222+0000 7fda83fff700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fda8806b080 0x7fda8806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.222+0000 7fda83fff700 1 -- 172.21.15.153:0/1027490140 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda8c08a8e0 con 0x7fda9c06c540 2023-11-24T08:07:38.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.222+0000 7fda9affd700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fda8806b080 0x7fda8806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.222+0000 7fda9affd700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fda8806b080 0x7fda8806d540 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fda9c143a40 tx=0x7fda90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.226+0000 7fda83fff700 1 -- 172.21.15.153:0/1027490140 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda8c055720 con 0x7fda9c06c540 2023-11-24T08:07:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.419+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1027490140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda9c0727f0 con 0x7fda9c06c540 2023-11-24T08:07:38.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.421+0000 7fda83fff700 1 -- 172.21.15.153:0/1027490140 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16601 (secure 0 0 0) 0x7fda8c020090 con 0x7fda9c06c540 2023-11-24T08:07:38.422 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:38.423 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":56,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:07:18.180030+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:14.800746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:15.529815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:38.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1027490140 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fda8806b080 msgr2=0x7fda8806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fda8806b080 0x7fda8806d540 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fda9c143a40 tx=0x7fda90008040 comp rx=0 tx=0).stop 2023-11-24T08:07:38.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1027490140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9c06c540 msgr2=0x7fda9c0c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9c06c540 0x7fda9c0c7580 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fda8c014040 tx=0x7fda8c004750 comp rx=0 tx=0).stop 2023-11-24T08:07:38.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1027490140 shutdown_connections 2023-11-24T08:07:38.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c144700 0x7fda9c13fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fda8806b080 0x7fda8806d540 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda9c06c540 0x7fda9c0c7580 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 --2- 172.21.15.153:0/1027490140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c0b52c0 0x7fda9c0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1027490140 >> 172.21.15.153:0/1027490140 conn(0x7fda9c071a90 msgr2=0x7fda9c0cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1027490140 shutdown_connections 2023-11-24T08:07:38.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.423+0000 7fdaa1f88700 1 -- 172.21.15.153:0/1027490140 wait complete. 2023-11-24T08:07:38.437 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:07:38.437 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:38.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.557+0000 7f716f2dc700 1 Processor -- start 2023-11-24T08:07:38.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.557+0000 7f716f2dc700 1 -- start start 2023-11-24T08:07:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f716f2dc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716815dfc0 0x7f71680d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f716f2dc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f71680d44e0 0x7f71680d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f716f2dc700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71680d2d10 con 0x7f71680b2fc0 2023-11-24T08:07:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f716f2dc700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71680cefd0 con 0x7f71680d44e0 2023-11-24T08:07:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f716f2dc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71680cf2b0 con 0x7f716815dfc0 2023-11-24T08:07:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f716c877700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f71680b2fc0 0x7f7168161b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46154/0 (socket says 172.21.15.153:46154) 2023-11-24T08:07:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f716c877700 1 -- 172.21.15.153:0/1963715432 learned_addr learned my addr 172.21.15.153:0/1963715432 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f716d879700 1 --2- 172.21.15.153:0/1963715432 >> v2:172.21.15.164:3300/0 conn(0x7f71680d44e0 0x7f71680d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f716d078700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716815dfc0 0x7f71680d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155684794 0 0) 0x7f71680d2d10 con 0x7f71680b2fc0 2023-11-24T08:07:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71540035b0 con 0x7f71680b2fc0 2023-11-24T08:07:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2250268531 0 0) 0x7f71540035b0 con 0x7f71680b2fc0 2023-11-24T08:07:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716815dfc0 msgr2=0x7f71680d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716815dfc0 0x7f71680d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 >> v2:172.21.15.164:3300/0 conn(0x7f71680d44e0 msgr2=0x7f71680d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 --2- 172.21.15.153:0/1963715432 >> v2:172.21.15.164:3300/0 conn(0x7f71680d44e0 0x7f71680d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680d2fb0 con 0x7f71680b2fc0 2023-11-24T08:07:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f7158001670 con 0x7f71680b2fc0 2023-11-24T08:07:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 >> v1:172.21.15.153:6789/0 conn(0x7f71680b2fc0 legacy=0x7f7168161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7154003a00 0x7f7154003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716815dfc0 0x7f7154004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 0x7f7154005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71680cefd0 con 0x7f7154004d90 2023-11-24T08:07:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71680cf2b0 con 0x7f7154003a00 2023-11-24T08:07:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.558+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715400ba10 con 0x7f716815dfc0 2023-11-24T08:07:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f716d879700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 0x7f7154005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f716d078700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7154003a00 0x7f7154003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f716c877700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716815dfc0 0x7f7154004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f716d879700 1 -- 172.21.15.153:0/1963715432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716815dfc0 msgr2=0x7f7154004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f716d879700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716815dfc0 0x7f7154004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f716d879700 1 -- 172.21.15.153:0/1963715432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7154003a00 msgr2=0x7f7154003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f716d879700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7154003a00 0x7f7154003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f716d879700 1 -- 172.21.15.153:0/1963715432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71540035b0 con 0x7f7154004d90 2023-11-24T08:07:38.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f716d879700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 0x7f7154005210 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7160009f90 tx=0x7f7154005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44ccd004b1cf7b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716000ec30 con 0x7f7154004d90 2023-11-24T08:07:38.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716000f040 con 0x7f7154004d90 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.559+0000 7f715ffff700 1 -- 172.21.15.153:0/1963715432 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160014480 con 0x7f7154004d90 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.560+0000 7f716f2dc700 1 -- 172.21.15.153:0/1963715432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 msgr2=0x7f7154005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.560+0000 7f716f2dc700 1 --2- 172.21.15.153:0/1963715432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 0x7f7154005210 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7160009f90 tx=0x7f7154005880 comp rx=0 tx=0).stop 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.560+0000 7f716d879700 1 -- 172.21.15.153:0/1963715432 reap_dead start 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.560+0000 7f716f2dc700 1 -- 172.21.15.153:0/1963715432 shutdown_connections 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.560+0000 7f716f2dc700 1 -- 172.21.15.153:0/1963715432 >> 172.21.15.153:0/1963715432 conn(0x7f716806b410 msgr2=0x7f716806b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.560+0000 7f716f2dc700 1 -- 172.21.15.153:0/1963715432 shutdown_connections 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.560+0000 7f716f2dc700 1 -- 172.21.15.153:0/1963715432 wait complete. 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.561+0000 7f716f2dc700 1 Processor -- start 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.561+0000 7f716f2dc700 1 -- start start 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716f2dc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 0x7f71680c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716f2dc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71680cafa0 0x7f71680cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716f2dc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716814b000 0x7f716814b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716f2dc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71680c8dd0 con 0x7f7154004d90 2023-11-24T08:07:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716f2dc700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71680cc7e0 con 0x7f71680cafa0 2023-11-24T08:07:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716f2dc700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71680cb960 con 0x7f716814b000 2023-11-24T08:07:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716d078700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 0x7f71680c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716d078700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 0x7f71680c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40060/0 (socket says 172.21.15.153:40060) 2023-11-24T08:07:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716d078700 1 -- 172.21.15.153:0/396228382 learned_addr learned my addr 172.21.15.153:0/396228382 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716c877700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71680cafa0 0x7f71680cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716d879700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716814b000 0x7f716814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716d078700 1 -- 172.21.15.153:0/396228382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716814b000 msgr2=0x7f716814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716d078700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716814b000 0x7f716814b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716d078700 1 -- 172.21.15.153:0/396228382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71680cafa0 msgr2=0x7f71680cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716d078700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71680cafa0 0x7f71680cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716d078700 1 -- 172.21.15.153:0/396228382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716814b9c0 con 0x7f7154004d90 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716c877700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71680cafa0 0x7f71680cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716d078700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 0x7f71680c97b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7164011b00 tx=0x7f7164011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f715dffb700 1 -- 172.21.15.153:0/396228382 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400fa00 con 0x7f7154004d90 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f715dffb700 1 -- 172.21.15.153:0/396228382 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716400fb60 con 0x7f7154004d90 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.562+0000 7f716f2dc700 1 -- 172.21.15.153:0/396228382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71680cbbd0 con 0x7f7154004d90 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.563+0000 7f715dffb700 1 -- 172.21.15.153:0/396228382 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164014440 con 0x7f7154004d90 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.563+0000 7f716f2dc700 1 -- 172.21.15.153:0/396228382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71680cc190 con 0x7f7154004d90 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.564+0000 7f716f2dc700 1 -- 172.21.15.153:0/396228382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7168067f60 con 0x7f7154004d90 2023-11-24T08:07:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.564+0000 7f715dffb700 1 -- 172.21.15.153:0/396228382 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f71640145a0 con 0x7f7154004d90 2023-11-24T08:07:38.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.564+0000 7f715dffb700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f714c06b080 0x7f714c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.565+0000 7f715dffb700 1 -- 172.21.15.153:0/396228382 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f716408a110 con 0x7f7154004d90 2023-11-24T08:07:38.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.565+0000 7f716c877700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f714c06b080 0x7f714c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.565+0000 7f716c877700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f714c06b080 0x7f714c06d540 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7168158e40 tx=0x7f7158009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.569+0000 7f715dffb700 1 -- 172.21.15.153:0/396228382 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7164055000 con 0x7f7154004d90 2023-11-24T08:07:38.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.804+0000 7f716f2dc700 1 -- 172.21.15.153:0/396228382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71680ced10 con 0x7f7154004d90 2023-11-24T08:07:38.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.805+0000 7f715dffb700 1 -- 172.21.15.153:0/396228382 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f7164058620 con 0x7f7154004d90 2023-11-24T08:07:38.806 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:38.807 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3525215026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3525215026},{"type":"v1","addr":"172.21.15.153:6837","nonce":3525215026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5318,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/946995567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":946995567},{"type":"v1","addr":"172.21.15.164:6834","nonce":946995567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6075,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/3002476497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3002476497},{"type":"v1","addr":"172.21.15.153:6836","nonce":3002476497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:16.566591+0000","modified":"2023-11-24T08:07:19.587429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6090":{"gid":6090,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/3019873912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3019873912},{"type":"v1","addr":"172.21.15.164:6835","nonce":3019873912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 -- 172.21.15.153:0/396228382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f714c06b080 msgr2=0x7f714c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f714c06b080 0x7f714c06d540 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7168158e40 tx=0x7f7158009040 comp rx=0 tx=0).stop 2023-11-24T08:07:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 -- 172.21.15.153:0/396228382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 msgr2=0x7f71680c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 0x7f71680c97b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7164011b00 tx=0x7f7164011ec0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 -- 172.21.15.153:0/396228382 shutdown_connections 2023-11-24T08:07:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f716814b000 0x7f716814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f714c06b080 0x7f714c06d540 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154004d90 0x7f71680c97b0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 --2- 172.21.15.153:0/396228382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71680cafa0 0x7f71680cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 -- 172.21.15.153:0/396228382 >> 172.21.15.153:0/396228382 conn(0x7f716806b410 msgr2=0x7f71680d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 -- 172.21.15.153:0/396228382 shutdown_connections 2023-11-24T08:07:38.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.807+0000 7f716f2dc700 1 -- 172.21.15.153:0/396228382 wait complete. 2023-11-24T08:07:38.810 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 37 2023-11-24T08:07:38.821 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.940+0000 7f7cde0eb700 1 Processor -- start 2023-11-24T08:07:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.940+0000 7f7cde0eb700 1 -- start start 2023-11-24T08:07:38.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cde0eb700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7cd815f180 0x7f7cd80cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cde0eb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7cd80cfd40 0x7f7cd80b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cde0eb700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd80b4290 con 0x7f7cd813e000 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cde0eb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd813e570 con 0x7f7cd80cfd40 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cde0eb700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd80d05d0 con 0x7f7cd815f180 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cd7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7cd80cfd40 0x7f7cd80b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cd7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7cd80cfd40 0x7f7cd80b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40068/0 (socket says 172.21.15.153:40068) 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cd7fff700 1 -- 172.21.15.153:0/1163643969 learned_addr learned my addr 172.21.15.153:0/1163643969 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cd6ffd700 1 --2- 172.21.15.153:0/1163643969 >> v2:172.21.15.164:3300/0 conn(0x7f7cd815f180 0x7f7cd80cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cd7fff700 1 -- 172.21.15.153:0/1163643969 >> v2:172.21.15.164:3300/0 conn(0x7f7cd815f180 msgr2=0x7f7cd80cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cd7fff700 1 --2- 172.21.15.153:0/1163643969 >> v2:172.21.15.164:3300/0 conn(0x7f7cd815f180 0x7f7cd80cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cd7fff700 1 -- 172.21.15.153:0/1163643969 >> v1:172.21.15.164:6789/0 conn(0x7f7cd813e000 legacy=0x7f7cd815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cd7fff700 1 -- 172.21.15.153:0/1163643969 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd80d08b0 con 0x7f7cd80cfd40 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.941+0000 7f7cd7fff700 1 --2- 172.21.15.153:0/1163643969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cd80cfd40 0x7f7cd80b4720 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7cd815e9d0 tx=0x7f7cd000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cf251057d9ea62 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.942+0000 7f7cd67fc700 1 -- 172.21.15.153:0/1163643969 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0010070 con 0x7f7cd80cfd40 2023-11-24T08:07:38.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.942+0000 7f7cd67fc700 1 -- 172.21.15.153:0/1163643969 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd000dce0 con 0x7f7cd80cfd40 2023-11-24T08:07:38.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.942+0000 7f7cd67fc700 1 -- 172.21.15.153:0/1163643969 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd000b310 con 0x7f7cd80cfd40 2023-11-24T08:07:38.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.942+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1163643969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cd80cfd40 msgr2=0x7f7cd80b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.942+0000 7f7cde0eb700 1 --2- 172.21.15.153:0/1163643969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cd80cfd40 0x7f7cd80b4720 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7cd815e9d0 tx=0x7f7cd000d430 comp rx=0 tx=0).stop 2023-11-24T08:07:38.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.942+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1163643969 shutdown_connections 2023-11-24T08:07:38.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.942+0000 7f7cde0eb700 1 --2- 172.21.15.153:0/1163643969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cd80cfd40 0x7f7cd80b4720 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.942+0000 7f7cde0eb700 1 --2- 172.21.15.153:0/1163643969 >> v2:172.21.15.164:3300/0 conn(0x7f7cd815f180 0x7f7cd80cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.942+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1163643969 >> 172.21.15.153:0/1163643969 conn(0x7f7cd8072990 msgr2=0x7f7cd806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.942+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1163643969 shutdown_connections 2023-11-24T08:07:38.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.942+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1163643969 wait complete. 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.943+0000 7f7cde0eb700 1 Processor -- start 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.944+0000 7f7cde0eb700 1 -- start start 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.944+0000 7f7cde0eb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cd80cfd40 0x7f7cd815dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.944+0000 7f7cde0eb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cd813e000 0x7f7cd8151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.944+0000 7f7cde0eb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7cd815f180 0x7f7cd813ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.944+0000 7f7cde0eb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd81eff10 con 0x7f7cd813e000 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.944+0000 7f7cde0eb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd813f8a0 con 0x7f7cd80cfd40 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.944+0000 7f7cde0eb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd815d8a0 con 0x7f7cd815f180 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.944+0000 7f7cd6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cd813e000 0x7f7cd8151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.944+0000 7f7cd6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cd813e000 0x7f7cd8151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40076/0 (socket says 172.21.15.153:40076) 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.944+0000 7f7cd6ffd700 1 -- 172.21.15.153:0/1071290384 learned_addr learned my addr 172.21.15.153:0/1071290384 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7cd77fe700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cd80cfd40 0x7f7cd815dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7cd7fff700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7cd815f180 0x7f7cd813ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7cd6ffd700 1 -- 172.21.15.153:0/1071290384 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7cd815f180 msgr2=0x7f7cd813ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7cd6ffd700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7cd815f180 0x7f7cd813ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7cd6ffd700 1 -- 172.21.15.153:0/1071290384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cd80cfd40 msgr2=0x7f7cd815dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7cd6ffd700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cd80cfd40 0x7f7cd815dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7cd6ffd700 1 -- 172.21.15.153:0/1071290384 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd000bd40 con 0x7f7cd813e000 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7cd7fff700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7cd815f180 0x7f7cd813ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7cd6ffd700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cd813e000 0x7f7cd8151550 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800e870 tx=0x7f7cc800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7ccffff700 1 -- 172.21.15.153:0/1071290384 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8009590 con 0x7f7cd813e000 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7ccffff700 1 -- 172.21.15.153:0/1071290384 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc8013680 con 0x7f7cd813e000 2023-11-24T08:07:38.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1071290384 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd813f290 con 0x7f7cd813e000 2023-11-24T08:07:38.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7ccffff700 1 -- 172.21.15.153:0/1071290384 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80139f0 con 0x7f7cd813e000 2023-11-24T08:07:38.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.945+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1071290384 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd81418b0 con 0x7f7cd813e000 2023-11-24T08:07:38.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.946+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1071290384 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd8067f60 con 0x7f7cd813e000 2023-11-24T08:07:38.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.946+0000 7f7ccffff700 1 -- 172.21.15.153:0/1071290384 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7cc8013b50 con 0x7f7cd813e000 2023-11-24T08:07:38.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.947+0000 7f7ccffff700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7cb806b080 0x7f7cb806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.947+0000 7f7ccffff700 1 -- 172.21.15.153:0/1071290384 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cc8089b40 con 0x7f7cd813e000 2023-11-24T08:07:38.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.947+0000 7f7cd77fe700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7cb806b080 0x7f7cb806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.947+0000 7f7cd77fe700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7cb806b080 0x7f7cb806d540 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0007fd0 tx=0x7f7cc0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:38.951+0000 7f7ccffff700 1 -- 172.21.15.153:0/1071290384 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7cc8054980 con 0x7f7cd813e000 2023-11-24T08:07:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.189+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1071290384 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cd813f5f0 con 0x7f7cd813e000 2023-11-24T08:07:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.189+0000 7f7ccffff700 1 -- 172.21.15.153:0/1071290384 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f7cc8057fa0 con 0x7f7cd813e000 2023-11-24T08:07:39.191 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:39.191 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3525215026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3525215026},{"type":"v1","addr":"172.21.15.153:6837","nonce":3525215026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5318,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/946995567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":946995567},{"type":"v1","addr":"172.21.15.164:6834","nonce":946995567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6075,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/3002476497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3002476497},{"type":"v1","addr":"172.21.15.153:6836","nonce":3002476497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:16.566591+0000","modified":"2023-11-24T08:07:19.587429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6090":{"gid":6090,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/3019873912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3019873912},{"type":"v1","addr":"172.21.15.164:6835","nonce":3019873912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:39.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1071290384 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7cb806b080 msgr2=0x7f7cb806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7cb806b080 0x7f7cb806d540 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0007fd0 tx=0x7f7cc0009040 comp rx=0 tx=0).stop 2023-11-24T08:07:39.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1071290384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cd813e000 msgr2=0x7f7cd8151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cd813e000 0x7f7cd8151550 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800e870 tx=0x7f7cc800eb80 comp rx=0 tx=0).stop 2023-11-24T08:07:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1071290384 shutdown_connections 2023-11-24T08:07:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7cd815f180 0x7f7cd813ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cd80cfd40 0x7f7cd815dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7cb806b080 0x7f7cb806d540 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 --2- 172.21.15.153:0/1071290384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cd813e000 0x7f7cd8151550 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1071290384 >> 172.21.15.153:0/1071290384 conn(0x7f7cd8072990 msgr2=0x7f7cd8073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1071290384 shutdown_connections 2023-11-24T08:07:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.191+0000 7f7cde0eb700 1 -- 172.21.15.153:0/1071290384 wait complete. 2023-11-24T08:07:39.195 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 37 2023-11-24T08:07:39.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.325+0000 7fc7fdfbb700 1 Processor -- start 2023-11-24T08:07:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.325+0000 7fc7fdfbb700 1 -- start start 2023-11-24T08:07:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7fdfbb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7f81446a0 0x7fc7f80b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7fdfbb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7f80adf00 0x7fc7f806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7fdfbb700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc7f806c540 0x7fc7f806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7fdfbb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f8144a80 con 0x7fc7f81446a0 2023-11-24T08:07:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7fdfbb700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f806c9b0 con 0x7fc7f806c540 2023-11-24T08:07:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7fdfbb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80af950 con 0x7fc7f80adf00 2023-11-24T08:07:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7f77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7f81446a0 0x7fc7f80b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7f77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7f81446a0 0x7fc7f80b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40082/0 (socket says 172.21.15.153:40082) 2023-11-24T08:07:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7f77fe700 1 -- 172.21.15.153:0/2640802573 learned_addr learned my addr 172.21.15.153:0/2640802573 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7f6ffd700 1 --2- 172.21.15.153:0/2640802573 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7f80adf00 0x7fc7f806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7f7fff700 1 --2- 172.21.15.153:0/2640802573 >> v2:172.21.15.164:3300/0 conn(0x7fc7f806c540 0x7fc7f806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7f77fe700 1 -- 172.21.15.153:0/2640802573 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7f80adf00 msgr2=0x7fc7f806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7f77fe700 1 --2- 172.21.15.153:0/2640802573 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7f80adf00 0x7fc7f806c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7f77fe700 1 -- 172.21.15.153:0/2640802573 >> v2:172.21.15.164:3300/0 conn(0x7fc7f806c540 msgr2=0x7fc7f806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7f77fe700 1 --2- 172.21.15.153:0/2640802573 >> v2:172.21.15.164:3300/0 conn(0x7fc7f806c540 0x7fc7f806da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7f77fe700 1 -- 172.21.15.153:0/2640802573 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80afc30 con 0x7fc7f81446a0 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.326+0000 7fc7f7fff700 1 --2- 172.21.15.153:0/2640802573 >> v2:172.21.15.164:3300/0 conn(0x7fc7f806c540 0x7fc7f806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7f77fe700 1 --2- 172.21.15.153:0/2640802573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f81446a0 0x7fc7f80b5ae0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc7f806f530 tx=0x7fc7e000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e3e0bdf9e0ec86 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7f67fc700 1 -- 172.21.15.153:0/2640802573 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e000dd10 con 0x7fc7f81446a0 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7f67fc700 1 -- 172.21.15.153:0/2640802573 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e000de70 con 0x7fc7f81446a0 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7f67fc700 1 -- 172.21.15.153:0/2640802573 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0010670 con 0x7fc7f81446a0 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/2640802573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f81446a0 msgr2=0x7fc7f80b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7fdfbb700 1 --2- 172.21.15.153:0/2640802573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f81446a0 0x7fc7f80b5ae0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc7f806f530 tx=0x7fc7e000bea0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/2640802573 shutdown_connections 2023-11-24T08:07:39.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7fdfbb700 1 --2- 172.21.15.153:0/2640802573 >> v2:172.21.15.164:3300/0 conn(0x7fc7f806c540 0x7fc7f806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7fdfbb700 1 --2- 172.21.15.153:0/2640802573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f81446a0 0x7fc7f80b5ae0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7fdfbb700 1 --2- 172.21.15.153:0/2640802573 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7f80adf00 0x7fc7f806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/2640802573 >> 172.21.15.153:0/2640802573 conn(0x7fc7f8071b90 msgr2=0x7fc7f8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/2640802573 shutdown_connections 2023-11-24T08:07:39.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.327+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/2640802573 wait complete. 2023-11-24T08:07:39.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.329+0000 7fc7fdfbb700 1 Processor -- start 2023-11-24T08:07:39.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.329+0000 7fc7fdfbb700 1 -- start start 2023-11-24T08:07:39.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7fdfbb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f806c540 0x7fc7f81f79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7fdfbb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7f80adf00 0x7fc7f809d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7fdfbb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7f81446a0 0x7fc7f8158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7fdfbb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80cfa40 con 0x7fc7f806c540 2023-11-24T08:07:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7fdfbb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80cf760 con 0x7fc7f81446a0 2023-11-24T08:07:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7fdfbb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f809cb00 con 0x7fc7f80adf00 2023-11-24T08:07:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7f77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f806c540 0x7fc7f81f79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7f77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f806c540 0x7fc7f81f79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40088/0 (socket says 172.21.15.153:40088) 2023-11-24T08:07:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7f77fe700 1 -- 172.21.15.153:0/1103650073 learned_addr learned my addr 172.21.15.153:0/1103650073 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7f7fff700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7f81446a0 0x7fc7f8158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7f6ffd700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7f80adf00 0x7fc7f809d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7f77fe700 1 -- 172.21.15.153:0/1103650073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7f80adf00 msgr2=0x7fc7f809d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7f77fe700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7f80adf00 0x7fc7f809d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7f77fe700 1 -- 172.21.15.153:0/1103650073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7f81446a0 msgr2=0x7fc7f8158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7f77fe700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7f81446a0 0x7fc7f8158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.330+0000 7fc7f77fe700 1 -- 172.21.15.153:0/1103650073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e000b7f0 con 0x7fc7f806c540 2023-11-24T08:07:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.331+0000 7fc7f77fe700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f806c540 0x7fc7f81f79c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0000c00 tx=0x7fc7e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.331+0000 7fc7effff700 1 -- 172.21.15.153:0/1103650073 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0003d20 con 0x7fc7f806c540 2023-11-24T08:07:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.331+0000 7fc7effff700 1 -- 172.21.15.153:0/1103650073 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e0010470 con 0x7fc7f806c540 2023-11-24T08:07:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.331+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/1103650073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f809cde0 con 0x7fc7f806c540 2023-11-24T08:07:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.331+0000 7fc7effff700 1 -- 172.21.15.153:0/1103650073 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0003ea0 con 0x7fc7f806c540 2023-11-24T08:07:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.331+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/1103650073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f809db20 con 0x7fc7f806c540 2023-11-24T08:07:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.332+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/1103650073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f80753f0 con 0x7fc7f806c540 2023-11-24T08:07:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.332+0000 7fc7effff700 1 -- 172.21.15.153:0/1103650073 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc7e0019400 con 0x7fc7f806c540 2023-11-24T08:07:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.332+0000 7fc7effff700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc7d806b080 0x7fc7d806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.333+0000 7fc7effff700 1 -- 172.21.15.153:0/1103650073 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7e008aec0 con 0x7fc7f806c540 2023-11-24T08:07:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.333+0000 7fc7f6ffd700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc7d806b080 0x7fc7d806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.333+0000 7fc7f6ffd700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc7d806b080 0x7fc7d806d540 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc7f81f7f00 tx=0x7fc7e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.337+0000 7fc7effff700 1 -- 172.21.15.153:0/1103650073 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7e0055bd0 con 0x7fc7f806c540 2023-11-24T08:07:39.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.529+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/1103650073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7f809dcb0 con 0x7fc7f806c540 2023-11-24T08:07:39.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.530+0000 7fc7effff700 1 -- 172.21.15.153:0/1103650073 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16601 (secure 0 0 0) 0x7fc7f809dcb0 con 0x7fc7f806c540 2023-11-24T08:07:39.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:39.532 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":56,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:07:18.180030+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:14.800746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:15.529815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/1103650073 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc7d806b080 msgr2=0x7fc7d806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc7d806b080 0x7fc7d806d540 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc7f81f7f00 tx=0x7fc7e8008040 comp rx=0 tx=0).stop 2023-11-24T08:07:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/1103650073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f806c540 msgr2=0x7fc7f81f79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f806c540 0x7fc7f81f79c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0000c00 tx=0x7fc7e0004750 comp rx=0 tx=0).stop 2023-11-24T08:07:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/1103650073 shutdown_connections 2023-11-24T08:07:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7f81446a0 0x7fc7f8158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc7d806b080 0x7fc7d806d540 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f806c540 0x7fc7f81f79c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 --2- 172.21.15.153:0/1103650073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7f80adf00 0x7fc7f809d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/1103650073 >> 172.21.15.153:0/1103650073 conn(0x7fc7f8071b90 msgr2=0x7fc7f815d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/1103650073 shutdown_connections 2023-11-24T08:07:39.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.533+0000 7fc7fdfbb700 1 -- 172.21.15.153:0/1103650073 wait complete. 2023-11-24T08:07:39.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:07:39.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.667+0000 7f27e6f6c700 1 Processor -- start 2023-11-24T08:07:39.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.667+0000 7f27e6f6c700 1 -- start start 2023-11-24T08:07:39.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e6f6c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f27e015bd60 0x7f27e00d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e6f6c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f27e00cf2b0 0x7f27e00c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e6f6c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e00cc780 con 0x7f27e015c140 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e6f6c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e00cc9b0 con 0x7f27e00cf2b0 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e6f6c700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e00ccc90 con 0x7f27e015bd60 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27dffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f27e015c140 0x7f27e00cda50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46200/0 (socket says 172.21.15.153:46200) 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27dffff700 1 -- 172.21.15.153:0/3485768205 learned_addr learned my addr 172.21.15.153:0/3485768205 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e5509700 1 --2- 172.21.15.153:0/3485768205 >> v2:172.21.15.153:3300/0 conn(0x7f27e00cf2b0 0x7f27e00c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e4d08700 1 --2- 172.21.15.153:0/3485768205 >> v2:172.21.15.164:3300/0 conn(0x7f27e015bd60 0x7f27e00d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27df7fe700 1 -- 172.21.15.153:0/3485768205 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881159396 0 0) 0x7f27e00cc780 con 0x7f27e015c140 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27df7fe700 1 -- 172.21.15.153:0/3485768205 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d00035b0 con 0x7f27e015c140 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e5509700 1 -- 172.21.15.153:0/3485768205 >> v2:172.21.15.164:3300/0 conn(0x7f27e015bd60 msgr2=0x7f27e00d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e5509700 1 --2- 172.21.15.153:0/3485768205 >> v2:172.21.15.164:3300/0 conn(0x7f27e015bd60 0x7f27e00d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e5509700 1 -- 172.21.15.153:0/3485768205 >> v1:172.21.15.153:6789/0 conn(0x7f27e015c140 legacy=0x7f27e00cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e5509700 1 -- 172.21.15.153:0/3485768205 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e00ccf70 con 0x7f27e00cf2b0 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.668+0000 7f27e5509700 1 --2- 172.21.15.153:0/3485768205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e00cf2b0 0x7f27e00c57c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f27e00c8cf0 tx=0x7f27d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506ed48ff6d07aba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.669+0000 7f27df7fe700 1 -- 172.21.15.153:0/3485768205 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d800e070 con 0x7f27e00cf2b0 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.669+0000 7f27df7fe700 1 -- 172.21.15.153:0/3485768205 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d800bb20 con 0x7f27e00cf2b0 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.669+0000 7f27df7fe700 1 -- 172.21.15.153:0/3485768205 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d800be90 con 0x7f27e00cf2b0 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.669+0000 7f27e6f6c700 1 -- 172.21.15.153:0/3485768205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e00cf2b0 msgr2=0x7f27e00c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.669+0000 7f27e6f6c700 1 --2- 172.21.15.153:0/3485768205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e00cf2b0 0x7f27e00c57c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f27e00c8cf0 tx=0x7f27d800b330 comp rx=0 tx=0).stop 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.669+0000 7f27e6f6c700 1 -- 172.21.15.153:0/3485768205 shutdown_connections 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.669+0000 7f27e6f6c700 1 --2- 172.21.15.153:0/3485768205 >> v2:172.21.15.164:3300/0 conn(0x7f27e015bd60 0x7f27e00d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.669+0000 7f27e6f6c700 1 --2- 172.21.15.153:0/3485768205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e00cf2b0 0x7f27e00c57c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.669+0000 7f27e6f6c700 1 -- 172.21.15.153:0/3485768205 >> 172.21.15.153:0/3485768205 conn(0x7f27e0073130 msgr2=0x7f27e009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.669+0000 7f27e6f6c700 1 -- 172.21.15.153:0/3485768205 shutdown_connections 2023-11-24T08:07:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.669+0000 7f27e6f6c700 1 -- 172.21.15.153:0/3485768205 wait complete. 2023-11-24T08:07:39.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.670+0000 7f27e6f6c700 1 Processor -- start 2023-11-24T08:07:39.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.670+0000 7f27e6f6c700 1 -- start start 2023-11-24T08:07:39.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.671+0000 7f27e6f6c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e00cf2b0 0x7f27e0151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.671+0000 7f27e6f6c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27e015bd60 0x7f27e0152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.671+0000 7f27e6f6c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27e015c140 0x7f27e006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.671+0000 7f27e6f6c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e0152890 con 0x7f27e00cf2b0 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.671+0000 7f27e6f6c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00b28e0 con 0x7f27e015c140 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.671+0000 7f27e6f6c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00b2600 con 0x7f27e015bd60 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.671+0000 7f27e4d08700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e00cf2b0 0x7f27e0151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.671+0000 7f27e4d08700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e00cf2b0 0x7f27e0151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40102/0 (socket says 172.21.15.153:40102) 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.671+0000 7f27e4d08700 1 -- 172.21.15.153:0/2940789165 learned_addr learned my addr 172.21.15.153:0/2940789165 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27e5509700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27e015c140 0x7f27e006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27dffff700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27e015bd60 0x7f27e0152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27e4d08700 1 -- 172.21.15.153:0/2940789165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27e015bd60 msgr2=0x7f27e0152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27e4d08700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27e015bd60 0x7f27e0152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27e4d08700 1 -- 172.21.15.153:0/2940789165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27e015c140 msgr2=0x7f27e006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27e4d08700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27e015c140 0x7f27e006aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27e4d08700 1 -- 172.21.15.153:0/2940789165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d8009a70 con 0x7f27e00cf2b0 2023-11-24T08:07:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27dffff700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27e015bd60 0x7f27e0152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27e4d08700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e00cf2b0 0x7f27e0151e10 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f27d400e9b0 tx=0x7f27d400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27dd7fa700 1 -- 172.21.15.153:0/2940789165 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4009710 con 0x7f27e00cf2b0 2023-11-24T08:07:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27dd7fa700 1 -- 172.21.15.153:0/2940789165 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d400c850 con 0x7f27e00cf2b0 2023-11-24T08:07:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27dd7fa700 1 -- 172.21.15.153:0/2940789165 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d400cbc0 con 0x7f27e00cf2b0 2023-11-24T08:07:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27e6f6c700 1 -- 172.21.15.153:0/2940789165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e00c9ec0 con 0x7f27e00cf2b0 2023-11-24T08:07:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.672+0000 7f27e6f6c700 1 -- 172.21.15.153:0/2940789165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e00ca480 con 0x7f27e00cf2b0 2023-11-24T08:07:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.673+0000 7f27e6f6c700 1 -- 172.21.15.153:0/2940789165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e00ca7f0 con 0x7f27e00cf2b0 2023-11-24T08:07:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.673+0000 7f27dd7fa700 1 -- 172.21.15.153:0/2940789165 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f27d400cd20 con 0x7f27e00cf2b0 2023-11-24T08:07:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.674+0000 7f27dd7fa700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c406b080 0x7f27c406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.674+0000 7f27dd7fa700 1 -- 172.21.15.153:0/2940789165 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27d4089960 con 0x7f27e00cf2b0 2023-11-24T08:07:39.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.674+0000 7f27dffff700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c406b080 0x7f27c406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.674+0000 7f27dffff700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c406b080 0x7f27c406d540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f27e01f7260 tx=0x7f27cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.678+0000 7f27dd7fa700 1 -- 172.21.15.153:0/2940789165 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f27d4054820 con 0x7f27e00cf2b0 2023-11-24T08:07:39.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.911+0000 7f27e6f6c700 1 -- 172.21.15.153:0/2940789165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f27e00ce0e0 con 0x7f27e00cf2b0 2023-11-24T08:07:39.913 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-11-24T08:07:39.912+0000 7f3f0fc90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:07:39.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.913+0000 7f27dd7fa700 1 -- 172.21.15.153:0/2940789165 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f27d4021090 con 0x7f27e00cf2b0 2023-11-24T08:07:39.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 -- 172.21.15.153:0/2940789165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c406b080 msgr2=0x7f27c406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c406b080 0x7f27c406d540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f27e01f7260 tx=0x7f27cc009040 comp rx=0 tx=0).stop 2023-11-24T08:07:39.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 -- 172.21.15.153:0/2940789165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e00cf2b0 msgr2=0x7f27e0151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e00cf2b0 0x7f27e0151e10 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f27d400e9b0 tx=0x7f27d400ed70 comp rx=0 tx=0).stop 2023-11-24T08:07:39.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 -- 172.21.15.153:0/2940789165 shutdown_connections 2023-11-24T08:07:39.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27e015c140 0x7f27e006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f27c406b080 0x7f27c406d540 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27e00cf2b0 0x7f27e0151e10 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 --2- 172.21.15.153:0/2940789165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27e015bd60 0x7f27e0152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 -- 172.21.15.153:0/2940789165 >> 172.21.15.153:0/2940789165 conn(0x7f27e0073130 msgr2=0x7f27e00c7180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 -- 172.21.15.153:0/2940789165 shutdown_connections 2023-11-24T08:07:39.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:39.916+0000 7f27e6f6c700 1 -- 172.21.15.153:0/2940789165 wait complete. 2023-11-24T08:07:39.919 INFO:tasks.ceph.mds.d.smithi164.stderr: -4475> 2023-11-24T08:07:12.069+0000 7fbe4fa3e700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-24T08:07:39.919 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:07:39.920 INFO:tasks.ceph.mds.d.smithi164.stderr: -3360> 2023-11-24T08:07:18.988+0000 7fbe49a32700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:07:39.930 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:07:39.950 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-11-24T08:07:40.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.051+0000 7fbddcee3700 1 Processor -- start 2023-11-24T08:07:40.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.051+0000 7fbddcee3700 1 -- start start 2023-11-24T08:07:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.052+0000 7fbddcee3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbdd815aef0 0x7fbdd80b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbddcee3700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbdd80cfab0 0x7fbdd80cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbddcee3700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd80622a0 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbddcee3700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd8062540 con 0x7fbdd815aef0 2023-11-24T08:07:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbddcee3700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd80c51a0 con 0x7fbdd80cfab0 2023-11-24T08:07:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbdd815aef0 0x7fbdd80b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd6d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbdd80c5aa0 0x7fbdd80ce2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46218/0 (socket says 172.21.15.153:46218) 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd6d9d700 1 -- 172.21.15.153:0/2960353822 learned_addr learned my addr 172.21.15.153:0/2960353822 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd5d9b700 1 --2- 172.21.15.153:0/2960353822 >> v2:172.21.15.164:3300/0 conn(0x7fbdd80cfab0 0x7fbdd80cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd659c700 1 -- 172.21.15.153:0/2960353822 >> v2:172.21.15.164:3300/0 conn(0x7fbdd80cfab0 msgr2=0x7fbdd80cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd659c700 1 --2- 172.21.15.153:0/2960353822 >> v2:172.21.15.164:3300/0 conn(0x7fbdd80cfab0 0x7fbdd80cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd659c700 1 -- 172.21.15.153:0/2960353822 >> v1:172.21.15.153:6789/0 conn(0x7fbdd80c5aa0 legacy=0x7fbdd80ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd659c700 1 -- 172.21.15.153:0/2960353822 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80c5480 con 0x7fbdd815aef0 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd559a700 1 -- 172.21.15.153:0/2960353822 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046869960 0 0) 0x7fbdd80622a0 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd659c700 1 --2- 172.21.15.153:0/2960353822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd815aef0 0x7fbdd80b15e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8070450 tx=0x7fbdcc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd6f337b29a65b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd559a700 1 -- 172.21.15.153:0/2960353822 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc011830 con 0x7fbdd815aef0 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd559a700 1 -- 172.21.15.153:0/2960353822 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc011990 con 0x7fbdd815aef0 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.053+0000 7fbdd559a700 1 -- 172.21.15.153:0/2960353822 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc011d20 con 0x7fbdd815aef0 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.054+0000 7fbddcee3700 1 -- 172.21.15.153:0/2960353822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd815aef0 msgr2=0x7fbdd80b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.054+0000 7fbddcee3700 1 --2- 172.21.15.153:0/2960353822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd815aef0 0x7fbdd80b15e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8070450 tx=0x7fbdcc009b20 comp rx=0 tx=0).stop 2023-11-24T08:07:40.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.054+0000 7fbddcee3700 1 -- 172.21.15.153:0/2960353822 shutdown_connections 2023-11-24T08:07:40.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.054+0000 7fbddcee3700 1 --2- 172.21.15.153:0/2960353822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd815aef0 0x7fbdd80b15e0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.054+0000 7fbddcee3700 1 --2- 172.21.15.153:0/2960353822 >> v2:172.21.15.164:3300/0 conn(0x7fbdd80cfab0 0x7fbdd80cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.054+0000 7fbddcee3700 1 -- 172.21.15.153:0/2960353822 >> 172.21.15.153:0/2960353822 conn(0x7fbdd80b1e90 msgr2=0x7fbdd80b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:40.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.054+0000 7fbddcee3700 1 -- 172.21.15.153:0/2960353822 shutdown_connections 2023-11-24T08:07:40.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.054+0000 7fbddcee3700 1 -- 172.21.15.153:0/2960353822 wait complete. 2023-11-24T08:07:40.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.055+0000 7fbddcee3700 1 Processor -- start 2023-11-24T08:07:40.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.055+0000 7fbddcee3700 1 -- start start 2023-11-24T08:07:40.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.056+0000 7fbddcee3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd80c5aa0 0x7fbdd8147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.056+0000 7fbddcee3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdd80cfab0 0x7fbdd81685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.056+0000 7fbddcee3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdd815aef0 0x7fbdd80b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.056+0000 7fbddcee3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd81675c0 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.056+0000 7fbddcee3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80b5e90 con 0x7fbdd80cfab0 2023-11-24T08:07:40.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.056+0000 7fbddcee3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8147860 con 0x7fbdd815aef0 2023-11-24T08:07:40.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.056+0000 7fbdd659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd80c5aa0 0x7fbdd8147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.056+0000 7fbdd659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd80c5aa0 0x7fbdd8147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40116/0 (socket says 172.21.15.153:40116) 2023-11-24T08:07:40.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.056+0000 7fbdd659c700 1 -- 172.21.15.153:0/2516742395 learned_addr learned my addr 172.21.15.153:0/2516742395 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:40.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.056+0000 7fbdd5d9b700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdd80cfab0 0x7fbdd81685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.056+0000 7fbdd6d9d700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdd815aef0 0x7fbdd80b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbdd659c700 1 -- 172.21.15.153:0/2516742395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdd815aef0 msgr2=0x7fbdd80b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbdd659c700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdd815aef0 0x7fbdd80b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbdd659c700 1 -- 172.21.15.153:0/2516742395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdd80cfab0 msgr2=0x7fbdd81685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbdd659c700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdd80cfab0 0x7fbdd81685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbdd659c700 1 -- 172.21.15.153:0/2516742395 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc0094a0 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbdd5d9b700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdd80cfab0 0x7fbdd81685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:40.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbdd6d9d700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdd815aef0 0x7fbdd80b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:40.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbdd659c700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd80c5aa0 0x7fbdd8147320 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0090b0 tx=0x7fbdcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbdc6ffd700 1 -- 172.21.15.153:0/2516742395 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0038a0 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbdc6ffd700 1 -- 172.21.15.153:0/2516742395 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc01e070 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbddcee3700 1 -- 172.21.15.153:0/2516742395 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd8167810 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbdc6ffd700 1 -- 172.21.15.153:0/2516742395 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc003c20 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.057+0000 7fbddcee3700 1 -- 172.21.15.153:0/2516742395 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd8167dd0 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.058+0000 7fbddcee3700 1 -- 172.21.15.153:0/2516742395 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd8068fb0 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.058+0000 7fbdc6ffd700 1 -- 172.21.15.153:0/2516742395 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbdcc01a420 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.059+0000 7fbdc6ffd700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbdb806b080 0x7fbdb806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.059+0000 7fbdc6ffd700 1 -- 172.21.15.153:0/2516742395 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fbdcc08aa90 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.059+0000 7fbdd5d9b700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbdb806b080 0x7fbdb806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.059+0000 7fbdd5d9b700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbdb806b080 0x7fbdb806d540 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80cf350 tx=0x7fbdc8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.063+0000 7fbdc6ffd700 1 -- 172.21.15.153:0/2516742395 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbdcc0557c0 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.302+0000 7fbddcee3700 1 -- 172.21.15.153:0/2516742395 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbdd80d0020 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.918+0000 7fbdc6ffd700 1 -- 172.21.15.153:0/2516742395 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbdcc0200a0 con 0x7fbdd80c5aa0 2023-11-24T08:07:40.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.920+0000 7fbddcee3700 1 -- 172.21.15.153:0/2516742395 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbdb806b080 msgr2=0x7fbdb806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.920+0000 7fbddcee3700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbdb806b080 0x7fbdb806d540 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80cf350 tx=0x7fbdc8008040 comp rx=0 tx=0).stop 2023-11-24T08:07:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.920+0000 7fbddcee3700 1 -- 172.21.15.153:0/2516742395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd80c5aa0 msgr2=0x7fbdd8147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.920+0000 7fbddcee3700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd80c5aa0 0x7fbdd8147320 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0090b0 tx=0x7fbdcc004750 comp rx=0 tx=0).stop 2023-11-24T08:07:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.921+0000 7fbddcee3700 1 -- 172.21.15.153:0/2516742395 shutdown_connections 2023-11-24T08:07:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.921+0000 7fbddcee3700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdd815aef0 0x7fbdd80b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.921+0000 7fbddcee3700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbdb806b080 0x7fbdb806d540 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.921+0000 7fbddcee3700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd80c5aa0 0x7fbdd8147320 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.921+0000 7fbddcee3700 1 --2- 172.21.15.153:0/2516742395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdd80cfab0 0x7fbdd81685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.921+0000 7fbddcee3700 1 -- 172.21.15.153:0/2516742395 >> 172.21.15.153:0/2516742395 conn(0x7fbdd80b1e90 msgr2=0x7fbdd8159b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.921+0000 7fbddcee3700 1 -- 172.21.15.153:0/2516742395 shutdown_connections 2023-11-24T08:07:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:40.921+0000 7fbddcee3700 1 -- 172.21.15.153:0/2516742395 wait complete. 2023-11-24T08:07:40.935 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:07:41.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.060+0000 7efe65768700 1 Processor -- start 2023-11-24T08:07:41.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.060+0000 7efe65768700 1 -- start start 2023-11-24T08:07:41.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.060+0000 7efe65768700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe600cf110 0x7efe600714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.060+0000 7efe65768700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efe600b3dd0 0x7efe6006d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.060+0000 7efe65768700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe600b3940 con 0x7efe6015def0 2023-11-24T08:07:41.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.060+0000 7efe65768700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe600cf8d0 con 0x7efe600cf110 2023-11-24T08:07:41.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.060+0000 7efe65768700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe600cf5f0 con 0x7efe600b3dd0 2023-11-24T08:07:41.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.060+0000 7efe5e7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe600cf110 0x7efe600714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.060+0000 7efe5effd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efe6015def0 0x7efe6015e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46228/0 (socket says 172.21.15.153:46228) 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5effd700 1 -- 172.21.15.153:0/4249596082 learned_addr learned my addr 172.21.15.153:0/4249596082 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5e7fc700 1 -- 172.21.15.153:0/4249596082 >> v2:172.21.15.164:3300/0 conn(0x7efe600b3dd0 msgr2=0x7efe6006d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5f7fe700 1 --2- 172.21.15.153:0/4249596082 >> v2:172.21.15.164:3300/0 conn(0x7efe600b3dd0 0x7efe6006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5dffb700 1 -- 172.21.15.153:0/4249596082 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077029828 0 0) 0x7efe600b3940 con 0x7efe6015def0 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5e7fc700 1 --2- 172.21.15.153:0/4249596082 >> v2:172.21.15.164:3300/0 conn(0x7efe600b3dd0 0x7efe6006d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5e7fc700 1 -- 172.21.15.153:0/4249596082 >> v1:172.21.15.153:6789/0 conn(0x7efe6015def0 legacy=0x7efe6015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5e7fc700 1 -- 172.21.15.153:0/4249596082 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe600b32f0 con 0x7efe600cf110 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5f7fe700 1 --2- 172.21.15.153:0/4249596082 >> v2:172.21.15.164:3300/0 conn(0x7efe600b3dd0 0x7efe6006d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5e7fc700 1 --2- 172.21.15.153:0/4249596082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe600cf110 0x7efe600714d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efe600cede0 tx=0x7efe50009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6870517dabe27a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5dffb700 1 -- 172.21.15.153:0/4249596082 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50011830 con 0x7efe600cf110 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5dffb700 1 -- 172.21.15.153:0/4249596082 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe50011990 con 0x7efe600cf110 2023-11-24T08:07:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.061+0000 7efe5dffb700 1 -- 172.21.15.153:0/4249596082 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50011d20 con 0x7efe600cf110 2023-11-24T08:07:41.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.062+0000 7efe65768700 1 -- 172.21.15.153:0/4249596082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe600cf110 msgr2=0x7efe600714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.062+0000 7efe65768700 1 --2- 172.21.15.153:0/4249596082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe600cf110 0x7efe600714d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efe600cede0 tx=0x7efe50009b20 comp rx=0 tx=0).stop 2023-11-24T08:07:41.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.062+0000 7efe65768700 1 -- 172.21.15.153:0/4249596082 shutdown_connections 2023-11-24T08:07:41.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.062+0000 7efe65768700 1 --2- 172.21.15.153:0/4249596082 >> v2:172.21.15.164:3300/0 conn(0x7efe600b3dd0 0x7efe6006d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.062+0000 7efe65768700 1 --2- 172.21.15.153:0/4249596082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe600cf110 0x7efe600714d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.062+0000 7efe65768700 1 -- 172.21.15.153:0/4249596082 >> 172.21.15.153:0/4249596082 conn(0x7efe600b1740 msgr2=0x7efe600b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:41.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.062+0000 7efe65768700 1 -- 172.21.15.153:0/4249596082 shutdown_connections 2023-11-24T08:07:41.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.062+0000 7efe65768700 1 -- 172.21.15.153:0/4249596082 wait complete. 2023-11-24T08:07:41.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.063+0000 7efe65768700 1 Processor -- start 2023-11-24T08:07:41.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.063+0000 7efe65768700 1 -- start start 2023-11-24T08:07:41.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe65768700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe600b3dd0 0x7efe6006e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe65768700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe600cf110 0x7efe600cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe65768700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe6015def0 0x7efe60140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe65768700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe601417c0 con 0x7efe6015def0 2023-11-24T08:07:41.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe65768700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe60141280 con 0x7efe600cf110 2023-11-24T08:07:41.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe65768700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6006d820 con 0x7efe600b3dd0 2023-11-24T08:07:41.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe6015def0 0x7efe60140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe6015def0 0x7efe60140d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40134/0 (socket says 172.21.15.153:40134) 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5f7fe700 1 -- 172.21.15.153:0/3063819858 learned_addr learned my addr 172.21.15.153:0/3063819858 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5e7fc700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe600cf110 0x7efe600cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5f7fe700 1 -- 172.21.15.153:0/3063819858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe600b3dd0 msgr2=0x7efe6006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5effd700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe600b3dd0 0x7efe6006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5f7fe700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe600b3dd0 0x7efe6006e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5f7fe700 1 -- 172.21.15.153:0/3063819858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe600cf110 msgr2=0x7efe600cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5f7fe700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe600cf110 0x7efe600cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5f7fe700 1 -- 172.21.15.153:0/3063819858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe500094a0 con 0x7efe6015def0 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5e7fc700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe600cf110 0x7efe600cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.064+0000 7efe5f7fe700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe6015def0 0x7efe60140d40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7efe5800cf20 tx=0x7efe5800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.065+0000 7efe477fe700 1 -- 172.21.15.153:0/3063819858 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5800ae80 con 0x7efe6015def0 2023-11-24T08:07:41.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.065+0000 7efe477fe700 1 -- 172.21.15.153:0/3063819858 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58015440 con 0x7efe6015def0 2023-11-24T08:07:41.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.065+0000 7efe65768700 1 -- 172.21.15.153:0/3063819858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6006e7a0 con 0x7efe6015def0 2023-11-24T08:07:41.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.065+0000 7efe477fe700 1 -- 172.21.15.153:0/3063819858 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580157d0 con 0x7efe6015def0 2023-11-24T08:07:41.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.065+0000 7efe65768700 1 -- 172.21.15.153:0/3063819858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6006cd40 con 0x7efe6015def0 2023-11-24T08:07:41.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.066+0000 7efe65768700 1 -- 172.21.15.153:0/3063819858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe60068b00 con 0x7efe6015def0 2023-11-24T08:07:41.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.066+0000 7efe477fe700 1 -- 172.21.15.153:0/3063819858 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7efe5800d430 con 0x7efe6015def0 2023-11-24T08:07:41.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.066+0000 7efe477fe700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe4c06b080 0x7efe4c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.067+0000 7efe5effd700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe4c06b080 0x7efe4c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.067+0000 7efe477fe700 1 -- 172.21.15.153:0/3063819858 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efe58089ff0 con 0x7efe6015def0 2023-11-24T08:07:41.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.067+0000 7efe5effd700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe4c06b080 0x7efe4c06d540 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7efe54000f60 tx=0x7efe54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.071+0000 7efe477fe700 1 -- 172.21.15.153:0/3063819858 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe580bce90 con 0x7efe6015def0 2023-11-24T08:07:41.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:41.269+0000 7efe65768700 1 -- 172.21.15.153:0/3063819858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efe6006e930 con 0x7efe6015def0 2023-11-24T08:07:42.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.271+0000 7efe477fe700 1 -- 172.21.15.153:0/3063819858 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7efe5801a020 con 0x7efe6015def0 2023-11-24T08:07:42.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 -- 172.21.15.153:0/3063819858 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe4c06b080 msgr2=0x7efe4c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe4c06b080 0x7efe4c06d540 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7efe54000f60 tx=0x7efe54009040 comp rx=0 tx=0).stop 2023-11-24T08:07:42.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 -- 172.21.15.153:0/3063819858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe6015def0 msgr2=0x7efe60140d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe6015def0 0x7efe60140d40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7efe5800cf20 tx=0x7efe5800a340 comp rx=0 tx=0).stop 2023-11-24T08:07:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 -- 172.21.15.153:0/3063819858 shutdown_connections 2023-11-24T08:07:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7efe4c06b080 0x7efe4c06d540 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe6015def0 0x7efe60140d40 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe600b3dd0 0x7efe6006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 --2- 172.21.15.153:0/3063819858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe600cf110 0x7efe600cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 -- 172.21.15.153:0/3063819858 >> 172.21.15.153:0/3063819858 conn(0x7efe600b1740 msgr2=0x7efe60159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 -- 172.21.15.153:0/3063819858 shutdown_connections 2023-11-24T08:07:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.274+0000 7efe65768700 1 -- 172.21.15.153:0/3063819858 wait complete. 2023-11-24T08:07:42.278 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:07:42.291 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:07:42.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.421+0000 7fbe6f009700 1 Processor -- start 2023-11-24T08:07:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.421+0000 7fbe6f009700 1 -- start start 2023-11-24T08:07:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6f009700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbe6815de80 0x7fbe680cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6f009700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6815e260 0x7fbe6806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6f009700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe680d02d0 con 0x7fbe6806f2b0 2023-11-24T08:07:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6f009700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6806b580 con 0x7fbe6815de80 2023-11-24T08:07:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6f009700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6806f810 con 0x7fbe6815e260 2023-11-24T08:07:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6cda5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbe6815de80 0x7fbe680cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6d5a6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbe6806f2b0 0x7fbe680d1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46246/0 (socket says 172.21.15.153:46246) 2023-11-24T08:07:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6d5a6700 1 -- 172.21.15.153:0/3269594854 learned_addr learned my addr 172.21.15.153:0/3269594854 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe67fff700 1 --2- 172.21.15.153:0/3269594854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6815e260 0x7fbe6806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6cda5700 1 -- 172.21.15.153:0/3269594854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6815e260 msgr2=0x7fbe6806ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6cda5700 1 --2- 172.21.15.153:0/3269594854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6815e260 0x7fbe6806ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6cda5700 1 -- 172.21.15.153:0/3269594854 >> v1:172.21.15.153:6789/0 conn(0x7fbe6806f2b0 legacy=0x7fbe680d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6cda5700 1 -- 172.21.15.153:0/3269594854 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6806faf0 con 0x7fbe6815de80 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe677fe700 1 -- 172.21.15.153:0/3269594854 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709302771 0 0) 0x7fbe680d02d0 con 0x7fbe6806f2b0 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe67fff700 1 --2- 172.21.15.153:0/3269594854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6815e260 0x7fbe6806ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe6cda5700 1 --2- 172.21.15.153:0/3269594854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6815de80 0x7fbe680cfd90 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009840 tx=0x7fbe5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de64b7dcd336b17e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe677fe700 1 -- 172.21.15.153:0/3269594854 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c011830 con 0x7fbe6815de80 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe677fe700 1 -- 172.21.15.153:0/3269594854 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c011990 con 0x7fbe6815de80 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.422+0000 7fbe677fe700 1 -- 172.21.15.153:0/3269594854 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c011d20 con 0x7fbe6815de80 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.423+0000 7fbe6f009700 1 -- 172.21.15.153:0/3269594854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6815de80 msgr2=0x7fbe680cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.423+0000 7fbe6f009700 1 --2- 172.21.15.153:0/3269594854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6815de80 0x7fbe680cfd90 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009840 tx=0x7fbe5c009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.423+0000 7fbe6f009700 1 -- 172.21.15.153:0/3269594854 shutdown_connections 2023-11-24T08:07:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.423+0000 7fbe6f009700 1 --2- 172.21.15.153:0/3269594854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6815de80 0x7fbe680cfd90 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.423+0000 7fbe6f009700 1 --2- 172.21.15.153:0/3269594854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6815e260 0x7fbe6806ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.423+0000 7fbe6f009700 1 -- 172.21.15.153:0/3269594854 >> 172.21.15.153:0/3269594854 conn(0x7fbe6809aa00 msgr2=0x7fbe6809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.423+0000 7fbe6f009700 1 -- 172.21.15.153:0/3269594854 shutdown_connections 2023-11-24T08:07:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.423+0000 7fbe6f009700 1 -- 172.21.15.153:0/3269594854 wait complete. 2023-11-24T08:07:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.424+0000 7fbe6f009700 1 Processor -- start 2023-11-24T08:07:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.424+0000 7fbe6f009700 1 -- start start 2023-11-24T08:07:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.425+0000 7fbe6f009700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6806f2b0 0x7fbe680b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.425+0000 7fbe6f009700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe6815de80 0x7fbe680c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.425+0000 7fbe6f009700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6815e260 0x7fbe680b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.425+0000 7fbe6f009700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe681f4980 con 0x7fbe6815e260 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.425+0000 7fbe6f009700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe681f3d10 con 0x7fbe6815de80 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.425+0000 7fbe6f009700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe681f3ff0 con 0x7fbe6806f2b0 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.425+0000 7fbe6d5a6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6815e260 0x7fbe680b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.425+0000 7fbe6d5a6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6815e260 0x7fbe680b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40146/0 (socket says 172.21.15.153:40146) 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.425+0000 7fbe6d5a6700 1 -- 172.21.15.153:0/2177993961 learned_addr learned my addr 172.21.15.153:0/2177993961 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.425+0000 7fbe6cda5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6806f2b0 0x7fbe680b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.425+0000 7fbe67fff700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe6815de80 0x7fbe680c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.426+0000 7fbe6d5a6700 1 -- 172.21.15.153:0/2177993961 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6806f2b0 msgr2=0x7fbe680b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.426+0000 7fbe6d5a6700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6806f2b0 0x7fbe680b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.426+0000 7fbe6d5a6700 1 -- 172.21.15.153:0/2177993961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe6815de80 msgr2=0x7fbe680c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.426+0000 7fbe6d5a6700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe6815de80 0x7fbe680c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.426+0000 7fbe6d5a6700 1 -- 172.21.15.153:0/2177993961 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0094a0 con 0x7fbe6815e260 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.426+0000 7fbe6d5a6700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6815e260 0x7fbe680b5de0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000cba0 tx=0x7fbe6000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.426+0000 7fbe657fa700 1 -- 172.21.15.153:0/2177993961 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6000aaa0 con 0x7fbe6815e260 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.426+0000 7fbe657fa700 1 -- 172.21.15.153:0/2177993961 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6000ac20 con 0x7fbe6815e260 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.426+0000 7fbe6f009700 1 -- 172.21.15.153:0/2177993961 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe681f42d0 con 0x7fbe6815e260 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.426+0000 7fbe657fa700 1 -- 172.21.15.153:0/2177993961 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe600070d0 con 0x7fbe6815e260 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.426+0000 7fbe6f009700 1 -- 172.21.15.153:0/2177993961 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe680c9a00 con 0x7fbe6815e260 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.427+0000 7fbe6f009700 1 -- 172.21.15.153:0/2177993961 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe680cc870 con 0x7fbe6815e260 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.427+0000 7fbe657fa700 1 -- 172.21.15.153:0/2177993961 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbe60007230 con 0x7fbe6815e260 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.428+0000 7fbe657fa700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe4c06b080 0x7fbe4c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.428+0000 7fbe657fa700 1 -- 172.21.15.153:0/2177993961 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fbe60089510 con 0x7fbe6815e260 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.428+0000 7fbe6cda5700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe4c06b080 0x7fbe4c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.428+0000 7fbe6cda5700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe4c06b080 0x7fbe4c06d540 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0090b0 tx=0x7fbe5c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.432+0000 7fbe657fa700 1 -- 172.21.15.153:0/2177993961 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe600544a0 con 0x7fbe6815e260 2023-11-24T08:07:42.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:42.624+0000 7fbe6f009700 1 -- 172.21.15.153:0/2177993961 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe681f4af0 con 0x7fbe6815e260 2023-11-24T08:07:43.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.278+0000 7fbe657fa700 1 -- 172.21.15.153:0/2177993961 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbe681f4af0 con 0x7fbe6815e260 2023-11-24T08:07:43.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 -- 172.21.15.153:0/2177993961 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe4c06b080 msgr2=0x7fbe4c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe4c06b080 0x7fbe4c06d540 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0090b0 tx=0x7fbe5c01c040 comp rx=0 tx=0).stop 2023-11-24T08:07:43.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 -- 172.21.15.153:0/2177993961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6815e260 msgr2=0x7fbe680b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6815e260 0x7fbe680b5de0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000cba0 tx=0x7fbe6000ceb0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 -- 172.21.15.153:0/2177993961 shutdown_connections 2023-11-24T08:07:43.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fbe4c06b080 0x7fbe4c06d540 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6815e260 0x7fbe680b5de0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe6806f2b0 0x7fbe680b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 --2- 172.21.15.153:0/2177993961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe6815de80 0x7fbe680c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 -- 172.21.15.153:0/2177993961 >> 172.21.15.153:0/2177993961 conn(0x7fbe6809aa00 msgr2=0x7fbe680cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 -- 172.21.15.153:0/2177993961 shutdown_connections 2023-11-24T08:07:43.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.281+0000 7fbe6f009700 1 -- 172.21.15.153:0/2177993961 wait complete. 2023-11-24T08:07:43.284 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-11-24T08:07:43.296 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T08:07:43.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.420+0000 7f1ea3229700 1 Processor -- start 2023-11-24T08:07:43.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.420+0000 7f1ea3229700 1 -- start start 2023-11-24T08:07:43.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.420+0000 7f1ea3229700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1e9c1587f0 0x7f1e9c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1ea3229700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c06b530 con 0x7f1e9c15b370 2023-11-24T08:07:43.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1ea3229700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c0ae5e0 con 0x7f1e9c0b4370 2023-11-24T08:07:43.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1ea3229700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9c15be30 con 0x7f1e9c1587f0 2023-11-24T08:07:43.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1e9c15b370 0x7f1e9c0b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46256/0 (socket says 172.21.15.153:46256) 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9bfff700 1 -- 172.21.15.153:0/1127108545 learned_addr learned my addr 172.21.15.153:0/1127108545 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168682864 0 0) 0x7f1e9c06b530 con 0x7f1e9c15b370 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e8c0057c0 con 0x7f1e9c15b370 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1ea0fc5700 1 --2- 172.21.15.153:0/1127108545 >> v2:172.21.15.164:3300/0 conn(0x7f1e9c1587f0 0x7f1e9c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 990706424 0 0) 0x7f1e8c0057c0 con 0x7f1e9c15b370 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 >> v2:172.21.15.164:3300/0 conn(0x7f1e9c1587f0 msgr2=0x7f1e9c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 --2- 172.21.15.153:0/1127108545 >> v2:172.21.15.164:3300/0 conn(0x7f1e9c1587f0 0x7f1e9c06aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 >> v1:172.21.15.164:6789/0 conn(0x7f1e9c0b4370 legacy=0x7f1e9c0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c15c110 con 0x7f1e9c15b370 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f1e88001670 con 0x7f1e9c15b370 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 >> v1:172.21.15.153:6789/0 conn(0x7f1e9c15b370 legacy=0x7f1e9c0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e8c005c10 0x7f1e8c006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c006a60 0x7f1e8c006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c007420 0x7f1e8c00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c15be30 con 0x7f1e8c006a60 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c00e3c0 con 0x7f1e8c007420 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c00e580 con 0x7f1e8c005c10 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1e9bfff700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c006a60 0x7f1e8c006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1ea0fc5700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e8c005c10 0x7f1e8c006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.421+0000 7f1ea17c6700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c007420 0x7f1e8c00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1e9bfff700 1 -- 172.21.15.153:0/1127108545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e8c005c10 msgr2=0x7f1e8c006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1e9bfff700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e8c005c10 0x7f1e8c006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1e9bfff700 1 -- 172.21.15.153:0/1127108545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c007420 msgr2=0x7f1e8c00dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1e9bfff700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c007420 0x7f1e8c00dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1e9bfff700 1 -- 172.21.15.153:0/1127108545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c0057c0 con 0x7f1e8c006a60 2023-11-24T08:07:43.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1ea17c6700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c007420 0x7f1e8c00dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:43.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1ea17c6700 1 -- 172.21.15.153:0/1127108545 reap_dead start 2023-11-24T08:07:43.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1e9bfff700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c006a60 0x7f1e8c006ee0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c240 tx=0x7f1e8c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd40b70d72994ab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88007c10 con 0x7f1e8c006a60 2023-11-24T08:07:43.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8800ce00 con 0x7f1e8c006a60 2023-11-24T08:07:43.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1e9b7fe700 1 -- 172.21.15.153:0/1127108545 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88005ba0 con 0x7f1e8c006a60 2023-11-24T08:07:43.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1ea3229700 1 -- 172.21.15.153:0/1127108545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c006a60 msgr2=0x7f1e8c006ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1ea3229700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c006a60 0x7f1e8c006ee0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c240 tx=0x7f1e8c007a90 comp rx=0 tx=0).stop 2023-11-24T08:07:43.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1ea3229700 1 -- 172.21.15.153:0/1127108545 shutdown_connections 2023-11-24T08:07:43.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.422+0000 7f1ea3229700 1 --2- 172.21.15.153:0/1127108545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c006a60 0x7f1e8c006ee0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.423+0000 7f1ea3229700 1 -- 172.21.15.153:0/1127108545 >> 172.21.15.153:0/1127108545 conn(0x7f1e9c0d0bf0 msgr2=0x7f1e9c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.423+0000 7f1ea3229700 1 -- 172.21.15.153:0/1127108545 shutdown_connections 2023-11-24T08:07:43.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.423+0000 7f1ea3229700 1 -- 172.21.15.153:0/1127108545 wait complete. 2023-11-24T08:07:43.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.424+0000 7f1ea3229700 1 Processor -- start 2023-11-24T08:07:43.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.424+0000 7f1ea3229700 1 -- start start 2023-11-24T08:07:43.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea3229700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c006a60 0x7f1e9c145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea3229700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e9c0affb0 0x7f1e9c09d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea3229700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e9c0b0430 0x7f1e9c09db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea3229700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c145740 con 0x7f1e9c0b0430 2023-11-24T08:07:43.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea3229700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c1489b0 con 0x7f1e8c006a60 2023-11-24T08:07:43.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea3229700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c0b0a00 con 0x7f1e9c0affb0 2023-11-24T08:07:43.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea17c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e9c0b0430 0x7f1e9c09db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea17c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e9c0b0430 0x7f1e9c09db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40166/0 (socket says 172.21.15.153:40166) 2023-11-24T08:07:43.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea17c6700 1 -- 172.21.15.153:0/3158155851 learned_addr learned my addr 172.21.15.153:0/3158155851 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:43.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1e9bfff700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e9c0affb0 0x7f1e9c09d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea0fc5700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c006a60 0x7f1e9c145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea17c6700 1 -- 172.21.15.153:0/3158155851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e9c0affb0 msgr2=0x7f1e9c09d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea17c6700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e9c0affb0 0x7f1e9c09d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea17c6700 1 -- 172.21.15.153:0/3158155851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c006a60 msgr2=0x7f1e9c145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea17c6700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c006a60 0x7f1e9c145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea17c6700 1 -- 172.21.15.153:0/3158155851 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c0b0ce0 con 0x7f1e9c0b0430 2023-11-24T08:07:43.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea17c6700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e9c0b0430 0x7f1e9c09db90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c072de0 tx=0x7f1e9400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1e997fa700 1 -- 172.21.15.153:0/3158155851 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9400ee80 con 0x7f1e9c0b0430 2023-11-24T08:07:43.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1e997fa700 1 -- 172.21.15.153:0/3158155851 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e94003c10 con 0x7f1e9c0b0430 2023-11-24T08:07:43.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1ea3229700 1 -- 172.21.15.153:0/3158155851 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9c0b0fc0 con 0x7f1e9c0b0430 2023-11-24T08:07:43.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.425+0000 7f1e997fa700 1 -- 172.21.15.153:0/3158155851 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940050d0 con 0x7f1e9c0b0430 2023-11-24T08:07:43.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.426+0000 7f1ea3229700 1 -- 172.21.15.153:0/3158155851 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9c0b1580 con 0x7f1e9c0b0430 2023-11-24T08:07:43.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.426+0000 7f1ea3229700 1 -- 172.21.15.153:0/3158155851 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9c0b18f0 con 0x7f1e9c0b0430 2023-11-24T08:07:43.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.427+0000 7f1e997fa700 1 -- 172.21.15.153:0/3158155851 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1e94005230 con 0x7f1e9c0b0430 2023-11-24T08:07:43.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.427+0000 7f1e997fa700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e8006b080 0x7f1e8006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.427+0000 7f1ea0fc5700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e8006b080 0x7f1e8006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.427+0000 7f1e997fa700 1 -- 172.21.15.153:0/3158155851 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1e94089450 con 0x7f1e9c0b0430 2023-11-24T08:07:43.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.428+0000 7f1ea0fc5700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e8006b080 0x7f1e8006d540 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009be0 tx=0x7f1e90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.432+0000 7f1e997fa700 1 -- 172.21.15.153:0/3158155851 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e94054580 con 0x7f1e9c0b0430 2023-11-24T08:07:43.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.638+0000 7f1ea3229700 1 -- 172.21.15.153:0/3158155851 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1e9c0b1710 con 0x7f1e9c0b0430 2023-11-24T08:07:43.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.642+0000 7f1e997fa700 1 -- 172.21.15.153:0/3158155851 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1e94057ba0 con 0x7f1e9c0b0430 2023-11-24T08:07:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 -- 172.21.15.153:0/3158155851 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e8006b080 msgr2=0x7f1e8006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e8006b080 0x7f1e8006d540 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009be0 tx=0x7f1e90008040 comp rx=0 tx=0).stop 2023-11-24T08:07:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 -- 172.21.15.153:0/3158155851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e9c0b0430 msgr2=0x7f1e9c09db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e9c0b0430 0x7f1e9c09db90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c072de0 tx=0x7f1e9400ed50 comp rx=0 tx=0).stop 2023-11-24T08:07:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 -- 172.21.15.153:0/3158155851 shutdown_connections 2023-11-24T08:07:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1e8006b080 0x7f1e8006d540 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e9c0b0430 0x7f1e9c09db90 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c006a60 0x7f1e9c145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 --2- 172.21.15.153:0/3158155851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e9c0affb0 0x7f1e9c09d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 -- 172.21.15.153:0/3158155851 >> 172.21.15.153:0/3158155851 conn(0x7f1e9c0d0bf0 msgr2=0x7f1e9c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 -- 172.21.15.153:0/3158155851 shutdown_connections 2023-11-24T08:07:43.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.644+0000 7f1ea3229700 1 -- 172.21.15.153:0/3158155851 wait complete. 2023-11-24T08:07:43.657 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:07:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.777+0000 7f965b327700 1 Processor -- start 2023-11-24T08:07:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.777+0000 7f965b327700 1 -- start start 2023-11-24T08:07:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f965b327700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96540af4d0 0x7f96540b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f965b327700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96540ae430 con 0x7f965415e080 2023-11-24T08:07:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f965b327700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96540ae710 con 0x7f965406c710 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f965b327700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96540af0b0 con 0x7f96540af4d0 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f96590c3700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f965415e080 0x7f965406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46274/0 (socket says 172.21.15.153:46274) 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f96590c3700 1 -- 172.21.15.153:0/3503602741 learned_addr learned my addr 172.21.15.153:0/3503602741 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f96598c4700 1 --2- 172.21.15.153:0/3503602741 >> v2:172.21.15.153:3300/0 conn(0x7f96540af4d0 0x7f96540b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f964bfff700 1 -- 172.21.15.153:0/3503602741 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943989188 0 0) 0x7f96540ae430 con 0x7f965415e080 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f964bfff700 1 -- 172.21.15.153:0/3503602741 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96400035b0 con 0x7f965415e080 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f96598c4700 1 -- 172.21.15.153:0/3503602741 >> v1:172.21.15.164:6789/0 conn(0x7f965406c710 legacy=0x7f965406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f96598c4700 1 -- 172.21.15.153:0/3503602741 >> v1:172.21.15.153:6789/0 conn(0x7f965415e080 legacy=0x7f965406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.778+0000 7f96598c4700 1 -- 172.21.15.153:0/3503602741 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540ae9f0 con 0x7f96540af4d0 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.779+0000 7f96598c4700 1 --2- 172.21.15.153:0/3503602741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96540af4d0 0x7f96540b5050 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f964c009d90 tx=0x7f964c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d38b36d963bbf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.779+0000 7f964bfff700 1 -- 172.21.15.153:0/3503602741 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00e070 con 0x7f96540af4d0 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.779+0000 7f964bfff700 1 -- 172.21.15.153:0/3503602741 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c00bae0 con 0x7f96540af4d0 2023-11-24T08:07:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.779+0000 7f964bfff700 1 -- 172.21.15.153:0/3503602741 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00be90 con 0x7f96540af4d0 2023-11-24T08:07:43.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.779+0000 7f965b327700 1 -- 172.21.15.153:0/3503602741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96540af4d0 msgr2=0x7f96540b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.779+0000 7f965b327700 1 --2- 172.21.15.153:0/3503602741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96540af4d0 0x7f96540b5050 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f964c009d90 tx=0x7f964c00b330 comp rx=0 tx=0).stop 2023-11-24T08:07:43.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.779+0000 7f965b327700 1 -- 172.21.15.153:0/3503602741 shutdown_connections 2023-11-24T08:07:43.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.779+0000 7f965b327700 1 --2- 172.21.15.153:0/3503602741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96540af4d0 0x7f96540b5050 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.779+0000 7f965b327700 1 -- 172.21.15.153:0/3503602741 >> 172.21.15.153:0/3503602741 conn(0x7f9654071b90 msgr2=0x7f9654071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.779+0000 7f965b327700 1 -- 172.21.15.153:0/3503602741 shutdown_connections 2023-11-24T08:07:43.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.779+0000 7f965b327700 1 -- 172.21.15.153:0/3503602741 wait complete. 2023-11-24T08:07:43.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.781+0000 7f965b327700 1 Processor -- start 2023-11-24T08:07:43.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.781+0000 7f965b327700 1 -- start start 2023-11-24T08:07:43.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.781+0000 7f965b327700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f965406c710 0x7f9654160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f965b327700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96540af4d0 0x7f96541f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f965b327700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f965415e080 0x7f96541f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f965b327700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96541f3520 con 0x7f965415e080 2023-11-24T08:07:43.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f965b327700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96541605b0 con 0x7f96540af4d0 2023-11-24T08:07:43.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f965b327700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96540d05c0 con 0x7f965406c710 2023-11-24T08:07:43.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f96598c4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f965415e080 0x7f96541f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f96598c4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f965415e080 0x7f96541f2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40180/0 (socket says 172.21.15.153:40180) 2023-11-24T08:07:43.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f96598c4700 1 -- 172.21.15.153:0/1385230057 learned_addr learned my addr 172.21.15.153:0/1385230057 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:43.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f96590c3700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f965406c710 0x7f9654160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f96588c2700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96540af4d0 0x7f96541f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f96598c4700 1 -- 172.21.15.153:0/1385230057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f965406c710 msgr2=0x7f9654160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f96598c4700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f965406c710 0x7f9654160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f96598c4700 1 -- 172.21.15.153:0/1385230057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96540af4d0 msgr2=0x7f96541f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f96598c4700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96540af4d0 0x7f96541f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f96598c4700 1 -- 172.21.15.153:0/1385230057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c009a70 con 0x7f965415e080 2023-11-24T08:07:43.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f96598c4700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f965415e080 0x7f96541f2fe0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f965409f040 tx=0x7f964c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f9649ffb700 1 -- 172.21.15.153:0/1385230057 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0045c0 con 0x7f965415e080 2023-11-24T08:07:43.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f9649ffb700 1 -- 172.21.15.153:0/1385230057 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c004740 con 0x7f965415e080 2023-11-24T08:07:43.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f965b327700 1 -- 172.21.15.153:0/1385230057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96540d02e0 con 0x7f965415e080 2023-11-24T08:07:43.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.782+0000 7f9649ffb700 1 -- 172.21.15.153:0/1385230057 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c012430 con 0x7f965415e080 2023-11-24T08:07:43.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.783+0000 7f965b327700 1 -- 172.21.15.153:0/1385230057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9654160240 con 0x7f965415e080 2023-11-24T08:07:43.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.783+0000 7f965b327700 1 -- 172.21.15.153:0/1385230057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96540753f0 con 0x7f965415e080 2023-11-24T08:07:43.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.785+0000 7f9649ffb700 1 -- 172.21.15.153:0/1385230057 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f964c012590 con 0x7f965415e080 2023-11-24T08:07:43.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.785+0000 7f9649ffb700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f963806b080 0x7f963806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.785+0000 7f9649ffb700 1 -- 172.21.15.153:0/1385230057 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f964c08bbc0 con 0x7f965415e080 2023-11-24T08:07:43.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.785+0000 7f96590c3700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f963806b080 0x7f963806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.786+0000 7f96590c3700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f963806b080 0x7f963806d540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9644007fd0 tx=0x7f9644009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:43.789+0000 7f9649ffb700 1 -- 172.21.15.153:0/1385230057 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f964c056c50 con 0x7f965415e080 2023-11-24T08:07:44.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.058+0000 7f965b327700 1 -- 172.21.15.153:0/1385230057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f9654160720 con 0x7f965415e080 2023-11-24T08:07:44.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.280+0000 7f9649ffb700 1 -- 172.21.15.153:0/1385230057 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v196) v1 ==== 161+0+0 (secure 0 0 0) 0x7f964c02a0e0 con 0x7f965415e080 2023-11-24T08:07:44.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 -- 172.21.15.153:0/1385230057 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f963806b080 msgr2=0x7f963806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f963806b080 0x7f963806d540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9644007fd0 tx=0x7f9644009040 comp rx=0 tx=0).stop 2023-11-24T08:07:44.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 -- 172.21.15.153:0/1385230057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f965415e080 msgr2=0x7f96541f2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f965415e080 0x7f96541f2fe0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f965409f040 tx=0x7f964c004ad0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 -- 172.21.15.153:0/1385230057 shutdown_connections 2023-11-24T08:07:44.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f963806b080 0x7f963806d540 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f965415e080 0x7f96541f2fe0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f965406c710 0x7f9654160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 --2- 172.21.15.153:0/1385230057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96540af4d0 0x7f96541f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 -- 172.21.15.153:0/1385230057 >> 172.21.15.153:0/1385230057 conn(0x7f9654071b90 msgr2=0x7f965406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:44.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 -- 172.21.15.153:0/1385230057 shutdown_connections 2023-11-24T08:07:44.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:44.283+0000 7f965b327700 1 -- 172.21.15.153:0/1385230057 wait complete. 2023-11-24T08:07:44.299 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system ... ERROR 2023-11-24T08:07:44.299 INFO:tasks.cephfs_test_runner: 2023-11-24T08:07:44.299 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T08:07:44.299 INFO:tasks.cephfs_test_runner:ERROR: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:07:44.299 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T08:07:44.299 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:07:44.299 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T08:07:44.299 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs/test_volumes.py", line 7874, in test_malicious_metafile_on_legacy_to_v1_upgrade 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner: subvol1, subvol2 = self._generate_random_subvolume_name(2) 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner:AttributeError: 'TestMisc' object has no attribute '_generate_random_subvolume_name' 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner: 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner:Ran 3 tests in 182.966s 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner: 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner: 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner:ERROR: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs/test_volumes.py", line 7874, in test_malicious_metafile_on_legacy_to_v1_upgrade 2023-11-24T08:07:44.300 INFO:tasks.cephfs_test_runner: subvol1, subvol2 = self._generate_random_subvolume_name(2) 2023-11-24T08:07:44.301 INFO:tasks.cephfs_test_runner:AttributeError: 'TestMisc' object has no attribute '_generate_random_subvolume_name' 2023-11-24T08:07:44.301 INFO:tasks.cephfs_test_runner: 2023-11-24T08:07:44.301 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:07:44.365 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5720a0285baf47d9bb6cf0d4bdb57aa4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:07:44.367 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-24T08:07:44.376 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-24T08:07:44.390 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-24T08:07:44.390 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:07:44.390 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:44.411 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3433 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T08:07:44.411 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-24T08:07:44.411 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:44.470 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3433 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T08:07:44.470 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:07:44.470 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:44.492 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=427 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T08:07:44.492 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-11-24T08:07:44.492 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:44.552 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=427 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T08:07:44.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:44.553 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-11-24T08:07:44.570 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:07:44.571 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:07:44.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:44.571 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:07:44.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:44.651 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:44.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:44.737 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2023-11-24T08:07:44.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:44.829 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-11-24T08:07:44.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:44.847 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2023-11-24T08:07:44.918 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2023-11-24T08:07:44.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:07:44.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:44.919 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-11-24T08:07:44.940 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:07:44.941 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:07:44.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:44.941 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:07:45.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:45.022 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:45.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:45.107 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2023-11-24T08:07:45.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:45.280 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-11-24T08:07:45.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:45.297 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2023-11-24T08:07:45.367 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2023-11-24T08:07:45.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:07:45.369 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-24T08:07:45.380 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T08:07:45.380 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:45.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.502+0000 7f0de5542700 1 Processor -- start 2023-11-24T08:07:45.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.502+0000 7f0de5542700 1 -- start start 2023-11-24T08:07:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.503+0000 7f0de5542700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0de00cf360 0x7f0de00b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.503+0000 7f0de5542700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0de015deb0 0x7f0de015e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.503+0000 7f0de5542700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de015a790 con 0x7f0de015a3b0 2023-11-24T08:07:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.503+0000 7f0de5542700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de00cf8b0 con 0x7f0de00cf360 2023-11-24T08:07:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.503+0000 7f0de5542700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de00b4c40 con 0x7f0de015deb0 2023-11-24T08:07:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.503+0000 7f0dde7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0de00cf360 0x7f0de00b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.503+0000 7f0ddeffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0de015a3b0 0x7f0de00b3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46288/0 (socket says 172.21.15.153:46288) 2023-11-24T08:07:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.503+0000 7f0ddeffd700 1 -- 172.21.15.153:0/187099896 learned_addr learned my addr 172.21.15.153:0/187099896 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0ddf7fe700 1 --2- 172.21.15.153:0/187099896 >> v2:172.21.15.164:3300/0 conn(0x7f0de015deb0 0x7f0de015e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0dde7fc700 1 -- 172.21.15.153:0/187099896 >> v2:172.21.15.164:3300/0 conn(0x7f0de015deb0 msgr2=0x7f0de015e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0dde7fc700 1 --2- 172.21.15.153:0/187099896 >> v2:172.21.15.164:3300/0 conn(0x7f0de015deb0 0x7f0de015e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0dde7fc700 1 -- 172.21.15.153:0/187099896 >> v1:172.21.15.153:6789/0 conn(0x7f0de015a3b0 legacy=0x7f0de00b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0dde7fc700 1 -- 172.21.15.153:0/187099896 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de0070c60 con 0x7f0de00cf360 2023-11-24T08:07:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0dddffb700 1 -- 172.21.15.153:0/187099896 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017852472 0 0) 0x7f0de015a790 con 0x7f0de015a3b0 2023-11-24T08:07:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0dde7fc700 1 --2- 172.21.15.153:0/187099896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de00cf360 0x7f0de00b3a30 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f0de0074fd0 tx=0x7f0dd400acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c448601bc62213a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0dddffb700 1 -- 172.21.15.153:0/187099896 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400cb70 con 0x7f0de00cf360 2023-11-24T08:07:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0dddffb700 1 -- 172.21.15.153:0/187099896 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd400ccd0 con 0x7f0de00cf360 2023-11-24T08:07:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0dddffb700 1 -- 172.21.15.153:0/187099896 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4018620 con 0x7f0de00cf360 2023-11-24T08:07:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0de5542700 1 -- 172.21.15.153:0/187099896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de00cf360 msgr2=0x7f0de00b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.504+0000 7f0de5542700 1 --2- 172.21.15.153:0/187099896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de00cf360 0x7f0de00b3a30 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f0de0074fd0 tx=0x7f0dd400acc0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.505+0000 7f0de5542700 1 -- 172.21.15.153:0/187099896 shutdown_connections 2023-11-24T08:07:45.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.505+0000 7f0de5542700 1 --2- 172.21.15.153:0/187099896 >> v2:172.21.15.164:3300/0 conn(0x7f0de015deb0 0x7f0de015e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.505+0000 7f0de5542700 1 --2- 172.21.15.153:0/187099896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de00cf360 0x7f0de00b3a30 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.505+0000 7f0de5542700 1 -- 172.21.15.153:0/187099896 >> 172.21.15.153:0/187099896 conn(0x7f0de00b1740 msgr2=0x7f0de00b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:45.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.505+0000 7f0de5542700 1 -- 172.21.15.153:0/187099896 shutdown_connections 2023-11-24T08:07:45.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.505+0000 7f0de5542700 1 -- 172.21.15.153:0/187099896 wait complete. 2023-11-24T08:07:45.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.506+0000 7f0de5542700 1 Processor -- start 2023-11-24T08:07:45.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.506+0000 7f0de5542700 1 -- start start 2023-11-24T08:07:45.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0de5542700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0de00cf360 0x7f0de015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0de5542700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015a3b0 0x7f0de015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0de5542700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0de015deb0 0x7f0de015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0de5542700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de015cad0 con 0x7f0de015a3b0 2023-11-24T08:07:45.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0de5542700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de0151ef0 con 0x7f0de015deb0 2023-11-24T08:07:45.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0de5542700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01587e0 con 0x7f0de00cf360 2023-11-24T08:07:45.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dde7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015a3b0 0x7f0de015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dde7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015a3b0 0x7f0de015ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40192/0 (socket says 172.21.15.153:40192) 2023-11-24T08:07:45.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dde7fc700 1 -- 172.21.15.153:0/3626083192 learned_addr learned my addr 172.21.15.153:0/3626083192 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:45.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0ddf7fe700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0de015deb0 0x7f0de015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0ddeffd700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0de00cf360 0x7f0de015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dde7fc700 1 -- 172.21.15.153:0/3626083192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0de00cf360 msgr2=0x7f0de015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dde7fc700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0de00cf360 0x7f0de015a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dde7fc700 1 -- 172.21.15.153:0/3626083192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0de015deb0 msgr2=0x7f0de015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dde7fc700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0de015deb0 0x7f0de015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dde7fc700 1 -- 172.21.15.153:0/3626083192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd400a640 con 0x7f0de015a3b0 2023-11-24T08:07:45.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dde7fc700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015a3b0 0x7f0de015ae90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400a1c0 tx=0x7f0dd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dc77fe700 1 -- 172.21.15.153:0/3626083192 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd401e070 con 0x7f0de015a3b0 2023-11-24T08:07:45.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dc77fe700 1 -- 172.21.15.153:0/3626083192 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd40038b0 con 0x7f0de015a3b0 2023-11-24T08:07:45.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0dc77fe700 1 -- 172.21.15.153:0/3626083192 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4003c60 con 0x7f0de015a3b0 2023-11-24T08:07:45.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.507+0000 7f0de5542700 1 -- 172.21.15.153:0/3626083192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de015cd20 con 0x7f0de015a3b0 2023-11-24T08:07:45.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.508+0000 7f0de5542700 1 -- 172.21.15.153:0/3626083192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de0152140 con 0x7f0de015a3b0 2023-11-24T08:07:45.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.509+0000 7f0de5542700 1 -- 172.21.15.153:0/3626083192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de015d240 con 0x7f0de015a3b0 2023-11-24T08:07:45.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.509+0000 7f0dc77fe700 1 -- 172.21.15.153:0/3626083192 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0dd4018400 con 0x7f0de015a3b0 2023-11-24T08:07:45.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.509+0000 7f0dc77fe700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0dcc06b080 0x7f0dcc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.510+0000 7f0ddeffd700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0dcc06b080 0x7f0dcc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.510+0000 7f0dc77fe700 1 -- 172.21.15.153:0/3626083192 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0dd408b850 con 0x7f0de015a3b0 2023-11-24T08:07:45.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.510+0000 7f0ddeffd700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0dcc06b080 0x7f0dcc06d540 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0000f60 tx=0x7f0dd0007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.514+0000 7f0dc77fe700 1 -- 172.21.15.153:0/3626083192 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0dd4056980 con 0x7f0de015a3b0 2023-11-24T08:07:45.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.699+0000 7f0de5542700 1 -- 172.21.15.153:0/3626083192 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0de0071570 con 0x7f0dcc06b080 2023-11-24T08:07:45.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.701+0000 7f0dc77fe700 1 -- 172.21.15.153:0/3626083192 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50568 (secure 0 0 0) 0x7f0dd0001290 con 0x7f0dcc06b080 2023-11-24T08:07:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:45.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.703+0000 7f0de5542700 1 -- 172.21.15.153:0/3626083192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0dcc06b080 msgr2=0x7f0dcc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.703+0000 7f0de5542700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0dcc06b080 0x7f0dcc06d540 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0000f60 tx=0x7f0dd0007e70 comp rx=0 tx=0).stop 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.703+0000 7f0de5542700 1 -- 172.21.15.153:0/3626083192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015a3b0 msgr2=0x7f0de015ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.703+0000 7f0de5542700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015a3b0 0x7f0de015ae90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400a1c0 tx=0x7f0dd4004750 comp rx=0 tx=0).stop 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.703+0000 7f0de5542700 1 -- 172.21.15.153:0/3626083192 shutdown_connections 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.703+0000 7f0de5542700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0de015deb0 0x7f0de015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.703+0000 7f0de5542700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0de00cf360 0x7f0de015a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.703+0000 7f0de5542700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f0dcc06b080 0x7f0dcc06d540 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.703+0000 7f0de5542700 1 --2- 172.21.15.153:0/3626083192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015a3b0 0x7f0de015ae90 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.703+0000 7f0de5542700 1 -- 172.21.15.153:0/3626083192 >> 172.21.15.153:0/3626083192 conn(0x7f0de00b1740 msgr2=0x7f0de006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:45.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.704+0000 7f0de5542700 1 -- 172.21.15.153:0/3626083192 shutdown_connections 2023-11-24T08:07:45.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.704+0000 7f0de5542700 1 -- 172.21.15.153:0/3626083192 wait complete. 2023-11-24T08:07:45.708 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:07:45.717 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-11-24T08:07:44.087241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222640,"kb_used_data":6480,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752080,"statfs":{"total":773094113280,"available":772866129920,"internally_reserved":0,"allocated":6635520,"data_stored":3417868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4058,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001207"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.177856+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:07:17.177856+0000","last_peered":"2023-11-24T08:07:17.177856+0000","last_clean":"2023-11-24T08:07:17.177856+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:07:17.177856+0000","last_undegraded":"2023-11-24T08:07:17.177856+0000","last_fullsized":"2023-11-24T08:07:17.177856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1273856,"data_stored":868487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72199999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.496},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.073,"15min":1.073},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.33200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.41899999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.317}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":277959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":10.285,"15min":10.285},"last":0.42699999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.745,"5min":2.089,"15min":2.089},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68400000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.627},{"interface":"front","average":{"1min":0.629,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.747,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":284130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.27100000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.20899999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33300000000000002,"15min":0.31900000000000001},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.252},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.22900000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.626,"15min":0.626},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.374}]},{"osd":5,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.5,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60699999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.309}]},{"osd":6,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.34000000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1659999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1277952,"data_stored":871291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.625,"5min":1.343,"15min":1.343},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61299999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.316}]},{"osd":3,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78600000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.505}]},{"osd":5,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.60399999999999998,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.93200000000000005,"15min":1.0720000000000001},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82499999999999996,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.44600000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.032,"15min":1.204},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.433},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":4,"15min":4},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":278015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.316,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.497,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.253},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.44,"15min":0.47199999999999998},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53600000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61799999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.59099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":5.673,"15min":5.673},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":1.216,"15min":1.216},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.246,"15min":1.246},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.82699999999999996},"min":{"1min":0.503,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.82999999999999996},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82099999999999995,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.758,"15min":5.758},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.89000000000000001},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":5.726,"15min":5.726},"last":0.502},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.499,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.625}]},{"osd":7,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.80300000000000005,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89400000000000002,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.94899999999999995},"min":{"1min":0.52000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99399999999999999,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":278015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.39600000000000002},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.59699999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58799999999999997,"5min":1.351,"15min":1.351},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40100000000000002,"15min":0.42699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.503,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.436},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.745,"5min":1.621,"15min":1.621},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.439},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63900000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45800000000000002,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64500000000000002,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.378}]},{"osd":4,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80500000000000005,"5min":1.389,"15min":1.389},"last":0.627},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90700000000000003,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.675,"15min":1.675},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":1.417,"15min":1.417},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.67100000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.54700000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95899999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":684032,"data_stored":281360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.5},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.496}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.623}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77100000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":1.101,"15min":1.101},"last":0.443},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":1.476,"15min":1.476},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.751,"5min":1.556,"15min":1.556},"last":0.48199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":278611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.314},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":1,"15min":1},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.495}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.77300000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":0.752},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:45.719 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:45.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.838+0000 7f486faa8700 1 Processor -- start 2023-11-24T08:07:45.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.838+0000 7f486faa8700 1 -- start start 2023-11-24T08:07:45.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486faa8700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4868152cc0 0x7f486806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486faa8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f48680b49a0 0x7f486806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486faa8700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48680cff20 0x7f48680d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486faa8700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486815c4b0 con 0x7f48680b49a0 2023-11-24T08:07:45.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486faa8700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486815c790 con 0x7f4868152cc0 2023-11-24T08:07:45.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486faa8700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486815ca70 con 0x7f48680cff20 2023-11-24T08:07:45.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486d043700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f48680b49a0 0x7f486806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486d043700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f48680b49a0 0x7f486806c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40200/0 (socket says 172.21.15.153:40200) 2023-11-24T08:07:45.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486d043700 1 -- 172.21.15.153:0/1091575778 learned_addr learned my addr 172.21.15.153:0/1091575778 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:45.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486e045700 1 --2- 172.21.15.153:0/1091575778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48680cff20 0x7f48680d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486d844700 1 --2- 172.21.15.153:0/1091575778 >> v2:172.21.15.164:3300/0 conn(0x7f4868152cc0 0x7f486806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486d043700 1 -- 172.21.15.153:0/1091575778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48680cff20 msgr2=0x7f48680d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:45.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486d043700 1 --2- 172.21.15.153:0/1091575778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48680cff20 0x7f48680d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486d043700 1 -- 172.21.15.153:0/1091575778 >> v2:172.21.15.164:3300/0 conn(0x7f4868152cc0 msgr2=0x7f486806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:45.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486d043700 1 --2- 172.21.15.153:0/1091575778 >> v2:172.21.15.164:3300/0 conn(0x7f4868152cc0 0x7f486806c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486d043700 1 -- 172.21.15.153:0/1091575778 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486815cd50 con 0x7f48680b49a0 2023-11-24T08:07:45.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486d043700 1 --2- 172.21.15.153:0/1091575778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48680b49a0 0x7f486806c540 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f4868075030 tx=0x7f4858009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121013eff2d9e78e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.839+0000 7f486c842700 1 -- 172.21.15.153:0/1091575778 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800b870 con 0x7f48680b49a0 2023-11-24T08:07:45.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.840+0000 7f486c842700 1 -- 172.21.15.153:0/1091575778 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485800b9d0 con 0x7f48680b49a0 2023-11-24T08:07:45.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.840+0000 7f486c842700 1 -- 172.21.15.153:0/1091575778 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800bd60 con 0x7f48680b49a0 2023-11-24T08:07:45.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.840+0000 7f486faa8700 1 -- 172.21.15.153:0/1091575778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48680b49a0 msgr2=0x7f486806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.840+0000 7f486faa8700 1 --2- 172.21.15.153:0/1091575778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48680b49a0 0x7f486806c540 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f4868075030 tx=0x7f4858009bd0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.840+0000 7f486faa8700 1 -- 172.21.15.153:0/1091575778 shutdown_connections 2023-11-24T08:07:45.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.840+0000 7f486faa8700 1 --2- 172.21.15.153:0/1091575778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48680cff20 0x7f48680d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.840+0000 7f486faa8700 1 --2- 172.21.15.153:0/1091575778 >> v2:172.21.15.164:3300/0 conn(0x7f4868152cc0 0x7f486806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.840+0000 7f486faa8700 1 --2- 172.21.15.153:0/1091575778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48680b49a0 0x7f486806c540 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.840+0000 7f486faa8700 1 -- 172.21.15.153:0/1091575778 >> 172.21.15.153:0/1091575778 conn(0x7f4868071b90 msgr2=0x7f4868071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:45.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.840+0000 7f486faa8700 1 -- 172.21.15.153:0/1091575778 shutdown_connections 2023-11-24T08:07:45.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.840+0000 7f486faa8700 1 -- 172.21.15.153:0/1091575778 wait complete. 2023-11-24T08:07:45.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.841+0000 7f486faa8700 1 Processor -- start 2023-11-24T08:07:45.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.841+0000 7f486faa8700 1 -- start start 2023-11-24T08:07:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486faa8700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48680b49a0 0x7f486813f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486faa8700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680cff20 0x7f4868159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486faa8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4868152cc0 0x7f486815e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486faa8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4868158ce0 con 0x7f4868152cc0 2023-11-24T08:07:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486faa8700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4868158060 con 0x7f48680cff20 2023-11-24T08:07:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486faa8700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4868158340 con 0x7f48680b49a0 2023-11-24T08:07:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486e045700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4868152cc0 0x7f486815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486e045700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4868152cc0 0x7f486815e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40208/0 (socket says 172.21.15.153:40208) 2023-11-24T08:07:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486e045700 1 -- 172.21.15.153:0/1985935800 learned_addr learned my addr 172.21.15.153:0/1985935800 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486d844700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48680b49a0 0x7f486813f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486e045700 1 -- 172.21.15.153:0/1985935800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48680b49a0 msgr2=0x7f486813f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486e045700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48680b49a0 0x7f486813f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486d043700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680cff20 0x7f4868159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486e045700 1 -- 172.21.15.153:0/1985935800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680cff20 msgr2=0x7f4868159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486e045700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680cff20 0x7f4868159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.842+0000 7f486e045700 1 -- 172.21.15.153:0/1985935800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4858009550 con 0x7f4868152cc0 2023-11-24T08:07:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.843+0000 7f486e045700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4868152cc0 0x7f486815e450 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f4860007e60 tx=0x7f486000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.843+0000 7f485e7fc700 1 -- 172.21.15.153:0/1985935800 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000ede0 con 0x7f4868152cc0 2023-11-24T08:07:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.843+0000 7f485e7fc700 1 -- 172.21.15.153:0/1985935800 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4860014420 con 0x7f4868152cc0 2023-11-24T08:07:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.843+0000 7f486faa8700 1 -- 172.21.15.153:0/1985935800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4868158620 con 0x7f4868152cc0 2023-11-24T08:07:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.843+0000 7f485e7fc700 1 -- 172.21.15.153:0/1985935800 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600147d0 con 0x7f4868152cc0 2023-11-24T08:07:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.843+0000 7f486faa8700 1 -- 172.21.15.153:0/1985935800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486813f810 con 0x7f4868152cc0 2023-11-24T08:07:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.844+0000 7f486faa8700 1 -- 172.21.15.153:0/1985935800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48680753f0 con 0x7f4868152cc0 2023-11-24T08:07:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.844+0000 7f485e7fc700 1 -- 172.21.15.153:0/1985935800 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4860014930 con 0x7f4868152cc0 2023-11-24T08:07:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.845+0000 7f485e7fc700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f484c06b080 0x7f484c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.845+0000 7f485e7fc700 1 -- 172.21.15.153:0/1985935800 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4860089c90 con 0x7f4868152cc0 2023-11-24T08:07:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.845+0000 7f486d844700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f484c06b080 0x7f484c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.845+0000 7f486d844700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f484c06b080 0x7f484c06d540 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4864009770 tx=0x7f4864008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:45.849+0000 7f485e7fc700 1 -- 172.21.15.153:0/1985935800 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4860054e50 con 0x7f4868152cc0 2023-11-24T08:07:46.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.037+0000 7f486faa8700 1 -- 172.21.15.153:0/1985935800 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f486815fa00 con 0x7f484c06b080 2023-11-24T08:07:46.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.039+0000 7f485e7fc700 1 -- 172.21.15.153:0/1985935800 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50568 (secure 0 0 0) 0x7f48640094e0 con 0x7f484c06b080 2023-11-24T08:07:46.041 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 -- 172.21.15.153:0/1985935800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f484c06b080 msgr2=0x7f484c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f484c06b080 0x7f484c06d540 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4864009770 tx=0x7f4864008040 comp rx=0 tx=0).stop 2023-11-24T08:07:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 -- 172.21.15.153:0/1985935800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4868152cc0 msgr2=0x7f486815e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4868152cc0 0x7f486815e450 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f4860007e60 tx=0x7f486000e3c0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 -- 172.21.15.153:0/1985935800 shutdown_connections 2023-11-24T08:07:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f484c06b080 0x7f484c06d540 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4868152cc0 0x7f486815e450 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48680b49a0 0x7f486813f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 --2- 172.21.15.153:0/1985935800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680cff20 0x7f4868159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 -- 172.21.15.153:0/1985935800 >> 172.21.15.153:0/1985935800 conn(0x7f4868071b90 msgr2=0x7f486806c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 -- 172.21.15.153:0/1985935800 shutdown_connections 2023-11-24T08:07:46.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.041+0000 7f486faa8700 1 -- 172.21.15.153:0/1985935800 wait complete. 2023-11-24T08:07:46.045 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:07:46.055 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-11-24T08:07:44.087241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222640,"kb_used_data":6480,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752080,"statfs":{"total":773094113280,"available":772866129920,"internally_reserved":0,"allocated":6635520,"data_stored":3417868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4058,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001207"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-24T08:07:17.177856+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:07:17.177856+0000","last_peered":"2023-11-24T08:07:17.177856+0000","last_clean":"2023-11-24T08:07:17.177856+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:07:17.177856+0000","last_undegraded":"2023-11-24T08:07:17.177856+0000","last_fullsized":"2023-11-24T08:07:17.177856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1273856,"data_stored":868487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72199999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.496},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.073,"15min":1.073},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.33200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.41899999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.317}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":277959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":10.285,"15min":10.285},"last":0.42699999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.745,"5min":2.089,"15min":2.089},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68400000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.627},{"interface":"front","average":{"1min":0.629,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.747,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":284130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.27100000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.20899999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33300000000000002,"15min":0.31900000000000001},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.252},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.22900000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.626,"15min":0.626},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.374}]},{"osd":5,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.5,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60699999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.309}]},{"osd":6,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.34000000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1659999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1277952,"data_stored":871291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.625,"5min":1.343,"15min":1.343},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61299999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.316}]},{"osd":3,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78600000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.505}]},{"osd":5,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.60399999999999998,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.93200000000000005,"15min":1.0720000000000001},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82499999999999996,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.44600000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.032,"15min":1.204},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.433},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":4,"15min":4},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":278015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.316,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.497,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.253},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.44,"15min":0.47199999999999998},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53600000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61799999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.59099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":5.673,"15min":5.673},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":1.216,"15min":1.216},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.246,"15min":1.246},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.82699999999999996},"min":{"1min":0.503,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.82999999999999996},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82099999999999995,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.758,"15min":5.758},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.89000000000000001},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":5.726,"15min":5.726},"last":0.502},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.499,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.625}]},{"osd":7,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.80300000000000005,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89400000000000002,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.94899999999999995},"min":{"1min":0.52000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99399999999999999,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":278015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.39600000000000002},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.59699999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58799999999999997,"5min":1.351,"15min":1.351},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40100000000000002,"15min":0.42699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.503,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.436},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.745,"5min":1.621,"15min":1.621},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.439},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63900000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45800000000000002,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64500000000000002,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.378}]},{"osd":4,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80500000000000005,"5min":1.389,"15min":1.389},"last":0.627},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90700000000000003,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.675,"15min":1.675},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":1.417,"15min":1.417},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.67100000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.54700000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95899999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":684032,"data_stored":281360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.5},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.496}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.623}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77100000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":1.101,"15min":1.101},"last":0.443},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":1.476,"15min":1.476},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.751,"5min":1.556,"15min":1.556},"last":0.48199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":278611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.314},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":1,"15min":1},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.495}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.77300000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":0.752},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:46.056 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T08:07:46.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:46.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.176+0000 7ff8ed5bf700 1 Processor -- start 2023-11-24T08:07:46.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.176+0000 7ff8ed5bf700 1 -- start start 2023-11-24T08:07:46.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8ed5bf700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8e815e480 0x7ff8e80d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8ed5bf700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff8e80d3610 0x7ff8e80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8ed5bf700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e80b62a0 con 0x7ff8e80b5e90 2023-11-24T08:07:46.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8ed5bf700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80d2a70 con 0x7ff8e80d3610 2023-11-24T08:07:46.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8ed5bf700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80d2d50 con 0x7ff8e815e480 2023-11-24T08:07:46.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e77fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff8e80b5e90 0x7ff8e806aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46320/0 (socket says 172.21.15.153:46320) 2023-11-24T08:07:46.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e77fe700 1 -- 172.21.15.153:0/2979844859 learned_addr learned my addr 172.21.15.153:0/2979844859 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:46.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e6ffd700 1 --2- 172.21.15.153:0/2979844859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8e815e480 0x7ff8e80d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e67fc700 1 --2- 172.21.15.153:0/2979844859 >> v2:172.21.15.164:3300/0 conn(0x7ff8e80d3610 0x7ff8e80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e5ffb700 1 -- 172.21.15.153:0/2979844859 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869394398 0 0) 0x7ff8e80b62a0 con 0x7ff8e80b5e90 2023-11-24T08:07:46.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e5ffb700 1 -- 172.21.15.153:0/2979844859 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d00035b0 con 0x7ff8e80b5e90 2023-11-24T08:07:46.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e67fc700 1 -- 172.21.15.153:0/2979844859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8e815e480 msgr2=0x7ff8e80d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:46.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e67fc700 1 --2- 172.21.15.153:0/2979844859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8e815e480 0x7ff8e80d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e67fc700 1 -- 172.21.15.153:0/2979844859 >> v1:172.21.15.153:6789/0 conn(0x7ff8e80b5e90 legacy=0x7ff8e806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e5ffb700 1 -- 172.21.15.153:0/2979844859 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1583627418 0 0) 0x7ff8d00035b0 con 0x7ff8e80b5e90 2023-11-24T08:07:46.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e67fc700 1 -- 172.21.15.153:0/2979844859 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e80d3030 con 0x7ff8e80d3610 2023-11-24T08:07:46.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.177+0000 7ff8e6ffd700 1 --2- 172.21.15.153:0/2979844859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8e815e480 0x7ff8e80d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:46.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8e67fc700 1 --2- 172.21.15.153:0/2979844859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8e80d3610 0x7ff8e80b5950 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009840 tx=0x7ff8d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=535e050935c2ad5c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8e5ffb700 1 -- 172.21.15.153:0/2979844859 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00019f0 con 0x7ff8e80d3610 2023-11-24T08:07:46.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8e5ffb700 1 -- 172.21.15.153:0/2979844859 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8004030 con 0x7ff8e80d3610 2023-11-24T08:07:46.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8e5ffb700 1 -- 172.21.15.153:0/2979844859 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80043a0 con 0x7ff8e80d3610 2023-11-24T08:07:46.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/2979844859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8e80d3610 msgr2=0x7ff8e80b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8ed5bf700 1 --2- 172.21.15.153:0/2979844859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8e80d3610 0x7ff8e80b5950 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009840 tx=0x7ff8d8009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:46.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/2979844859 shutdown_connections 2023-11-24T08:07:46.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8ed5bf700 1 --2- 172.21.15.153:0/2979844859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8e815e480 0x7ff8e80d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8ed5bf700 1 --2- 172.21.15.153:0/2979844859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8e80d3610 0x7ff8e80b5950 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/2979844859 >> 172.21.15.153:0/2979844859 conn(0x7ff8e80d0950 msgr2=0x7ff8e80d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/2979844859 shutdown_connections 2023-11-24T08:07:46.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.178+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/2979844859 wait complete. 2023-11-24T08:07:46.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.180+0000 7ff8ed5bf700 1 Processor -- start 2023-11-24T08:07:46.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.180+0000 7ff8ed5bf700 1 -- start start 2023-11-24T08:07:46.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.180+0000 7ff8ed5bf700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8e80b5e90 0x7ff8e8160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.180+0000 7ff8ed5bf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8e80d3610 0x7ff8e81f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.180+0000 7ff8ed5bf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8e815e480 0x7ff8e81f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.180+0000 7ff8ed5bf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e81608c0 con 0x7ff8e815e480 2023-11-24T08:07:46.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.180+0000 7ff8ed5bf700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e815fcb0 con 0x7ff8e80d3610 2023-11-24T08:07:46.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.180+0000 7ff8ed5bf700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e815ff90 con 0x7ff8e80b5e90 2023-11-24T08:07:46.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8e77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8e815e480 0x7ff8e81f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8e77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8e815e480 0x7ff8e81f4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40222/0 (socket says 172.21.15.153:40222) 2023-11-24T08:07:46.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8e77fe700 1 -- 172.21.15.153:0/37904522 learned_addr learned my addr 172.21.15.153:0/37904522 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:46.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8e67fc700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8e80d3610 0x7ff8e81f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8e6ffd700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8e80b5e90 0x7ff8e8160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8e77fe700 1 -- 172.21.15.153:0/37904522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8e80b5e90 msgr2=0x7ff8e8160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8e77fe700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8e80b5e90 0x7ff8e8160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8e77fe700 1 -- 172.21.15.153:0/37904522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8e80d3610 msgr2=0x7ff8e81f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8e77fe700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8e80d3610 0x7ff8e81f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8e77fe700 1 -- 172.21.15.153:0/37904522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0094a0 con 0x7ff8e815e480 2023-11-24T08:07:46.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8e77fe700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8e815e480 0x7ff8e81f4720 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000cb90 tx=0x7ff8e000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8cf7fe700 1 -- 172.21.15.153:0/37904522 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e000aaa0 con 0x7ff8e815e480 2023-11-24T08:07:46.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8cf7fe700 1 -- 172.21.15.153:0/37904522 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e000ac00 con 0x7ff8e815e480 2023-11-24T08:07:46.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/37904522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d80094a0 con 0x7ff8e815e480 2023-11-24T08:07:46.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8cf7fe700 1 -- 172.21.15.153:0/37904522 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00070d0 con 0x7ff8e815e480 2023-11-24T08:07:46.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.181+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/37904522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e8160550 con 0x7ff8e815e480 2023-11-24T08:07:46.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.182+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/37904522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e8160a30 con 0x7ff8e815e480 2023-11-24T08:07:46.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.183+0000 7ff8cf7fe700 1 -- 172.21.15.153:0/37904522 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff8e0007230 con 0x7ff8e815e480 2023-11-24T08:07:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.183+0000 7ff8cf7fe700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff8d406b080 0x7ff8d406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.183+0000 7ff8cf7fe700 1 -- 172.21.15.153:0/37904522 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff8e00892a0 con 0x7ff8e815e480 2023-11-24T08:07:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.183+0000 7ff8e6ffd700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff8d406b080 0x7ff8d406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.184+0000 7ff8e6ffd700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff8d406b080 0x7ff8d406d540 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009cd0 tx=0x7ff8dc009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.188+0000 7ff8cf7fe700 1 -- 172.21.15.153:0/37904522 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8e0054460 con 0x7ff8e815e480 2023-11-24T08:07:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.375+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/37904522 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8e80d2640 con 0x7ff8d406b080 2023-11-24T08:07:46.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.377+0000 7ff8cf7fe700 1 -- 172.21.15.153:0/37904522 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50801 (secure 0 0 0) 0x7ff8dc009e10 con 0x7ff8d406b080 2023-11-24T08:07:46.380 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:46.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/37904522 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff8d406b080 msgr2=0x7ff8d406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff8d406b080 0x7ff8d406d540 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009cd0 tx=0x7ff8dc009210 comp rx=0 tx=0).stop 2023-11-24T08:07:46.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/37904522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8e815e480 msgr2=0x7ff8e81f4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8e815e480 0x7ff8e81f4720 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000cb90 tx=0x7ff8e000cea0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/37904522 shutdown_connections 2023-11-24T08:07:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7ff8d406b080 0x7ff8d406d540 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8e815e480 0x7ff8e81f4720 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8e80b5e90 0x7ff8e8160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 --2- 172.21.15.153:0/37904522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8e80d3610 0x7ff8e81f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/37904522 >> 172.21.15.153:0/37904522 conn(0x7ff8e80d0950 msgr2=0x7ff8e80b6610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/37904522 shutdown_connections 2023-11-24T08:07:46.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.379+0000 7ff8ed5bf700 1 -- 172.21.15.153:0/37904522 wait complete. 2023-11-24T08:07:46.383 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:07:46.393 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-11-24T08:07:46.087545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222920,"kb_used_data":6756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751800,"statfs":{"total":773094113280,"available":772865843200,"internally_reserved":0,"allocated":6918144,"data_stored":3544581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4058,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.172670"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T08:07:43.108357+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:07:43.108357+0000","last_peered":"2023-11-24T08:07:43.108357+0000","last_clean":"2023-11-24T08:07:43.108357+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:07:43.108357+0000","last_undegraded":"2023-11-24T08:07:43.108357+0000","last_fullsized":"2023-11-24T08:07:43.108357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1310720,"data_stored":885976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72199999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.68899999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.073,"15min":1.073},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.33200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.437},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":10.285,"15min":10.285},"last":0.442}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.745,"5min":2.089,"15min":2.089},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68400000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.629,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.747,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.90900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.214},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.27100000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.29799999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33300000000000002,"15min":0.31900000000000001},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.28299999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.626,"15min":0.626},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.5,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60699999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1659999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1306624,"data_stored":884957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.625,"5min":1.343,"15min":1.343},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61299999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.32600000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78600000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.60399999999999998,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.93200000000000005,"15min":1.0720000000000001},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82499999999999996,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.627},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.032,"15min":1.204},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":4,"15min":4},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.316,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.497,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.214},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.44,"15min":0.47199999999999998},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.25}]},{"osd":1,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53600000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61799999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.29699999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.59099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":5.673,"15min":5.673},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":1.216,"15min":1.216},"last":0.307}]},{"osd":4,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.246,"15min":1.246},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.82699999999999996},"min":{"1min":0.503,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.82999999999999996},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82099999999999995,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.758,"15min":5.758},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.89000000000000001},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":5.726,"15min":5.726},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.499,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.80300000000000005,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89400000000000002,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.94899999999999995},"min":{"1min":0.52000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99399999999999999,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.60299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.39600000000000002},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.59699999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58799999999999997,"5min":1.351,"15min":1.351},"last":0.33600000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40100000000000002,"15min":0.42699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.503,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.745,"5min":1.621,"15min":1.621},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.439},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63900000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45800000000000002,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64500000000000002,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.38500000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80500000000000005,"5min":1.389,"15min":1.389},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90700000000000003,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.675,"15min":1.675},"last":0.44400000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":1.417,"15min":1.417},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.67100000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.51400000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95899999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.504}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.5},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77100000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":1.101,"15min":1.101},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.499,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":1.476,"15min":1.476},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.751,"5min":1.556,"15min":1.556},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":1,"15min":1},"last":0.435}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.498},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.77300000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":0.752},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:46.395 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:46.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.515+0000 7f9aaf301700 1 Processor -- start 2023-11-24T08:07:46.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.515+0000 7f9aaf301700 1 -- start start 2023-11-24T08:07:46.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aaf301700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9aa806c710 0x7f9aa80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aaf301700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9aa80af4d0 0x7f9aa80afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aaf301700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa80ae430 con 0x7f9aa815e080 2023-11-24T08:07:46.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aaf301700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa80af0b0 con 0x7f9aa806c710 2023-11-24T08:07:46.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aaf301700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa80b05a0 con 0x7f9aa80af4d0 2023-11-24T08:07:46.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aac89c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9aa806c710 0x7f9aa80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aac89c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9aa806c710 0x7f9aa80b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40228/0 (socket says 172.21.15.153:40228) 2023-11-24T08:07:46.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aac89c700 1 -- 172.21.15.153:0/708732740 learned_addr learned my addr 172.21.15.153:0/708732740 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:46.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aad89e700 1 --2- 172.21.15.153:0/708732740 >> v2:172.21.15.164:3300/0 conn(0x7f9aa80af4d0 0x7f9aa80afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aac89c700 1 -- 172.21.15.153:0/708732740 >> v2:172.21.15.164:3300/0 conn(0x7f9aa80af4d0 msgr2=0x7f9aa80afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aac89c700 1 --2- 172.21.15.153:0/708732740 >> v2:172.21.15.164:3300/0 conn(0x7f9aa80af4d0 0x7f9aa80afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aac89c700 1 -- 172.21.15.153:0/708732740 >> v1:172.21.15.164:6789/0 conn(0x7f9aa815e080 legacy=0x7f9aa806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.516+0000 7f9aac89c700 1 -- 172.21.15.153:0/708732740 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80ae710 con 0x7f9aa806c710 2023-11-24T08:07:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9aac89c700 1 --2- 172.21.15.153:0/708732740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aa806c710 0x7f9aa80b5050 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9aa809eea0 tx=0x7f9a98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6449e6d2cfa308 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9a9ffff700 1 -- 172.21.15.153:0/708732740 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011830 con 0x7f9aa806c710 2023-11-24T08:07:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9a9ffff700 1 -- 172.21.15.153:0/708732740 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a98011990 con 0x7f9aa806c710 2023-11-24T08:07:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9a9ffff700 1 -- 172.21.15.153:0/708732740 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011d20 con 0x7f9aa806c710 2023-11-24T08:07:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9aaf301700 1 -- 172.21.15.153:0/708732740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aa806c710 msgr2=0x7f9aa80b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9aaf301700 1 --2- 172.21.15.153:0/708732740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aa806c710 0x7f9aa80b5050 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9aa809eea0 tx=0x7f9a98009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9aaf301700 1 -- 172.21.15.153:0/708732740 shutdown_connections 2023-11-24T08:07:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9aaf301700 1 --2- 172.21.15.153:0/708732740 >> v2:172.21.15.164:3300/0 conn(0x7f9aa80af4d0 0x7f9aa80afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9aaf301700 1 --2- 172.21.15.153:0/708732740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aa806c710 0x7f9aa80b5050 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9aaf301700 1 -- 172.21.15.153:0/708732740 >> 172.21.15.153:0/708732740 conn(0x7f9aa8071b90 msgr2=0x7f9aa8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9aaf301700 1 -- 172.21.15.153:0/708732740 shutdown_connections 2023-11-24T08:07:46.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.517+0000 7f9aaf301700 1 -- 172.21.15.153:0/708732740 wait complete. 2023-11-24T08:07:46.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.519+0000 7f9aaf301700 1 Processor -- start 2023-11-24T08:07:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.519+0000 7f9aaf301700 1 -- start start 2023-11-24T08:07:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.519+0000 7f9aaf301700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9aa806c710 0x7f9aa8141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.519+0000 7f9aaf301700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aa80af4d0 0x7f9aa80cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.519+0000 7f9aaf301700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9aa815e080 0x7f9aa8142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.519+0000 7f9aaf301700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80cf390 con 0x7f9aa80af4d0 2023-11-24T08:07:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.519+0000 7f9aaf301700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80ce710 con 0x7f9aa815e080 2023-11-24T08:07:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.519+0000 7f9aaf301700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80ce9f0 con 0x7f9aa806c710 2023-11-24T08:07:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.519+0000 7f9aac89c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aa80af4d0 0x7f9aa80cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.519+0000 7f9aac89c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aa80af4d0 0x7f9aa80cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40234/0 (socket says 172.21.15.153:40234) 2023-11-24T08:07:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.519+0000 7f9aac89c700 1 -- 172.21.15.153:0/3965668019 learned_addr learned my addr 172.21.15.153:0/3965668019 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9aad89e700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9aa815e080 0x7f9aa8142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9aad09d700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9aa806c710 0x7f9aa8141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9aac89c700 1 -- 172.21.15.153:0/3965668019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9aa806c710 msgr2=0x7f9aa8141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9aac89c700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9aa806c710 0x7f9aa8141de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9aac89c700 1 -- 172.21.15.153:0/3965668019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9aa815e080 msgr2=0x7f9aa8142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9aac89c700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9aa815e080 0x7f9aa8142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9aac89c700 1 -- 172.21.15.153:0/3965668019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98009550 con 0x7f9aa80af4d0 2023-11-24T08:07:46.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9aad89e700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9aa815e080 0x7f9aa8142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:46.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9aac89c700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aa80af4d0 0x7f9aa80cf7b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009c40 tx=0x7f9a98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9a9dffb700 1 -- 172.21.15.153:0/3965668019 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98004480 con 0x7f9aa80af4d0 2023-11-24T08:07:46.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9a9dffb700 1 -- 172.21.15.153:0/3965668019 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9801f070 con 0x7f9aa80af4d0 2023-11-24T08:07:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9aaf301700 1 -- 172.21.15.153:0/3965668019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa80cecd0 con 0x7f9aa80af4d0 2023-11-24T08:07:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9a9dffb700 1 -- 172.21.15.153:0/3965668019 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980038a0 con 0x7f9aa80af4d0 2023-11-24T08:07:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.520+0000 7f9aaf301700 1 -- 172.21.15.153:0/3965668019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa8142320 con 0x7f9aa80af4d0 2023-11-24T08:07:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.521+0000 7f9aaf301700 1 -- 172.21.15.153:0/3965668019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa80753f0 con 0x7f9aa80af4d0 2023-11-24T08:07:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.522+0000 7f9a9dffb700 1 -- 172.21.15.153:0/3965668019 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9a98021030 con 0x7f9aa80af4d0 2023-11-24T08:07:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.522+0000 7f9a9dffb700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9a8c06b080 0x7f9a8c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.522+0000 7f9a9dffb700 1 -- 172.21.15.153:0/3965668019 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9a9808aa60 con 0x7f9aa80af4d0 2023-11-24T08:07:46.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.522+0000 7f9aad09d700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9a8c06b080 0x7f9a8c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.523+0000 7f9aad09d700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9a8c06b080 0x7f9a8c06d540 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4000f60 tx=0x7f9aa4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.527+0000 7f9a9dffb700 1 -- 172.21.15.153:0/3965668019 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a98055c20 con 0x7f9aa80af4d0 2023-11-24T08:07:46.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.717+0000 7f9aaf301700 1 -- 172.21.15.153:0/3965668019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9aa80cf4d0 con 0x7f9aa80af4d0 2023-11-24T08:07:46.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.718+0000 7f9a9dffb700 1 -- 172.21.15.153:0/3965668019 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+13024 (secure 0 0 0) 0x7f9aa80cf4d0 con 0x7f9aa80af4d0 2023-11-24T08:07:46.720 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:46.720 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":59,"fsid":"a594d4d2-de60-4a04-bb93-76779d526986","created":"2023-11-24T08:03:54.360279+0000","modified":"2023-11-24T08:07:43.272559+0000","last_up_change":"2023-11-24T08:04:05.097171+0000","last_in_change":"2023-11-24T08:03:56.867721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:04:06.085280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6065e1a-81e5-4b14-bdc6-6427e75ceebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6801","nonce":486972395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6803","nonce":486972395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6807","nonce":486972395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":486972395},{"type":"v1","addr":"172.21.15.153:6805","nonce":486972395}]},"public_addr":"172.21.15.153:6801/486972395","cluster_addr":"172.21.15.153:6803/486972395","heartbeat_back_addr":"172.21.15.153:6807/486972395","heartbeat_front_addr":"172.21.15.153:6805/486972395","state":["exists","up"]},{"osd":1,"uuid":"d416c3bb-a85f-4c70-b5ea-740bc5182eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6811","nonce":3506833465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6815","nonce":3506833465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6823","nonce":3506833465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":3506833465},{"type":"v1","addr":"172.21.15.153:6819","nonce":3506833465}]},"public_addr":"172.21.15.153:6811/3506833465","cluster_addr":"172.21.15.153:6815/3506833465","heartbeat_back_addr":"172.21.15.153:6823/3506833465","heartbeat_front_addr":"172.21.15.153:6819/3506833465","state":["exists","up"]},{"osd":2,"uuid":"330df0f9-611a-442a-becf-3e8d2919cbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6810","nonce":3697118367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6814","nonce":3697118367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6822","nonce":3697118367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3697118367},{"type":"v1","addr":"172.21.15.153:6818","nonce":3697118367}]},"public_addr":"172.21.15.153:6810/3697118367","cluster_addr":"172.21.15.153:6814/3697118367","heartbeat_back_addr":"172.21.15.153:6822/3697118367","heartbeat_front_addr":"172.21.15.153:6818/3697118367","state":["exists","up"]},{"osd":3,"uuid":"84627f84-784e-42e5-bcce-e2cd257e53a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6825","nonce":1489086647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6827","nonce":1489086647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6831","nonce":1489086647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1489086647},{"type":"v1","addr":"172.21.15.153:6829","nonce":1489086647}]},"public_addr":"172.21.15.153:6825/1489086647","cluster_addr":"172.21.15.153:6827/1489086647","heartbeat_back_addr":"172.21.15.153:6831/1489086647","heartbeat_front_addr":"172.21.15.153:6829/1489086647","state":["exists","up"]},{"osd":4,"uuid":"8b85c70d-b206-40de-9fe2-8aad22c2804b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6802","nonce":3824651650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6805","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6807","nonce":3824651650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6815","nonce":3824651650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6809","nonce":3824651650},{"type":"v1","addr":"172.21.15.164:6811","nonce":3824651650}]},"public_addr":"172.21.15.164:6802/3824651650","cluster_addr":"172.21.15.164:6807/3824651650","heartbeat_back_addr":"172.21.15.164:6815/3824651650","heartbeat_front_addr":"172.21.15.164:6811/3824651650","state":["exists","up"]},{"osd":5,"uuid":"af815c84-01be-40c2-83a2-97483fc8fecf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6801","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6803","nonce":2836417954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6806","nonce":2836417954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6814","nonce":2836417954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":2836417954},{"type":"v1","addr":"172.21.15.164:6810","nonce":2836417954}]},"public_addr":"172.21.15.164:6803/2836417954","cluster_addr":"172.21.15.164:6806/2836417954","heartbeat_back_addr":"172.21.15.164:6814/2836417954","heartbeat_front_addr":"172.21.15.164:6810/2836417954","state":["exists","up"]},{"osd":6,"uuid":"23bfab6c-1646-4508-9629-df61b02320ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6825","nonce":1534902913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6827","nonce":1534902913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6831","nonce":1534902913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1534902913},{"type":"v1","addr":"172.21.15.164:6829","nonce":1534902913}]},"public_addr":"172.21.15.164:6825/1534902913","cluster_addr":"172.21.15.164:6827/1534902913","heartbeat_back_addr":"172.21.15.164:6831/1534902913","heartbeat_front_addr":"172.21.15.164:6829/1534902913","state":["exists","up"]},{"osd":7,"uuid":"9db18f97-85f2-4a6a-b358-a73c682805a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6817","nonce":525702944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6819","nonce":525702944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6823","nonce":525702944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":525702944},{"type":"v1","addr":"172.21.15.164:6821","nonce":525702944}]},"public_addr":"172.21.15.164:6817/525702944","cluster_addr":"172.21.15.164:6819/525702944","heartbeat_back_addr":"172.21.15.164:6823/525702944","heartbeat_front_addr":"172.21.15.164:6821/525702944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:01.877090+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.064982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.078113+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.108533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.043276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.102725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.054540+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:04:02.034815+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:6835/3019873912":"2023-11-25T08:07:39.912772+0000","172.21.15.164:6833/3019873912":"2023-11-25T08:07:39.912772+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:46.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.720+0000 7f9aaf301700 1 -- 172.21.15.153:0/3965668019 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9a8c06b080 msgr2=0x7f9a8c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.720+0000 7f9aaf301700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9a8c06b080 0x7f9a8c06d540 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4000f60 tx=0x7f9aa4009040 comp rx=0 tx=0).stop 2023-11-24T08:07:46.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.720+0000 7f9aaf301700 1 -- 172.21.15.153:0/3965668019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aa80af4d0 msgr2=0x7f9aa80cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.720+0000 7f9aaf301700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aa80af4d0 0x7f9aa80cf7b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009c40 tx=0x7f9a98004750 comp rx=0 tx=0).stop 2023-11-24T08:07:46.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.720+0000 7f9aaf301700 1 -- 172.21.15.153:0/3965668019 shutdown_connections 2023-11-24T08:07:46.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.720+0000 7f9aaf301700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9aa815e080 0x7f9aa8142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.720+0000 7f9aaf301700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9aa806c710 0x7f9aa8141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.720+0000 7f9aaf301700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9a8c06b080 0x7f9a8c06d540 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.720+0000 7f9aaf301700 1 --2- 172.21.15.153:0/3965668019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aa80af4d0 0x7f9aa80cf7b0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.721+0000 7f9aaf301700 1 -- 172.21.15.153:0/3965668019 >> 172.21.15.153:0/3965668019 conn(0x7f9aa8071b90 msgr2=0x7f9aa806bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.721+0000 7f9aaf301700 1 -- 172.21.15.153:0/3965668019 shutdown_connections 2023-11-24T08:07:46.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:46.721+0000 7f9aaf301700 1 -- 172.21.15.153:0/3965668019 wait complete. 2023-11-24T08:07:47.735 INFO:tasks.ceph:Scrubbing osd.0 2023-11-24T08:07:47.735 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:47.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.872+0000 7f2d2ba04700 1 Processor -- start 2023-11-24T08:07:47.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.872+0000 7f2d2ba04700 1 -- start start 2023-11-24T08:07:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d2ba04700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2d240b01e0 0x7f2d2406e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d2ba04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2d240b59c0 0x7f2d240b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d2ba04700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d24073f90 0x7f2d240743b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d2ba04700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d241470a0 con 0x7f2d240b59c0 2023-11-24T08:07:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d2ba04700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d240b5e70 con 0x7f2d240b01e0 2023-11-24T08:07:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d2ba04700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d240748f0 con 0x7f2d24073f90 2023-11-24T08:07:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d28f9f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2d240b59c0 0x7f2d240b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d28f9f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2d240b59c0 0x7f2d240b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40240/0 (socket says 172.21.15.153:40240) 2023-11-24T08:07:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d28f9f700 1 -- 172.21.15.153:0/1224471448 learned_addr learned my addr 172.21.15.153:0/1224471448 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d297a0700 1 --2- 172.21.15.153:0/1224471448 >> v2:172.21.15.164:3300/0 conn(0x7f2d240b01e0 0x7f2d2406e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d28f9f700 1 -- 172.21.15.153:0/1224471448 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d24073f90 msgr2=0x7f2d240743b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:47.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d29fa1700 1 --2- 172.21.15.153:0/1224471448 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d24073f90 0x7f2d240743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d28f9f700 1 --2- 172.21.15.153:0/1224471448 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d24073f90 0x7f2d240743b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d28f9f700 1 -- 172.21.15.153:0/1224471448 >> v2:172.21.15.164:3300/0 conn(0x7f2d240b01e0 msgr2=0x7f2d2406e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:47.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d28f9f700 1 --2- 172.21.15.153:0/1224471448 >> v2:172.21.15.164:3300/0 conn(0x7f2d240b01e0 0x7f2d2406e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d28f9f700 1 -- 172.21.15.153:0/1224471448 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240b05c0 con 0x7f2d240b59c0 2023-11-24T08:07:47.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d297a0700 1 --2- 172.21.15.153:0/1224471448 >> v2:172.21.15.164:3300/0 conn(0x7f2d240b01e0 0x7f2d2406e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:47.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.873+0000 7f2d28f9f700 1 --2- 172.21.15.153:0/1224471448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d240b59c0 0x7f2d240b3b50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2d24072ce0 tx=0x7f2d20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3aef98a5a5505c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d1bfff700 1 -- 172.21.15.153:0/1224471448 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000b860 con 0x7f2d240b59c0 2023-11-24T08:07:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d1bfff700 1 -- 172.21.15.153:0/1224471448 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2000b9c0 con 0x7f2d240b59c0 2023-11-24T08:07:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d1bfff700 1 -- 172.21.15.153:0/1224471448 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000bd50 con 0x7f2d240b59c0 2023-11-24T08:07:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d2ba04700 1 -- 172.21.15.153:0/1224471448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d240b59c0 msgr2=0x7f2d240b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d2ba04700 1 --2- 172.21.15.153:0/1224471448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d240b59c0 0x7f2d240b3b50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2d24072ce0 tx=0x7f2d20009c00 comp rx=0 tx=0).stop 2023-11-24T08:07:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d2ba04700 1 -- 172.21.15.153:0/1224471448 shutdown_connections 2023-11-24T08:07:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d2ba04700 1 --2- 172.21.15.153:0/1224471448 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d24073f90 0x7f2d240743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d2ba04700 1 --2- 172.21.15.153:0/1224471448 >> v2:172.21.15.164:3300/0 conn(0x7f2d240b01e0 0x7f2d2406e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d2ba04700 1 --2- 172.21.15.153:0/1224471448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d240b59c0 0x7f2d240b3b50 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d2ba04700 1 -- 172.21.15.153:0/1224471448 >> 172.21.15.153:0/1224471448 conn(0x7f2d240d0b40 msgr2=0x7f2d240d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:47.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d2ba04700 1 -- 172.21.15.153:0/1224471448 shutdown_connections 2023-11-24T08:07:47.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.874+0000 7f2d2ba04700 1 -- 172.21.15.153:0/1224471448 wait complete. 2023-11-24T08:07:47.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.875+0000 7f2d2ba04700 1 Processor -- start 2023-11-24T08:07:47.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.875+0000 7f2d2ba04700 1 -- start start 2023-11-24T08:07:47.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.876+0000 7f2d2ba04700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d24073f90 0x7f2d2415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.876+0000 7f2d2ba04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d240b01e0 0x7f2d24138100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.876+0000 7f2d2ba04700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d240b59c0 0x7f2d241f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.876+0000 7f2d2ba04700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d24160150 con 0x7f2d240b01e0 2023-11-24T08:07:47.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.876+0000 7f2d2ba04700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2415f4d0 con 0x7f2d24073f90 2023-11-24T08:07:47.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.876+0000 7f2d2ba04700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2415f7b0 con 0x7f2d240b59c0 2023-11-24T08:07:47.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.876+0000 7f2d28f9f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d240b01e0 0x7f2d24138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.876+0000 7f2d28f9f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d240b01e0 0x7f2d24138100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40248/0 (socket says 172.21.15.153:40248) 2023-11-24T08:07:47.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.876+0000 7f2d28f9f700 1 -- 172.21.15.153:0/3116056637 learned_addr learned my addr 172.21.15.153:0/3116056637 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:47.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.876+0000 7f2d297a0700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d24073f90 0x7f2d2415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d29fa1700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d240b59c0 0x7f2d241f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d28f9f700 1 -- 172.21.15.153:0/3116056637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d240b59c0 msgr2=0x7f2d241f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d28f9f700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d240b59c0 0x7f2d241f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d28f9f700 1 -- 172.21.15.153:0/3116056637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d24073f90 msgr2=0x7f2d2415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d28f9f700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d24073f90 0x7f2d2415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d28f9f700 1 -- 172.21.15.153:0/3116056637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d20009550 con 0x7f2d240b01e0 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d297a0700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d24073f90 0x7f2d2415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d28f9f700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d240b01e0 0x7f2d24138100 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2d20014040 tx=0x7f2d20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d19ffb700 1 -- 172.21.15.153:0/3116056637 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200036a0 con 0x7f2d240b01e0 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d19ffb700 1 -- 172.21.15.153:0/3116056637 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2001e070 con 0x7f2d240b01e0 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d2ba04700 1 -- 172.21.15.153:0/3116056637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2415fa90 con 0x7f2d240b01e0 2023-11-24T08:07:47.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d19ffb700 1 -- 172.21.15.153:0/3116056637 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20003a60 con 0x7f2d240b01e0 2023-11-24T08:07:47.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.877+0000 7f2d2ba04700 1 -- 172.21.15.153:0/3116056637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d240c7750 con 0x7f2d240b01e0 2023-11-24T08:07:47.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.878+0000 7f2d2ba04700 1 -- 172.21.15.153:0/3116056637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d2406dee0 con 0x7f2d240b01e0 2023-11-24T08:07:47.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.879+0000 7f2d19ffb700 1 -- 172.21.15.153:0/3116056637 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2d20003bc0 con 0x7f2d240b01e0 2023-11-24T08:07:47.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.879+0000 7f2d19ffb700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2d0806b080 0x7f2d0806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.879+0000 7f2d19ffb700 1 -- 172.21.15.153:0/3116056637 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2d20020070 con 0x7f2d240b01e0 2023-11-24T08:07:47.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.879+0000 7f2d297a0700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2d0806b080 0x7f2d0806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.879+0000 7f2d19ffb700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] conn(0x7f2d08070ee0 0x7f2d08073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.879+0000 7f2d19ffb700 1 -- 172.21.15.153:0/3116056637 --> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d080739d0 con 0x7f2d08070ee0 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.879+0000 7f2d19ffb700 1 -- 172.21.15.153:0/3116056637 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d2008f2a0 con 0x7f2d240b01e0 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.879+0000 7f2d29fa1700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] conn(0x7f2d08070ee0 0x7f2d08073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.880+0000 7f2d297a0700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2d0806b080 0x7f2d0806d540 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2d14006fd0 tx=0x7f2d14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.880+0000 7f2d29fa1700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] conn(0x7f2d08070ee0 0x7f2d08073300 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.880+0000 7f2d19ffb700 1 -- 172.21.15.153:0/3116056637 <== osd.0 v2:172.21.15.153:6800/486972395 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2d080739d0 con 0x7f2d08070ee0 2023-11-24T08:07:47.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.895+0000 7f2d2ba04700 1 -- 172.21.15.153:0/3116056637 --> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2d2406dc00 con 0x7f2d08070ee0 2023-11-24T08:07:47.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.895+0000 7f2d19ffb700 1 -- 172.21.15.153:0/3116056637 <== osd.0 v2:172.21.15.153:6800/486972395 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2d1c00f400 con 0x7f2d08070ee0 2023-11-24T08:07:47.897 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:07:47.898 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:47.898 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:07:47.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.896+0000 7f2d2ba04700 1 -- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] conn(0x7f2d08070ee0 msgr2=0x7f2d08073300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.896+0000 7f2d2ba04700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:6800/486972395,v1:172.21.15.153:6801/486972395] conn(0x7f2d08070ee0 0x7f2d08073300 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.896+0000 7f2d2ba04700 1 -- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2d0806b080 msgr2=0x7f2d0806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.896+0000 7f2d2ba04700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2d0806b080 0x7f2d0806d540 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2d14006fd0 tx=0x7f2d14008040 comp rx=0 tx=0).stop 2023-11-24T08:07:47.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.896+0000 7f2d2ba04700 1 -- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d240b01e0 msgr2=0x7f2d24138100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.896+0000 7f2d2ba04700 1 --2- 172.21.15.153:0/3116056637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d240b01e0 0x7f2d24138100 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2d20014040 tx=0x7f2d20004750 comp rx=0 tx=0).stop 2023-11-24T08:07:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.896+0000 7f2d29fa1700 1 -- 172.21.15.153:0/3116056637 reap_dead start 2023-11-24T08:07:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.896+0000 7f2d2ba04700 1 -- 172.21.15.153:0/3116056637 shutdown_connections 2023-11-24T08:07:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.896+0000 7f2d2ba04700 1 -- 172.21.15.153:0/3116056637 >> 172.21.15.153:0/3116056637 conn(0x7f2d240d0b40 msgr2=0x7f2d240b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.896+0000 7f2d2ba04700 1 -- 172.21.15.153:0/3116056637 shutdown_connections 2023-11-24T08:07:47.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:47.896+0000 7f2d2ba04700 1 -- 172.21.15.153:0/3116056637 wait complete. 2023-11-24T08:07:47.909 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-24T08:07:48.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.030+0000 7f176d93a700 1 Processor -- start 2023-11-24T08:07:48.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.030+0000 7f176d93a700 1 -- start start 2023-11-24T08:07:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f176d93a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17680d0870 0x7f17680d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f176d93a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17680b6ef0 0x7f17680b7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f176d93a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17680d1210 con 0x7f176815e1e0 2023-11-24T08:07:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f176d93a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17680d3150 con 0x7f17680b6ef0 2023-11-24T08:07:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f176d93a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176815e5c0 con 0x7f17680d0870 2023-11-24T08:07:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f17677fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17680b6ef0 0x7f17680b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f17677fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17680b6ef0 0x7f17680b7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40260/0 (socket says 172.21.15.153:40260) 2023-11-24T08:07:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f17677fe700 1 -- 172.21.15.153:0/2247899227 learned_addr learned my addr 172.21.15.153:0/2247899227 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f17667fc700 1 --2- 172.21.15.153:0/2247899227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17680d0870 0x7f17680d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f17677fe700 1 -- 172.21.15.153:0/2247899227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17680d0870 msgr2=0x7f17680d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f17677fe700 1 --2- 172.21.15.153:0/2247899227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17680d0870 0x7f17680d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f17677fe700 1 -- 172.21.15.153:0/2247899227 >> v1:172.21.15.164:6789/0 conn(0x7f176815e1e0 legacy=0x7f17680d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f17677fe700 1 -- 172.21.15.153:0/2247899227 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680d20b0 con 0x7f17680b6ef0 2023-11-24T08:07:48.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f17677fe700 1 --2- 172.21.15.153:0/2247899227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17680b6ef0 0x7f17680b7380 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1760009e50 tx=0x7f176000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b16c6657c1caddf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f1765ffb700 1 -- 172.21.15.153:0/2247899227 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000e070 con 0x7f17680b6ef0 2023-11-24T08:07:48.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f1765ffb700 1 -- 172.21.15.153:0/2247899227 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176000b9c0 con 0x7f17680b6ef0 2023-11-24T08:07:48.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.031+0000 7f1765ffb700 1 -- 172.21.15.153:0/2247899227 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000bd70 con 0x7f17680b6ef0 2023-11-24T08:07:48.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.032+0000 7f176d93a700 1 -- 172.21.15.153:0/2247899227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17680b6ef0 msgr2=0x7f17680b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.032+0000 7f176d93a700 1 --2- 172.21.15.153:0/2247899227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17680b6ef0 0x7f17680b7380 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1760009e50 tx=0x7f176000b330 comp rx=0 tx=0).stop 2023-11-24T08:07:48.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.032+0000 7f176d93a700 1 -- 172.21.15.153:0/2247899227 shutdown_connections 2023-11-24T08:07:48.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.032+0000 7f176d93a700 1 --2- 172.21.15.153:0/2247899227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17680b6ef0 0x7f17680b7380 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.032+0000 7f176d93a700 1 --2- 172.21.15.153:0/2247899227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17680d0870 0x7f17680d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.032+0000 7f176d93a700 1 -- 172.21.15.153:0/2247899227 >> 172.21.15.153:0/2247899227 conn(0x7f17680b5b50 msgr2=0x7f17680b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.032+0000 7f176d93a700 1 -- 172.21.15.153:0/2247899227 shutdown_connections 2023-11-24T08:07:48.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.032+0000 7f176d93a700 1 -- 172.21.15.153:0/2247899227 wait complete. 2023-11-24T08:07:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.033+0000 7f176d93a700 1 Processor -- start 2023-11-24T08:07:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.033+0000 7f176d93a700 1 -- start start 2023-11-24T08:07:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.034+0000 7f176d93a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17680b6ef0 0x7f17681513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.034+0000 7f176d93a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17680d0870 0x7f17680cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.034+0000 7f176d93a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f176815e1e0 0x7f17680cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.034+0000 7f176d93a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680cbe90 con 0x7f17680b6ef0 2023-11-24T08:07:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.034+0000 7f176d93a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680caf30 con 0x7f17680d0870 2023-11-24T08:07:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.034+0000 7f176d93a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17680cb210 con 0x7f176815e1e0 2023-11-24T08:07:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.034+0000 7f1766ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17680b6ef0 0x7f17681513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.034+0000 7f1766ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17680b6ef0 0x7f17681513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40262/0 (socket says 172.21.15.153:40262) 2023-11-24T08:07:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.034+0000 7f1766ffd700 1 -- 172.21.15.153:0/2508455240 learned_addr learned my addr 172.21.15.153:0/2508455240 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.034+0000 7f17677fe700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f176815e1e0 0x7f17680cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.034+0000 7f17667fc700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17680d0870 0x7f17680cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f1766ffd700 1 -- 172.21.15.153:0/2508455240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f176815e1e0 msgr2=0x7f17680cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f1766ffd700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f176815e1e0 0x7f17680cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f1766ffd700 1 -- 172.21.15.153:0/2508455240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17680d0870 msgr2=0x7f17680cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f1766ffd700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17680d0870 0x7f17680cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f1766ffd700 1 -- 172.21.15.153:0/2508455240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009b30 con 0x7f17680b6ef0 2023-11-24T08:07:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f17677fe700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f176815e1e0 0x7f17680cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f17667fc700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17680d0870 0x7f17680cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f1766ffd700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17680b6ef0 0x7f17681513d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f175800c450 tx=0x7f175800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f174ffff700 1 -- 172.21.15.153:0/2508455240 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17580052d0 con 0x7f17680b6ef0 2023-11-24T08:07:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f174ffff700 1 -- 172.21.15.153:0/2508455240 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758005430 con 0x7f17680b6ef0 2023-11-24T08:07:48.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f174ffff700 1 -- 172.21.15.153:0/2508455240 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17580038c0 con 0x7f17680b6ef0 2023-11-24T08:07:48.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f176d93a700 1 -- 172.21.15.153:0/2508455240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17680cb4f0 con 0x7f17680b6ef0 2023-11-24T08:07:48.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.035+0000 7f176d93a700 1 -- 172.21.15.153:0/2508455240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17680cbab0 con 0x7f17680b6ef0 2023-11-24T08:07:48.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.036+0000 7f176d93a700 1 -- 172.21.15.153:0/2508455240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17680751e0 con 0x7f17680b6ef0 2023-11-24T08:07:48.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.036+0000 7f174ffff700 1 -- 172.21.15.153:0/2508455240 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1758003a20 con 0x7f17680b6ef0 2023-11-24T08:07:48.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.037+0000 7f174ffff700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f175406b080 0x7f175406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.037+0000 7f17667fc700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f175406b080 0x7f175406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.037+0000 7f174ffff700 1 -- 172.21.15.153:0/2508455240 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f17580889f0 con 0x7f17680b6ef0 2023-11-24T08:07:48.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.037+0000 7f17667fc700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f175406b080 0x7f175406d540 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f17680cf2a0 tx=0x7f175c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.041+0000 7f174ffff700 1 -- 172.21.15.153:0/2508455240 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1758053a80 con 0x7f17680b6ef0 2023-11-24T08:07:48.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.232+0000 7f176d93a700 1 -- 172.21.15.153:0/2508455240 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f17680d2950 con 0x7f175406b080 2023-11-24T08:07:48.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.232+0000 7f174ffff700 1 -- 172.21.15.153:0/2508455240 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f175c009680 con 0x7f175406b080 2023-11-24T08:07:48.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 -- 172.21.15.153:0/2508455240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f175406b080 msgr2=0x7f175406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f175406b080 0x7f175406d540 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f17680cf2a0 tx=0x7f175c008040 comp rx=0 tx=0).stop 2023-11-24T08:07:48.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 -- 172.21.15.153:0/2508455240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17680b6ef0 msgr2=0x7f17681513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17680b6ef0 0x7f17681513d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f175800c450 tx=0x7f175800c810 comp rx=0 tx=0).stop 2023-11-24T08:07:48.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 -- 172.21.15.153:0/2508455240 shutdown_connections 2023-11-24T08:07:48.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f176815e1e0 0x7f17680cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f175406b080 0x7f175406d540 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17680b6ef0 0x7f17681513d0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 --2- 172.21.15.153:0/2508455240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17680d0870 0x7f17680cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 -- 172.21.15.153:0/2508455240 >> 172.21.15.153:0/2508455240 conn(0x7f17680b5b50 msgr2=0x7f17680b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 -- 172.21.15.153:0/2508455240 shutdown_connections 2023-11-24T08:07:48.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.234+0000 7f176d93a700 1 -- 172.21.15.153:0/2508455240 wait complete. 2023-11-24T08:07:48.238 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 0 to deep-scrub 2023-11-24T08:07:48.247 INFO:tasks.ceph:Scrubbing osd.1 2023-11-24T08:07:48.248 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:48.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.371+0000 7f466addd700 1 Processor -- start 2023-11-24T08:07:48.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.371+0000 7f466addd700 1 -- start start 2023-11-24T08:07:48.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f466addd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4664145620 0x7f466406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f466addd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4664073f90 0x7f4664074400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f466addd700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46640cf530 con 0x7f46640cd810 2023-11-24T08:07:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f466addd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466406b700 con 0x7f4664073f90 2023-11-24T08:07:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f466addd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4664074940 con 0x7f4664145620 2023-11-24T08:07:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f466937a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4664073f90 0x7f4664074400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f4663fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f46640cd810 0x7f466406aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46376/0 (socket says 172.21.15.153:46376) 2023-11-24T08:07:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f4663fff700 1 -- 172.21.15.153:0/2756384347 learned_addr learned my addr 172.21.15.153:0/2756384347 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f4668b79700 1 --2- 172.21.15.153:0/2756384347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4664145620 0x7f466406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f466937a700 1 -- 172.21.15.153:0/2756384347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4664145620 msgr2=0x7f466406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:48.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f466937a700 1 --2- 172.21.15.153:0/2756384347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4664145620 0x7f466406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f466937a700 1 -- 172.21.15.153:0/2756384347 >> v1:172.21.15.153:6789/0 conn(0x7f46640cd810 legacy=0x7f466406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f46637fe700 1 -- 172.21.15.153:0/2756384347 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241619424 0 0) 0x7f46640cf530 con 0x7f46640cd810 2023-11-24T08:07:48.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.372+0000 7f466937a700 1 -- 172.21.15.153:0/2756384347 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466406b8f0 con 0x7f4664073f90 2023-11-24T08:07:48.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f466937a700 1 --2- 172.21.15.153:0/2756384347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4664073f90 0x7f4664074400 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f465c009dc0 tx=0x7f465c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b68f296a079c26b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f46637fe700 1 -- 172.21.15.153:0/2756384347 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c00e070 con 0x7f4664073f90 2023-11-24T08:07:48.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f46637fe700 1 -- 172.21.15.153:0/2756384347 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c00bb90 con 0x7f4664073f90 2023-11-24T08:07:48.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f46637fe700 1 -- 172.21.15.153:0/2756384347 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c012430 con 0x7f4664073f90 2023-11-24T08:07:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f466addd700 1 -- 172.21.15.153:0/2756384347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4664073f90 msgr2=0x7f4664074400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f466addd700 1 --2- 172.21.15.153:0/2756384347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4664073f90 0x7f4664074400 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f465c009dc0 tx=0x7f465c00b330 comp rx=0 tx=0).stop 2023-11-24T08:07:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f466addd700 1 -- 172.21.15.153:0/2756384347 shutdown_connections 2023-11-24T08:07:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f466addd700 1 --2- 172.21.15.153:0/2756384347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4664145620 0x7f466406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f466addd700 1 --2- 172.21.15.153:0/2756384347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4664073f90 0x7f4664074400 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f466addd700 1 -- 172.21.15.153:0/2756384347 >> 172.21.15.153:0/2756384347 conn(0x7f46640d0b40 msgr2=0x7f46640d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f466addd700 1 -- 172.21.15.153:0/2756384347 shutdown_connections 2023-11-24T08:07:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.373+0000 7f466addd700 1 -- 172.21.15.153:0/2756384347 wait complete. 2023-11-24T08:07:48.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.375+0000 7f466addd700 1 Processor -- start 2023-11-24T08:07:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.375+0000 7f466addd700 1 -- start start 2023-11-24T08:07:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f466addd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4664073f90 0x7f4664158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f466addd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46640cd810 0x7f466415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f466addd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4664145620 0x7f466413b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f466addd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466413ae20 con 0x7f46640cd810 2023-11-24T08:07:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f466addd700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466413a210 con 0x7f4664145620 2023-11-24T08:07:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f466addd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466413a4f0 con 0x7f4664073f90 2023-11-24T08:07:48.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f4663fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46640cd810 0x7f466415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f4663fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46640cd810 0x7f466415a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40278/0 (socket says 172.21.15.153:40278) 2023-11-24T08:07:48.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f4663fff700 1 -- 172.21.15.153:0/685141811 learned_addr learned my addr 172.21.15.153:0/685141811 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:48.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f4663fff700 1 -- 172.21.15.153:0/685141811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4664073f90 msgr2=0x7f4664158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f4663fff700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4664073f90 0x7f4664158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f4663fff700 1 -- 172.21.15.153:0/685141811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4664145620 msgr2=0x7f466413b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f4663fff700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4664145620 0x7f466413b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f4663fff700 1 -- 172.21.15.153:0/685141811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c009a70 con 0x7f46640cd810 2023-11-24T08:07:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.376+0000 7f4663fff700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46640cd810 0x7f466415a590 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f46500011e0 tx=0x7f465000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.377+0000 7f46617fa700 1 -- 172.21.15.153:0/685141811 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650004c80 con 0x7f46640cd810 2023-11-24T08:07:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.377+0000 7f46617fa700 1 -- 172.21.15.153:0/685141811 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4650004e00 con 0x7f46640cd810 2023-11-24T08:07:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.377+0000 7f46617fa700 1 -- 172.21.15.153:0/685141811 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650007310 con 0x7f46640cd810 2023-11-24T08:07:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.377+0000 7f466addd700 1 -- 172.21.15.153:0/685141811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466413a7d0 con 0x7f46640cd810 2023-11-24T08:07:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.377+0000 7f466addd700 1 -- 172.21.15.153:0/685141811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466415aad0 con 0x7f46640cd810 2023-11-24T08:07:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.377+0000 7f466addd700 1 -- 172.21.15.153:0/685141811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f466406beb0 con 0x7f46640cd810 2023-11-24T08:07:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.378+0000 7f46617fa700 1 -- 172.21.15.153:0/685141811 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4650007470 con 0x7f46640cd810 2023-11-24T08:07:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.378+0000 7f46617fa700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f464806b080 0x7f464806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.379+0000 7f46617fa700 1 -- 172.21.15.153:0/685141811 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4650089cf0 con 0x7f46640cd810 2023-11-24T08:07:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.379+0000 7f4668b79700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f464806b080 0x7f464806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.379+0000 7f46617fa700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] conn(0x7f4648070ee0 0x7f4648073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.379+0000 7f46617fa700 1 -- 172.21.15.153:0/685141811 --> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46480739d0 con 0x7f4648070ee0 2023-11-24T08:07:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.379+0000 7f46617fa700 1 -- 172.21.15.153:0/685141811 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f465008a060 con 0x7f46640cd810 2023-11-24T08:07:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.379+0000 7f466937a700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] conn(0x7f4648070ee0 0x7f4648073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.379+0000 7f4668b79700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f464806b080 0x7f464806d540 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f46580098d0 tx=0x7f4658008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.379+0000 7f466937a700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] conn(0x7f4648070ee0 0x7f4648073300 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.380+0000 7f46617fa700 1 -- 172.21.15.153:0/685141811 <== osd.1 v2:172.21.15.153:6809/3506833465 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f46480739d0 con 0x7f4648070ee0 2023-11-24T08:07:48.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466addd700 1 -- 172.21.15.153:0/685141811 --> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f46640cf1c0 con 0x7f4648070ee0 2023-11-24T08:07:48.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f46617fa700 1 -- 172.21.15.153:0/685141811 <== osd.1 v2:172.21.15.153:6809/3506833465 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f465c0098f0 con 0x7f4648070ee0 2023-11-24T08:07:48.397 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:07:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:48.397 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:07:48.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466addd700 1 -- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] conn(0x7f4648070ee0 msgr2=0x7f4648073300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466addd700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:6809/3506833465,v1:172.21.15.153:6811/3506833465] conn(0x7f4648070ee0 0x7f4648073300 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466addd700 1 -- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f464806b080 msgr2=0x7f464806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466addd700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f464806b080 0x7f464806d540 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f46580098d0 tx=0x7f4658008040 comp rx=0 tx=0).stop 2023-11-24T08:07:48.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466addd700 1 -- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46640cd810 msgr2=0x7f466415a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466addd700 1 --2- 172.21.15.153:0/685141811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46640cd810 0x7f466415a590 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f46500011e0 tx=0x7f465000cae0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466937a700 1 -- 172.21.15.153:0/685141811 reap_dead start 2023-11-24T08:07:48.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466addd700 1 -- 172.21.15.153:0/685141811 shutdown_connections 2023-11-24T08:07:48.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466addd700 1 -- 172.21.15.153:0/685141811 >> 172.21.15.153:0/685141811 conn(0x7f46640d0b40 msgr2=0x7f466415b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466addd700 1 -- 172.21.15.153:0/685141811 shutdown_connections 2023-11-24T08:07:48.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.395+0000 7f466addd700 1 -- 172.21.15.153:0/685141811 wait complete. 2023-11-24T08:07:48.409 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-24T08:07:48.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.529+0000 7fc4478f1700 1 Processor -- start 2023-11-24T08:07:48.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.529+0000 7fc4478f1700 1 -- start start 2023-11-24T08:07:48.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.530+0000 7fc4478f1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc44006c710 0x7fc440165b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.530+0000 7fc4478f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4400af950 con 0x7fc4401446a0 2023-11-24T08:07:48.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.530+0000 7fc4478f1700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4400afc30 con 0x7fc4400adf00 2023-11-24T08:07:48.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.530+0000 7fc4478f1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc440144a80 con 0x7fc44006c710 2023-11-24T08:07:48.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.530+0000 7fc445e8e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc44006c710 0x7fc440165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.530+0000 7fc44568d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc4401446a0 0x7fc4400b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46390/0 (socket says 172.21.15.153:46390) 2023-11-24T08:07:48.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.530+0000 7fc44568d700 1 -- 172.21.15.153:0/3657076069 learned_addr learned my addr 172.21.15.153:0/3657076069 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:48.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc445e8e700 1 -- 172.21.15.153:0/3657076069 >> v1:172.21.15.164:6789/0 conn(0x7fc4400adf00 legacy=0x7fc44006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc445e8e700 1 -- 172.21.15.153:0/3657076069 >> v1:172.21.15.153:6789/0 conn(0x7fc4401446a0 legacy=0x7fc4400b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc437fff700 1 -- 172.21.15.153:0/3657076069 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034518300 0 0) 0x7fc4400af950 con 0x7fc4401446a0 2023-11-24T08:07:48.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc445e8e700 1 -- 172.21.15.153:0/3657076069 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4400aff10 con 0x7fc44006c710 2023-11-24T08:07:48.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc445e8e700 1 --2- 172.21.15.153:0/3657076069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc44006c710 0x7fc440165b70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc438009d90 tx=0x7fc43800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a37080ebd0d3d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc437fff700 1 -- 172.21.15.153:0/3657076069 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800e070 con 0x7fc44006c710 2023-11-24T08:07:48.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc437fff700 1 -- 172.21.15.153:0/3657076069 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43800bbd0 con 0x7fc44006c710 2023-11-24T08:07:48.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc437fff700 1 -- 172.21.15.153:0/3657076069 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438012430 con 0x7fc44006c710 2023-11-24T08:07:48.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc4478f1700 1 -- 172.21.15.153:0/3657076069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc44006c710 msgr2=0x7fc440165b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc4478f1700 1 --2- 172.21.15.153:0/3657076069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc44006c710 0x7fc440165b70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc438009d90 tx=0x7fc43800b330 comp rx=0 tx=0).stop 2023-11-24T08:07:48.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc4478f1700 1 -- 172.21.15.153:0/3657076069 shutdown_connections 2023-11-24T08:07:48.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc4478f1700 1 --2- 172.21.15.153:0/3657076069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc44006c710 0x7fc440165b70 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.531+0000 7fc4478f1700 1 -- 172.21.15.153:0/3657076069 >> 172.21.15.153:0/3657076069 conn(0x7fc440071b90 msgr2=0x7fc440071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.532+0000 7fc4478f1700 1 -- 172.21.15.153:0/3657076069 shutdown_connections 2023-11-24T08:07:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.532+0000 7fc4478f1700 1 -- 172.21.15.153:0/3657076069 wait complete. 2023-11-24T08:07:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.533+0000 7fc4478f1700 1 Processor -- start 2023-11-24T08:07:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.533+0000 7fc4478f1700 1 -- start start 2023-11-24T08:07:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.533+0000 7fc4478f1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc44006c710 0x7fc4400cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.533+0000 7fc4478f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4400adf00 0x7fc4400ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.533+0000 7fc4478f1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4401446a0 0x7fc4401569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.533+0000 7fc4478f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4400ce7a0 con 0x7fc4400adf00 2023-11-24T08:07:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.533+0000 7fc4478f1700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4400d04d0 con 0x7fc4401446a0 2023-11-24T08:07:48.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.533+0000 7fc4478f1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc440156f20 con 0x7fc44006c710 2023-11-24T08:07:48.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc444e8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4400adf00 0x7fc4400ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc444e8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4400adf00 0x7fc4400ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40294/0 (socket says 172.21.15.153:40294) 2023-11-24T08:07:48.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc444e8c700 1 -- 172.21.15.153:0/1678099072 learned_addr learned my addr 172.21.15.153:0/1678099072 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:48.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc44568d700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc44006c710 0x7fc4400cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc445e8e700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4401446a0 0x7fc4401569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc444e8c700 1 -- 172.21.15.153:0/1678099072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc44006c710 msgr2=0x7fc4400cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc444e8c700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc44006c710 0x7fc4400cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc444e8c700 1 -- 172.21.15.153:0/1678099072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4401446a0 msgr2=0x7fc4401569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc444e8c700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4401446a0 0x7fc4401569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc444e8c700 1 -- 172.21.15.153:0/1678099072 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc438009a70 con 0x7fc4400adf00 2023-11-24T08:07:48.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc445e8e700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4401446a0 0x7fc4401569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:48.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc444e8c700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4400adf00 0x7fc4400ce260 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00c450 tx=0x7fc43c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc435ffb700 1 -- 172.21.15.153:0/1678099072 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0052d0 con 0x7fc4400adf00 2023-11-24T08:07:48.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc435ffb700 1 -- 172.21.15.153:0/1678099072 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c005430 con 0x7fc4400adf00 2023-11-24T08:07:48.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc4478f1700 1 -- 172.21.15.153:0/1678099072 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc440141450 con 0x7fc4400adf00 2023-11-24T08:07:48.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc435ffb700 1 -- 172.21.15.153:0/1678099072 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0038c0 con 0x7fc4400adf00 2023-11-24T08:07:48.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.534+0000 7fc4478f1700 1 -- 172.21.15.153:0/1678099072 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4400cddd0 con 0x7fc4400adf00 2023-11-24T08:07:48.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.535+0000 7fc4478f1700 1 -- 172.21.15.153:0/1678099072 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4400753f0 con 0x7fc4400adf00 2023-11-24T08:07:48.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.536+0000 7fc435ffb700 1 -- 172.21.15.153:0/1678099072 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc43c003a20 con 0x7fc4400adf00 2023-11-24T08:07:48.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.536+0000 7fc435ffb700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc42406b080 0x7fc42406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.536+0000 7fc44568d700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc42406b080 0x7fc42406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.536+0000 7fc435ffb700 1 -- 172.21.15.153:0/1678099072 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc43c088940 con 0x7fc4400adf00 2023-11-24T08:07:48.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.537+0000 7fc44568d700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc42406b080 0x7fc42406d540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc430000f60 tx=0x7fc430007d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.541+0000 7fc435ffb700 1 -- 172.21.15.153:0/1678099072 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc43c053a80 con 0x7fc4400adf00 2023-11-24T08:07:48.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.732+0000 7fc4478f1700 1 -- 172.21.15.153:0/1678099072 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4400b04d0 con 0x7fc42406b080 2023-11-24T08:07:48.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.732+0000 7fc435ffb700 1 -- 172.21.15.153:0/1678099072 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc430004870 con 0x7fc42406b080 2023-11-24T08:07:48.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 -- 172.21.15.153:0/1678099072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc42406b080 msgr2=0x7fc42406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc42406b080 0x7fc42406d540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc430000f60 tx=0x7fc430007d90 comp rx=0 tx=0).stop 2023-11-24T08:07:48.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 -- 172.21.15.153:0/1678099072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4400adf00 msgr2=0x7fc4400ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4400adf00 0x7fc4400ce260 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00c450 tx=0x7fc43c00c810 comp rx=0 tx=0).stop 2023-11-24T08:07:48.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 -- 172.21.15.153:0/1678099072 shutdown_connections 2023-11-24T08:07:48.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4401446a0 0x7fc4401569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc44006c710 0x7fc4400cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc42406b080 0x7fc42406d540 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 --2- 172.21.15.153:0/1678099072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4400adf00 0x7fc4400ce260 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 -- 172.21.15.153:0/1678099072 >> 172.21.15.153:0/1678099072 conn(0x7fc440071b90 msgr2=0x7fc440071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 -- 172.21.15.153:0/1678099072 shutdown_connections 2023-11-24T08:07:48.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.734+0000 7fc4478f1700 1 -- 172.21.15.153:0/1678099072 wait complete. 2023-11-24T08:07:48.740 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 1 to deep-scrub 2023-11-24T08:07:48.748 INFO:tasks.ceph:Scrubbing osd.2 2023-11-24T08:07:48.748 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:48.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.871+0000 7f06735ce700 1 Processor -- start 2023-11-24T08:07:48.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.871+0000 7f06735ce700 1 -- start start 2023-11-24T08:07:48.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.872+0000 7f06735ce700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f066c144600 0x7f066c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.872+0000 7f06735ce700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f066c06f480 0x7f066c06c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.872+0000 7f06735ce700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066c06b200 con 0x7f066c06e830 2023-11-24T08:07:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.872+0000 7f06735ce700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c06aff0 con 0x7f066c06f480 2023-11-24T08:07:48.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.872+0000 7f06735ce700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c06b4e0 con 0x7f066c144600 2023-11-24T08:07:48.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.872+0000 7f0670b69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f066c06f480 0x7f066c06c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.872+0000 7f0670b69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f066c06f480 0x7f066c06c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40302/0 (socket says 172.21.15.153:40302) 2023-11-24T08:07:48.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.872+0000 7f0670b69700 1 -- 172.21.15.153:0/256802338 learned_addr learned my addr 172.21.15.153:0/256802338 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:48.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.873+0000 7f067136a700 1 --2- 172.21.15.153:0/256802338 >> v2:172.21.15.164:3300/0 conn(0x7f066c144600 0x7f066c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.873+0000 7f0670b69700 1 -- 172.21.15.153:0/256802338 >> v2:172.21.15.164:3300/0 conn(0x7f066c144600 msgr2=0x7f066c0b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:48.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.873+0000 7f0670b69700 1 --2- 172.21.15.153:0/256802338 >> v2:172.21.15.164:3300/0 conn(0x7f066c144600 0x7f066c0b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.873+0000 7f0670b69700 1 -- 172.21.15.153:0/256802338 >> v1:172.21.15.164:6789/0 conn(0x7f066c06e830 legacy=0x7f066c0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.873+0000 7f0670b69700 1 -- 172.21.15.153:0/256802338 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c06b7c0 con 0x7f066c06f480 2023-11-24T08:07:48.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.873+0000 7f0670b69700 1 --2- 172.21.15.153:0/256802338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f066c06f480 0x7f066c06c2a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f066c0734a0 tx=0x7f0668009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a316b797c73bf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.873+0000 7f0663fff700 1 -- 172.21.15.153:0/256802338 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800b870 con 0x7f066c06f480 2023-11-24T08:07:48.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.873+0000 7f0663fff700 1 -- 172.21.15.153:0/256802338 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066800b9d0 con 0x7f066c06f480 2023-11-24T08:07:48.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.873+0000 7f0663fff700 1 -- 172.21.15.153:0/256802338 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800bd60 con 0x7f066c06f480 2023-11-24T08:07:48.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.874+0000 7f06735ce700 1 -- 172.21.15.153:0/256802338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f066c06f480 msgr2=0x7f066c06c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.874+0000 7f06735ce700 1 --2- 172.21.15.153:0/256802338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f066c06f480 0x7f066c06c2a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f066c0734a0 tx=0x7f0668009bd0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.874+0000 7f06735ce700 1 -- 172.21.15.153:0/256802338 shutdown_connections 2023-11-24T08:07:48.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.874+0000 7f06735ce700 1 --2- 172.21.15.153:0/256802338 >> v2:172.21.15.164:3300/0 conn(0x7f066c144600 0x7f066c0b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.874+0000 7f06735ce700 1 --2- 172.21.15.153:0/256802338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f066c06f480 0x7f066c06c2a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.874+0000 7f06735ce700 1 -- 172.21.15.153:0/256802338 >> 172.21.15.153:0/256802338 conn(0x7f066c0d0b40 msgr2=0x7f066c0d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.874+0000 7f06735ce700 1 -- 172.21.15.153:0/256802338 shutdown_connections 2023-11-24T08:07:48.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.874+0000 7f06735ce700 1 -- 172.21.15.153:0/256802338 wait complete. 2023-11-24T08:07:48.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.875+0000 7f06735ce700 1 Processor -- start 2023-11-24T08:07:48.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.875+0000 7f06735ce700 1 -- start start 2023-11-24T08:07:48.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f06735ce700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f066c06e830 0x7f066c15c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f06735ce700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f066c06f480 0x7f066c15a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f06735ce700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f066c144600 0x7f066c15cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f06735ce700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c15d9b0 con 0x7f066c06f480 2023-11-24T08:07:48.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f06735ce700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c15b2d0 con 0x7f066c06e830 2023-11-24T08:07:48.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f06735ce700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c15ac40 con 0x7f066c144600 2023-11-24T08:07:48.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0670b69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f066c06f480 0x7f066c15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0670b69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f066c06f480 0x7f066c15a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40308/0 (socket says 172.21.15.153:40308) 2023-11-24T08:07:48.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0670b69700 1 -- 172.21.15.153:0/3268596045 learned_addr learned my addr 172.21.15.153:0/3268596045 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:48.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f067136a700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f066c06e830 0x7f066c15c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0671b6b700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f066c144600 0x7f066c15cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0670b69700 1 -- 172.21.15.153:0/3268596045 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f066c144600 msgr2=0x7f066c15cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0670b69700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f066c144600 0x7f066c15cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0670b69700 1 -- 172.21.15.153:0/3268596045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f066c06e830 msgr2=0x7f066c15c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0670b69700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f066c06e830 0x7f066c15c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0670b69700 1 -- 172.21.15.153:0/3268596045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0668009550 con 0x7f066c06f480 2023-11-24T08:07:48.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0671b6b700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f066c144600 0x7f066c15cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:48.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0670b69700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f066c06f480 0x7f066c15a700 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0668000c00 tx=0x7f0668004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0661ffb700 1 -- 172.21.15.153:0/3268596045 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668004540 con 0x7f066c06f480 2023-11-24T08:07:48.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0661ffb700 1 -- 172.21.15.153:0/3268596045 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06680036a0 con 0x7f066c06f480 2023-11-24T08:07:48.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f0661ffb700 1 -- 172.21.15.153:0/3268596045 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668003a10 con 0x7f066c06f480 2023-11-24T08:07:48.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.876+0000 7f06735ce700 1 -- 172.21.15.153:0/3268596045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066c15d6d0 con 0x7f066c06f480 2023-11-24T08:07:48.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.877+0000 7f06735ce700 1 -- 172.21.15.153:0/3268596045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066c15b800 con 0x7f066c06f480 2023-11-24T08:07:48.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.877+0000 7f06735ce700 1 -- 172.21.15.153:0/3268596045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f066c0d10f0 con 0x7f066c06f480 2023-11-24T08:07:48.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.878+0000 7f0661ffb700 1 -- 172.21.15.153:0/3268596045 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0668021070 con 0x7f066c06f480 2023-11-24T08:07:48.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.878+0000 7f0661ffb700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f065006b080 0x7f065006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.879+0000 7f0661ffb700 1 -- 172.21.15.153:0/3268596045 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f066808ae30 con 0x7f066c06f480 2023-11-24T08:07:48.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.879+0000 7f067136a700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f065006b080 0x7f065006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.879+0000 7f0661ffb700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] conn(0x7f0650070ee0 0x7f0650073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.879+0000 7f0661ffb700 1 -- 172.21.15.153:0/3268596045 --> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06500739d0 con 0x7f0650070ee0 2023-11-24T08:07:48.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.879+0000 7f0661ffb700 1 -- 172.21.15.153:0/3268596045 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f066808b280 con 0x7f066c06f480 2023-11-24T08:07:48.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.879+0000 7f0671b6b700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] conn(0x7f0650070ee0 0x7f0650073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.879+0000 7f067136a700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f065006b080 0x7f065006d540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f066c0b1950 tx=0x7f065c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.879+0000 7f0671b6b700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] conn(0x7f0650070ee0 0x7f0650073300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.880+0000 7f0661ffb700 1 -- 172.21.15.153:0/3268596045 <== osd.2 v2:172.21.15.153:6808/3697118367 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f06500739d0 con 0x7f0650070ee0 2023-11-24T08:07:48.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.895+0000 7f06735ce700 1 -- 172.21.15.153:0/3268596045 --> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f066c0d0f40 con 0x7f0650070ee0 2023-11-24T08:07:48.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.895+0000 7f0661ffb700 1 -- 172.21.15.153:0/3268596045 <== osd.2 v2:172.21.15.153:6808/3697118367 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f066c0d0f40 con 0x7f0650070ee0 2023-11-24T08:07:48.901 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:07:48.901 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:48.901 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:07:48.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.895+0000 7f06735ce700 1 -- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] conn(0x7f0650070ee0 msgr2=0x7f0650073300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.895+0000 7f06735ce700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:6808/3697118367,v1:172.21.15.153:6810/3697118367] conn(0x7f0650070ee0 0x7f0650073300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.895+0000 7f06735ce700 1 -- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f065006b080 msgr2=0x7f065006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.895+0000 7f06735ce700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f065006b080 0x7f065006d540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f066c0b1950 tx=0x7f065c008040 comp rx=0 tx=0).stop 2023-11-24T08:07:48.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.895+0000 7f06735ce700 1 -- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f066c06f480 msgr2=0x7f066c15a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.895+0000 7f06735ce700 1 --2- 172.21.15.153:0/3268596045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f066c06f480 0x7f066c15a700 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0668000c00 tx=0x7f0668004750 comp rx=0 tx=0).stop 2023-11-24T08:07:48.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.895+0000 7f0671b6b700 1 -- 172.21.15.153:0/3268596045 reap_dead start 2023-11-24T08:07:48.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.895+0000 7f06735ce700 1 -- 172.21.15.153:0/3268596045 shutdown_connections 2023-11-24T08:07:48.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.895+0000 7f06735ce700 1 -- 172.21.15.153:0/3268596045 >> 172.21.15.153:0/3268596045 conn(0x7f066c0d0b40 msgr2=0x7f066c0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.896+0000 7f06735ce700 1 -- 172.21.15.153:0/3268596045 shutdown_connections 2023-11-24T08:07:48.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:48.896+0000 7f06735ce700 1 -- 172.21.15.153:0/3268596045 wait complete. 2023-11-24T08:07:48.909 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-24T08:07:49.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.030+0000 7f6546aa7700 1 Processor -- start 2023-11-24T08:07:49.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.030+0000 7f6546aa7700 1 -- start start 2023-11-24T08:07:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6546aa7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f654015bdd0 0x7f65401604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6546aa7700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f65400d1c70 0x7f65400d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6546aa7700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65400b22d0 con 0x7f65400b3370 2023-11-24T08:07:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6546aa7700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65400b2f50 con 0x7f654015bdd0 2023-11-24T08:07:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6546aa7700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65400d2640 con 0x7f65400d1c70 2023-11-24T08:07:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6544843700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f654015bdd0 0x7f65401604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6544843700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f654015bdd0 0x7f65401604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40316/0 (socket says 172.21.15.153:40316) 2023-11-24T08:07:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6544843700 1 -- 172.21.15.153:0/1121292389 learned_addr learned my addr 172.21.15.153:0/1121292389 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6545044700 1 --2- 172.21.15.153:0/1121292389 >> v2:172.21.15.164:3300/0 conn(0x7f65400d1c70 0x7f65400d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6544843700 1 -- 172.21.15.153:0/1121292389 >> v2:172.21.15.164:3300/0 conn(0x7f65400d1c70 msgr2=0x7f65400d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6544843700 1 --2- 172.21.15.153:0/1121292389 >> v2:172.21.15.164:3300/0 conn(0x7f65400d1c70 0x7f65400d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6544843700 1 -- 172.21.15.153:0/1121292389 >> v1:172.21.15.164:6789/0 conn(0x7f65400b3370 legacy=0x7f65400b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6544843700 1 -- 172.21.15.153:0/1121292389 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65400b25b0 con 0x7f654015bdd0 2023-11-24T08:07:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.031+0000 7f6544843700 1 --2- 172.21.15.153:0/1121292389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654015bdd0 0x7f65401604e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6540160a50 tx=0x7f6534009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a991078e3acc942b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.032+0000 7f653f7fe700 1 -- 172.21.15.153:0/1121292389 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400b870 con 0x7f654015bdd0 2023-11-24T08:07:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.032+0000 7f653f7fe700 1 -- 172.21.15.153:0/1121292389 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653400b9d0 con 0x7f654015bdd0 2023-11-24T08:07:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.032+0000 7f653f7fe700 1 -- 172.21.15.153:0/1121292389 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400bd60 con 0x7f654015bdd0 2023-11-24T08:07:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.032+0000 7f6546aa7700 1 -- 172.21.15.153:0/1121292389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654015bdd0 msgr2=0x7f65401604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.032+0000 7f6546aa7700 1 --2- 172.21.15.153:0/1121292389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654015bdd0 0x7f65401604e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6540160a50 tx=0x7f6534009bd0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.032+0000 7f6546aa7700 1 -- 172.21.15.153:0/1121292389 shutdown_connections 2023-11-24T08:07:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.032+0000 7f6546aa7700 1 --2- 172.21.15.153:0/1121292389 >> v2:172.21.15.164:3300/0 conn(0x7f65400d1c70 0x7f65400d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.032+0000 7f6546aa7700 1 --2- 172.21.15.153:0/1121292389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654015bdd0 0x7f65401604e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.032+0000 7f6546aa7700 1 -- 172.21.15.153:0/1121292389 >> 172.21.15.153:0/1121292389 conn(0x7f65400731a0 msgr2=0x7f654009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.032+0000 7f6546aa7700 1 -- 172.21.15.153:0/1121292389 shutdown_connections 2023-11-24T08:07:49.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.032+0000 7f6546aa7700 1 -- 172.21.15.153:0/1121292389 wait complete. 2023-11-24T08:07:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.034+0000 7f6546aa7700 1 Processor -- start 2023-11-24T08:07:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.034+0000 7f6546aa7700 1 -- start start 2023-11-24T08:07:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6546aa7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65400b3370 0x7f65400c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6546aa7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65400d1c70 0x7f65401e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6546aa7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f654015bdd0 0x7f6540150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6546aa7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65400c6890 con 0x7f65400b3370 2023-11-24T08:07:49.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6546aa7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65400c6b70 con 0x7f654015bdd0 2023-11-24T08:07:49.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6546aa7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65400c6e50 con 0x7f65400d1c70 2023-11-24T08:07:49.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6544843700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65400b3370 0x7f65400c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6544843700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65400b3370 0x7f65400c6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40322/0 (socket says 172.21.15.153:40322) 2023-11-24T08:07:49.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6544843700 1 -- 172.21.15.153:0/1140536518 learned_addr learned my addr 172.21.15.153:0/1140536518 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:49.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6545044700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f654015bdd0 0x7f6540150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6544843700 1 -- 172.21.15.153:0/1140536518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65400d1c70 msgr2=0x7f65401e8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6544843700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65400d1c70 0x7f65401e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6544843700 1 -- 172.21.15.153:0/1140536518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f654015bdd0 msgr2=0x7f6540150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6544843700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f654015bdd0 0x7f6540150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.035+0000 7f6544843700 1 -- 172.21.15.153:0/1140536518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6534009550 con 0x7f65400b3370 2023-11-24T08:07:49.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.036+0000 7f6544843700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65400b3370 0x7f65400c6200 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6534000c00 tx=0x7f6534004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.036+0000 7f653d7fa700 1 -- 172.21.15.153:0/1140536518 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340129c0 con 0x7f65400b3370 2023-11-24T08:07:49.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.036+0000 7f653d7fa700 1 -- 172.21.15.153:0/1140536518 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653401e070 con 0x7f65400b3370 2023-11-24T08:07:49.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.036+0000 7f6546aa7700 1 -- 172.21.15.153:0/1140536518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65400c7130 con 0x7f65400b3370 2023-11-24T08:07:49.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.036+0000 7f653d7fa700 1 -- 172.21.15.153:0/1140536518 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534012d40 con 0x7f65400b3370 2023-11-24T08:07:49.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.036+0000 7f6546aa7700 1 -- 172.21.15.153:0/1140536518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6540150570 con 0x7f65400b3370 2023-11-24T08:07:49.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.037+0000 7f6546aa7700 1 -- 172.21.15.153:0/1140536518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6540067f60 con 0x7f65400b3370 2023-11-24T08:07:49.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.037+0000 7f653d7fa700 1 -- 172.21.15.153:0/1140536518 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f653402d450 con 0x7f65400b3370 2023-11-24T08:07:49.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.037+0000 7f653d7fa700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f652406b080 0x7f652406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.038+0000 7f653d7fa700 1 -- 172.21.15.153:0/1140536518 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f653408a6f0 con 0x7f65400b3370 2023-11-24T08:07:49.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.038+0000 7f653ffff700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f652406b080 0x7f652406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.038+0000 7f653ffff700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f652406b080 0x7f652406d540 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f652c000f60 tx=0x7f652c007a60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.042+0000 7f653d7fa700 1 -- 172.21.15.153:0/1140536518 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65340558b0 con 0x7f65400b3370 2023-11-24T08:07:49.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.233+0000 7f6546aa7700 1 -- 172.21.15.153:0/1140536518 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f65400b2b70 con 0x7f652406b080 2023-11-24T08:07:49.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.233+0000 7f653d7fa700 1 -- 172.21.15.153:0/1140536518 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f652c005080 con 0x7f652406b080 2023-11-24T08:07:49.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 -- 172.21.15.153:0/1140536518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f652406b080 msgr2=0x7f652406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f652406b080 0x7f652406d540 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f652c000f60 tx=0x7f652c007a60 comp rx=0 tx=0).stop 2023-11-24T08:07:49.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 -- 172.21.15.153:0/1140536518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65400b3370 msgr2=0x7f65400c6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65400b3370 0x7f65400c6200 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6534000c00 tx=0x7f6534004750 comp rx=0 tx=0).stop 2023-11-24T08:07:49.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 -- 172.21.15.153:0/1140536518 shutdown_connections 2023-11-24T08:07:49.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f654015bdd0 0x7f6540150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f652406b080 0x7f652406d540 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65400b3370 0x7f65400c6200 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 --2- 172.21.15.153:0/1140536518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65400d1c70 0x7f65401e8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 -- 172.21.15.153:0/1140536518 >> 172.21.15.153:0/1140536518 conn(0x7f65400731a0 msgr2=0x7f65400aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 -- 172.21.15.153:0/1140536518 shutdown_connections 2023-11-24T08:07:49.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.236+0000 7f6546aa7700 1 -- 172.21.15.153:0/1140536518 wait complete. 2023-11-24T08:07:49.239 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 2 to deep-scrub 2023-11-24T08:07:49.249 INFO:tasks.ceph:Scrubbing osd.3 2023-11-24T08:07:49.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:49.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.374+0000 7f6855aed700 1 Processor -- start 2023-11-24T08:07:49.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.374+0000 7f6855aed700 1 -- start start 2023-11-24T08:07:49.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.375+0000 7f6855aed700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f685006e9c0 0x7f68500b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.375+0000 7f6855aed700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685006ee50 con 0x7f68500b01e0 2023-11-24T08:07:49.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.375+0000 7f6855aed700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68500b05c0 con 0x7f68500746a0 2023-11-24T08:07:49.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.375+0000 7f6855aed700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68501470a0 con 0x7f685006e9c0 2023-11-24T08:07:49.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.375+0000 7f684f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f68500b01e0 0x7f6850073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46434/0 (socket says 172.21.15.153:46434) 2023-11-24T08:07:49.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.375+0000 7f684f7fe700 1 -- 172.21.15.153:0/1072563414 learned_addr learned my addr 172.21.15.153:0/1072563414 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:49.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.375+0000 7f684ffff700 1 --2- 172.21.15.153:0/1072563414 >> v2:172.21.15.164:3300/0 conn(0x7f685006e9c0 0x7f68500b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.375+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736143593 0 0) 0x7f685006ee50 con 0x7f68500b01e0 2023-11-24T08:07:49.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.375+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68380035b0 con 0x7f68500b01e0 2023-11-24T08:07:49.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1334365234 0 0) 0x7f68380035b0 con 0x7f68500b01e0 2023-11-24T08:07:49.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 >> v2:172.21.15.164:3300/0 conn(0x7f685006e9c0 msgr2=0x7f68500b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:49.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 --2- 172.21.15.153:0/1072563414 >> v2:172.21.15.164:3300/0 conn(0x7f685006e9c0 0x7f68500b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 >> v1:172.21.15.164:6789/0 conn(0x7f68500746a0 legacy=0x7f685006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500b4250 con 0x7f68500b01e0 2023-11-24T08:07:49.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f6844001670 con 0x7f68500b01e0 2023-11-24T08:07:49.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 >> v1:172.21.15.153:6789/0 conn(0x7f68500b01e0 legacy=0x7f6850073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 --2- 172.21.15.153:0/1072563414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6838003a00 0x7f6838003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 --2- 172.21.15.153:0/1072563414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6838004850 0x7f6838004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 --2- 172.21.15.153:0/1072563414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6838005210 0x7f683800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68501470a0 con 0x7f6838005210 2023-11-24T08:07:49.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683800c1b0 con 0x7f6838004850 2023-11-24T08:07:49.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683800c370 con 0x7f6838003a00 2023-11-24T08:07:49.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684ffff700 1 --2- 172.21.15.153:0/1072563414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6838005210 0x7f683800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684f7fe700 1 --2- 172.21.15.153:0/1072563414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6838003a00 0x7f6838003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684effd700 1 --2- 172.21.15.153:0/1072563414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6838004850 0x7f6838004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684ffff700 1 -- 172.21.15.153:0/1072563414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6838003a00 msgr2=0x7f6838003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:49.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684ffff700 1 --2- 172.21.15.153:0/1072563414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6838003a00 0x7f6838003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684ffff700 1 -- 172.21.15.153:0/1072563414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6838004850 msgr2=0x7f6838004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:49.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684ffff700 1 --2- 172.21.15.153:0/1072563414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6838004850 0x7f6838004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684ffff700 1 -- 172.21.15.153:0/1072563414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68380035b0 con 0x7f6838005210 2023-11-24T08:07:49.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684ffff700 1 -- 172.21.15.153:0/1072563414 reap_dead start 2023-11-24T08:07:49.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684ffff700 1 --2- 172.21.15.153:0/1072563414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6838005210 0x7f683800ba10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6848009fc0 tx=0x7f6838005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e89c42a73362d6a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848003a20 con 0x7f6838005210 2023-11-24T08:07:49.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684800f040 con 0x7f6838005210 2023-11-24T08:07:49.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.376+0000 7f684e7fc700 1 -- 172.21.15.153:0/1072563414 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848003de0 con 0x7f6838005210 2023-11-24T08:07:49.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.377+0000 7f6855aed700 1 -- 172.21.15.153:0/1072563414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6838005210 msgr2=0x7f683800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.377+0000 7f6855aed700 1 --2- 172.21.15.153:0/1072563414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6838005210 0x7f683800ba10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6848009fc0 tx=0x7f6838005880 comp rx=0 tx=0).stop 2023-11-24T08:07:49.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.377+0000 7f6855aed700 1 -- 172.21.15.153:0/1072563414 shutdown_connections 2023-11-24T08:07:49.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.377+0000 7f6855aed700 1 --2- 172.21.15.153:0/1072563414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6838005210 0x7f683800ba10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.377+0000 7f6855aed700 1 -- 172.21.15.153:0/1072563414 >> 172.21.15.153:0/1072563414 conn(0x7f68500d0b40 msgr2=0x7f68500d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.377+0000 7f6855aed700 1 -- 172.21.15.153:0/1072563414 shutdown_connections 2023-11-24T08:07:49.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.377+0000 7f6855aed700 1 -- 172.21.15.153:0/1072563414 wait complete. 2023-11-24T08:07:49.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.378+0000 7f6855aed700 1 Processor -- start 2023-11-24T08:07:49.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.378+0000 7f6855aed700 1 -- start start 2023-11-24T08:07:49.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.379+0000 7f6855aed700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6838005210 0x7f6850160210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.379+0000 7f6855aed700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68501e8940 0x7f68501e8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.379+0000 7f6855aed700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6850145b00 0x7f6850145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.379+0000 7f6855aed700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68501464c0 con 0x7f68501e8940 2023-11-24T08:07:49.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.379+0000 7f6855aed700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68501f3ca0 con 0x7f6850145b00 2023-11-24T08:07:49.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.379+0000 7f6855aed700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68501e9400 con 0x7f6838005210 2023-11-24T08:07:49.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.379+0000 7f684effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68501e8940 0x7f68501e8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.379+0000 7f684effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68501e8940 0x7f68501e8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40344/0 (socket says 172.21.15.153:40344) 2023-11-24T08:07:49.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.379+0000 7f684effd700 1 -- 172.21.15.153:0/1071302653 learned_addr learned my addr 172.21.15.153:0/1071302653 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:49.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.379+0000 7f684f7fe700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6838005210 0x7f6850160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.379+0000 7f684ffff700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6850145b00 0x7f6850145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.380+0000 7f684effd700 1 -- 172.21.15.153:0/1071302653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6838005210 msgr2=0x7f6850160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.380+0000 7f684effd700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6838005210 0x7f6850160210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.380+0000 7f684effd700 1 -- 172.21.15.153:0/1071302653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6850145b00 msgr2=0x7f6850145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.380+0000 7f684effd700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6850145b00 0x7f6850145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.380+0000 7f684effd700 1 -- 172.21.15.153:0/1071302653 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68501e96e0 con 0x7f68501e8940 2023-11-24T08:07:49.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.380+0000 7f684effd700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68501e8940 0x7f68501e8dc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f684000f610 tx=0x7f684000f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.380+0000 7f6837fff700 1 -- 172.21.15.153:0/1071302653 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68400052e0 con 0x7f68501e8940 2023-11-24T08:07:49.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.380+0000 7f6837fff700 1 -- 172.21.15.153:0/1071302653 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6840005440 con 0x7f68501e8940 2023-11-24T08:07:49.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.380+0000 7f6855aed700 1 -- 172.21.15.153:0/1071302653 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68501f3f60 con 0x7f68501e8940 2023-11-24T08:07:49.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.380+0000 7f6837fff700 1 -- 172.21.15.153:0/1071302653 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68400038a0 con 0x7f68501e8940 2023-11-24T08:07:49.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.380+0000 7f6855aed700 1 -- 172.21.15.153:0/1071302653 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6850160f60 con 0x7f68501e8940 2023-11-24T08:07:49.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.381+0000 7f6855aed700 1 -- 172.21.15.153:0/1071302653 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6850074e70 con 0x7f68501e8940 2023-11-24T08:07:49.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.381+0000 7f6837fff700 1 -- 172.21.15.153:0/1071302653 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6840003a00 con 0x7f68501e8940 2023-11-24T08:07:49.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.382+0000 7f6837fff700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f683c06b080 0x7f683c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.382+0000 7f6837fff700 1 -- 172.21.15.153:0/1071302653 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6840089d60 con 0x7f68501e8940 2023-11-24T08:07:49.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.382+0000 7f684f7fe700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f683c06b080 0x7f683c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.382+0000 7f6837fff700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] conn(0x7f683c070ee0 0x7f683c073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.382+0000 7f6837fff700 1 -- 172.21.15.153:0/1071302653 --> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f683c0739d0 con 0x7f683c070ee0 2023-11-24T08:07:49.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.382+0000 7f6837fff700 1 -- 172.21.15.153:0/1071302653 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f684008a1b0 con 0x7f68501e8940 2023-11-24T08:07:49.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.382+0000 7f684ffff700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] conn(0x7f683c070ee0 0x7f683c073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.382+0000 7f684f7fe700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f683c06b080 0x7f683c06d540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6844007cd0 tx=0x7f6844009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.382+0000 7f684ffff700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] conn(0x7f683c070ee0 0x7f683c073300 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.383+0000 7f6837fff700 1 -- 172.21.15.153:0/1071302653 <== osd.3 v2:172.21.15.153:6824/1489086647 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f683c0739d0 con 0x7f683c070ee0 2023-11-24T08:07:49.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6855aed700 1 -- 172.21.15.153:0/1071302653 --> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f68501610f0 con 0x7f683c070ee0 2023-11-24T08:07:49.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6837fff700 1 -- 172.21.15.153:0/1071302653 <== osd.3 v2:172.21.15.153:6824/1489086647 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f68501610f0 con 0x7f683c070ee0 2023-11-24T08:07:49.400 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:07:49.400 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:49.400 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:07:49.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6855aed700 1 -- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] conn(0x7f683c070ee0 msgr2=0x7f683c073300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6855aed700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:6824/1489086647,v1:172.21.15.153:6825/1489086647] conn(0x7f683c070ee0 0x7f683c073300 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6855aed700 1 -- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f683c06b080 msgr2=0x7f683c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6855aed700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f683c06b080 0x7f683c06d540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6844007cd0 tx=0x7f6844009040 comp rx=0 tx=0).stop 2023-11-24T08:07:49.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6855aed700 1 -- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68501e8940 msgr2=0x7f68501e8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6855aed700 1 --2- 172.21.15.153:0/1071302653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68501e8940 0x7f68501e8dc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f684000f610 tx=0x7f684000f9d0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f684ffff700 1 -- 172.21.15.153:0/1071302653 reap_dead start 2023-11-24T08:07:49.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6855aed700 1 -- 172.21.15.153:0/1071302653 shutdown_connections 2023-11-24T08:07:49.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6855aed700 1 -- 172.21.15.153:0/1071302653 >> 172.21.15.153:0/1071302653 conn(0x7f68500d0b40 msgr2=0x7f685006c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6855aed700 1 -- 172.21.15.153:0/1071302653 shutdown_connections 2023-11-24T08:07:49.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.398+0000 7f6855aed700 1 -- 172.21.15.153:0/1071302653 wait complete. 2023-11-24T08:07:49.412 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-24T08:07:49.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.534+0000 7fee2a958700 1 Processor -- start 2023-11-24T08:07:49.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.534+0000 7fee2a958700 1 -- start start 2023-11-24T08:07:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.534+0000 7fee2a958700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee2415b200 0x7fee240b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.534+0000 7fee2a958700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fee240b1a70 0x7fee24164b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.534+0000 7fee2a958700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee240cfd40 con 0x7fee2415ae20 2023-11-24T08:07:49.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.534+0000 7fee2a958700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee240d0020 con 0x7fee240b1a70 2023-11-24T08:07:49.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.534+0000 7fee2a958700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee240affa0 con 0x7fee2415b200 2023-11-24T08:07:49.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.534+0000 7fee23fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fee2415ae20 0x7fee240b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46456/0 (socket says 172.21.15.153:46456) 2023-11-24T08:07:49.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.534+0000 7fee23fff700 1 -- 172.21.15.153:0/3679898047 learned_addr learned my addr 172.21.15.153:0/3679898047 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:49.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee237fe700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee2415b200 0x7fee240b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee28ef5700 1 --2- 172.21.15.153:0/3679898047 >> v2:172.21.15.164:3300/0 conn(0x7fee240b1a70 0x7fee24164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158346928 0 0) 0x7fee240cfd40 con 0x7fee2415ae20 2023-11-24T08:07:49.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee100035b0 con 0x7fee2415ae20 2023-11-24T08:07:49.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1244748913 0 0) 0x7fee100035b0 con 0x7fee2415ae20 2023-11-24T08:07:49.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee2415b200 msgr2=0x7fee240b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:49.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee2415b200 0x7fee240b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 >> v2:172.21.15.164:3300/0 conn(0x7fee240b1a70 msgr2=0x7fee24164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 --2- 172.21.15.153:0/3679898047 >> v2:172.21.15.164:3300/0 conn(0x7fee240b1a70 0x7fee24164b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240b0280 con 0x7fee2415ae20 2023-11-24T08:07:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fee0c001670 con 0x7fee2415ae20 2023-11-24T08:07:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 >> v1:172.21.15.153:6789/0 conn(0x7fee2415ae20 legacy=0x7fee240b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee10003a00 0x7fee10003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10004850 0x7fee10004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee2415b200 0x7fee10005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240d0020 con 0x7fee10003a00 2023-11-24T08:07:49.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240affa0 con 0x7fee10004850 2023-11-24T08:07:49.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1000ba10 con 0x7fee2415b200 2023-11-24T08:07:49.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee23fff700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee10003a00 0x7fee10003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee28ef5700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee2415b200 0x7fee10005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee237fe700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10004850 0x7fee10004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee23fff700 1 -- 172.21.15.153:0/3679898047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee2415b200 msgr2=0x7fee10005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:49.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee23fff700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee2415b200 0x7fee10005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee23fff700 1 -- 172.21.15.153:0/3679898047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10004850 msgr2=0x7fee10004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:49.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee23fff700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10004850 0x7fee10004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.535+0000 7fee23fff700 1 -- 172.21.15.153:0/3679898047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee100035b0 con 0x7fee10003a00 2023-11-24T08:07:49.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.536+0000 7fee23fff700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee10003a00 0x7fee10003e20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c370 tx=0x7fee10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d214c8445c805948 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.536+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c007c60 con 0x7fee10003a00 2023-11-24T08:07:49.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.536+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c005960 con 0x7fee10003a00 2023-11-24T08:07:49.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.536+0000 7fee22ffd700 1 -- 172.21.15.153:0/3679898047 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c005d10 con 0x7fee10003a00 2023-11-24T08:07:49.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.536+0000 7fee2a958700 1 -- 172.21.15.153:0/3679898047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee10003a00 msgr2=0x7fee10003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.536+0000 7fee2a958700 1 --2- 172.21.15.153:0/3679898047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee10003a00 0x7fee10003e20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c370 tx=0x7fee10005880 comp rx=0 tx=0).stop 2023-11-24T08:07:49.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.536+0000 7fee28ef5700 1 -- 172.21.15.153:0/3679898047 reap_dead start 2023-11-24T08:07:49.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.536+0000 7fee2a958700 1 -- 172.21.15.153:0/3679898047 shutdown_connections 2023-11-24T08:07:49.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.536+0000 7fee2a958700 1 -- 172.21.15.153:0/3679898047 >> 172.21.15.153:0/3679898047 conn(0x7fee240b57b0 msgr2=0x7fee240b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.536+0000 7fee2a958700 1 -- 172.21.15.153:0/3679898047 shutdown_connections 2023-11-24T08:07:49.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.536+0000 7fee2a958700 1 -- 172.21.15.153:0/3679898047 wait complete. 2023-11-24T08:07:49.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.538+0000 7fee2a958700 1 Processor -- start 2023-11-24T08:07:49.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.538+0000 7fee2a958700 1 -- start start 2023-11-24T08:07:49.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.538+0000 7fee2a958700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10003a00 0x7fee240cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.538+0000 7fee2a958700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee24156be0 0x7fee24157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.538+0000 7fee2a958700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee24144850 0x7fee24144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.538+0000 7fee2a958700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee241575a0 con 0x7fee24144850 2023-11-24T08:07:49.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.538+0000 7fee2a958700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240cd6f0 con 0x7fee10003a00 2023-11-24T08:07:49.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.538+0000 7fee2a958700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee240cc110 con 0x7fee24156be0 2023-11-24T08:07:49.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee28ef5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee24144850 0x7fee24144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee28ef5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee24144850 0x7fee24144ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40368/0 (socket says 172.21.15.153:40368) 2023-11-24T08:07:49.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee28ef5700 1 -- 172.21.15.153:0/245304263 learned_addr learned my addr 172.21.15.153:0/245304263 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:49.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee237fe700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee24156be0 0x7fee24157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee23fff700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10003a00 0x7fee240cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee28ef5700 1 -- 172.21.15.153:0/245304263 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee24156be0 msgr2=0x7fee24157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee28ef5700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee24156be0 0x7fee24157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee28ef5700 1 -- 172.21.15.153:0/245304263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10003a00 msgr2=0x7fee240cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee28ef5700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10003a00 0x7fee240cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee28ef5700 1 -- 172.21.15.153:0/245304263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240cc3f0 con 0x7fee24144850 2023-11-24T08:07:49.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee28ef5700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee24144850 0x7fee24144ce0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fee240b1f60 tx=0x7fee1c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee20ff9700 1 -- 172.21.15.153:0/245304263 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c00e040 con 0x7fee24144850 2023-11-24T08:07:49.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee20ff9700 1 -- 172.21.15.153:0/245304263 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c00f040 con 0x7fee24144850 2023-11-24T08:07:49.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee2a958700 1 -- 172.21.15.153:0/245304263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee240cc6d0 con 0x7fee24144850 2023-11-24T08:07:49.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee20ff9700 1 -- 172.21.15.153:0/245304263 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c00fe30 con 0x7fee24144850 2023-11-24T08:07:49.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.539+0000 7fee2a958700 1 -- 172.21.15.153:0/245304263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee240ccc90 con 0x7fee24144850 2023-11-24T08:07:49.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.540+0000 7fee2a958700 1 -- 172.21.15.153:0/245304263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee24067f60 con 0x7fee24144850 2023-11-24T08:07:49.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.541+0000 7fee20ff9700 1 -- 172.21.15.153:0/245304263 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fee1c022460 con 0x7fee24144850 2023-11-24T08:07:49.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.541+0000 7fee20ff9700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee0406b070 0x7fee0406d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.541+0000 7fee20ff9700 1 -- 172.21.15.153:0/245304263 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fee1c089b10 con 0x7fee24144850 2023-11-24T08:07:49.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.541+0000 7fee23fff700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee0406b070 0x7fee0406d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.542+0000 7fee23fff700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee0406b070 0x7fee0406d530 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fee0c015040 tx=0x7fee0c00a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.546+0000 7fee20ff9700 1 -- 172.21.15.153:0/245304263 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee1c054b30 con 0x7fee24144850 2023-11-24T08:07:49.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.739+0000 7fee2a958700 1 -- 172.21.15.153:0/245304263 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fee24158af0 con 0x7fee0406b070 2023-11-24T08:07:49.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.739+0000 7fee20ff9700 1 -- 172.21.15.153:0/245304263 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fee24158af0 con 0x7fee0406b070 2023-11-24T08:07:49.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 -- 172.21.15.153:0/245304263 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee0406b070 msgr2=0x7fee0406d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee0406b070 0x7fee0406d530 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fee0c015040 tx=0x7fee0c00a000 comp rx=0 tx=0).stop 2023-11-24T08:07:49.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 -- 172.21.15.153:0/245304263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee24144850 msgr2=0x7fee24144ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee24144850 0x7fee24144ce0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fee240b1f60 tx=0x7fee1c011f60 comp rx=0 tx=0).stop 2023-11-24T08:07:49.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 -- 172.21.15.153:0/245304263 shutdown_connections 2023-11-24T08:07:49.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fee0406b070 0x7fee0406d530 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee24144850 0x7fee24144ce0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10003a00 0x7fee240cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 --2- 172.21.15.153:0/245304263 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee24156be0 0x7fee24157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 -- 172.21.15.153:0/245304263 >> 172.21.15.153:0/245304263 conn(0x7fee240b57b0 msgr2=0x7fee240d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 -- 172.21.15.153:0/245304263 shutdown_connections 2023-11-24T08:07:49.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.741+0000 7fee2a958700 1 -- 172.21.15.153:0/245304263 wait complete. 2023-11-24T08:07:49.745 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 3 to deep-scrub 2023-11-24T08:07:49.755 INFO:tasks.ceph:Scrubbing osd.4 2023-11-24T08:07:49.756 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:49.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.878+0000 7faca658f700 1 Processor -- start 2023-11-24T08:07:49.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.878+0000 7faca658f700 1 -- start start 2023-11-24T08:07:49.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.878+0000 7faca658f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faca00b01e0 0x7faca006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7faca658f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca00b05c0 con 0x7faca00b59c0 2023-11-24T08:07:49.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7faca658f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca00b4250 con 0x7faca00746a0 2023-11-24T08:07:49.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7faca658f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca01470a0 con 0x7faca00b01e0 2023-11-24T08:07:49.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7fac9ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faca00b01e0 0x7faca006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7fac9f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7faca00b59c0 0x7faca0073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46478/0 (socket says 172.21.15.153:46478) 2023-11-24T08:07:49.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7fac9f7fe700 1 -- 172.21.15.153:0/739116309 learned_addr learned my addr 172.21.15.153:0/739116309 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:49.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7fac9ffff700 1 -- 172.21.15.153:0/739116309 >> v1:172.21.15.164:6789/0 conn(0x7faca00746a0 legacy=0x7faca006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7fac9ffff700 1 -- 172.21.15.153:0/739116309 >> v1:172.21.15.153:6789/0 conn(0x7faca00b59c0 legacy=0x7faca0073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7fac9ffff700 1 -- 172.21.15.153:0/739116309 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca006dc00 con 0x7faca00b01e0 2023-11-24T08:07:49.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7fac9effd700 1 -- 172.21.15.153:0/739116309 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529542690 0 0) 0x7faca00b05c0 con 0x7faca00b59c0 2023-11-24T08:07:49.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7fac9ffff700 1 --2- 172.21.15.153:0/739116309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca00b01e0 0x7faca006e9c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fac94009840 tx=0x7fac94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e6de2fee729738 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7fac9effd700 1 -- 172.21.15.153:0/739116309 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94011830 con 0x7faca00b01e0 2023-11-24T08:07:49.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7fac9effd700 1 -- 172.21.15.153:0/739116309 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac94011990 con 0x7faca00b01e0 2023-11-24T08:07:49.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.879+0000 7fac9effd700 1 -- 172.21.15.153:0/739116309 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94011d20 con 0x7faca00b01e0 2023-11-24T08:07:49.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.880+0000 7faca658f700 1 -- 172.21.15.153:0/739116309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca00b01e0 msgr2=0x7faca006e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.880+0000 7faca658f700 1 --2- 172.21.15.153:0/739116309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca00b01e0 0x7faca006e9c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fac94009840 tx=0x7fac94009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:49.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.880+0000 7faca658f700 1 -- 172.21.15.153:0/739116309 shutdown_connections 2023-11-24T08:07:49.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.880+0000 7faca658f700 1 --2- 172.21.15.153:0/739116309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca00b01e0 0x7faca006e9c0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.880+0000 7faca658f700 1 -- 172.21.15.153:0/739116309 >> 172.21.15.153:0/739116309 conn(0x7faca00d0b40 msgr2=0x7faca00d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.880+0000 7faca658f700 1 -- 172.21.15.153:0/739116309 shutdown_connections 2023-11-24T08:07:49.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.880+0000 7faca658f700 1 -- 172.21.15.153:0/739116309 wait complete. 2023-11-24T08:07:49.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.881+0000 7faca658f700 1 Processor -- start 2023-11-24T08:07:49.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.881+0000 7faca658f700 1 -- start start 2023-11-24T08:07:49.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7faca658f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faca00746a0 0x7faca0145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7faca658f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca00b01e0 0x7faca0138080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7faca658f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faca00b59c0 0x7faca015bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7faca658f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca01385c0 con 0x7faca00b01e0 2023-11-24T08:07:49.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7faca658f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca01454a0 con 0x7faca00746a0 2023-11-24T08:07:49.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7faca658f700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca015f390 con 0x7faca00b59c0 2023-11-24T08:07:49.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7fac9f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca00b01e0 0x7faca0138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7fac9f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca00b01e0 0x7faca0138080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40380/0 (socket says 172.21.15.153:40380) 2023-11-24T08:07:49.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7fac9f7fe700 1 -- 172.21.15.153:0/2149847684 learned_addr learned my addr 172.21.15.153:0/2149847684 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:49.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7faca4b2c700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faca00b59c0 0x7faca015bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7fac9ffff700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faca00746a0 0x7faca0145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7fac9f7fe700 1 -- 172.21.15.153:0/2149847684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faca00b59c0 msgr2=0x7faca015bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7fac9f7fe700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faca00b59c0 0x7faca015bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7fac9f7fe700 1 -- 172.21.15.153:0/2149847684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faca00746a0 msgr2=0x7faca0145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7fac9f7fe700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faca00746a0 0x7faca0145930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7fac9f7fe700 1 -- 172.21.15.153:0/2149847684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac940094a0 con 0x7faca00b01e0 2023-11-24T08:07:49.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.882+0000 7fac9f7fe700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca00b01e0 0x7faca0138080 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c520 tx=0x7fac9000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.883+0000 7fac9cff9700 1 -- 172.21.15.153:0/2149847684 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90004c80 con 0x7faca00b01e0 2023-11-24T08:07:49.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.883+0000 7fac9cff9700 1 -- 172.21.15.153:0/2149847684 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac90004e20 con 0x7faca00b01e0 2023-11-24T08:07:49.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.883+0000 7faca658f700 1 -- 172.21.15.153:0/2149847684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca015f670 con 0x7faca00b01e0 2023-11-24T08:07:49.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.883+0000 7fac9cff9700 1 -- 172.21.15.153:0/2149847684 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90007310 con 0x7faca00b01e0 2023-11-24T08:07:49.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.883+0000 7faca658f700 1 -- 172.21.15.153:0/2149847684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca0145130 con 0x7faca00b01e0 2023-11-24T08:07:49.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.883+0000 7faca658f700 1 -- 172.21.15.153:0/2149847684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faca006e1c0 con 0x7faca00b01e0 2023-11-24T08:07:49.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.884+0000 7fac9cff9700 1 -- 172.21.15.153:0/2149847684 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fac90007470 con 0x7faca00b01e0 2023-11-24T08:07:49.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.884+0000 7fac9cff9700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fac8c06b0b0 0x7fac8c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.885+0000 7fac9cff9700 1 -- 172.21.15.153:0/2149847684 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fac90089b60 con 0x7faca00b01e0 2023-11-24T08:07:49.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.885+0000 7fac9ffff700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fac8c06b0b0 0x7fac8c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.885+0000 7fac9cff9700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] conn(0x7fac8c070f10 0x7fac8c073330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.885+0000 7fac9cff9700 1 -- 172.21.15.153:0/2149847684 --> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac8c073a00 con 0x7fac8c070f10 2023-11-24T08:07:49.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.885+0000 7fac9cff9700 1 -- 172.21.15.153:0/2149847684 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac90089ed0 con 0x7faca00b01e0 2023-11-24T08:07:49.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.885+0000 7fac9ffff700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fac8c06b0b0 0x7fac8c06d570 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faca0131eb0 tx=0x7fac9401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.885+0000 7faca4b2c700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] conn(0x7fac8c070f10 0x7fac8c073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.885+0000 7faca4b2c700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] conn(0x7fac8c070f10 0x7fac8c073330 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.886+0000 7fac9cff9700 1 -- 172.21.15.153:0/2149847684 <== osd.4 v2:172.21.15.164:6800/3824651650 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fac8c073a00 con 0x7fac8c070f10 2023-11-24T08:07:49.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.901+0000 7faca658f700 1 -- 172.21.15.153:0/2149847684 --> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faca00b5e70 con 0x7fac8c070f10 2023-11-24T08:07:49.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7fac9cff9700 1 -- 172.21.15.153:0/2149847684 <== osd.4 v2:172.21.15.164:6800/3824651650 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fac98001dc0 con 0x7fac8c070f10 2023-11-24T08:07:49.903 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:07:49.904 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:49.904 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:07:49.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7faca658f700 1 -- 172.21.15.153:0/2149847684 >> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] conn(0x7fac8c070f10 msgr2=0x7fac8c073330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7faca658f700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.164:6800/3824651650,v1:172.21.15.164:6802/3824651650] conn(0x7fac8c070f10 0x7fac8c073330 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7faca658f700 1 -- 172.21.15.153:0/2149847684 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fac8c06b0b0 msgr2=0x7fac8c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7faca658f700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fac8c06b0b0 0x7fac8c06d570 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faca0131eb0 tx=0x7fac9401c040 comp rx=0 tx=0).stop 2023-11-24T08:07:49.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7faca658f700 1 -- 172.21.15.153:0/2149847684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca00b01e0 msgr2=0x7faca0138080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7faca658f700 1 --2- 172.21.15.153:0/2149847684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faca00b01e0 0x7faca0138080 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c520 tx=0x7fac9000c8e0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7faca4b2c700 1 -- 172.21.15.153:0/2149847684 reap_dead start 2023-11-24T08:07:49.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7faca658f700 1 -- 172.21.15.153:0/2149847684 shutdown_connections 2023-11-24T08:07:49.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7faca658f700 1 -- 172.21.15.153:0/2149847684 >> 172.21.15.153:0/2149847684 conn(0x7faca00d0b40 msgr2=0x7faca00b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7faca658f700 1 -- 172.21.15.153:0/2149847684 shutdown_connections 2023-11-24T08:07:49.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:49.902+0000 7faca658f700 1 -- 172.21.15.153:0/2149847684 wait complete. 2023-11-24T08:07:49.916 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-24T08:07:50.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.035+0000 7f1a3f7f0700 1 Processor -- start 2023-11-24T08:07:50.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.036+0000 7f1a3f7f0700 1 -- start start 2023-11-24T08:07:50.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.036+0000 7f1a3f7f0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a380b3370 0x7f1a381604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.036+0000 7f1a3f7f0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1a380d1c70 0x7f1a380d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.036+0000 7f1a3f7f0700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a380b22d0 con 0x7f1a3815bdd0 2023-11-24T08:07:50.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.036+0000 7f1a3f7f0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a380b2f50 con 0x7f1a380d1c70 2023-11-24T08:07:50.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a3f7f0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a380d2640 con 0x7f1a380b3370 2023-11-24T08:07:50.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a3dd8d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1a380d1c70 0x7f1a380d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a3dd8d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1a380d1c70 0x7f1a380d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40392/0 (socket says 172.21.15.153:40392) 2023-11-24T08:07:50.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a3dd8d700 1 -- 172.21.15.153:0/3453822045 learned_addr learned my addr 172.21.15.153:0/3453822045 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:50.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a3cd8b700 1 --2- 172.21.15.153:0/3453822045 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a380b3370 0x7f1a381604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a3dd8d700 1 -- 172.21.15.153:0/3453822045 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a380b3370 msgr2=0x7f1a381604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a3dd8d700 1 --2- 172.21.15.153:0/3453822045 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a380b3370 0x7f1a381604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a3dd8d700 1 -- 172.21.15.153:0/3453822045 >> v1:172.21.15.164:6789/0 conn(0x7f1a3815bdd0 legacy=0x7f1a380b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a3dd8d700 1 -- 172.21.15.153:0/3453822045 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a380b25b0 con 0x7f1a380d1c70 2023-11-24T08:07:50.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a3dd8d700 1 --2- 172.21.15.153:0/3453822045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a380d1c70 0x7f1a380d2100 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009e50 tx=0x7f1a3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b120e5ee092e03ad server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a2bfff700 1 -- 172.21.15.153:0/3453822045 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3000e070 con 0x7f1a380d1c70 2023-11-24T08:07:50.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a2bfff700 1 -- 172.21.15.153:0/3453822045 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3000b910 con 0x7f1a380d1c70 2023-11-24T08:07:50.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.037+0000 7f1a2bfff700 1 -- 172.21.15.153:0/3453822045 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3000bcc0 con 0x7f1a380d1c70 2023-11-24T08:07:50.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.038+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3453822045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a380d1c70 msgr2=0x7f1a380d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.038+0000 7f1a3f7f0700 1 --2- 172.21.15.153:0/3453822045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a380d1c70 0x7f1a380d2100 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009e50 tx=0x7f1a3000b330 comp rx=0 tx=0).stop 2023-11-24T08:07:50.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.038+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3453822045 shutdown_connections 2023-11-24T08:07:50.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.038+0000 7f1a3f7f0700 1 --2- 172.21.15.153:0/3453822045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a380d1c70 0x7f1a380d2100 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.038+0000 7f1a3f7f0700 1 --2- 172.21.15.153:0/3453822045 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a380b3370 0x7f1a381604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.038+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3453822045 >> 172.21.15.153:0/3453822045 conn(0x7f1a380731a0 msgr2=0x7f1a3809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.038+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3453822045 shutdown_connections 2023-11-24T08:07:50.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.038+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3453822045 wait complete. 2023-11-24T08:07:50.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.039+0000 7f1a3f7f0700 1 Processor -- start 2023-11-24T08:07:50.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.039+0000 7f1a3f7f0700 1 -- start start 2023-11-24T08:07:50.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3f7f0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a380b3370 0x7f1a3806ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3f7f0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a380d1c70 0x7f1a381490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3f7f0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3815bdd0 0x7f1a380c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3f7f0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a38146e60 con 0x7f1a3815bdd0 2023-11-24T08:07:50.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3f7f0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3806bfe0 con 0x7f1a380b3370 2023-11-24T08:07:50.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3f7f0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3806c2c0 con 0x7f1a380d1c70 2023-11-24T08:07:50.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3dd8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3815bdd0 0x7f1a380c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3dd8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3815bdd0 0x7f1a380c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40398/0 (socket says 172.21.15.153:40398) 2023-11-24T08:07:50.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3dd8d700 1 -- 172.21.15.153:0/3924088922 learned_addr learned my addr 172.21.15.153:0/3924088922 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:50.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3cd8b700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a380d1c70 0x7f1a381490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3d58c700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a380b3370 0x7f1a3806ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3dd8d700 1 -- 172.21.15.153:0/3924088922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a380d1c70 msgr2=0x7f1a381490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3dd8d700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a380d1c70 0x7f1a381490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3dd8d700 1 -- 172.21.15.153:0/3924088922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a380b3370 msgr2=0x7f1a3806ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3dd8d700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a380b3370 0x7f1a3806ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3dd8d700 1 -- 172.21.15.153:0/3924088922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a30009b30 con 0x7f1a3815bdd0 2023-11-24T08:07:50.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3d58c700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a380b3370 0x7f1a3806ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:50.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.040+0000 7f1a3dd8d700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3815bdd0 0x7f1a380c7d50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1a380716d0 tx=0x7f1a30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.041+0000 7f1a29ffb700 1 -- 172.21.15.153:0/3924088922 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30004960 con 0x7f1a3815bdd0 2023-11-24T08:07:50.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.041+0000 7f1a29ffb700 1 -- 172.21.15.153:0/3924088922 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a300099b0 con 0x7f1a3815bdd0 2023-11-24T08:07:50.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.041+0000 7f1a29ffb700 1 -- 172.21.15.153:0/3924088922 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3001c680 con 0x7f1a3815bdd0 2023-11-24T08:07:50.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.041+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3924088922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3806c5a0 con 0x7f1a3815bdd0 2023-11-24T08:07:50.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.041+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3924088922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a38149600 con 0x7f1a3815bdd0 2023-11-24T08:07:50.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.042+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3924088922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a381497c0 con 0x7f1a3815bdd0 2023-11-24T08:07:50.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.042+0000 7f1a29ffb700 1 -- 172.21.15.153:0/3924088922 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1a3001c7e0 con 0x7f1a3815bdd0 2023-11-24T08:07:50.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.043+0000 7f1a29ffb700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1a1c06b080 0x7f1a1c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.043+0000 7f1a29ffb700 1 -- 172.21.15.153:0/3924088922 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1a3008b430 con 0x7f1a3815bdd0 2023-11-24T08:07:50.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.043+0000 7f1a3d58c700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1a1c06b080 0x7f1a1c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.043+0000 7f1a3d58c700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1a1c06b080 0x7f1a1c06d540 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c000f60 tx=0x7f1a2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.047+0000 7f1a29ffb700 1 -- 172.21.15.153:0/3924088922 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a300564e0 con 0x7f1a3815bdd0 2023-11-24T08:07:50.092 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:50.095 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:50.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.244+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3924088922 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a380b2b70 con 0x7f1a1c06b080 2023-11-24T08:07:50.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.245+0000 7f1a29ffb700 1 -- 172.21.15.153:0/3924088922 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1a2c001450 con 0x7f1a1c06b080 2023-11-24T08:07:50.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3924088922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1a1c06b080 msgr2=0x7f1a1c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1a1c06b080 0x7f1a1c06d540 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c000f60 tx=0x7f1a2c009040 comp rx=0 tx=0).stop 2023-11-24T08:07:50.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3924088922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3815bdd0 msgr2=0x7f1a380c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3815bdd0 0x7f1a380c7d50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1a380716d0 tx=0x7f1a30004ad0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3924088922 shutdown_connections 2023-11-24T08:07:50.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f1a1c06b080 0x7f1a1c06d540 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3815bdd0 0x7f1a380c7d50 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a380b3370 0x7f1a3806ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 --2- 172.21.15.153:0/3924088922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a380d1c70 0x7f1a381490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3924088922 >> 172.21.15.153:0/3924088922 conn(0x7f1a380731a0 msgr2=0x7f1a3815f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3924088922 shutdown_connections 2023-11-24T08:07:50.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.247+0000 7f1a3f7f0700 1 -- 172.21.15.153:0/3924088922 wait complete. 2023-11-24T08:07:50.250 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 4 to deep-scrub 2023-11-24T08:07:50.261 INFO:tasks.ceph:Scrubbing osd.5 2023-11-24T08:07:50.261 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:50.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.385+0000 7fdf67878700 1 Processor -- start 2023-11-24T08:07:50.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.385+0000 7fdf67878700 1 -- start start 2023-11-24T08:07:50.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.386+0000 7fdf67878700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdf600746a0 0x7fdf6006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.386+0000 7fdf67878700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf600b5e50 con 0x7fdf600b59c0 2023-11-24T08:07:50.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.386+0000 7fdf67878700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf600b05c0 con 0x7fdf600b01e0 2023-11-24T08:07:50.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.386+0000 7fdf67878700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf601470a0 con 0x7fdf600746a0 2023-11-24T08:07:50.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.386+0000 7fdf65e15700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdf600b59c0 0x7fdf6006aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46510/0 (socket says 172.21.15.153:46510) 2023-11-24T08:07:50.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.386+0000 7fdf65e15700 1 -- 172.21.15.153:0/1026628588 learned_addr learned my addr 172.21.15.153:0/1026628588 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:50.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.386+0000 7fdf64e13700 1 --2- 172.21.15.153:0/1026628588 >> v2:172.21.15.164:3300/0 conn(0x7fdf600746a0 0x7fdf6006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.386+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487984241 0 0) 0x7fdf58001490 con 0x7fdf600b59c0 2023-11-24T08:07:50.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.386+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf4c0035b0 con 0x7fdf600b59c0 2023-11-24T08:07:50.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3427889802 0 0) 0x7fdf4c0035b0 con 0x7fdf600b59c0 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 >> v2:172.21.15.164:3300/0 conn(0x7fdf600746a0 msgr2=0x7fdf6006e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 --2- 172.21.15.153:0/1026628588 >> v2:172.21.15.164:3300/0 conn(0x7fdf600746a0 0x7fdf6006e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 >> v1:172.21.15.164:6789/0 conn(0x7fdf600b01e0 legacy=0x7fdf60073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf600b4250 con 0x7fdf600b59c0 2023-11-24T08:07:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7fdf58001b80 con 0x7fdf600b59c0 2023-11-24T08:07:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 >> v1:172.21.15.153:6789/0 conn(0x7fdf600b59c0 legacy=0x7fdf6006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 --2- 172.21.15.153:0/1026628588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf4c003a00 0x7fdf4c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 --2- 172.21.15.153:0/1026628588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf4c004400 0x7fdf4c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 --2- 172.21.15.153:0/1026628588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 0x7fdf4c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf601470a0 con 0x7fdf4c005170 2023-11-24T08:07:50.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c00c0b0 con 0x7fdf4c003a00 2023-11-24T08:07:50.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c00c270 con 0x7fdf4c004400 2023-11-24T08:07:50.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf65e15700 1 --2- 172.21.15.153:0/1026628588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 0x7fdf4c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf65614700 1 --2- 172.21.15.153:0/1026628588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf4c003a00 0x7fdf4c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf64e13700 1 --2- 172.21.15.153:0/1026628588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf4c004400 0x7fdf4c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf65e15700 1 -- 172.21.15.153:0/1026628588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf4c004400 msgr2=0x7fdf4c0048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf65e15700 1 --2- 172.21.15.153:0/1026628588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf4c004400 0x7fdf4c0048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf65e15700 1 -- 172.21.15.153:0/1026628588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf4c003a00 msgr2=0x7fdf4c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf65e15700 1 --2- 172.21.15.153:0/1026628588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf4c003a00 0x7fdf4c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf65e15700 1 -- 172.21.15.153:0/1026628588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c0035b0 con 0x7fdf4c005170 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf65e15700 1 -- 172.21.15.153:0/1026628588 reap_dead start 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf65e15700 1 --2- 172.21.15.153:0/1026628588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 0x7fdf4c00ba10 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800a840 tx=0x7fdf4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739c5ba9ee1c3bf9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.387+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58012600 con 0x7fdf4c005170 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.388+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf58012760 con 0x7fdf4c005170 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.388+0000 7fdf57fff700 1 -- 172.21.15.153:0/1026628588 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58012af0 con 0x7fdf4c005170 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.388+0000 7fdf67878700 1 -- 172.21.15.153:0/1026628588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 msgr2=0x7fdf4c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.388+0000 7fdf67878700 1 --2- 172.21.15.153:0/1026628588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 0x7fdf4c00ba10 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800a840 tx=0x7fdf4c005880 comp rx=0 tx=0).stop 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.388+0000 7fdf67878700 1 -- 172.21.15.153:0/1026628588 shutdown_connections 2023-11-24T08:07:50.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.388+0000 7fdf67878700 1 --2- 172.21.15.153:0/1026628588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 0x7fdf4c00ba10 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.388+0000 7fdf67878700 1 -- 172.21.15.153:0/1026628588 >> 172.21.15.153:0/1026628588 conn(0x7fdf600d0b40 msgr2=0x7fdf600d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.388+0000 7fdf67878700 1 -- 172.21.15.153:0/1026628588 shutdown_connections 2023-11-24T08:07:50.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.388+0000 7fdf67878700 1 -- 172.21.15.153:0/1026628588 wait complete. 2023-11-24T08:07:50.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.390+0000 7fdf67878700 1 Processor -- start 2023-11-24T08:07:50.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.390+0000 7fdf67878700 1 -- start start 2023-11-24T08:07:50.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf67878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 0x7fdf600c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf67878700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf60160f80 0x7fdf60134e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf67878700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf601323a0 0x7fdf600c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf67878700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600c5ac0 con 0x7fdf4c005170 2023-11-24T08:07:50.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf67878700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600c6600 con 0x7fdf60160f80 2023-11-24T08:07:50.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf67878700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf60135390 con 0x7fdf601323a0 2023-11-24T08:07:50.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf65614700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 0x7fdf600c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf65614700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 0x7fdf600c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40414/0 (socket says 172.21.15.153:40414) 2023-11-24T08:07:50.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf65614700 1 -- 172.21.15.153:0/498957981 learned_addr learned my addr 172.21.15.153:0/498957981 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:50.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf64e13700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf60160f80 0x7fdf60134e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf65e15700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf601323a0 0x7fdf600c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf65614700 1 -- 172.21.15.153:0/498957981 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf601323a0 msgr2=0x7fdf600c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf65614700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf601323a0 0x7fdf600c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf65614700 1 -- 172.21.15.153:0/498957981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf60160f80 msgr2=0x7fdf60134e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf65614700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf60160f80 0x7fdf60134e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf65614700 1 -- 172.21.15.153:0/498957981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf600c5cd0 con 0x7fdf4c005170 2023-11-24T08:07:50.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf65614700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 0x7fdf600c83b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000f7e0 tx=0x7fdf5000faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf55ffb700 1 -- 172.21.15.153:0/498957981 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf500052e0 con 0x7fdf4c005170 2023-11-24T08:07:50.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.391+0000 7fdf55ffb700 1 -- 172.21.15.153:0/498957981 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf50005460 con 0x7fdf4c005170 2023-11-24T08:07:50.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.392+0000 7fdf67878700 1 -- 172.21.15.153:0/498957981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf600c5fb0 con 0x7fdf4c005170 2023-11-24T08:07:50.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.392+0000 7fdf55ffb700 1 -- 172.21.15.153:0/498957981 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf500038c0 con 0x7fdf4c005170 2023-11-24T08:07:50.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.392+0000 7fdf67878700 1 -- 172.21.15.153:0/498957981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf60132820 con 0x7fdf4c005170 2023-11-24T08:07:50.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.393+0000 7fdf67878700 1 -- 172.21.15.153:0/498957981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf600d0800 con 0x7fdf4c005170 2023-11-24T08:07:50.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.393+0000 7fdf55ffb700 1 -- 172.21.15.153:0/498957981 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fdf50003a20 con 0x7fdf4c005170 2023-11-24T08:07:50.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.393+0000 7fdf55ffb700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdf4406b080 0x7fdf4406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.394+0000 7fdf55ffb700 1 -- 172.21.15.153:0/498957981 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdf500893a0 con 0x7fdf4c005170 2023-11-24T08:07:50.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.394+0000 7fdf64e13700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdf4406b080 0x7fdf4406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.394+0000 7fdf55ffb700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] conn(0x7fdf44070ee0 0x7fdf44073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.394+0000 7fdf55ffb700 1 -- 172.21.15.153:0/498957981 --> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf440739d0 con 0x7fdf44070ee0 2023-11-24T08:07:50.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.394+0000 7fdf55ffb700 1 -- 172.21.15.153:0/498957981 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf5008b900 con 0x7fdf4c005170 2023-11-24T08:07:50.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.394+0000 7fdf64e13700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdf4406b080 0x7fdf4406d540 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdf600b11f0 tx=0x7fdf5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.394+0000 7fdf65e15700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] conn(0x7fdf44070ee0 0x7fdf44073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.394+0000 7fdf65e15700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] conn(0x7fdf44070ee0 0x7fdf44073300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.395+0000 7fdf55ffb700 1 -- 172.21.15.153:0/498957981 <== osd.5 v2:172.21.15.164:6801/2836417954 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fdf440739d0 con 0x7fdf44070ee0 2023-11-24T08:07:50.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.410+0000 7fdf67878700 1 -- 172.21.15.153:0/498957981 --> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdf6006e1c0 con 0x7fdf44070ee0 2023-11-24T08:07:50.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.411+0000 7fdf55ffb700 1 -- 172.21.15.153:0/498957981 <== osd.5 v2:172.21.15.164:6801/2836417954 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdf58012400 con 0x7fdf44070ee0 2023-11-24T08:07:50.422 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:07:50.422 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:50.422 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:07:50.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.411+0000 7fdf67878700 1 -- 172.21.15.153:0/498957981 >> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] conn(0x7fdf44070ee0 msgr2=0x7fdf44073300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.411+0000 7fdf67878700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.164:6801/2836417954,v1:172.21.15.164:6803/2836417954] conn(0x7fdf44070ee0 0x7fdf44073300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.411+0000 7fdf67878700 1 -- 172.21.15.153:0/498957981 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdf4406b080 msgr2=0x7fdf4406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.411+0000 7fdf67878700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fdf4406b080 0x7fdf4406d540 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdf600b11f0 tx=0x7fdf5c008040 comp rx=0 tx=0).stop 2023-11-24T08:07:50.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.412+0000 7fdf67878700 1 -- 172.21.15.153:0/498957981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 msgr2=0x7fdf600c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.412+0000 7fdf67878700 1 --2- 172.21.15.153:0/498957981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf4c005170 0x7fdf600c83b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000f7e0 tx=0x7fdf5000faf0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.412+0000 7fdf65e15700 1 -- 172.21.15.153:0/498957981 reap_dead start 2023-11-24T08:07:50.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.412+0000 7fdf67878700 1 -- 172.21.15.153:0/498957981 shutdown_connections 2023-11-24T08:07:50.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.412+0000 7fdf67878700 1 -- 172.21.15.153:0/498957981 >> 172.21.15.153:0/498957981 conn(0x7fdf600d0b40 msgr2=0x7fdf600ad900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.412+0000 7fdf67878700 1 -- 172.21.15.153:0/498957981 shutdown_connections 2023-11-24T08:07:50.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.412+0000 7fdf67878700 1 -- 172.21.15.153:0/498957981 wait complete. 2023-11-24T08:07:50.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-24T08:07:50.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.546+0000 7f5ceecc3700 1 Processor -- start 2023-11-24T08:07:50.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.546+0000 7f5ceecc3700 1 -- start start 2023-11-24T08:07:50.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.546+0000 7f5ceecc3700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5ce806c710 0x7f5ce80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.546+0000 7f5ceecc3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5ce80af4d0 0x7f5ce80afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.546+0000 7f5ceecc3700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce80ae430 con 0x7f5ce815e080 2023-11-24T08:07:50.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.546+0000 7f5ceecc3700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce80af0b0 con 0x7f5ce80af4d0 2023-11-24T08:07:50.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.546+0000 7f5ceecc3700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce80b05a0 con 0x7f5ce806c710 2023-11-24T08:07:50.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ced260700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5ce80af4d0 0x7f5ce80afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ced260700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5ce80af4d0 0x7f5ce80afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40428/0 (socket says 172.21.15.153:40428) 2023-11-24T08:07:50.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ced260700 1 -- 172.21.15.153:0/310065535 learned_addr learned my addr 172.21.15.153:0/310065535 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:50.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ce7fff700 1 --2- 172.21.15.153:0/310065535 >> v2:172.21.15.164:3300/0 conn(0x7f5ce806c710 0x7f5ce80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ced260700 1 -- 172.21.15.153:0/310065535 >> v2:172.21.15.164:3300/0 conn(0x7f5ce806c710 msgr2=0x7f5ce80b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ced260700 1 --2- 172.21.15.153:0/310065535 >> v2:172.21.15.164:3300/0 conn(0x7f5ce806c710 0x7f5ce80b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ced260700 1 -- 172.21.15.153:0/310065535 >> v1:172.21.15.164:6789/0 conn(0x7f5ce815e080 legacy=0x7f5ce806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ced260700 1 -- 172.21.15.153:0/310065535 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce80ae710 con 0x7f5ce80af4d0 2023-11-24T08:07:50.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ce7fff700 1 --2- 172.21.15.153:0/310065535 >> v2:172.21.15.164:3300/0 conn(0x7f5ce806c710 0x7f5ce80b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:50.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ced260700 1 --2- 172.21.15.153:0/310065535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce80af4d0 0x7f5ce80afb90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5ce806e4e0 tx=0x7f5ce000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c74d6ed23c21868 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ce77fe700 1 -- 172.21.15.153:0/310065535 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000e070 con 0x7f5ce80af4d0 2023-11-24T08:07:50.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ce77fe700 1 -- 172.21.15.153:0/310065535 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce000b980 con 0x7f5ce80af4d0 2023-11-24T08:07:50.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.547+0000 7f5ce77fe700 1 -- 172.21.15.153:0/310065535 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000bd30 con 0x7f5ce80af4d0 2023-11-24T08:07:50.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.548+0000 7f5ceecc3700 1 -- 172.21.15.153:0/310065535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce80af4d0 msgr2=0x7f5ce80afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.548+0000 7f5ceecc3700 1 --2- 172.21.15.153:0/310065535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce80af4d0 0x7f5ce80afb90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5ce806e4e0 tx=0x7f5ce000b330 comp rx=0 tx=0).stop 2023-11-24T08:07:50.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.548+0000 7f5ceecc3700 1 -- 172.21.15.153:0/310065535 shutdown_connections 2023-11-24T08:07:50.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.548+0000 7f5ceecc3700 1 --2- 172.21.15.153:0/310065535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce80af4d0 0x7f5ce80afb90 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.548+0000 7f5ceecc3700 1 --2- 172.21.15.153:0/310065535 >> v2:172.21.15.164:3300/0 conn(0x7f5ce806c710 0x7f5ce80b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.548+0000 7f5ceecc3700 1 -- 172.21.15.153:0/310065535 >> 172.21.15.153:0/310065535 conn(0x7f5ce8071b90 msgr2=0x7f5ce8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.548+0000 7f5ceecc3700 1 -- 172.21.15.153:0/310065535 shutdown_connections 2023-11-24T08:07:50.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.548+0000 7f5ceecc3700 1 -- 172.21.15.153:0/310065535 wait complete. 2023-11-24T08:07:50.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.549+0000 7f5ceecc3700 1 Processor -- start 2023-11-24T08:07:50.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.549+0000 7f5ceecc3700 1 -- start start 2023-11-24T08:07:50.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceecc3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce806c710 0x7f5ce81593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceecc3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ce80af4d0 0x7f5ce8160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceecc3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ce815e080 0x7f5ce815f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceecc3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce8157610 con 0x7f5ce806c710 2023-11-24T08:07:50.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceecc3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce81612a0 con 0x7f5ce80af4d0 2023-11-24T08:07:50.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceecc3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce81578b0 con 0x7f5ce815e080 2023-11-24T08:07:50.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceca5f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce806c710 0x7f5ce81593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceca5f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce806c710 0x7f5ce81593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40430/0 (socket says 172.21.15.153:40430) 2023-11-24T08:07:50.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceca5f700 1 -- 172.21.15.153:0/1400977891 learned_addr learned my addr 172.21.15.153:0/1400977891 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:50.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ce7fff700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ce80af4d0 0x7f5ce8160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ced260700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ce815e080 0x7f5ce815f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceca5f700 1 -- 172.21.15.153:0/1400977891 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ce815e080 msgr2=0x7f5ce815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceca5f700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ce815e080 0x7f5ce815f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceca5f700 1 -- 172.21.15.153:0/1400977891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ce80af4d0 msgr2=0x7f5ce8160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceca5f700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ce80af4d0 0x7f5ce8160840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.550+0000 7f5ceca5f700 1 -- 172.21.15.153:0/1400977891 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce0009b30 con 0x7f5ce806c710 2023-11-24T08:07:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.551+0000 7f5ceca5f700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce806c710 0x7f5ce81593c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c430 tx=0x7f5cdc00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.551+0000 7f5ce57fa700 1 -- 172.21.15.153:0/1400977891 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0050d0 con 0x7f5ce806c710 2023-11-24T08:07:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.551+0000 7f5ce57fa700 1 -- 172.21.15.153:0/1400977891 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc005250 con 0x7f5ce806c710 2023-11-24T08:07:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.551+0000 7f5ceecc3700 1 -- 172.21.15.153:0/1400977891 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce8157b90 con 0x7f5ce806c710 2023-11-24T08:07:50.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.551+0000 7f5ce57fa700 1 -- 172.21.15.153:0/1400977891 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc006860 con 0x7f5ce806c710 2023-11-24T08:07:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.551+0000 7f5ceecc3700 1 -- 172.21.15.153:0/1400977891 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce8159900 con 0x7f5ce806c710 2023-11-24T08:07:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.552+0000 7f5ceecc3700 1 -- 172.21.15.153:0/1400977891 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce80753f0 con 0x7f5ce806c710 2023-11-24T08:07:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.552+0000 7f5ce57fa700 1 -- 172.21.15.153:0/1400977891 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5cdc003680 con 0x7f5ce806c710 2023-11-24T08:07:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.552+0000 7f5ce57fa700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5ccc06b080 0x7f5ccc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.553+0000 7f5ce57fa700 1 -- 172.21.15.153:0/1400977891 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5cdc0887f0 con 0x7f5ce806c710 2023-11-24T08:07:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.553+0000 7f5ce7fff700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5ccc06b080 0x7f5ccc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.553+0000 7f5ce7fff700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5ccc06b080 0x7f5ccc06d540 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80d0700 tx=0x7f5cd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.557+0000 7f5ce57fa700 1 -- 172.21.15.153:0/1400977891 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5cdc053800 con 0x7f5ce806c710 2023-11-24T08:07:50.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.745+0000 7f5ceecc3700 1 -- 172.21.15.153:0/1400977891 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ce80aecd0 con 0x7f5ccc06b080 2023-11-24T08:07:50.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.745+0000 7f5ce57fa700 1 -- 172.21.15.153:0/1400977891 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5cd4004020 con 0x7f5ccc06b080 2023-11-24T08:07:50.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.747+0000 7f5ceecc3700 1 -- 172.21.15.153:0/1400977891 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5ccc06b080 msgr2=0x7f5ccc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.747+0000 7f5ceecc3700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5ccc06b080 0x7f5ccc06d540 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80d0700 tx=0x7f5cd4008040 comp rx=0 tx=0).stop 2023-11-24T08:07:50.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.747+0000 7f5ceecc3700 1 -- 172.21.15.153:0/1400977891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce806c710 msgr2=0x7f5ce81593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.747+0000 7f5ceecc3700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce806c710 0x7f5ce81593c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c430 tx=0x7f5cdc00c740 comp rx=0 tx=0).stop 2023-11-24T08:07:50.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.747+0000 7f5ceecc3700 1 -- 172.21.15.153:0/1400977891 shutdown_connections 2023-11-24T08:07:50.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.747+0000 7f5ceecc3700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ce815e080 0x7f5ce815f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.747+0000 7f5ceecc3700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f5ccc06b080 0x7f5ccc06d540 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.747+0000 7f5ceecc3700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce806c710 0x7f5ce81593c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.747+0000 7f5ceecc3700 1 --2- 172.21.15.153:0/1400977891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ce80af4d0 0x7f5ce8160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.747+0000 7f5ceecc3700 1 -- 172.21.15.153:0/1400977891 >> 172.21.15.153:0/1400977891 conn(0x7f5ce8071b90 msgr2=0x7f5ce80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.748+0000 7f5ceecc3700 1 -- 172.21.15.153:0/1400977891 shutdown_connections 2023-11-24T08:07:50.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.748+0000 7f5ceecc3700 1 -- 172.21.15.153:0/1400977891 wait complete. 2023-11-24T08:07:50.751 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 5 to deep-scrub 2023-11-24T08:07:50.761 INFO:tasks.ceph:Scrubbing osd.6 2023-11-24T08:07:50.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:50.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.884+0000 7f2e30e17700 1 Processor -- start 2023-11-24T08:07:50.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.884+0000 7f2e30e17700 1 -- start start 2023-11-24T08:07:50.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e30e17700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e2c0b01e0 0x7f2e2c06e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e30e17700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e2c0b59c0 0x7f2e2c0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e30e17700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c0b5e40 con 0x7f2e2c073f90 2023-11-24T08:07:50.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e30e17700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c1470a0 con 0x7f2e2c0b59c0 2023-11-24T08:07:50.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e30e17700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c0b05c0 con 0x7f2e2c0b01e0 2023-11-24T08:07:50.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e29d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e2c0b59c0 0x7f2e2c0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e2ad9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2e2c073f90 0x7f2e2c06aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46546/0 (socket says 172.21.15.153:46546) 2023-11-24T08:07:50.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e2ad9d700 1 -- 172.21.15.153:0/2611637917 learned_addr learned my addr 172.21.15.153:0/2611637917 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:50.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e2a59c700 1 --2- 172.21.15.153:0/2611637917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e2c0b01e0 0x7f2e2c06e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e29d9b700 1 -- 172.21.15.153:0/2611637917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e2c0b01e0 msgr2=0x7f2e2c06e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e29d9b700 1 --2- 172.21.15.153:0/2611637917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e2c0b01e0 0x7f2e2c06e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e29d9b700 1 -- 172.21.15.153:0/2611637917 >> v1:172.21.15.153:6789/0 conn(0x7f2e2c073f90 legacy=0x7f2e2c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e2959a700 1 -- 172.21.15.153:0/2611637917 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332432425 0 0) 0x7f2e2c0b5e40 con 0x7f2e2c073f90 2023-11-24T08:07:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e29d9b700 1 -- 172.21.15.153:0/2611637917 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c0b4250 con 0x7f2e2c0b59c0 2023-11-24T08:07:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.885+0000 7f2e29d9b700 1 --2- 172.21.15.153:0/2611637917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c0b59c0 0x7f2e2c0b3b50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009840 tx=0x7f2e1c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc495e7db8933cdf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.886+0000 7f2e2959a700 1 -- 172.21.15.153:0/2611637917 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c011830 con 0x7f2e2c0b59c0 2023-11-24T08:07:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.886+0000 7f2e2959a700 1 -- 172.21.15.153:0/2611637917 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c011990 con 0x7f2e2c0b59c0 2023-11-24T08:07:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.886+0000 7f2e2959a700 1 -- 172.21.15.153:0/2611637917 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c011d20 con 0x7f2e2c0b59c0 2023-11-24T08:07:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.886+0000 7f2e30e17700 1 -- 172.21.15.153:0/2611637917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c0b59c0 msgr2=0x7f2e2c0b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.886+0000 7f2e30e17700 1 --2- 172.21.15.153:0/2611637917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c0b59c0 0x7f2e2c0b3b50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009840 tx=0x7f2e1c009b50 comp rx=0 tx=0).stop 2023-11-24T08:07:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.886+0000 7f2e30e17700 1 -- 172.21.15.153:0/2611637917 shutdown_connections 2023-11-24T08:07:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.886+0000 7f2e30e17700 1 --2- 172.21.15.153:0/2611637917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e2c0b01e0 0x7f2e2c06e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.886+0000 7f2e30e17700 1 --2- 172.21.15.153:0/2611637917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c0b59c0 0x7f2e2c0b3b50 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.886+0000 7f2e30e17700 1 -- 172.21.15.153:0/2611637917 >> 172.21.15.153:0/2611637917 conn(0x7f2e2c0d0b40 msgr2=0x7f2e2c0d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.886+0000 7f2e30e17700 1 -- 172.21.15.153:0/2611637917 shutdown_connections 2023-11-24T08:07:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.886+0000 7f2e30e17700 1 -- 172.21.15.153:0/2611637917 wait complete. 2023-11-24T08:07:50.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.888+0000 7f2e30e17700 1 Processor -- start 2023-11-24T08:07:50.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.888+0000 7f2e30e17700 1 -- start start 2023-11-24T08:07:50.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.888+0000 7f2e30e17700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c073f90 0x7f2e2c13eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.888+0000 7f2e30e17700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e2c0b01e0 0x7f2e2c161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.888+0000 7f2e30e17700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e2c0b59c0 0x7f2e2c1411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e30e17700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c13c180 con 0x7f2e2c073f90 2023-11-24T08:07:50.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e30e17700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c13e900 con 0x7f2e2c0b01e0 2023-11-24T08:07:50.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e30e17700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c140680 con 0x7f2e2c0b59c0 2023-11-24T08:07:50.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e2a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c073f90 0x7f2e2c13eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e2a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c073f90 0x7f2e2c13eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40446/0 (socket says 172.21.15.153:40446) 2023-11-24T08:07:50.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e2a59c700 1 -- 172.21.15.153:0/3145493354 learned_addr learned my addr 172.21.15.153:0/3145493354 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:50.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e29d9b700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e2c0b01e0 0x7f2e2c161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e2ad9d700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e2c0b59c0 0x7f2e2c1411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e2a59c700 1 -- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e2c0b59c0 msgr2=0x7f2e2c1411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e2a59c700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e2c0b59c0 0x7f2e2c1411a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e2a59c700 1 -- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e2c0b01e0 msgr2=0x7f2e2c161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e2a59c700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e2c0b01e0 0x7f2e2c161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e2a59c700 1 -- 172.21.15.153:0/3145493354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0094a0 con 0x7f2e2c073f90 2023-11-24T08:07:50.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e2ad9d700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e2c0b59c0 0x7f2e2c1411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:50.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e2a59c700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c073f90 0x7f2e2c13eb30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000e810 tx=0x7f2e2000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e1affd700 1 -- 172.21.15.153:0/3145493354 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20013610 con 0x7f2e2c073f90 2023-11-24T08:07:50.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e1affd700 1 -- 172.21.15.153:0/3145493354 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e20013770 con 0x7f2e2c073f90 2023-11-24T08:07:50.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e1affd700 1 -- 172.21.15.153:0/3145493354 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20013b00 con 0x7f2e2c073f90 2023-11-24T08:07:50.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e30e17700 1 -- 172.21.15.153:0/3145493354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c13c3d0 con 0x7f2e2c073f90 2023-11-24T08:07:50.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.889+0000 7f2e30e17700 1 -- 172.21.15.153:0/3145493354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c13c990 con 0x7f2e2c073f90 2023-11-24T08:07:50.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.890+0000 7f2e30e17700 1 -- 172.21.15.153:0/3145493354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e2c0d0800 con 0x7f2e2c073f90 2023-11-24T08:07:50.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.891+0000 7f2e1affd700 1 -- 172.21.15.153:0/3145493354 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2e20013c60 con 0x7f2e2c073f90 2023-11-24T08:07:50.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.891+0000 7f2e1affd700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2e0c06b080 0x7f2e0c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.891+0000 7f2e1affd700 1 -- 172.21.15.153:0/3145493354 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2e20089360 con 0x7f2e2c073f90 2023-11-24T08:07:50.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.891+0000 7f2e29d9b700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2e0c06b080 0x7f2e0c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.891+0000 7f2e1affd700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] conn(0x7f2e0c070ee0 0x7f2e0c073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.891+0000 7f2e1affd700 1 -- 172.21.15.153:0/3145493354 --> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e0c0739d0 con 0x7f2e0c070ee0 2023-11-24T08:07:50.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.891+0000 7f2e1affd700 1 -- 172.21.15.153:0/3145493354 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e2008ba00 con 0x7f2e2c073f90 2023-11-24T08:07:50.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.891+0000 7f2e2ad9d700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] conn(0x7f2e0c070ee0 0x7f2e0c073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.891+0000 7f2e29d9b700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2e0c06b080 0x7f2e0c06d540 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0090b0 tx=0x7f2e1c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.892+0000 7f2e2ad9d700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] conn(0x7f2e0c070ee0 0x7f2e0c073300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.893+0000 7f2e1affd700 1 -- 172.21.15.153:0/3145493354 <== osd.6 v2:172.21.15.164:6824/1534902913 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2e0c0739d0 con 0x7f2e0c070ee0 2023-11-24T08:07:50.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.907+0000 7f2e30e17700 1 -- 172.21.15.153:0/3145493354 --> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2e2c06e1c0 con 0x7f2e0c070ee0 2023-11-24T08:07:50.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e1affd700 1 -- 172.21.15.153:0/3145493354 <== osd.6 v2:172.21.15.164:6824/1534902913 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2e240070b0 con 0x7f2e0c070ee0 2023-11-24T08:07:50.910 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:07:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:50.910 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:07:50.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e30e17700 1 -- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] conn(0x7f2e0c070ee0 msgr2=0x7f2e0c073300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e30e17700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.164:6824/1534902913,v1:172.21.15.164:6825/1534902913] conn(0x7f2e0c070ee0 0x7f2e0c073300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e30e17700 1 -- 172.21.15.153:0/3145493354 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2e0c06b080 msgr2=0x7f2e0c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e30e17700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f2e0c06b080 0x7f2e0c06d540 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0090b0 tx=0x7f2e1c008030 comp rx=0 tx=0).stop 2023-11-24T08:07:50.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e30e17700 1 -- 172.21.15.153:0/3145493354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c073f90 msgr2=0x7f2e2c13eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e30e17700 1 --2- 172.21.15.153:0/3145493354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c073f90 0x7f2e2c13eb30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000e810 tx=0x7f2e2000ebd0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e2ad9d700 1 -- 172.21.15.153:0/3145493354 reap_dead start 2023-11-24T08:07:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e30e17700 1 -- 172.21.15.153:0/3145493354 shutdown_connections 2023-11-24T08:07:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e30e17700 1 -- 172.21.15.153:0/3145493354 >> 172.21.15.153:0/3145493354 conn(0x7f2e2c0d0b40 msgr2=0x7f2e2c0b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e30e17700 1 -- 172.21.15.153:0/3145493354 shutdown_connections 2023-11-24T08:07:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:50.908+0000 7f2e30e17700 1 -- 172.21.15.153:0/3145493354 wait complete. 2023-11-24T08:07:50.922 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-24T08:07:51.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.042+0000 7f9cb3b18700 1 Processor -- start 2023-11-24T08:07:51.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.042+0000 7f9cb3b18700 1 -- start start 2023-11-24T08:07:51.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.043+0000 7f9cb3b18700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cac15e1e0 0x7f9cac0d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.043+0000 7f9cb3b18700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9cac0d0f80 0x7f9cac0b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.043+0000 7f9cb3b18700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac0d20b0 con 0x7f9cac0d3a00 2023-11-24T08:07:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.043+0000 7f9cb3b18700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac0d3150 con 0x7f9cac0d0f80 2023-11-24T08:07:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.043+0000 7f9cb3b18700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac15e5c0 con 0x7f9cac15e1e0 2023-11-24T08:07:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.043+0000 7f9cb20b5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9cac0d0f80 0x7f9cac0b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.043+0000 7f9cb20b5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9cac0d0f80 0x7f9cac0b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40458/0 (socket says 172.21.15.153:40458) 2023-11-24T08:07:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.043+0000 7f9cb20b5700 1 -- 172.21.15.153:0/580096603 learned_addr learned my addr 172.21.15.153:0/580096603 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.043+0000 7f9cb18b4700 1 --2- 172.21.15.153:0/580096603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cac15e1e0 0x7f9cac0d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb20b5700 1 -- 172.21.15.153:0/580096603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cac15e1e0 msgr2=0x7f9cac0d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:51.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb20b5700 1 --2- 172.21.15.153:0/580096603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cac15e1e0 0x7f9cac0d34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb20b5700 1 -- 172.21.15.153:0/580096603 >> v1:172.21.15.164:6789/0 conn(0x7f9cac0d3a00 legacy=0x7f9cac0d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:51.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb20b5700 1 -- 172.21.15.153:0/580096603 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac0d2390 con 0x7f9cac0d0f80 2023-11-24T08:07:51.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb20b5700 1 --2- 172.21.15.153:0/580096603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cac0d0f80 0x7f9cac0b6ef0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009e80 tx=0x7f9ca400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc781f729310d78 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb08b2700 1 -- 172.21.15.153:0/580096603 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400e070 con 0x7f9cac0d0f80 2023-11-24T08:07:51.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb08b2700 1 -- 172.21.15.153:0/580096603 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca4003a20 con 0x7f9cac0d0f80 2023-11-24T08:07:51.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb08b2700 1 -- 172.21.15.153:0/580096603 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4003dd0 con 0x7f9cac0d0f80 2023-11-24T08:07:51.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb3b18700 1 -- 172.21.15.153:0/580096603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cac0d0f80 msgr2=0x7f9cac0b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb3b18700 1 --2- 172.21.15.153:0/580096603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cac0d0f80 0x7f9cac0b6ef0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009e80 tx=0x7f9ca400b330 comp rx=0 tx=0).stop 2023-11-24T08:07:51.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb3b18700 1 -- 172.21.15.153:0/580096603 shutdown_connections 2023-11-24T08:07:51.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb3b18700 1 --2- 172.21.15.153:0/580096603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cac0d0f80 0x7f9cac0b6ef0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb3b18700 1 --2- 172.21.15.153:0/580096603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cac15e1e0 0x7f9cac0d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.044+0000 7f9cb3b18700 1 -- 172.21.15.153:0/580096603 >> 172.21.15.153:0/580096603 conn(0x7f9cac0b5b50 msgr2=0x7f9cac0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:51.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.045+0000 7f9cb3b18700 1 -- 172.21.15.153:0/580096603 shutdown_connections 2023-11-24T08:07:51.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.045+0000 7f9cb3b18700 1 -- 172.21.15.153:0/580096603 wait complete. 2023-11-24T08:07:51.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.046+0000 7f9cb3b18700 1 Processor -- start 2023-11-24T08:07:51.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.046+0000 7f9cb3b18700 1 -- start start 2023-11-24T08:07:51.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.046+0000 7f9cb3b18700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cac0d0f80 0x7f9cac1f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.046+0000 7f9cb3b18700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cac0d3a00 0x7f9cac0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.046+0000 7f9cb3b18700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cac15e1e0 0x7f9cac157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.046+0000 7f9cb3b18700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac15a690 con 0x7f9cac0d0f80 2023-11-24T08:07:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.046+0000 7f9cb3b18700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac1f7f40 con 0x7f9cac0d3a00 2023-11-24T08:07:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.046+0000 7f9cb3b18700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac159a10 con 0x7f9cac15e1e0 2023-11-24T08:07:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb18b4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cac0d0f80 0x7f9cac1f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb18b4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cac0d0f80 0x7f9cac1f7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40460/0 (socket says 172.21.15.153:40460) 2023-11-24T08:07:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb18b4700 1 -- 172.21.15.153:0/172716418 learned_addr learned my addr 172.21.15.153:0/172716418 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb10b3700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cac0d3a00 0x7f9cac0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb20b5700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cac15e1e0 0x7f9cac157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb18b4700 1 -- 172.21.15.153:0/172716418 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cac15e1e0 msgr2=0x7f9cac157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb18b4700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cac15e1e0 0x7f9cac157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb18b4700 1 -- 172.21.15.153:0/172716418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cac0d3a00 msgr2=0x7f9cac0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb18b4700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cac0d3a00 0x7f9cac0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb18b4700 1 -- 172.21.15.153:0/172716418 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009b30 con 0x7f9cac0d0f80 2023-11-24T08:07:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb10b3700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cac0d3a00 0x7f9cac0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb18b4700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cac0d0f80 0x7f9cac1f7a00 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00c7f0 tx=0x7f9c9c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9ca27fc700 1 -- 172.21.15.153:0/172716418 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c011800 con 0x7f9cac0d0f80 2023-11-24T08:07:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9ca27fc700 1 -- 172.21.15.153:0/172716418 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c011960 con 0x7f9cac0d0f80 2023-11-24T08:07:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb3b18700 1 -- 172.21.15.153:0/172716418 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cac159cf0 con 0x7f9cac0d0f80 2023-11-24T08:07:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9ca27fc700 1 -- 172.21.15.153:0/172716418 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c011d10 con 0x7f9cac0d0f80 2023-11-24T08:07:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.047+0000 7f9cb3b18700 1 -- 172.21.15.153:0/172716418 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac15a2b0 con 0x7f9cac0d0f80 2023-11-24T08:07:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.048+0000 7f9cb3b18700 1 -- 172.21.15.153:0/172716418 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac0751e0 con 0x7f9cac0d0f80 2023-11-24T08:07:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.049+0000 7f9ca27fc700 1 -- 172.21.15.153:0/172716418 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9c9c018360 con 0x7f9cac0d0f80 2023-11-24T08:07:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.049+0000 7f9ca27fc700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c9006b080 0x7f9c9006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.049+0000 7f9ca27fc700 1 -- 172.21.15.153:0/172716418 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c9c089690 con 0x7f9cac0d0f80 2023-11-24T08:07:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.049+0000 7f9cb10b3700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c9006b080 0x7f9c9006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.049+0000 7f9cb10b3700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c9006b080 0x7f9c9006d540 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9cac1f6f80 tx=0x7f9ca8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.054+0000 7f9ca27fc700 1 -- 172.21.15.153:0/172716418 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c9c054740 con 0x7f9cac0d0f80 2023-11-24T08:07:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.245+0000 7f9cb3b18700 1 -- 172.21.15.153:0/172716418 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cac159b80 con 0x7f9c9006b080 2023-11-24T08:07:51.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.246+0000 7f9ca27fc700 1 -- 172.21.15.153:0/172716418 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9cac159b80 con 0x7f9c9006b080 2023-11-24T08:07:51.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 -- 172.21.15.153:0/172716418 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c9006b080 msgr2=0x7f9c9006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c9006b080 0x7f9c9006d540 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9cac1f6f80 tx=0x7f9ca8009040 comp rx=0 tx=0).stop 2023-11-24T08:07:51.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 -- 172.21.15.153:0/172716418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cac0d0f80 msgr2=0x7f9cac1f7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cac0d0f80 0x7f9cac1f7a00 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00c7f0 tx=0x7f9c9c00cbb0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 -- 172.21.15.153:0/172716418 shutdown_connections 2023-11-24T08:07:51.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cac15e1e0 0x7f9cac157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f9c9006b080 0x7f9c9006d540 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cac0d0f80 0x7f9cac1f7a00 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 --2- 172.21.15.153:0/172716418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cac0d3a00 0x7f9cac0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 -- 172.21.15.153:0/172716418 >> 172.21.15.153:0/172716418 conn(0x7f9cac0b5b50 msgr2=0x7f9cac15e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:51.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 -- 172.21.15.153:0/172716418 shutdown_connections 2023-11-24T08:07:51.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.248+0000 7f9cb3b18700 1 -- 172.21.15.153:0/172716418 wait complete. 2023-11-24T08:07:51.252 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 6 to deep-scrub 2023-11-24T08:07:51.261 INFO:tasks.ceph:Scrubbing osd.7 2023-11-24T08:07:51.262 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:51.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.386+0000 7f0105adf700 1 Processor -- start 2023-11-24T08:07:51.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.386+0000 7f0105adf700 1 -- start start 2023-11-24T08:07:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.387+0000 7f0105adf700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0100144600 0x7f01000b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.387+0000 7f0105adf700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f010006f480 0x7f010006c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.387+0000 7f0105adf700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f010006e830 0x7f010006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.387+0000 7f0105adf700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010006aff0 con 0x7f010006f480 2023-11-24T08:07:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.387+0000 7f0105adf700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010006f1c0 con 0x7f0100144600 2023-11-24T08:07:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.387+0000 7f0105adf700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010006b200 con 0x7f010006e830 2023-11-24T08:07:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.387+0000 7f00feffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f010006f480 0x7f010006c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.387+0000 7f00feffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f010006f480 0x7f010006c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40468/0 (socket says 172.21.15.153:40468) 2023-11-24T08:07:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.387+0000 7f00feffd700 1 -- 172.21.15.153:0/1110048461 learned_addr learned my addr 172.21.15.153:0/1110048461 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00fffff700 1 --2- 172.21.15.153:0/1110048461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f010006e830 0x7f010006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00ff7fe700 1 --2- 172.21.15.153:0/1110048461 >> v2:172.21.15.164:3300/0 conn(0x7f0100144600 0x7f01000b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00feffd700 1 -- 172.21.15.153:0/1110048461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f010006e830 msgr2=0x7f010006ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00feffd700 1 --2- 172.21.15.153:0/1110048461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f010006e830 0x7f010006ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00feffd700 1 -- 172.21.15.153:0/1110048461 >> v2:172.21.15.164:3300/0 conn(0x7f0100144600 msgr2=0x7f01000b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00feffd700 1 --2- 172.21.15.153:0/1110048461 >> v2:172.21.15.164:3300/0 conn(0x7f0100144600 0x7f01000b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00feffd700 1 -- 172.21.15.153:0/1110048461 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010006b4e0 con 0x7f010006f480 2023-11-24T08:07:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00ff7fe700 1 --2- 172.21.15.153:0/1110048461 >> v2:172.21.15.164:3300/0 conn(0x7f0100144600 0x7f01000b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00feffd700 1 --2- 172.21.15.153:0/1110048461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010006f480 0x7f010006c2a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f01000734a0 tx=0x7f00f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158c41c7803471ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00fe7fc700 1 -- 172.21.15.153:0/1110048461 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000b870 con 0x7f010006f480 2023-11-24T08:07:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00fe7fc700 1 -- 172.21.15.153:0/1110048461 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f000b9d0 con 0x7f010006f480 2023-11-24T08:07:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.388+0000 7f00fe7fc700 1 -- 172.21.15.153:0/1110048461 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000bd60 con 0x7f010006f480 2023-11-24T08:07:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.389+0000 7f0105adf700 1 -- 172.21.15.153:0/1110048461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010006f480 msgr2=0x7f010006c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.389+0000 7f0105adf700 1 --2- 172.21.15.153:0/1110048461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010006f480 0x7f010006c2a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f01000734a0 tx=0x7f00f0009bd0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.389+0000 7f0105adf700 1 -- 172.21.15.153:0/1110048461 shutdown_connections 2023-11-24T08:07:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.389+0000 7f0105adf700 1 --2- 172.21.15.153:0/1110048461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f010006e830 0x7f010006ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.389+0000 7f0105adf700 1 --2- 172.21.15.153:0/1110048461 >> v2:172.21.15.164:3300/0 conn(0x7f0100144600 0x7f01000b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.389+0000 7f0105adf700 1 --2- 172.21.15.153:0/1110048461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010006f480 0x7f010006c2a0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.389+0000 7f0105adf700 1 -- 172.21.15.153:0/1110048461 >> 172.21.15.153:0/1110048461 conn(0x7f01000d0b40 msgr2=0x7f01000d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:51.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.389+0000 7f0105adf700 1 -- 172.21.15.153:0/1110048461 shutdown_connections 2023-11-24T08:07:51.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.389+0000 7f0105adf700 1 -- 172.21.15.153:0/1110048461 wait complete. 2023-11-24T08:07:51.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.390+0000 7f0105adf700 1 Processor -- start 2023-11-24T08:07:51.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.390+0000 7f0105adf700 1 -- start start 2023-11-24T08:07:51.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.391+0000 7f0105adf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010006e830 0x7f01001423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.391+0000 7f0105adf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f010006f480 0x7f010015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.391+0000 7f0105adf700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0100144600 0x7f01000abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.391+0000 7f0105adf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010012f040 con 0x7f010006e830 2023-11-24T08:07:51.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.391+0000 7f0105adf700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010015dca0 con 0x7f010006f480 2023-11-24T08:07:51.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.391+0000 7f0105adf700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010015df80 con 0x7f0100144600 2023-11-24T08:07:51.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.391+0000 7f00ff7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010006e830 0x7f01001423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.391+0000 7f00ff7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010006e830 0x7f01001423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40474/0 (socket says 172.21.15.153:40474) 2023-11-24T08:07:51.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.391+0000 7f00ff7fe700 1 -- 172.21.15.153:0/3777831350 learned_addr learned my addr 172.21.15.153:0/3777831350 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:51.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00feffd700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f010006f480 0x7f010015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00fffff700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0100144600 0x7f01000abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00ff7fe700 1 -- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0100144600 msgr2=0x7f01000abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00ff7fe700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0100144600 0x7f01000abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00ff7fe700 1 -- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f010006f480 msgr2=0x7f010015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00ff7fe700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f010006f480 0x7f010015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00ff7fe700 1 -- 172.21.15.153:0/3777831350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f0009550 con 0x7f010006e830 2023-11-24T08:07:51.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00fffff700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0100144600 0x7f01000abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:51.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00feffd700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f010006f480 0x7f010015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:51.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00ff7fe700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010006e830 0x7f01001423e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f00f400ed70 tx=0x7f00f4009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00e7fff700 1 -- 172.21.15.153:0/3777831350 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f400ee50 con 0x7f010006e830 2023-11-24T08:07:51.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00e7fff700 1 -- 172.21.15.153:0/3777831350 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f4010440 con 0x7f010006e830 2023-11-24T08:07:51.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f00e7fff700 1 -- 172.21.15.153:0/3777831350 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4010810 con 0x7f010006e830 2023-11-24T08:07:51.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f0105adf700 1 -- 172.21.15.153:0/3777831350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010015e260 con 0x7f010006e830 2023-11-24T08:07:51.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.392+0000 7f0105adf700 1 -- 172.21.15.153:0/3777831350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0100142920 con 0x7f010006e830 2023-11-24T08:07:51.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.393+0000 7f0105adf700 1 -- 172.21.15.153:0/3777831350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f010006bd80 con 0x7f010006e830 2023-11-24T08:07:51.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.393+0000 7f00e7fff700 1 -- 172.21.15.153:0/3777831350 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f00f4010970 con 0x7f010006e830 2023-11-24T08:07:51.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.394+0000 7f00e7fff700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f00ec06b080 0x7f00ec06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.394+0000 7f00e7fff700 1 -- 172.21.15.153:0/3777831350 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f00f4014070 con 0x7f010006e830 2023-11-24T08:07:51.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.394+0000 7f00feffd700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f00ec06b080 0x7f00ec06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.394+0000 7f00e7fff700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] conn(0x7f00ec070ee0 0x7f00ec073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.394+0000 7f00e7fff700 1 -- 172.21.15.153:0/3777831350 --> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00ec0739d0 con 0x7f00ec070ee0 2023-11-24T08:07:51.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.394+0000 7f00e7fff700 1 -- 172.21.15.153:0/3777831350 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00f408e340 con 0x7f010006e830 2023-11-24T08:07:51.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.394+0000 7f00fffff700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] conn(0x7f00ec070ee0 0x7f00ec073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.394+0000 7f00feffd700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f00ec06b080 0x7f00ec06d540 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f00f0000c00 tx=0x7f00f0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.395+0000 7f00fffff700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] conn(0x7f00ec070ee0 0x7f00ec073300 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.395+0000 7f00e7fff700 1 -- 172.21.15.153:0/3777831350 <== osd.7 v2:172.21.15.164:6816/525702944 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f00ec0739d0 con 0x7f00ec070ee0 2023-11-24T08:07:51.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.410+0000 7f0105adf700 1 -- 172.21.15.153:0/3777831350 --> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f010006baa0 con 0x7f00ec070ee0 2023-11-24T08:07:51.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f00e7fff700 1 -- 172.21.15.153:0/3777831350 <== osd.7 v2:172.21.15.164:6816/525702944 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f00f800e3f0 con 0x7f00ec070ee0 2023-11-24T08:07:51.415 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-11-24T08:07:51.415 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:51.416 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-11-24T08:07:51.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f0105adf700 1 -- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] conn(0x7f00ec070ee0 msgr2=0x7f00ec073300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f0105adf700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.164:6816/525702944,v1:172.21.15.164:6817/525702944] conn(0x7f00ec070ee0 0x7f00ec073300 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f0105adf700 1 -- 172.21.15.153:0/3777831350 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f00ec06b080 msgr2=0x7f00ec06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f0105adf700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f00ec06b080 0x7f00ec06d540 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f00f0000c00 tx=0x7f00f0008030 comp rx=0 tx=0).stop 2023-11-24T08:07:51.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f0105adf700 1 -- 172.21.15.153:0/3777831350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010006e830 msgr2=0x7f01001423e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f0105adf700 1 --2- 172.21.15.153:0/3777831350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010006e830 0x7f01001423e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f00f400ed70 tx=0x7f00f4009530 comp rx=0 tx=0).stop 2023-11-24T08:07:51.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f00fffff700 1 -- 172.21.15.153:0/3777831350 reap_dead start 2023-11-24T08:07:51.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f0105adf700 1 -- 172.21.15.153:0/3777831350 shutdown_connections 2023-11-24T08:07:51.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f0105adf700 1 -- 172.21.15.153:0/3777831350 >> 172.21.15.153:0/3777831350 conn(0x7f01000d0b40 msgr2=0x7f01000d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:51.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f0105adf700 1 -- 172.21.15.153:0/3777831350 shutdown_connections 2023-11-24T08:07:51.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.411+0000 7f0105adf700 1 -- 172.21.15.153:0/3777831350 wait complete. 2023-11-24T08:07:51.425 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-24T08:07:51.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.545+0000 7fc54c007700 1 Processor -- start 2023-11-24T08:07:51.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.545+0000 7fc54c007700 1 -- start start 2023-11-24T08:07:51.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc54c007700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc54415ae20 0x7fc5440b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc54c007700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc54415b200 0x7fc5440b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc54c007700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5440cfd40 con 0x7fc5440cf780 2023-11-24T08:07:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc54c007700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5440d0020 con 0x7fc54415ae20 2023-11-24T08:07:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc54c007700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5440affa0 con 0x7fc54415b200 2023-11-24T08:07:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc549da3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc54415ae20 0x7fc5440b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc54a5a4700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc5440cf780 0x7fc5440b0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46590/0 (socket says 172.21.15.153:46590) 2023-11-24T08:07:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc54a5a4700 1 -- 172.21.15.153:0/3173486193 learned_addr learned my addr 172.21.15.153:0/3173486193 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc5495a2700 1 --2- 172.21.15.153:0/3173486193 >> v2:172.21.15.164:3300/0 conn(0x7fc54415b200 0x7fc5440b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc549da3700 1 -- 172.21.15.153:0/3173486193 >> v2:172.21.15.164:3300/0 conn(0x7fc54415b200 msgr2=0x7fc5440b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc549da3700 1 --2- 172.21.15.153:0/3173486193 >> v2:172.21.15.164:3300/0 conn(0x7fc54415b200 0x7fc5440b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc549da3700 1 -- 172.21.15.153:0/3173486193 >> v1:172.21.15.153:6789/0 conn(0x7fc5440cf780 legacy=0x7fc5440b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc549da3700 1 -- 172.21.15.153:0/3173486193 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5440b0280 con 0x7fc54415ae20 2023-11-24T08:07:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc548da1700 1 -- 172.21.15.153:0/3173486193 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104552551 0 0) 0x7fc5440cfd40 con 0x7fc5440cf780 2023-11-24T08:07:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc549da3700 1 --2- 172.21.15.153:0/3173486193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc54415ae20 0x7fc5440b29a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc5440cefe0 tx=0x7fc534009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794ab6cd4b25c490 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.546+0000 7fc548da1700 1 -- 172.21.15.153:0/3173486193 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534011830 con 0x7fc54415ae20 2023-11-24T08:07:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.547+0000 7fc548da1700 1 -- 172.21.15.153:0/3173486193 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc534011990 con 0x7fc54415ae20 2023-11-24T08:07:51.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.547+0000 7fc548da1700 1 -- 172.21.15.153:0/3173486193 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534011d20 con 0x7fc54415ae20 2023-11-24T08:07:51.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.547+0000 7fc54c007700 1 -- 172.21.15.153:0/3173486193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc54415ae20 msgr2=0x7fc5440b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.547+0000 7fc54c007700 1 --2- 172.21.15.153:0/3173486193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc54415ae20 0x7fc5440b29a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc5440cefe0 tx=0x7fc534009b20 comp rx=0 tx=0).stop 2023-11-24T08:07:51.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.547+0000 7fc54c007700 1 -- 172.21.15.153:0/3173486193 shutdown_connections 2023-11-24T08:07:51.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.547+0000 7fc54c007700 1 --2- 172.21.15.153:0/3173486193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc54415ae20 0x7fc5440b29a0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.547+0000 7fc54c007700 1 --2- 172.21.15.153:0/3173486193 >> v2:172.21.15.164:3300/0 conn(0x7fc54415b200 0x7fc5440b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.547+0000 7fc54c007700 1 -- 172.21.15.153:0/3173486193 >> 172.21.15.153:0/3173486193 conn(0x7fc5440b57b0 msgr2=0x7fc5440b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:51.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.547+0000 7fc54c007700 1 -- 172.21.15.153:0/3173486193 shutdown_connections 2023-11-24T08:07:51.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.547+0000 7fc54c007700 1 -- 172.21.15.153:0/3173486193 wait complete. 2023-11-24T08:07:51.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.548+0000 7fc54c007700 1 Processor -- start 2023-11-24T08:07:51.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.548+0000 7fc54c007700 1 -- start start 2023-11-24T08:07:51.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc54c007700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5440cf780 0x7fc5441500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc54c007700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc54415ae20 0x7fc544147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc54c007700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc54415b200 0x7fc5441f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc54c007700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440ae5b0 con 0x7fc54415ae20 2023-11-24T08:07:51.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc54c007700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5441506d0 con 0x7fc54415b200 2023-11-24T08:07:51.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc54c007700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440adc80 con 0x7fc5440cf780 2023-11-24T08:07:51.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc5495a2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc54415ae20 0x7fc544147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc5495a2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc54415ae20 0x7fc544147af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40490/0 (socket says 172.21.15.153:40490) 2023-11-24T08:07:51.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc5495a2700 1 -- 172.21.15.153:0/2311633934 learned_addr learned my addr 172.21.15.153:0/2311633934 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc549da3700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5440cf780 0x7fc5441500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc54a5a4700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc54415b200 0x7fc5441f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc5495a2700 1 -- 172.21.15.153:0/2311633934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5440cf780 msgr2=0x7fc5441500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc5495a2700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5440cf780 0x7fc5441500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc5495a2700 1 -- 172.21.15.153:0/2311633934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc54415b200 msgr2=0x7fc5441f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc5495a2700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc54415b200 0x7fc5441f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc5495a2700 1 -- 172.21.15.153:0/2311633934 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5340094a0 con 0x7fc54415ae20 2023-11-24T08:07:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.549+0000 7fc549da3700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5440cf780 0x7fc5441500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.550+0000 7fc5495a2700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc54415ae20 0x7fc544147af0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc54000d800 tx=0x7fc54000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.550+0000 7fc53a7fc700 1 -- 172.21.15.153:0/2311633934 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5400125f0 con 0x7fc54415ae20 2023-11-24T08:07:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.550+0000 7fc53a7fc700 1 -- 172.21.15.153:0/2311633934 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc540012750 con 0x7fc54415ae20 2023-11-24T08:07:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.550+0000 7fc54c007700 1 -- 172.21.15.153:0/2311633934 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5440adf60 con 0x7fc54415ae20 2023-11-24T08:07:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.550+0000 7fc53a7fc700 1 -- 172.21.15.153:0/2311633934 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540012b00 con 0x7fc54415ae20 2023-11-24T08:07:51.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.550+0000 7fc54c007700 1 -- 172.21.15.153:0/2311633934 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc544148030 con 0x7fc54415ae20 2023-11-24T08:07:51.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.551+0000 7fc54c007700 1 -- 172.21.15.153:0/2311633934 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5440ae890 con 0x7fc54415ae20 2023-11-24T08:07:51.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.551+0000 7fc53a7fc700 1 -- 172.21.15.153:0/2311633934 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc540012c60 con 0x7fc54415ae20 2023-11-24T08:07:51.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.552+0000 7fc53a7fc700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc52806b080 0x7fc52806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.552+0000 7fc53a7fc700 1 -- 172.21.15.153:0/2311633934 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc540089800 con 0x7fc54415ae20 2023-11-24T08:07:51.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.552+0000 7fc549da3700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc52806b080 0x7fc52806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.552+0000 7fc549da3700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc52806b080 0x7fc52806d540 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc5340090b0 tx=0x7fc534008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.556+0000 7fc53a7fc700 1 -- 172.21.15.153:0/2311633934 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5400548a0 con 0x7fc54415ae20 2023-11-24T08:07:51.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.746+0000 7fc54c007700 1 -- 172.21.15.153:0/2311633934 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5440b37d0 con 0x7fc52806b080 2023-11-24T08:07:51.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.746+0000 7fc53a7fc700 1 -- 172.21.15.153:0/2311633934 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc534011c00 con 0x7fc52806b080 2023-11-24T08:07:51.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 -- 172.21.15.153:0/2311633934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc52806b080 msgr2=0x7fc52806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc52806b080 0x7fc52806d540 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc5340090b0 tx=0x7fc534008030 comp rx=0 tx=0).stop 2023-11-24T08:07:51.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 -- 172.21.15.153:0/2311633934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc54415ae20 msgr2=0x7fc544147af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc54415ae20 0x7fc544147af0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc54000d800 tx=0x7fc54000dbc0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 -- 172.21.15.153:0/2311633934 shutdown_connections 2023-11-24T08:07:51.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc54415b200 0x7fc5441f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5440cf780 0x7fc5441500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fc52806b080 0x7fc52806d540 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 --2- 172.21.15.153:0/2311633934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc54415ae20 0x7fc544147af0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 -- 172.21.15.153:0/2311633934 >> 172.21.15.153:0/2311633934 conn(0x7fc5440b57b0 msgr2=0x7fc544150ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:51.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 -- 172.21.15.153:0/2311633934 shutdown_connections 2023-11-24T08:07:51.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.748+0000 7fc54c007700 1 -- 172.21.15.153:0/2311633934 wait complete. 2023-11-24T08:07:51.752 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 7 to deep-scrub 2023-11-24T08:07:51.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:51.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.880+0000 7fd7d4371700 1 Processor -- start 2023-11-24T08:07:51.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.880+0000 7fd7d4371700 1 -- start start 2023-11-24T08:07:51.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.881+0000 7fd7d4371700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7cc0af4d0 0x7fd7cc0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.881+0000 7fd7d4371700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc0ae430 con 0x7fd7cc06c710 2023-11-24T08:07:51.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.881+0000 7fd7d4371700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc0ae710 con 0x7fd7cc15e080 2023-11-24T08:07:51.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.881+0000 7fd7d4371700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7cc0af0b0 con 0x7fd7cc0af4d0 2023-11-24T08:07:51.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.881+0000 7fd7d190c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd7cc06c710 0x7fd7cc06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46600/0 (socket says 172.21.15.153:46600) 2023-11-24T08:07:51.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.881+0000 7fd7d190c700 1 -- 172.21.15.153:0/95635632 learned_addr learned my addr 172.21.15.153:0/95635632 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:07:51.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.882+0000 7fd7d290e700 1 --2- 172.21.15.153:0/95635632 >> v2:172.21.15.153:3300/0 conn(0x7fd7cc0af4d0 0x7fd7cc0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.882+0000 7fd7d110b700 1 -- 172.21.15.153:0/95635632 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215368946 0 0) 0x7fd7cc0ae430 con 0x7fd7cc06c710 2023-11-24T08:07:51.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.882+0000 7fd7d110b700 1 -- 172.21.15.153:0/95635632 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7b80035b0 con 0x7fd7cc06c710 2023-11-24T08:07:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.882+0000 7fd7d290e700 1 -- 172.21.15.153:0/95635632 >> v1:172.21.15.164:6789/0 conn(0x7fd7cc15e080 legacy=0x7fd7cc06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.882+0000 7fd7d290e700 1 -- 172.21.15.153:0/95635632 >> v1:172.21.15.153:6789/0 conn(0x7fd7cc06c710 legacy=0x7fd7cc06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.882+0000 7fd7d290e700 1 -- 172.21.15.153:0/95635632 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc0ae9f0 con 0x7fd7cc0af4d0 2023-11-24T08:07:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.882+0000 7fd7d290e700 1 --2- 172.21.15.153:0/95635632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7cc0af4d0 0x7fd7cc0b5050 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009d90 tx=0x7fd7c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae78e9eb4ea9e0bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.882+0000 7fd7d110b700 1 -- 172.21.15.153:0/95635632 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c400e070 con 0x7fd7cc0af4d0 2023-11-24T08:07:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.882+0000 7fd7d110b700 1 -- 172.21.15.153:0/95635632 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c400bb20 con 0x7fd7cc0af4d0 2023-11-24T08:07:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.882+0000 7fd7d110b700 1 -- 172.21.15.153:0/95635632 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4012430 con 0x7fd7cc0af4d0 2023-11-24T08:07:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.883+0000 7fd7d4371700 1 -- 172.21.15.153:0/95635632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7cc0af4d0 msgr2=0x7fd7cc0b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.883+0000 7fd7d4371700 1 --2- 172.21.15.153:0/95635632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7cc0af4d0 0x7fd7cc0b5050 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009d90 tx=0x7fd7c400b330 comp rx=0 tx=0).stop 2023-11-24T08:07:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.883+0000 7fd7d4371700 1 -- 172.21.15.153:0/95635632 shutdown_connections 2023-11-24T08:07:51.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.883+0000 7fd7d4371700 1 --2- 172.21.15.153:0/95635632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7cc0af4d0 0x7fd7cc0b5050 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.883+0000 7fd7d4371700 1 -- 172.21.15.153:0/95635632 >> 172.21.15.153:0/95635632 conn(0x7fd7cc071b90 msgr2=0x7fd7cc071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:51.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.883+0000 7fd7d4371700 1 -- 172.21.15.153:0/95635632 shutdown_connections 2023-11-24T08:07:51.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.883+0000 7fd7d4371700 1 -- 172.21.15.153:0/95635632 wait complete. 2023-11-24T08:07:51.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.884+0000 7fd7d4371700 1 Processor -- start 2023-11-24T08:07:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.884+0000 7fd7d4371700 1 -- start start 2023-11-24T08:07:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d4371700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7cc06c710 0x7fd7cc141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d4371700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7cc0af4d0 0x7fd7cc160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d4371700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7cc15e080 0x7fd7cc142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d4371700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc15b7c0 con 0x7fd7cc15e080 2023-11-24T08:07:51.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d4371700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc0cf870 con 0x7fd7cc06c710 2023-11-24T08:07:51.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d4371700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc161410 con 0x7fd7cc0af4d0 2023-11-24T08:07:51.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d290e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7cc15e080 0x7fd7cc142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d290e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7cc15e080 0x7fd7cc142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40506/0 (socket says 172.21.15.153:40506) 2023-11-24T08:07:51.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d290e700 1 -- 172.21.15.153:0/3667507894 learned_addr learned my addr 172.21.15.153:0/3667507894 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:07:51.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d210d700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7cc06c710 0x7fd7cc141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d190c700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7cc0af4d0 0x7fd7cc160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d290e700 1 -- 172.21.15.153:0/3667507894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7cc0af4d0 msgr2=0x7fd7cc160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d290e700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7cc0af4d0 0x7fd7cc160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d290e700 1 -- 172.21.15.153:0/3667507894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7cc06c710 msgr2=0x7fd7cc141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d290e700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7cc06c710 0x7fd7cc141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d290e700 1 -- 172.21.15.153:0/3667507894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c4009a70 con 0x7fd7cc15e080 2023-11-24T08:07:51.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d290e700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7cc15e080 0x7fd7cc142550 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400b680 tx=0x7fd7c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7c2ffd700 1 -- 172.21.15.153:0/3667507894 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4012430 con 0x7fd7cc15e080 2023-11-24T08:07:51.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7c2ffd700 1 -- 172.21.15.153:0/3667507894 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c4020070 con 0x7fd7cc15e080 2023-11-24T08:07:51.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.885+0000 7fd7d4371700 1 -- 172.21.15.153:0/3667507894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc0cef80 con 0x7fd7cc15e080 2023-11-24T08:07:51.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.886+0000 7fd7c2ffd700 1 -- 172.21.15.153:0/3667507894 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4004280 con 0x7fd7cc15e080 2023-11-24T08:07:51.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.886+0000 7fd7d4371700 1 -- 172.21.15.153:0/3667507894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc0cf220 con 0x7fd7cc15e080 2023-11-24T08:07:51.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.886+0000 7fd7d4371700 1 -- 172.21.15.153:0/3667507894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7cc0753f0 con 0x7fd7cc15e080 2023-11-24T08:07:51.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.887+0000 7fd7c2ffd700 1 -- 172.21.15.153:0/3667507894 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd7c40043e0 con 0x7fd7cc15e080 2023-11-24T08:07:51.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.887+0000 7fd7c2ffd700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7b006b080 0x7fd7b006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.887+0000 7fd7c2ffd700 1 -- 172.21.15.153:0/3667507894 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd7c4022070 con 0x7fd7cc15e080 2023-11-24T08:07:51.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.887+0000 7fd7d210d700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7b006b080 0x7fd7b006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.888+0000 7fd7d210d700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7b006b080 0x7fd7b006d540 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc007fd0 tx=0x7fd7bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:51.892+0000 7fd7c2ffd700 1 -- 172.21.15.153:0/3667507894 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7c4056810 con 0x7fd7cc15e080 2023-11-24T08:07:52.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.078+0000 7fd7d4371700 1 -- 172.21.15.153:0/3667507894 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7cc0b05a0 con 0x7fd7b006b080 2023-11-24T08:07:52.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.080+0000 7fd7c2ffd700 1 -- 172.21.15.153:0/3667507894 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50801 (secure 0 0 0) 0x7fd7bc001cc0 con 0x7fd7b006b080 2023-11-24T08:07:52.083 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:07:52.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 -- 172.21.15.153:0/3667507894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7b006b080 msgr2=0x7fd7b006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7b006b080 0x7fd7b006d540 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc007fd0 tx=0x7fd7bc009040 comp rx=0 tx=0).stop 2023-11-24T08:07:52.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 -- 172.21.15.153:0/3667507894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7cc15e080 msgr2=0x7fd7cc142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7cc15e080 0x7fd7cc142550 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400b680 tx=0x7fd7c4004ad0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 -- 172.21.15.153:0/3667507894 shutdown_connections 2023-11-24T08:07:52.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fd7b006b080 0x7fd7b006d540 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7cc15e080 0x7fd7cc142550 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7cc06c710 0x7fd7cc141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 --2- 172.21.15.153:0/3667507894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7cc0af4d0 0x7fd7cc160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 -- 172.21.15.153:0/3667507894 >> 172.21.15.153:0/3667507894 conn(0x7fd7cc071b90 msgr2=0x7fd7cc0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:52.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 -- 172.21.15.153:0/3667507894 shutdown_connections 2023-11-24T08:07:52.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:07:52.082+0000 7fd7d4371700 1 -- 172.21.15.153:0/3667507894 wait complete. 2023-11-24T08:07:52.088 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:07:52.096 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2023-11-24T08:07:50.088113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222920,"kb_used_data":6756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751800,"statfs":{"total":773094113280,"available":772865843200,"internally_reserved":0,"allocated":6918144,"data_stored":3544581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4199,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001417"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T08:07:43.108357+0000","last_change":"2023-11-24T08:04:07.477984+0000","last_active":"2023-11-24T08:07:43.108357+0000","last_peered":"2023-11-24T08:07:43.108357+0000","last_clean":"2023-11-24T08:07:43.108357+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:07:43.108357+0000","last_undegraded":"2023-11-24T08:07:43.108357+0000","last_fullsized":"2023-11-24T08:07:43.108357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:06.098648+0000","last_clean_scrub_stamp":"2023-11-24T08:04:06.098648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:09.697403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1310720,"data_stored":885976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72199999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.68899999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.073,"15min":1.073},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.33200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.437},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":10.285,"15min":10.285},"last":0.442}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.745,"5min":2.089,"15min":2.089},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68400000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.629,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.747,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.90900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.214},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.27100000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.29799999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33300000000000002,"15min":0.31900000000000001},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.28299999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.626,"15min":0.626},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.5,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60699999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1659999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1306624,"data_stored":884957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34300000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.625,"5min":1.343,"15min":1.343},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61299999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.32600000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78600000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.60399999999999998,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.93200000000000005,"15min":1.0720000000000001},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82499999999999996,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.627},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.032,"15min":1.204},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":4,"15min":4},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.316,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.497,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.214},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.44,"15min":0.47199999999999998},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.25}]},{"osd":1,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53600000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61799999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.29699999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.59099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":5.673,"15min":5.673},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":1.216,"15min":1.216},"last":0.307}]},{"osd":4,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.246,"15min":1.246},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.82699999999999996},"min":{"1min":0.503,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.82999999999999996},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82099999999999995,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.758,"15min":5.758},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.89000000000000001},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":5.726,"15min":5.726},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.499,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.80300000000000005,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89400000000000002,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.94899999999999995},"min":{"1min":0.52000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99399999999999999,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.60299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.39600000000000002},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.59699999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58799999999999997,"5min":1.351,"15min":1.351},"last":0.33600000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40100000000000002,"15min":0.42699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.503,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.745,"5min":1.621,"15min":1.621},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.439},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63900000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45800000000000002,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64500000000000002,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.38500000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80500000000000005,"5min":1.389,"15min":1.389},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90700000000000003,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.675,"15min":1.675},"last":0.44400000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":1.417,"15min":1.417},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.67100000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.51400000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95899999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.504}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.5},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77100000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":1.101,"15min":1.101},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.499,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":1.476,"15min":1.476},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.751,"5min":1.556,"15min":1.556},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":1,"15min":1},"last":0.435}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.498},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.77300000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":0.752},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:52.102 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-24T08:04:06.098648+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=8, tm_min=4, tm_sec=6, tm_wday=4, tm_yday=328, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=8, tm_min=7, tm_sec=46, tm_wday=4, tm_yday=328, tm_isdst=0) 2023-11-24T08:07:52.103 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-24T08:08:12.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:08:12.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.238+0000 7fe410095700 1 Processor -- start 2023-11-24T08:08:12.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.238+0000 7fe410095700 1 -- start start 2023-11-24T08:08:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe410095700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe4080d0c40 0x7fe4080ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe410095700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4080d10d0 con 0x7fe4080afc80 2023-11-24T08:08:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe410095700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4080622a0 con 0x7fe4080b0fa0 2023-11-24T08:08:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe410095700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4080ca6d0 con 0x7fe4080d0c40 2023-11-24T08:08:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe40e632700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe4080d0c40 0x7fe4080ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe40d630700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe4080afc80 0x7fe4080ce1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46614/0 (socket says 172.21.15.153:46614) 2023-11-24T08:08:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe40d630700 1 -- 172.21.15.153:0/564479448 learned_addr learned my addr 172.21.15.153:0/564479448 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:08:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe40e632700 1 -- 172.21.15.153:0/564479448 >> v1:172.21.15.164:6789/0 conn(0x7fe4080b0fa0 legacy=0x7fe4080b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe40e632700 1 -- 172.21.15.153:0/564479448 >> v1:172.21.15.153:6789/0 conn(0x7fe4080afc80 legacy=0x7fe4080ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe40e632700 1 -- 172.21.15.153:0/564479448 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408062580 con 0x7fe4080d0c40 2023-11-24T08:08:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe40ce2f700 1 -- 172.21.15.153:0/564479448 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312522175 0 0) 0x7fe4080d10d0 con 0x7fe4080afc80 2023-11-24T08:08:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe40e632700 1 --2- 172.21.15.153:0/564479448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4080d0c40 0x7fe4080ca190 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe400009d90 tx=0x7fe40000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c061800000b255d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.239+0000 7fe40ce2f700 1 -- 172.21.15.153:0/564479448 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40000e070 con 0x7fe4080d0c40 2023-11-24T08:08:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.240+0000 7fe40ce2f700 1 -- 172.21.15.153:0/564479448 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40000bb90 con 0x7fe4080d0c40 2023-11-24T08:08:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.240+0000 7fe40ce2f700 1 -- 172.21.15.153:0/564479448 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400003a20 con 0x7fe4080d0c40 2023-11-24T08:08:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.240+0000 7fe410095700 1 -- 172.21.15.153:0/564479448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4080d0c40 msgr2=0x7fe4080ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.240+0000 7fe410095700 1 --2- 172.21.15.153:0/564479448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4080d0c40 0x7fe4080ca190 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe400009d90 tx=0x7fe40000b330 comp rx=0 tx=0).stop 2023-11-24T08:08:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.240+0000 7fe410095700 1 -- 172.21.15.153:0/564479448 shutdown_connections 2023-11-24T08:08:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.240+0000 7fe410095700 1 --2- 172.21.15.153:0/564479448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4080d0c40 0x7fe4080ca190 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.240+0000 7fe410095700 1 -- 172.21.15.153:0/564479448 >> 172.21.15.153:0/564479448 conn(0x7fe4080b57b0 msgr2=0x7fe4080b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.240+0000 7fe410095700 1 -- 172.21.15.153:0/564479448 shutdown_connections 2023-11-24T08:08:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.240+0000 7fe410095700 1 -- 172.21.15.153:0/564479448 wait complete. 2023-11-24T08:08:12.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.241+0000 7fe410095700 1 Processor -- start 2023-11-24T08:08:12.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.241+0000 7fe410095700 1 -- start start 2023-11-24T08:08:12.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe410095700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4080afc80 0x7fe40815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe410095700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4080b0fa0 0x7fe4081583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe410095700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4080d0c40 0x7fe4080b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe410095700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe408157f40 con 0x7fe4080b0fa0 2023-11-24T08:08:12.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe410095700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe408157330 con 0x7fe4080afc80 2023-11-24T08:08:12.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe410095700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe408157610 con 0x7fe4080d0c40 2023-11-24T08:08:12.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe40d630700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4080b0fa0 0x7fe4081583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe40d630700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4080b0fa0 0x7fe4081583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40518/0 (socket says 172.21.15.153:40518) 2023-11-24T08:08:12.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe40d630700 1 -- 172.21.15.153:0/1336725436 learned_addr learned my addr 172.21.15.153:0/1336725436 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:08:12.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe40d630700 1 -- 172.21.15.153:0/1336725436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4080d0c40 msgr2=0x7fe4080b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe40d630700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4080d0c40 0x7fe4080b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe40d630700 1 -- 172.21.15.153:0/1336725436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4080afc80 msgr2=0x7fe40815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe40d630700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4080afc80 0x7fe40815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.242+0000 7fe40d630700 1 -- 172.21.15.153:0/1336725436 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400009a70 con 0x7fe4080b0fa0 2023-11-24T08:08:12.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.243+0000 7fe40d630700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4080b0fa0 0x7fe4081583d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80011e0 tx=0x7fe3f800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.243+0000 7fe3fe7fc700 1 -- 172.21.15.153:0/1336725436 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8004c80 con 0x7fe4080b0fa0 2023-11-24T08:08:12.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.243+0000 7fe3fe7fc700 1 -- 172.21.15.153:0/1336725436 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f8004e00 con 0x7fe4080b0fa0 2023-11-24T08:08:12.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.243+0000 7fe3fe7fc700 1 -- 172.21.15.153:0/1336725436 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8007310 con 0x7fe4080b0fa0 2023-11-24T08:08:12.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.243+0000 7fe410095700 1 -- 172.21.15.153:0/1336725436 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4081578f0 con 0x7fe4080b0fa0 2023-11-24T08:08:12.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.243+0000 7fe410095700 1 -- 172.21.15.153:0/1336725436 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40815c310 con 0x7fe4080b0fa0 2023-11-24T08:08:12.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.244+0000 7fe410095700 1 -- 172.21.15.153:0/1336725436 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe408067f60 con 0x7fe4080b0fa0 2023-11-24T08:08:12.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.244+0000 7fe3fe7fc700 1 -- 172.21.15.153:0/1336725436 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe3f8007470 con 0x7fe4080b0fa0 2023-11-24T08:08:12.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.245+0000 7fe3fe7fc700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe3ec06b080 0x7fe3ec06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.245+0000 7fe3fe7fc700 1 -- 172.21.15.153:0/1336725436 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe3f80894d0 con 0x7fe4080b0fa0 2023-11-24T08:08:12.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.245+0000 7fe40de31700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe3ec06b080 0x7fe3ec06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.245+0000 7fe40de31700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe3ec06b080 0x7fe3ec06d540 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe408158cb0 tx=0x7fe404007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.249+0000 7fe3fe7fc700 1 -- 172.21.15.153:0/1336725436 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3f8054560 con 0x7fe4080b0fa0 2023-11-24T08:08:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.436+0000 7fe410095700 1 -- 172.21.15.153:0/1336725436 --> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4080c9c70 con 0x7fe3ec06b080 2023-11-24T08:08:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.438+0000 7fe3fe7fc700 1 -- 172.21.15.153:0/1336725436 <== mgr.4101 v2:172.21.15.153:6832/4027560183 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50672 (secure 0 0 0) 0x7fe404014400 con 0x7fe3ec06b080 2023-11-24T08:08:12.441 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:08:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.440+0000 7fe410095700 1 -- 172.21.15.153:0/1336725436 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe3ec06b080 msgr2=0x7fe3ec06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.441+0000 7fe410095700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe3ec06b080 0x7fe3ec06d540 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe408158cb0 tx=0x7fe404007a40 comp rx=0 tx=0).stop 2023-11-24T08:08:12.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.441+0000 7fe410095700 1 -- 172.21.15.153:0/1336725436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4080b0fa0 msgr2=0x7fe4081583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.441+0000 7fe410095700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4080b0fa0 0x7fe4081583d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80011e0 tx=0x7fe3f800cae0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.441+0000 7fe410095700 1 -- 172.21.15.153:0/1336725436 shutdown_connections 2023-11-24T08:08:12.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.441+0000 7fe410095700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4080d0c40 0x7fe4080b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.441+0000 7fe410095700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4080afc80 0x7fe40815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.441+0000 7fe410095700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7fe3ec06b080 0x7fe3ec06d540 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.441+0000 7fe410095700 1 --2- 172.21.15.153:0/1336725436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4080b0fa0 0x7fe4081583d0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.441+0000 7fe410095700 1 -- 172.21.15.153:0/1336725436 >> 172.21.15.153:0/1336725436 conn(0x7fe4080b57b0 msgr2=0x7fe4080b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:12.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.441+0000 7fe410095700 1 -- 172.21.15.153:0/1336725436 shutdown_connections 2023-11-24T08:08:12.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.441+0000 7fe410095700 1 -- 172.21.15.153:0/1336725436 wait complete. 2023-11-24T08:08:12.446 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-11-24T08:08:12.454 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-11-24T08:08:12.092517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222908,"kb_used_data":6756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751812,"statfs":{"total":773094113280,"available":772865855488,"internally_reserved":0,"allocated":6918144,"data_stored":3544581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002350"},"pg_stats":[{"pgid":"1.0","version":"59'119","reported_seq":212,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T08:07:52.348702+0000","last_change":"2023-11-24T08:07:52.348702+0000","last_active":"2023-11-24T08:07:52.348702+0000","last_peered":"2023-11-24T08:07:52.348702+0000","last_clean":"2023-11-24T08:07:52.348702+0000","last_became_active":"2023-11-24T08:04:07.476885+0000","last_became_peered":"2023-11-24T08:04:07.476885+0000","last_unstale":"2023-11-24T08:07:52.348702+0000","last_undegraded":"2023-11-24T08:07:52.348702+0000","last_fullsized":"2023-11-24T08:07:52.348702+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'119","last_scrub_stamp":"2023-11-24T08:07:52.348536+0000","last_deep_scrub":"59'119","last_deep_scrub_stamp":"2023-11-24T08:07:52.348536+0000","last_clean_scrub_stamp":"2023-11-24T08:07:52.348536+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:15.948894+0000","scrub_duration":0.0058153390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1310720,"data_stored":885976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72199999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.073,"15min":1.073},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.33200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.625},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.81200000000000006,"15min":0.93799999999999994},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":10.285,"15min":10.285},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.623},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.60899999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64900000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.745,"5min":2.089,"15min":2.089},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68400000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.68899999999999995}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.747,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.27100000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33300000000000002,"15min":0.31900000000000001},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60299999999999998,"5min":0.626,"15min":0.626},"last":0.441}]},{"osd":4,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.5,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60699999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.624}]},{"osd":7,"last update":"Fri Nov 24 08:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1659999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1306624,"data_stored":884957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.33900000000000002,"15min":0.34100000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.49299999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38500000000000001,"15min":0.39800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.57699999999999996,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39400000000000002,"15min":0.41099999999999998},"min":{"1min":0.27200000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.51900000000000002,"5min":1.343,"15min":1.343},"last":0.442},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41699999999999998,"15min":0.43099999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61899999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41999999999999998,"15min":0.44600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58599999999999997,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.46000000000000002,"15min":0.48399999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.622,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92700000000000005,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.48499999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.58399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.82699999999999996,"15min":1.0369999999999999},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0349999999999999,"5min":9.8109999999999999,"15min":9.8109999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96699999999999997,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.89900000000000002,"15min":1.1599999999999999},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95699999999999996,"5min":9.9100000000000001,"15min":9.9100000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.73699999999999999,"15min":0.82499999999999996},"min":{"1min":0.48399999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":4,"15min":4},"last":0.63600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.316,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.497,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.442},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.44,"15min":0.47199999999999998},"min":{"1min":0.22,"5min":0.218,"15min":0.218},"max":{"1min":0.55500000000000005,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53600000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61799999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.60299999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.59099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":5.673,"15min":5.673},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":1.216,"15min":1.216},"last":0.57799999999999996}]},{"osd":4,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.246,"15min":1.246},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.82699999999999996},"min":{"1min":0.503,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.752}]},{"osd":5,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.82999999999999996},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82099999999999995,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.758,"15min":5.758},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.89000000000000001},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":5.726,"15min":5.726},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.499,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.80300000000000005,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89400000000000002,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.94899999999999995},"min":{"1min":0.52000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99399999999999999,"5min":5.7880000000000003,"15min":5.7880000000000003},"last":0.78700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.39600000000000002},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.59699999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58799999999999997,"5min":1.351,"15min":1.351},"last":0.496}]},{"osd":1,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40100000000000002,"15min":0.42699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.503,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.745,"5min":1.621,"15min":1.621},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.439},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63900000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45800000000000002,"15min":0.47499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64500000000000002,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80500000000000005,"5min":1.389,"15min":1.389},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90700000000000003,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.745},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.675,"15min":1.675},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":1.417,"15min":1.417},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.67100000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95899999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.61799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.5},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.54200000000000004}]},{"osd":1,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77100000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":1.101,"15min":1.101},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.499,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":1.476,"15min":1.476},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.751,"5min":1.556,"15min":1.556},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":295608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":1,"15min":1},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.77300000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":0.752},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56200000000000006}]},{"osd":7,"last update":"Fri Nov 24 08:07:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:08:12.456 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-24T08:08:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.575+0000 7f7fcb5d1700 1 Processor -- start 2023-11-24T08:08:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.576+0000 7f7fcb5d1700 1 -- start start 2023-11-24T08:08:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.576+0000 7f7fcb5d1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc40af520 0x7f7fc40afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.576+0000 7f7fcb5d1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7fc40b0070 0x7f7fc4073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.576+0000 7f7fcb5d1700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc415bf70 con 0x7f7fc40b4020 2023-11-24T08:08:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.576+0000 7f7fcb5d1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc415ee00 con 0x7f7fc40b0070 2023-11-24T08:08:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.576+0000 7f7fcb5d1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc415e4f0 con 0x7f7fc40af520 2023-11-24T08:08:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fc8b6c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7fc40b0070 0x7f7fc4073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fc8b6c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7fc40b0070 0x7f7fc4073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40526/0 (socket says 172.21.15.153:40526) 2023-11-24T08:08:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fc8b6c700 1 -- 172.21.15.153:0/3334489324 learned_addr learned my addr 172.21.15.153:0/3334489324 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:08:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fc936d700 1 --2- 172.21.15.153:0/3334489324 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc40af520 0x7f7fc40afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fc8b6c700 1 -- 172.21.15.153:0/3334489324 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc40af520 msgr2=0x7f7fc40afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fc8b6c700 1 --2- 172.21.15.153:0/3334489324 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc40af520 0x7f7fc40afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fc8b6c700 1 -- 172.21.15.153:0/3334489324 >> v1:172.21.15.164:6789/0 conn(0x7f7fc40b4020 legacy=0x7f7fc4161ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fc8b6c700 1 -- 172.21.15.153:0/3334489324 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40b04f0 con 0x7f7fc40b0070 2023-11-24T08:08:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fc8b6c700 1 --2- 172.21.15.153:0/3334489324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc40b0070 0x7f7fc4073f90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00098f0 tx=0x7f7fc0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac3e971fd1a004 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fbbfff700 1 -- 172.21.15.153:0/3334489324 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc000b8a0 con 0x7f7fc40b0070 2023-11-24T08:08:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fbbfff700 1 -- 172.21.15.153:0/3334489324 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc000ba00 con 0x7f7fc40b0070 2023-11-24T08:08:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.577+0000 7f7fbbfff700 1 -- 172.21.15.153:0/3334489324 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc000bd90 con 0x7f7fc40b0070 2023-11-24T08:08:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.578+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/3334489324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc40b0070 msgr2=0x7f7fc4073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.578+0000 7f7fcb5d1700 1 --2- 172.21.15.153:0/3334489324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc40b0070 0x7f7fc4073f90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00098f0 tx=0x7f7fc0009c00 comp rx=0 tx=0).stop 2023-11-24T08:08:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.578+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/3334489324 shutdown_connections 2023-11-24T08:08:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.578+0000 7f7fcb5d1700 1 --2- 172.21.15.153:0/3334489324 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc40af520 0x7f7fc40afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.578+0000 7f7fcb5d1700 1 --2- 172.21.15.153:0/3334489324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc40b0070 0x7f7fc4073f90 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.578+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/3334489324 >> 172.21.15.153:0/3334489324 conn(0x7f7fc40b28f0 msgr2=0x7f7fc40b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.578+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/3334489324 shutdown_connections 2023-11-24T08:08:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.578+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/3334489324 wait complete. 2023-11-24T08:08:12.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.579+0000 7f7fcb5d1700 1 Processor -- start 2023-11-24T08:08:12.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.579+0000 7f7fcb5d1700 1 -- start start 2023-11-24T08:08:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fcb5d1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc40af520 0x7f7fc414b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fcb5d1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc40b0070 0x7f7fc4160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fcb5d1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc40b4020 0x7f7fc414b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fcb5d1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc4161300 con 0x7f7fc40b0070 2023-11-24T08:08:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fcb5d1700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc41607c0 con 0x7f7fc40af520 2023-11-24T08:08:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fcb5d1700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc4160a60 con 0x7f7fc40b4020 2023-11-24T08:08:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc8b6c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc40b0070 0x7f7fc4160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc8b6c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc40b0070 0x7f7fc4160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40532/0 (socket says 172.21.15.153:40532) 2023-11-24T08:08:12.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc8b6c700 1 -- 172.21.15.153:0/4283150250 learned_addr learned my addr 172.21.15.153:0/4283150250 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:08:12.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc936d700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc40af520 0x7f7fc414b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc9b6e700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc40b4020 0x7f7fc414b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc8b6c700 1 -- 172.21.15.153:0/4283150250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc40b4020 msgr2=0x7f7fc414b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc8b6c700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc40b4020 0x7f7fc414b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc8b6c700 1 -- 172.21.15.153:0/4283150250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc40af520 msgr2=0x7f7fc414b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc8b6c700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc40af520 0x7f7fc414b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc8b6c700 1 -- 172.21.15.153:0/4283150250 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc0009550 con 0x7f7fc40b0070 2023-11-24T08:08:12.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc936d700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc40af520 0x7f7fc414b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:08:12.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fc8b6c700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc40b0070 0x7f7fc4160280 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0000c00 tx=0x7f7fc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fb9ffb700 1 -- 172.21.15.153:0/4283150250 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0004380 con 0x7f7fc40b0070 2023-11-24T08:08:12.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fb9ffb700 1 -- 172.21.15.153:0/4283150250 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc001f070 con 0x7f7fc40b0070 2023-11-24T08:08:12.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fb9ffb700 1 -- 172.21.15.153:0/4283150250 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00036a0 con 0x7f7fc40b0070 2023-11-24T08:08:12.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.580+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/4283150250 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc4160d40 con 0x7f7fc40b0070 2023-11-24T08:08:12.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.581+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/4283150250 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc4148f30 con 0x7f7fc40b0070 2023-11-24T08:08:12.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.581+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/4283150250 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc41490c0 con 0x7f7fc40b0070 2023-11-24T08:08:12.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.582+0000 7f7fb9ffb700 1 -- 172.21.15.153:0/4283150250 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7fc0021030 con 0x7f7fc40b0070 2023-11-24T08:08:12.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.582+0000 7f7fb9ffb700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7fa806b0b0 0x7f7fa806d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.582+0000 7f7fb9ffb700 1 -- 172.21.15.153:0/4283150250 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7fc008a980 con 0x7f7fc40b0070 2023-11-24T08:08:12.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.582+0000 7f7fc936d700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7fa806b0b0 0x7f7fa806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.583+0000 7f7fc936d700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7fa806b0b0 0x7f7fa806d570 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40099f0 tx=0x7f7fb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.587+0000 7f7fb9ffb700 1 -- 172.21.15.153:0/4283150250 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7fc0055ac0 con 0x7f7fc40b0070 2023-11-24T08:08:12.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.778+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/4283150250 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f7fc4068fb0 con 0x7f7fc40b0070 2023-11-24T08:08:12.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.781+0000 7f7fb9ffb700 1 -- 172.21.15.153:0/4283150250 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f7fc00590e0 con 0x7f7fc40b0070 2023-11-24T08:08:12.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.782+0000 7f7fb9ffb700 1 -- 172.21.15.153:0/4283150250 <== mon.0 v2:172.21.15.153:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7fc0055ac0 con 0x7f7fc40b0070 2023-11-24T08:08:12.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.784+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/4283150250 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7fa806b0b0 msgr2=0x7f7fa806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.784+0000 7f7fcb5d1700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7fa806b0b0 0x7f7fa806d570 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40099f0 tx=0x7f7fb4008040 comp rx=0 tx=0).stop 2023-11-24T08:08:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.784+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/4283150250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc40b0070 msgr2=0x7f7fc4160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.784+0000 7f7fcb5d1700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc40b0070 0x7f7fc4160280 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0000c00 tx=0x7f7fc0004750 comp rx=0 tx=0).stop 2023-11-24T08:08:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.784+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/4283150250 shutdown_connections 2023-11-24T08:08:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.784+0000 7f7fcb5d1700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc40b4020 0x7f7fc414b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.784+0000 7f7fcb5d1700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc40af520 0x7f7fc414b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.784+0000 7f7fcb5d1700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f7fa806b0b0 0x7f7fa806d570 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.784+0000 7f7fcb5d1700 1 --2- 172.21.15.153:0/4283150250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc40b0070 0x7f7fc4160280 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.784+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/4283150250 >> 172.21.15.153:0/4283150250 conn(0x7f7fc40b28f0 msgr2=0x7f7fc4161a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.784+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/4283150250 shutdown_connections 2023-11-24T08:08:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.785+0000 7f7fcb5d1700 1 -- 172.21.15.153:0/4283150250 wait complete. 2023-11-24T08:08:12.799 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:08:12.799 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:08:12.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.919+0000 7f0052f2a700 1 Processor -- start 2023-11-24T08:08:12.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.919+0000 7f0052f2a700 1 -- start start 2023-11-24T08:08:12.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f0052f2a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15e1e0 0x7f004c0d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f0052f2a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f004c0d0f80 0x7f004c0b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f0052f2a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004c0d20b0 con 0x7f004c0d3a00 2023-11-24T08:08:12.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f0052f2a700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004c0d3150 con 0x7f004c0d0f80 2023-11-24T08:08:12.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f0052f2a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c15e5c0 con 0x7f004c15e1e0 2023-11-24T08:08:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f004c0d3a00 0x7f004c0d0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46642/0 (socket says 172.21.15.153:46642) 2023-11-24T08:08:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004bfff700 1 -- 172.21.15.153:0/1203415684 learned_addr learned my addr 172.21.15.153:0/1203415684 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-24T08:08:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288140878 0 0) 0x7f004c0d20b0 con 0x7f004c0d3a00 2023-11-24T08:08:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f003c0035b0 con 0x7f004c0d3a00 2023-11-24T08:08:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f00514c7700 1 --2- 172.21.15.153:0/1203415684 >> v2:172.21.15.164:3300/0 conn(0x7f004c0d0f80 0x7f004c0b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f0050cc6700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15e1e0 0x7f004c0d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2764461067 0 0) 0x7f003c0035b0 con 0x7f004c0d3a00 2023-11-24T08:08:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15e1e0 msgr2=0x7f004c0d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:12.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15e1e0 0x7f004c0d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 >> v2:172.21.15.164:3300/0 conn(0x7f004c0d0f80 msgr2=0x7f004c0b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:12.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 --2- 172.21.15.153:0/1203415684 >> v2:172.21.15.164:3300/0 conn(0x7f004c0d0f80 0x7f004c0b6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0d2390 con 0x7f004c0d3a00 2023-11-24T08:08:12.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1347830427 0 0) 0x7f0038001670 con 0x7f004c0d3a00 2023-11-24T08:08:12.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 >> v1:172.21.15.153:6789/0 conn(0x7f004c0d3a00 legacy=0x7f004c0d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f003c003a30 0x7f003c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.920+0000 7f004b7fe700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003c004850 0x7f003c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f004b7fe700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15e1e0 0x7f003c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0d3150 con 0x7f003c003a30 2023-11-24T08:08:12.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c15e5c0 con 0x7f003c004850 2023-11-24T08:08:12.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003c00ba40 con 0x7f004c15e1e0 2023-11-24T08:08:12.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f0050cc6700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f003c003a30 0x7f003c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f004bfff700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003c004850 0x7f003c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f00514c7700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15e1e0 0x7f003c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f0050cc6700 1 -- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15e1e0 msgr2=0x7f003c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:12.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f0050cc6700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15e1e0 0x7f003c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f0050cc6700 1 -- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003c004850 msgr2=0x7f003c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:12.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f0050cc6700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003c004850 0x7f003c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f0050cc6700 1 -- 172.21.15.153:0/1203415684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c0035b0 con 0x7f003c003a30 2023-11-24T08:08:12.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f004bfff700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003c004850 0x7f003c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:08:12.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f0050cc6700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f003c003a30 0x7f003c003e50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0040009b60 tx=0x7f003c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397a70c9451c7501 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000e6c0 con 0x7f003c003a30 2023-11-24T08:08:12.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f004000e820 con 0x7f003c003a30 2023-11-24T08:08:12.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.921+0000 7f004b7fe700 1 -- 172.21.15.153:0/1203415684 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000ebb0 con 0x7f003c003a30 2023-11-24T08:08:12.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.922+0000 7f0052f2a700 1 -- 172.21.15.153:0/1203415684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f003c003a30 msgr2=0x7f003c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.922+0000 7f0052f2a700 1 --2- 172.21.15.153:0/1203415684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f003c003a30 0x7f003c003e50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0040009b60 tx=0x7f003c005880 comp rx=0 tx=0).stop 2023-11-24T08:08:12.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.922+0000 7f00514c7700 1 -- 172.21.15.153:0/1203415684 reap_dead start 2023-11-24T08:08:12.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.922+0000 7f0052f2a700 1 -- 172.21.15.153:0/1203415684 shutdown_connections 2023-11-24T08:08:12.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.922+0000 7f0052f2a700 1 -- 172.21.15.153:0/1203415684 >> 172.21.15.153:0/1203415684 conn(0x7f004c0b5b50 msgr2=0x7f004c0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:12.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.922+0000 7f0052f2a700 1 -- 172.21.15.153:0/1203415684 shutdown_connections 2023-11-24T08:08:12.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.922+0000 7f0052f2a700 1 -- 172.21.15.153:0/1203415684 wait complete. 2023-11-24T08:08:12.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.923+0000 7f0052f2a700 1 Processor -- start 2023-11-24T08:08:12.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.923+0000 7f0052f2a700 1 -- start start 2023-11-24T08:08:12.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f0052f2a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003c003a30 0x7f004c0cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f0052f2a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15ba20 0x7f004c13fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f0052f2a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c15bea0 0x7f004c140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f0052f2a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c140680 con 0x7f004c15bea0 2023-11-24T08:08:12.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f0052f2a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0cd390 con 0x7f003c003a30 2023-11-24T08:08:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f0052f2a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c145f80 con 0x7f004c15ba20 2023-11-24T08:08:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00514c7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c15bea0 0x7f004c140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00514c7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c15bea0 0x7f004c140140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40552/0 (socket says 172.21.15.153:40552) 2023-11-24T08:08:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00514c7700 1 -- 172.21.15.153:0/187524872 learned_addr learned my addr 172.21.15.153:0/187524872 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-24T08:08:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f0050cc6700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003c003a30 0x7f004c0cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f004bfff700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15ba20 0x7f004c13fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00514c7700 1 -- 172.21.15.153:0/187524872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15ba20 msgr2=0x7f004c13fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00514c7700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15ba20 0x7f004c13fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00514c7700 1 -- 172.21.15.153:0/187524872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003c003a30 msgr2=0x7f004c0cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00514c7700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003c003a30 0x7f004c0cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00514c7700 1 -- 172.21.15.153:0/187524872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0cb360 con 0x7f004c15bea0 2023-11-24T08:08:12.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f0050cc6700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003c003a30 0x7f004c0cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:08:12.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f004bfff700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15ba20 0x7f004c13fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:08:12.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00514c7700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c15bea0 0x7f004c140140 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f004c0ce440 tx=0x7f004400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00497fa700 1 -- 172.21.15.153:0/187524872 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400e040 con 0x7f004c15bea0 2023-11-24T08:08:12.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00497fa700 1 -- 172.21.15.153:0/187524872 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f004400f040 con 0x7f004c15bea0 2023-11-24T08:08:12.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f0052f2a700 1 -- 172.21.15.153:0/187524872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004c0ccd40 con 0x7f004c15bea0 2023-11-24T08:08:12.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.924+0000 7f00497fa700 1 -- 172.21.15.153:0/187524872 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044015430 con 0x7f004c15bea0 2023-11-24T08:08:12.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.925+0000 7f0052f2a700 1 -- 172.21.15.153:0/187524872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c0cb640 con 0x7f004c15bea0 2023-11-24T08:08:12.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.926+0000 7f0052f2a700 1 -- 172.21.15.153:0/187524872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004c0ccba0 con 0x7f004c15bea0 2023-11-24T08:08:12.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.926+0000 7f00497fa700 1 -- 172.21.15.153:0/187524872 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 8) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f00440155b0 con 0x7f004c15bea0 2023-11-24T08:08:12.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.926+0000 7f00497fa700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f003006b080 0x7f003006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.927+0000 7f00497fa700 1 -- 172.21.15.153:0/187524872 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0044089d90 con 0x7f004c15bea0 2023-11-24T08:08:12.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.927+0000 7f0050cc6700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f003006b080 0x7f003006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.927+0000 7f0050cc6700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f003006b080 0x7f003006d540 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f00400090b0 tx=0x7f0040008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:12.931+0000 7f00497fa700 1 -- 172.21.15.153:0/187524872 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f004c0ccba0 con 0x7f004c15bea0 2023-11-24T08:08:13.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.162+0000 7f0052f2a700 1 -- 172.21.15.153:0/187524872 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f004c0ccba0 con 0x7f004c15bea0 2023-11-24T08:08:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.163+0000 7f00497fa700 1 -- 172.21.15.153:0/187524872 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f004c0ccba0 con 0x7f004c15bea0 2023-11-24T08:08:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-24T08:08:13.166 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3525215026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":3525215026},{"type":"v1","addr":"172.21.15.153:6837","nonce":3525215026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5318,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/946995567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":946995567},{"type":"v1","addr":"172.21.15.164:6834","nonce":946995567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":5935,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/624432468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":624432468},{"type":"v1","addr":"172.21.15.164:6835","nonce":624432468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6075,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/3002476497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3002476497},{"type":"v1","addr":"172.21.15.153:6836","nonce":3002476497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[]} 2023-11-24T08:08:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 -- 172.21.15.153:0/187524872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f003006b080 msgr2=0x7f003006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f003006b080 0x7f003006d540 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f00400090b0 tx=0x7f0040008030 comp rx=0 tx=0).stop 2023-11-24T08:08:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 -- 172.21.15.153:0/187524872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c15bea0 msgr2=0x7f004c140140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c15bea0 0x7f004c140140 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f004c0ce440 tx=0x7f004400f490 comp rx=0 tx=0).stop 2023-11-24T08:08:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 -- 172.21.15.153:0/187524872 shutdown_connections 2023-11-24T08:08:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.153:6832/4027560183,v1:172.21.15.153:6833/4027560183] conn(0x7f003006b080 0x7f003006d540 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c15bea0 0x7f004c140140 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003c003a30 0x7f004c0cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 --2- 172.21.15.153:0/187524872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f004c15ba20 0x7f004c13fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 -- 172.21.15.153:0/187524872 >> 172.21.15.153:0/187524872 conn(0x7f004c0b5b50 msgr2=0x7f004c153330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 -- 172.21.15.153:0/187524872 shutdown_connections 2023-11-24T08:08:13.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-24T08:08:13.165+0000 7f0052f2a700 1 -- 172.21.15.153:0/187524872 wait complete. 2023-11-24T08:08:13.170 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 39 2023-11-24T08:08:13.179 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-24T08:08:13.179 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-24T08:08:13.180 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:08:13.180 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.188 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:08:13.189 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:08:13.189 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.237 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:08:13.238 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:08:13.238 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.249 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:08:13.250 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:08:13.250 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.300 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:08:13.300 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-24T08:08:13.301 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-24T08:08:13.301 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.339 INFO:tasks.ceph.osd.0:Stopped 2023-11-24T08:08:13.339 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-24T08:08:13.339 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.410 INFO:tasks.ceph.osd.1:Stopped 2023-11-24T08:08:13.411 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-24T08:08:13.411 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.483 INFO:tasks.ceph.osd.2:Stopped 2023-11-24T08:08:13.483 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-24T08:08:13.483 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.563 INFO:tasks.ceph.osd.3:Stopped 2023-11-24T08:08:13.563 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-24T08:08:13.563 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.594 INFO:tasks.ceph.osd.4:Stopped 2023-11-24T08:08:13.595 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.669 INFO:tasks.ceph.osd.5:Stopped 2023-11-24T08:08:13.670 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-24T08:08:13.670 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.743 INFO:tasks.ceph.osd.6:Stopped 2023-11-24T08:08:13.743 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-24T08:08:13.743 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.816 INFO:tasks.ceph.osd.7:Stopped 2023-11-24T08:08:13.817 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-24T08:08:13.817 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-24T08:08:13.817 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.842 INFO:tasks.ceph.mgr.y:Stopped 2023-11-24T08:08:13.842 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-24T08:08:13.842 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.883 INFO:tasks.ceph.mgr.x:Stopped 2023-11-24T08:08:13.883 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-24T08:08:13.883 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-24T08:08:13.883 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.894 INFO:tasks.ceph.mon.a:Stopped 2023-11-24T08:08:13.895 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-24T08:08:13.895 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.936 INFO:tasks.ceph.mon.b:Stopped 2023-11-24T08:08:13.936 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-24T08:08:13.936 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:13.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-24T08:08:13.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-24T08:08:13.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-24T08:08:13.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-24T08:08:13.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-11-24T08:08:13.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-24T08:08:13.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-24T08:08:13.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-11-24T08:08:13.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-11-24T08:08:13.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-11-24T08:08:13.990 INFO:tasks.ceph.mon.c:Stopped 2023-11-24T08:08:13.991 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-24T08:08:13.991 DEBUG:teuthology.orchestra.run.smithi153:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-24T08:08:14.026 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:08:14.027 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-24T08:08:14.288 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:08:14.289 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-24T08:08:14.380 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:08:14.380 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-24T08:08:14.465 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:08:14.466 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-24T08:08:14.538 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:08:14.538 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-24T08:08:14.741 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:08:14.741 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-24T08:08:14.858 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:08:14.858 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-24T08:08:14.934 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:08:14.934 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-24T08:08:15.007 INFO:tasks.ceph:Archiving mon data... 2023-11-24T08:08:15.008 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584/data/mon.a.tgz 2023-11-24T08:08:15.008 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2023-11-24T08:08:15.026 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.AyfQrFPtHS 2023-11-24T08:08:15.027 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.AyfQrFPtHS 2023-11-24T08:08:15.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.AyfQrFPtHS 2023-11-24T08:08:15.269 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.AyfQrFPtHS is 472KB 2023-11-24T08:08:15.369 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.AyfQrFPtHS 2023-11-24T08:08:15.385 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584/data/mon.b.tgz 2023-11-24T08:08:15.386 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2023-11-24T08:08:15.407 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.aCRsIqUmLf 2023-11-24T08:08:15.407 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.aCRsIqUmLf 2023-11-24T08:08:15.596 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.aCRsIqUmLf 2023-11-24T08:08:15.683 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.aCRsIqUmLf is 639KB 2023-11-24T08:08:15.754 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.aCRsIqUmLf 2023-11-24T08:08:15.770 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584/data/mon.c.tgz 2023-11-24T08:08:15.771 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2023-11-24T08:08:15.827 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.fKn9DsdIo2 2023-11-24T08:08:15.827 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fKn9DsdIo2 2023-11-24T08:08:16.002 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.fKn9DsdIo2 2023-11-24T08:08:16.089 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.fKn9DsdIo2 is 639KB 2023-11-24T08:08:16.194 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.fKn9DsdIo2 2023-11-24T08:08:16.210 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-24T08:08:16.210 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T08:08:16.213 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T08:08:16.276 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-24T08:08:16.276 DEBUG:teuthology.orchestra.run.smithi153:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T08:08:16.285 DEBUG:teuthology.orchestra.run.smithi164:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T08:08:16.344 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T08:08:16.354 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T08:08:16.359 INFO:tasks.ceph:Archiving crash dumps... 2023-11-24T08:08:16.362 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584/remote/smithi153/crash 2023-11-24T08:08:16.363 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T08:08:16.392 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584/remote/smithi164/crash 2023-11-24T08:08:16.393 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T08:08:16.425 INFO:tasks.ceph:Shutting down logrotate 2023-11-24T08:08:16.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:16.437 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:16.530 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:16.559 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:16.586 INFO:tasks.ceph:Compressing logs... 2023-11-24T08:08:16.586 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T08:08:16.602 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T08:08:16.627 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118292.log 2023-11-24T08:08:16.627 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113608.log 2023-11-24T08:08:16.628 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.118292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125107.log 2023-11-24T08:08:16.653 INFO:teuthology.orchestra.run.smithi153.stderr: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.118292.log.gz--verbose 2023-11-24T08:08:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:-- /var/log/ceph/ceph-client.admin.121196.log 2023-11-24T08:08:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.113608.log: /var/log/ceph/ceph-client.admin.125107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122816.log 2023-11-24T08:08:16.653 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113608.log.gz 2023-11-24T08:08:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121196.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125107.log.gz 2023-11-24T08:08:16.654 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122886.log 2023-11-24T08:08:16.654 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121196.log.gz 2023-11-24T08:08:16.654 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.121704.log 2023-11-24T08:08:16.654 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117306.log 2023-11-24T08:08:16.654 INFO:teuthology.orchestra.run.smithi153.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122816.log.gz 2023-11-24T08:08:16.654 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.121704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125936.log 2023-11-24T08:08:16.654 INFO:teuthology.orchestra.run.smithi153.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122886.log.gz 2023-11-24T08:08:16.655 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121704.log.gz 2023-11-24T08:08:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126843.log 2023-11-24T08:08:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125936.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117306.log.gz 2023-11-24T08:08:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117720.log 2023-11-24T08:08:16.655 INFO:teuthology.orchestra.run.smithi153.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.125936.log.gz 2023-11-24T08:08:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127736.log 2023-11-24T08:08:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116198.log 2023-11-24T08:08:16.655 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126843.log.gz 2023-11-24T08:08:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127736.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.117720.log.gz 2023-11-24T08:08:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113654.log 2023-11-24T08:08:16.656 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.127736.log.gz 2023-11-24T08:08:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.116198.log: -- /var/log/ceph/ceph-client.admin.119177.log 2023-11-24T08:08:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.113654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110199.log 2023-11-24T08:08:16.656 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116198.log.gz 2023-11-24T08:08:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114794.log 2023-11-24T08:08:16.656 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113654.log.gz 2023-11-24T08:08:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110199.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119177.log.gz 2023-11-24T08:08:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122956.log 2023-11-24T08:08:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114794.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110199.log.gz 2023-11-24T08:08:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128898.log 2023-11-24T08:08:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122956.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114794.log.gz 2023-11-24T08:08:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128509.log 2023-11-24T08:08:16.657 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122956.log.gz 2023-11-24T08:08:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117120.log 2023-11-24T08:08:16.658 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128509.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.128898.log.gz 2023-11-24T08:08:16.658 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125866.log 2023-11-24T08:08:16.658 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128509.log.gz 2023-11-24T08:08:16.658 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111142.log 2023-11-24T08:08:16.658 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117120.log.gz 2023-11-24T08:08:16.658 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110701.log 2023-11-24T08:08:16.658 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111140.log 2023-11-24T08:08:16.658 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111142.log.gz 2023-11-24T08:08:16.659 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110701.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.125866.log.gz 2023-11-24T08:08:16.659 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126279.log 2023-11-24T08:08:16.659 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110701.log.gz 2023-11-24T08:08:16.659 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109438.log 2023-11-24T08:08:16.659 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111140.log.gz 2023-11-24T08:08:16.659 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119656.log 2023-11-24T08:08:16.659 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109438.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126279.log.gz 2023-11-24T08:08:16.659 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124699.log 2023-11-24T08:08:16.660 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119656.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109438.log.gz 2023-11-24T08:08:16.660 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113336.log 2023-11-24T08:08:16.660 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124699.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119656.log.gz 2023-11-24T08:08:16.660 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-24T08:08:16.660 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.2.113336.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124699.log.gz 2023-11-24T08:08:16.660 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.120583.log 2023-11-24T08:08:16.660 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.2.113336.log.gz 2023-11-24T08:08:16.660 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119564.log 2023-11-24T08:08:16.661 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123782.log 2023-11-24T08:08:16.661 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120583.log: /var/log/ceph/ceph-client.admin.119564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110404.log 2023-11-24T08:08:16.661 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123782.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.120583.log.gz 2023-11-24T08:08:16.661 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119564.log.gz 2023-11-24T08:08:16.661 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109948.log 2023-11-24T08:08:16.661 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110404.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123782.log.gz 2023-11-24T08:08:16.661 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122130.log 2023-11-24T08:08:16.661 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110404.log.gz 2023-11-24T08:08:16.662 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126797.log 2023-11-24T08:08:16.662 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109948.log: /var/log/ceph/ceph-client.admin.122130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120722.log 2023-11-24T08:08:16.662 INFO:teuthology.orchestra.run.smithi153.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109948.log.gz 2023-11-24T08:08:16.662 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126797.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122130.log.gz 2023-11-24T08:08:16.662 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113746.log 2023-11-24T08:08:16.662 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124407.log 2023-11-24T08:08:16.662 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4%/var/log/ceph/ceph-client.admin.120722.log: -- replaced with /var/log/ceph/ceph-client.admin.126797.log.gz 2023-11-24T08:08:16.662 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.113746.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120722.log.gz 2023-11-24T08:08:16.663 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115830.log 2023-11-24T08:08:16.663 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113746.log.gz 2023-11-24T08:08:16.663 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115420.log 2023-11-24T08:08:16.663 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124407.log: /var/log/ceph/ceph-client.admin.115830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120408.log 2023-11-24T08:08:16.663 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124407.log.gz 2023-11-24T08:08:16.663 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115420.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115830.log.gz 2023-11-24T08:08:16.663 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124789.log 2023-11-24T08:08:16.663 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115420.log.gz 2023-11-24T08:08:16.664 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125013.log 2023-11-24T08:08:16.664 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120408.log.gz 2023-11-24T08:08:16.664 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125247.log 2023-11-24T08:08:16.664 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124789.log: /var/log/ceph/ceph-client.admin.125013.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T08:08:16.664 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124789.log.gz 2023-11-24T08:08:16.664 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125013.log.gz 2023-11-24T08:08:16.664 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128668.log 2023-11-24T08:08:16.664 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118186.log 2023-11-24T08:08:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125247.log.gz 2023-11-24T08:08:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111809.log 2023-11-24T08:08:16.665 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128668.log.gz 2023-11-24T08:08:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.118186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103564.log 2023-11-24T08:08:16.665 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118186.log.gz 2023-11-24T08:08:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125059.log 2023-11-24T08:08:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111809.log: 85.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T08:08:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.103564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118182.log 2023-11-24T08:08:16.666 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111809.log.gz 2023-11-24T08:08:16.666 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103564.log.gz 2023-11-24T08:08:16.666 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.126169.log 2023-11-24T08:08:16.666 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125059.log: /var/log/ceph/ceph-client.0.118182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127092.log 2023-11-24T08:08:16.666 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118182.log.gz 2023-11-24T08:08:16.666 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125059.log.gz 2023-11-24T08:08:16.666 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.126169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109718.log 2023-11-24T08:08:16.667 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.126169.log.gz 2023-11-24T08:08:16.667 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127414.log 2023-11-24T08:08:16.667 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127092.log.gz 2023-11-24T08:08:16.667 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112905.log 2023-11-24T08:08:16.667 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109718.log: /var/log/ceph/ceph-client.admin.127414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113700.log 2023-11-24T08:08:16.667 INFO:teuthology.orchestra.run.smithi153.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109718.log.gz 2023-11-24T08:08:16.667 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.112905.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127414.log.gz 2023-11-24T08:08:16.667 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117398.log 2023-11-24T08:08:16.667 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119223.log 2023-11-24T08:08:16.668 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112905.log.gz 2023-11-24T08:08:16.668 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.113700.log: /var/log/ceph/ceph-client.admin.117398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111395.log 2023-11-24T08:08:16.668 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113700.log.gz 2023-11-24T08:08:16.668 INFO:teuthology.orchestra.run.smithi153.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.117398.log.gz 2023-11-24T08:08:16.668 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125682.log 2023-11-24T08:08:16.668 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122402.log 2023-11-24T08:08:16.668 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119223.log.gz 2023-11-24T08:08:16.668 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124158.log 2023-11-24T08:08:16.669 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111395.log.gz 2023-11-24T08:08:16.669 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122402.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125682.log.gz 2023-11-24T08:08:16.669 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110398.log 2023-11-24T08:08:16.669 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122402.log.gz 2023-11-24T08:08:16.669 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115374.log 2023-11-24T08:08:16.669 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124158.log: /var/log/ceph/ceph-client.admin.110398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109902.log 2023-11-24T08:08:16.669 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124158.log.gz 2023-11-24T08:08:16.669 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115374.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110398.log.gz 2023-11-24T08:08:16.669 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116060.log 2023-11-24T08:08:16.670 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127230.log 2023-11-24T08:08:16.670 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109902.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115374.log.gz 2023-11-24T08:08:16.670 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117260.log 2023-11-24T08:08:16.670 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109902.log.gz 2023-11-24T08:08:16.670 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116060.log.gz 2023-11-24T08:08:16.670 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122310.log 2023-11-24T08:08:16.670 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127230.log: /var/log/ceph/ceph-client.admin.117260.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127230.log.gz 2023-11-24T08:08:16.670 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.117260.log.gz--verbose 2023-11-24T08:08:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:-- /var/log/ceph/ceph-client.admin.117490.log 2023-11-24T08:08:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111070.log 2023-11-24T08:08:16.671 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.122310.log.gz 2023-11-24T08:08:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127460.log 2023-11-24T08:08:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111070.log: /var/log/ceph/ceph-client.admin.120254.log 2023-11-24T08:08:16.671 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117490.log.gz 2023-11-24T08:08:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127460.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111070.log.gz 2023-11-24T08:08:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120024.log 2023-11-24T08:08:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119748.log 2023-11-24T08:08:16.672 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5%/var/log/ceph/ceph-client.admin.120254.log: -- replaced with /var/log/ceph/ceph-client.admin.127460.log.gz 2023-11-24T08:08:16.672 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120024.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120254.log.gz 2023-11-24T08:08:16.672 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114748.log 2023-11-24T08:08:16.672 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120024.log.gz 2023-11-24T08:08:16.672 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-24T08:08:16.672 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119748.log: /var/log/ceph/ceph-client.admin.114748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124453.log 2023-11-24T08:08:16.672 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119748.log.gz 2023-11-24T08:08:16.672 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.0.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114748.log.gz 2023-11-24T08:08:16.673 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114437.log 2023-11-24T08:08:16.673 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116742.log 2023-11-24T08:08:16.673 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114437.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124453.log.gz 2023-11-24T08:08:16.673 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117628.log 2023-11-24T08:08:16.673 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116742.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110399.log 2023-11-24T08:08:16.673 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.114437.log.gz 2023-11-24T08:08:16.673 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117628.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116742.log.gz 2023-11-24T08:08:16.673 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127552.log 2023-11-24T08:08:16.674 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117628.log.gz 2023-11-24T08:08:16.674 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112193.log 2023-11-24T08:08:16.674 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127552.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110399.log.gz 2023-11-24T08:08:16.674 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111671.log 2023-11-24T08:08:16.674 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127552.log.gz 2023-11-24T08:08:16.674 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.112193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127184.log 2023-11-24T08:08:16.674 INFO:teuthology.orchestra.run.smithi153.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112193.log.gz 2023-11-24T08:08:16.674 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111947.log 2023-11-24T08:08:16.675 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111671.log.gz 2023-11-24T08:08:16.688 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-24T08:08:16.688 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.112750.log 2023-11-24T08:08:16.688 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T08:08:16.688 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.112750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.111464.log 2023-11-24T08:08:16.688 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.112750.log.gz 2023-11-24T08:08:16.689 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.110669.log 2023-11-24T08:08:16.689 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.111464.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.1.111464.log.gz--verbose 2023-11-24T08:08:16.689 INFO:teuthology.orchestra.run.smithi164.stderr:-- /var/log/ceph/ceph-client.1.112070.log 2023-11-24T08:08:16.689 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.3.110669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103424.log 2023-11-24T08:08:16.689 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.110669.log.gz 2023-11-24T08:08:16.689 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.112070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103471.log 2023-11-24T08:08:16.689 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.112070.log.gz 2023-11-24T08:08:16.689 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.103424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103659.log 2023-11-24T08:08:16.690 INFO:teuthology.orchestra.run.smithi164.stderr: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T08:08:16.690 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103424.log.gz 2023-11-24T08:08:16.690 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.103471.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-24T08:08:16.690 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103561.log 2023-11-24T08:08:16.690 INFO:teuthology.orchestra.run.smithi164.stderr: 89.2%/var/log/ceph/ceph-client.admin.103659.log: -- replaced with /var/log/ceph/ceph-client.admin.103471.log.gz 2023-11-24T08:08:16.690 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103379.log 2023-11-24T08:08:16.690 INFO:teuthology.orchestra.run.smithi164.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103659.log.gz 2023-11-24T08:08:16.690 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.103561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.111468.log 2023-11-24T08:08:16.691 INFO:teuthology.orchestra.run.smithi164.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103561.log.gz 2023-11-24T08:08:16.691 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.103379.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-24T08:08:16.691 INFO:teuthology.orchestra.run.smithi164.stderr:gzip 87.0%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.103379.log.gz/var/log/ceph/ceph-client.1.112074.log 2023-11-24T08:08:16.691 INFO:teuthology.orchestra.run.smithi164.stderr: 2023-11-24T08:08:16.691 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.111468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.111468.log.gz 2023-11-24T08:08:16.691 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.110665.log 2023-11-24T08:08:16.691 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.112074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110058.log 2023-11-24T08:08:16.691 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.112074.log.gz 2023-11-24T08:08:16.692 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.3.110665.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T08:08:16.692 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.110665.log.gz 2023-11-24T08:08:16.692 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.110058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.112746.log 2023-11-24T08:08:16.692 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110058.log.gz 2023-11-24T08:08:16.692 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-24T08:08:16.692 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.1.112746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.112746.log.gz 2023-11-24T08:08:16.692 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103332.log 2023-11-24T08:08:16.692 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103516.log 2023-11-24T08:08:16.693 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.103332.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103332.log.gz 2023-11-24T08:08:16.693 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.103516.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103516.log.gz 2023-11-24T08:08:16.693 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-24T08:08:16.693 INFO:teuthology.orchestra.run.smithi164.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T08:08:16.693 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-24T08:08:16.693 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-24T08:08:16.693 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103606.log 2023-11-24T08:08:16.693 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.103606.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103606.log.gz 2023-11-24T08:08:16.694 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110050.log 2023-11-24T08:08:16.694 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.110050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110050.log.gz 2023-11-24T08:08:16.694 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-24T08:08:16.694 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.b.log: 93.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-24T08:08:16.694 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-24T08:08:16.714 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119361.log 2023-11-24T08:08:16.714 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111947.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127184.log.gz 2023-11-24T08:08:16.715 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111625.log 2023-11-24T08:08:16.715 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111947.log.gz 2023-11-24T08:08:16.715 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120768.log 2023-11-24T08:08:16.715 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124966.log 2023-11-24T08:08:16.715 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111625.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119361.log.gz 2023-11-24T08:08:16.715 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120768.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-24T08:08:16.715 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111625.log.gz 2023-11-24T08:08:16.715 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124966.log: gzip 88.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.120768.log.gz-- 2023-11-24T08:08:16.716 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111487.log 2023-11-24T08:08:16.716 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124966.log.gz 2023-11-24T08:08:16.716 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120208.log 2023-11-24T08:08:16.716 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114529.log 2023-11-24T08:08:16.716 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111487.log: /var/log/ceph/ceph-client.admin.120208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114161.log 2023-11-24T08:08:16.716 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111487.log.gz 2023-11-24T08:08:16.716 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7%/var/log/ceph/ceph-client.admin.114529.log: -- replaced with /var/log/ceph/ceph-client.admin.120208.log.gz 2023-11-24T08:08:16.716 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119702.log 2023-11-24T08:08:16.717 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114161.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114529.log.gz 2023-11-24T08:08:16.717 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111855.log 2023-11-24T08:08:16.717 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.114161.log.gz 2023-11-24T08:08:16.717 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119702.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.119702.log.gz 2023-11-24T08:08:16.717 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109098.log 2023-11-24T08:08:16.717 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111855.log.gz 2023-11-24T08:08:16.717 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123488.log 2023-11-24T08:08:16.717 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116980.log 2023-11-24T08:08:16.718 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.109098.log.gz 2023-11-24T08:08:16.718 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120162.log 2023-11-24T08:08:16.718 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117352.log 2023-11-24T08:08:16.718 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116980.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123488.log.gz 2023-11-24T08:08:16.718 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115112.log 2023-11-24T08:08:16.718 INFO:teuthology.orchestra.run.smithi153.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116980.log.gz 2023-11-24T08:08:16.718 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117352.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120162.log.gz 2023-11-24T08:08:16.718 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116014.log 2023-11-24T08:08:16.719 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115112.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117352.log.gz 2023-11-24T08:08:16.719 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116014.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115112.log.gz 2023-11-24T08:08:16.719 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116014.log.gz 2023-11-24T08:08:16.719 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119610.log 2023-11-24T08:08:16.719 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119472.log 2023-11-24T08:08:16.719 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119610.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-24T08:08:16.719 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.119610.log.gz 2023-11-24T08:08:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119472.log: /var/log/ceph/ceph-osd.3.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119472.log.gz 2023-11-24T08:08:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121309.log 2023-11-24T08:08:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113340.log 2023-11-24T08:08:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125590.log 2023-11-24T08:08:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.2.113340.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121309.log.gz 2023-11-24T08:08:16.720 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.113340.log.gz 2023-11-24T08:08:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125590.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125590.log.gz 2023-11-24T08:08:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114932.log 2023-11-24T08:08:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124066.log 2023-11-24T08:08:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114932.log: /var/log/ceph/ceph-client.admin.124066.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114932.log.gz 2023-11-24T08:08:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120116.log 2023-11-24T08:08:16.721 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124066.log.gz 2023-11-24T08:08:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124545.log 2023-11-24T08:08:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126417.log 2023-11-24T08:08:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120116.log: /var/log/ceph/ceph-client.admin.124545.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120116.log.gz 2023-11-24T08:08:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126417.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124545.log.gz 2023-11-24T08:08:16.722 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120864.log 2023-11-24T08:08:16.722 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126417.log.gz 2023-11-24T08:08:16.722 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117168.log 2023-11-24T08:08:16.722 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116336.log 2023-11-24T08:08:16.722 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120864.log.gz 2023-11-24T08:08:16.722 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123974.log 2023-11-24T08:08:16.722 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117168.log.gz 2023-11-24T08:08:16.722 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116336.log: /var/log/ceph/ceph-client.admin.123974.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116336.log.gz 2023-11-24T08:08:16.723 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123974.log.gz 2023-11-24T08:08:16.723 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113838.log 2023-11-24T08:08:16.723 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113977.log 2023-11-24T08:08:16.723 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.113838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117766.log 2023-11-24T08:08:16.723 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.113977.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113838.log.gz 2023-11-24T08:08:16.723 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117766.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.113977.log.gz 2023-11-24T08:08:16.723 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117766.log.gz 2023-11-24T08:08:16.723 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112039.log 2023-11-24T08:08:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128806.log 2023-11-24T08:08:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.112039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116696.log 2023-11-24T08:08:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128806.log: /var/log/ceph/ceph-client.admin.116696.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.112039.log.gz 2023-11-24T08:08:16.724 INFO:teuthology.orchestra.run.smithi153.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.128806.log.gz 2023-11-24T08:08:16.724 INFO:teuthology.orchestra.run.smithi153.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.116696.log.gz 2023-11-24T08:08:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116382.log 2023-11-24T08:08:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128852.log 2023-11-24T08:08:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116382.log: /var/log/ceph/ceph-client.admin.128852.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116382.log.gz 2023-11-24T08:08:16.725 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128852.log.gz 2023-11-24T08:08:16.725 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127506.log 2023-11-24T08:08:16.725 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111901.log 2023-11-24T08:08:16.725 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127506.log: /var/log/ceph/ceph-client.admin.111901.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127506.log.gz 2023-11-24T08:08:16.725 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111901.log.gz 2023-11-24T08:08:16.725 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123690.log 2023-11-24T08:08:16.725 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117026.log 2023-11-24T08:08:16.725 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123690.log: /var/log/ceph/ceph-client.admin.117026.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.123690.log.gz 2023-11-24T08:08:16.726 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117026.log.gz 2023-11-24T08:08:16.726 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127598.log 2023-11-24T08:08:16.726 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127276.log 2023-11-24T08:08:16.726 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127598.log: /var/log/ceph/ceph-client.admin.127276.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127598.log.gz 2023-11-24T08:08:16.726 INFO:teuthology.orchestra.run.smithi153.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127276.log.gz 2023-11-24T08:08:16.726 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122222.log 2023-11-24T08:08:16.726 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126617.log 2023-11-24T08:08:16.726 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126935.log 2023-11-24T08:08:16.727 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122222.log.gz/var/log/ceph/ceph-client.admin.126617.log: 2023-11-24T08:08:16.727 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126935.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126617.log.gz 2023-11-24T08:08:16.727 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126935.log.gz 2023-11-24T08:08:16.727 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125820.log 2023-11-24T08:08:16.727 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121861.log 2023-11-24T08:08:16.727 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109384.log 2023-11-24T08:08:16.727 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125820.log.gz 2023-11-24T08:08:16.727 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121861.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121861.log.gz 2023-11-24T08:08:16.728 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109384.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109384.log.gz 2023-11-24T08:08:16.728 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119840.log 2023-11-24T08:08:16.728 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121150.log 2023-11-24T08:08:16.728 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116650.log 2023-11-24T08:08:16.728 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119840.log.gz 2023-11-24T08:08:16.728 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121150.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121150.log.gz 2023-11-24T08:08:16.728 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116650.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116650.log.gz 2023-11-24T08:08:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122038.log 2023-11-24T08:08:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-24T08:08:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114345.log 2023-11-24T08:08:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.c.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122038.log.gz 2023-11-24T08:08:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114345.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114345.log.gz 2023-11-24T08:08:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113884.log 2023-11-24T08:08:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116934.log 2023-11-24T08:08:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.113884.log: /var/log/ceph/ceph-client.admin.116934.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113884.log.gz 2023-11-24T08:08:16.730 INFO:teuthology.orchestra.run.smithi153.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-24T08:08:16.730 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116934.log.gz 2023-11-24T08:08:16.730 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123928.log 2023-11-24T08:08:16.730 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111441.log 2023-11-24T08:08:16.730 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123928.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123928.log.gz 2023-11-24T08:08:16.730 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111441.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111441.log.gz 2023-11-24T08:08:16.730 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119315.log 2023-11-24T08:08:16.730 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119886.log 2023-11-24T08:08:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119315.log: /var/log/ceph/ceph-client.admin.119886.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119315.log.gz 2023-11-24T08:08:16.731 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119886.log.gz 2023-11-24T08:08:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110406.log 2023-11-24T08:08:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125155.log 2023-11-24T08:08:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110406.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110406.log.gz 2023-11-24T08:08:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125155.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125155.log.gz 2023-11-24T08:08:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119269.log 2023-11-24T08:08:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110699.log 2023-11-24T08:08:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119269.log: /var/log/ceph/ceph-client.admin.110699.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119269.log.gz 2023-11-24T08:08:16.732 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110699.log.gz 2023-11-24T08:08:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125498.log 2023-11-24T08:08:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119518.log 2023-11-24T08:08:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124315.log 2023-11-24T08:08:16.732 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125498.log.gz 2023-11-24T08:08:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119518.log: /var/log/ceph/ceph-client.admin.124315.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.119518.log.gz 2023-11-24T08:08:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120070.log 2023-11-24T08:08:16.733 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124315.log.gz 2023-11-24T08:08:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115020.log 2023-11-24T08:08:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114840.log 2023-11-24T08:08:16.733 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120070.log.gz 2023-11-24T08:08:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115020.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115020.log.gz 2023-11-24T08:08:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114840.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114840.log.gz 2023-11-24T08:08:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121401.log 2023-11-24T08:08:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121010.log 2023-11-24T08:08:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121401.log: /var/log/ceph/ceph-client.admin.121010.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.121401.log.gz 2023-11-24T08:08:16.734 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121010.log.gz 2023-11-24T08:08:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125544.log 2023-11-24T08:08:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117582.log 2023-11-24T08:08:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125544.log: /var/log/ceph/ceph-client.admin.117582.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125544.log.gz 2023-11-24T08:08:16.734 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117582.log.gz 2023-11-24T08:08:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115158.log 2023-11-24T08:08:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123327.log 2023-11-24T08:08:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115158.log: /var/log/ceph/ceph-client.admin.123327.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115158.log.gz 2023-11-24T08:08:16.735 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123327.log.gz 2023-11-24T08:08:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116834.log 2023-11-24T08:08:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121954.log 2023-11-24T08:08:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116834.log: /var/log/ceph/ceph-client.admin.121954.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116834.log.gz 2023-11-24T08:08:16.735 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121954.log.gz 2023-11-24T08:08:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114253.log 2023-11-24T08:08:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115307.log 2023-11-24T08:08:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122668.log 2023-11-24T08:08:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115307.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114253.log.gz 2023-11-24T08:08:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122668.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115307.log.gz 2023-11-24T08:08:16.736 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122668.log.gz 2023-11-24T08:08:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114575.log 2023-11-24T08:08:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123397.log 2023-11-24T08:08:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128049.log 2023-11-24T08:08:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123397.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114575.log.gz 2023-11-24T08:08:16.737 INFO:teuthology.orchestra.run.smithi153.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123397.log.gz 2023-11-24T08:08:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128049.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128049.log.gz 2023-11-24T08:08:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128417.log 2023-11-24T08:08:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124920.log 2023-11-24T08:08:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128417.log: /var/log/ceph/ceph-client.admin.124920.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128417.log.gz 2023-11-24T08:08:16.737 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124920.log.gz 2023-11-24T08:08:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112675.log 2023-11-24T08:08:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110400.log 2023-11-24T08:08:16.738 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.112675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112675.log.gz 2023-11-24T08:08:16.738 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110400.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110400.log.gz 2023-11-24T08:08:16.738 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126889.log 2023-11-24T08:08:16.738 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123874.log 2023-11-24T08:08:16.738 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126889.log: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-24T08:08:16.738 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123874.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126889.log.gz 2023-11-24T08:08:16.738 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123874.log.gz 2023-11-24T08:08:16.739 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126525.log 2023-11-24T08:08:16.739 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103256.log 2023-11-24T08:08:16.739 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126525.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T08:08:16.739 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.126525.log.gz 2023-11-24T08:08:16.739 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.103256.log: /var/log/ceph/ceph.audit.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.103256.log.gz 2023-11-24T08:08:16.739 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T08:08:16.739 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120498.log 2023-11-24T08:08:16.739 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119932.log 2023-11-24T08:08:16.740 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124361.log 2023-11-24T08:08:16.740 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120300.log 2023-11-24T08:08:16.740 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120498.log.gz 2023-11-24T08:08:16.740 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124361.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119932.log.gz 2023-11-24T08:08:16.740 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124361.log.gz 2023-11-24T08:08:16.740 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119426.log 2023-11-24T08:08:16.753 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mds.b.log: 95.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-24T08:08:16.762 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119794.log 2023-11-24T08:08:16.762 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120300.log.gz 2023-11-24T08:08:16.762 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117214.log 2023-11-24T08:08:16.762 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111003.log 2023-11-24T08:08:16.762 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119794.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.119426.log.gz 2023-11-24T08:08:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117214.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.119794.log.gz 2023-11-24T08:08:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128997.log 2023-11-24T08:08:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110700.log 2023-11-24T08:08:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111003.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117214.log.gz 2023-11-24T08:08:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128997.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111003.log.gz 2023-11-24T08:08:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118797.log 2023-11-24T08:08:16.763 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8%/var/log/ceph/ceph-client.admin.110700.log: -- replaced with /var/log/ceph/ceph-client.admin.128997.log.gz 2023-11-24T08:08:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114391.log 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7%/var/log/ceph/ceph-client.admin.118797.log: -- replaced with /var/log/ceph/ceph-client.admin.110700.log.gz 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114391.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118797.log.gz 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114391.log.gz 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124499.log 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120918.log 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121355.log 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124499.log.gz 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120918.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.120918.log.gz 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121355.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121355.log.gz 2023-11-24T08:08:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120816.log 2023-11-24T08:08:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115968.log 2023-11-24T08:08:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115466.log 2023-11-24T08:08:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115968.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120816.log.gz 2023-11-24T08:08:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115466.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115968.log.gz 2023-11-24T08:08:16.765 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115466.log.gz 2023-11-24T08:08:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116788.log 2023-11-24T08:08:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126325.log 2023-11-24T08:08:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128555.log 2023-11-24T08:08:16.766 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116788.log.gz 2023-11-24T08:08:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125774.log 2023-11-24T08:08:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110402.log 2023-11-24T08:08:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128555.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126325.log.gz 2023-11-24T08:08:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111146.log 2023-11-24T08:08:16.766 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128555.log.gz 2023-11-24T08:08:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110402.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125774.log.gz 2023-11-24T08:08:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116428.log 2023-11-24T08:08:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111146.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110402.log.gz 2023-11-24T08:08:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116518.log 2023-11-24T08:08:16.767 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4%/var/log/ceph/ceph-client.admin.116428.log: -- replaced with /var/log/ceph/ceph-client.admin.111146.log.gz 2023-11-24T08:08:16.767 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.116428.log.gz 2023-11-24T08:08:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116518.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116518.log.gz 2023-11-24T08:08:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119978.log 2023-11-24T08:08:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126571.log 2023-11-24T08:08:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126709.log 2023-11-24T08:08:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126571.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119978.log.gz 2023-11-24T08:08:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126709.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126571.log.gz 2023-11-24T08:08:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114621.log 2023-11-24T08:08:16.768 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126709.log.gz 2023-11-24T08:08:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109484.log 2023-11-24T08:08:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123117.log 2023-11-24T08:08:16.769 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114621.log.gz 2023-11-24T08:08:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127690.log 2023-11-24T08:08:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123117.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109484.log.gz 2023-11-24T08:08:16.769 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.123117.log.gz 2023-11-24T08:08:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127690.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127690.log.gz 2023-11-24T08:08:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115876.log 2023-11-24T08:08:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124591.log 2023-11-24T08:08:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128622.log 2023-11-24T08:08:16.770 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124591.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.115876.log.gz 2023-11-24T08:08:16.770 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124591.log.gz 2023-11-24T08:08:16.770 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125406.log 2023-11-24T08:08:16.770 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128622.log.gz 2023-11-24T08:08:16.770 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119043.log 2023-11-24T08:08:16.770 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126371.log 2023-11-24T08:08:16.770 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128371.log 2023-11-24T08:08:16.770 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125406.log.gz 2023-11-24T08:08:16.771 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126371.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119043.log.gz 2023-11-24T08:08:16.771 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126371.log.gz 2023-11-24T08:08:16.771 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110132.log 2023-11-24T08:08:16.771 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116888.log 2023-11-24T08:08:16.771 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128371.log.gz 2023-11-24T08:08:16.771 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110086.log 2023-11-24T08:08:16.771 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116244.log 2023-11-24T08:08:16.771 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116888.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110132.log.gz 2023-11-24T08:08:16.771 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110086.log: gzip -5 87.8%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.116888.log.gz/var/log/ceph/ceph-client.admin.128233.log 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116244.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110086.log.gz 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128233.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116244.log.gz 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110040.log 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 /var/log/ceph/ceph-osd.1.log: --verbose -- /var/log/ceph/ceph-client.admin.114207.log 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128233.log.gz 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118997.log 2023-11-24T08:08:16.773 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114207.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110040.log.gz 2023-11-24T08:08:16.773 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.114207.log.gz 2023-11-24T08:08:16.773 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.118997.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118997.log.gz 2023-11-24T08:08:16.773 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127644.log 2023-11-24T08:08:16.773 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109207.log 2023-11-24T08:08:16.773 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127644.log: /var/log/ceph/ceph-client.admin.109207.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127644.log.gz 2023-11-24T08:08:16.773 INFO:teuthology.orchestra.run.smithi153.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109207.log.gz 2023-11-24T08:08:16.773 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111004.log 2023-11-24T08:08:16.773 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128463.log 2023-11-24T08:08:16.774 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115512.log 2023-11-24T08:08:16.774 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128463.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111004.log.gz 2023-11-24T08:08:16.774 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115512.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128463.log.gz 2023-11-24T08:08:16.774 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115512.log.gz 2023-11-24T08:08:16.774 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115066.log 2023-11-24T08:08:16.774 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123047.log 2023-11-24T08:08:16.774 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127138.log 2023-11-24T08:08:16.774 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115066.log.gz 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123047.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123047.log.gz 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115784.log 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116106.log 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115784.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.127138.log.gz 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115784.log.gz 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112683.log 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.121708.log 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.112683.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116106.log.gz 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112683.log.gz 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.121708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121708.log.gz 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121104.log 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126981.log 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121104.log: /var/log/ceph/ceph-client.admin.126981.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.121104.log.gz 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126981.log.gz 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110705.log 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122494.log 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122176.log 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110705.log.gz 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122494.log: /var/log/ceph/ceph-client.admin.122176.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122494.log.gz 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi153.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122176.log.gz 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114023.log 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128325.log 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110770.log 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114023.log.gz 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128325.log: /var/log/ceph/ceph-client.admin.110770.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128325.log.gz 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi153.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110770.log.gz 2023-11-24T08:08:16.778 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121471.log 2023-11-24T08:08:16.778 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109576.log 2023-11-24T08:08:16.778 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121471.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121471.log.gz 2023-11-24T08:08:16.778 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109576.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109576.log.gz 2023-11-24T08:08:16.778 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115204.log 2023-11-24T08:08:16.778 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109292.log 2023-11-24T08:08:16.778 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115204.log: /var/log/ceph/ceph-client.admin.109292.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.115204.log.gz 2023-11-24T08:08:16.778 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109292.log.gz 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125201.log 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122738.log 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125201.log: /var/log/ceph/ceph-client.admin.122738.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125201.log.gz 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi153.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.122738.log.gz 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115600.log 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122448.log 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115600.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115600.log.gz 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122448.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122448.log.gz 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121908.log 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124220.log 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121908.log: /var/log/ceph/ceph-client.admin.124220.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121908.log.gz 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124220.log.gz 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129043.log 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118905.log 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.129043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117536.log 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.118905.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.129043.log.gz 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.118905.log.gz 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117536.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117536.log.gz 2023-11-24T08:08:16.781 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122084.log 2023-11-24T08:08:16.781 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.126173.log 2023-11-24T08:08:16.781 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122084.log: /var/log/ceph/ceph-client.0.126173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.126173.log.gz 2023-11-24T08:08:16.781 INFO:teuthology.orchestra.run.smithi153.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122084.log.gz 2023-11-24T08:08:16.781 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103700.log 2023-11-24T08:08:16.781 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110698.log 2023-11-24T08:08:16.781 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.103700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121263.log 2023-11-24T08:08:16.781 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103700.log.gz 2023-11-24T08:08:16.781 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123736.log 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121263.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110698.log.gz 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123736.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121263.log.gz 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123736.log.gz 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114115.log 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117072.log 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119089.log 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114115.log.gz 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117072.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117072.log.gz 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111717.log 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125452.log 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111717.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.119089.log.gz 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111717.log.gz 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi164.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi164.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-24T08:08:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111069.log 2023-11-24T08:08:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115692.log 2023-11-24T08:08:16.801 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125452.log.gz 2023-11-24T08:08:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111069.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111069.log.gz 2023-11-24T08:08:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115692.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115692.log.gz 2023-11-24T08:08:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128141.log 2023-11-24T08:08:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116604.log 2023-11-24T08:08:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128141.log: /var/log/ceph/ceph-client.admin.116604.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128141.log.gz 2023-11-24T08:08:16.801 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116604.log.gz 2023-11-24T08:08:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110389.log 2023-11-24T08:08:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118951.log 2023-11-24T08:08:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110389.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110389.log.gz 2023-11-24T08:08:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.118951.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118951.log.gz 2023-11-24T08:08:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121814.log 2023-11-24T08:08:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128953.log 2023-11-24T08:08:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121814.log: /var/log/ceph/ceph-client.admin.128953.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121814.log.gz 2023-11-24T08:08:16.802 INFO:teuthology.orchestra.run.smithi153.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.128953.log.gz 2023-11-24T08:08:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109764.log 2023-11-24T08:08:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111073.log 2023-11-24T08:08:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128760.log 2023-11-24T08:08:16.803 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.109764.log.gz 2023-11-24T08:08:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111073.log: /var/log/ceph/ceph-client.admin.128760.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111073.log.gz 2023-11-24T08:08:16.803 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128760.log.gz 2023-11-24T08:08:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118621.log 2023-11-24T08:08:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123187.log 2023-11-24T08:08:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.118621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115922.log 2023-11-24T08:08:16.804 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118621.log.gz 2023-11-24T08:08:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123187.log: /var/log/ceph/ceph-client.admin.115922.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123187.log.gz 2023-11-24T08:08:16.804 INFO:teuthology.orchestra.run.smithi153.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115922.log.gz 2023-11-24T08:08:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110397.log 2023-11-24T08:08:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125636.log 2023-11-24T08:08:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110397.log: /var/log/ceph/ceph-client.admin.125636.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110397.log.gz 2023-11-24T08:08:16.804 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125636.log.gz 2023-11-24T08:08:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109530.log 2023-11-24T08:08:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125293.log 2023-11-24T08:08:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109530.log: /var/log/ceph/ceph-client.admin.125293.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109530.log.gz 2023-11-24T08:08:16.805 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125293.log.gz 2023-11-24T08:08:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126663.log 2023-11-24T08:08:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117928.log 2023-11-24T08:08:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126663.log: /var/log/ceph/ceph-client.admin.117928.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.126663.log.gz 2023-11-24T08:08:16.805 INFO:teuthology.orchestra.run.smithi153.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.117928.log.gz 2023-11-24T08:08:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125339.log 2023-11-24T08:08:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114069.log 2023-11-24T08:08:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125339.log: /var/log/ceph/ceph-client.admin.114069.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125339.log.gz 2023-11-24T08:08:16.806 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114069.log.gz 2023-11-24T08:08:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118561.log 2023-11-24T08:08:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110774.log 2023-11-24T08:08:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.118561.log: /var/log/ceph/ceph-client.admin.110774.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118561.log.gz 2023-11-24T08:08:16.806 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110774.log.gz 2023-11-24T08:08:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127046.log 2023-11-24T08:08:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111763.log 2023-11-24T08:08:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127046.log: /var/log/ceph/ceph-client.admin.111763.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127046.log.gz 2023-11-24T08:08:16.807 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111763.log.gz 2023-11-24T08:08:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128187.log 2023-11-24T08:08:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118384.log 2023-11-24T08:08:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128187.log: /var/log/ceph/ceph-client.admin.118384.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128187.log.gz 2023-11-24T08:08:16.807 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118384.log.gz 2023-11-24T08:08:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118338.log 2023-11-24T08:08:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123257.log 2023-11-24T08:08:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.118338.log: /var/log/ceph/ceph-client.admin.123257.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118338.log.gz 2023-11-24T08:08:16.808 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123257.log.gz 2023-11-24T08:08:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123558.log 2023-11-24T08:08:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118430.log 2023-11-24T08:08:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109672.log 2023-11-24T08:08:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.118430.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123558.log.gz 2023-11-24T08:08:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109672.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.118430.log.gz 2023-11-24T08:08:16.809 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109672.log.gz 2023-11-24T08:08:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120629.log 2023-11-24T08:08:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116152.log 2023-11-24T08:08:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111349.log 2023-11-24T08:08:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116152.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.120629.log.gz 2023-11-24T08:08:16.809 INFO:teuthology.orchestra.run.smithi153.stderr: 88.7%/var/log/ceph/ceph-client.admin.111349.log: -- replaced with /var/log/ceph/ceph-client.admin.116152.log.gz 2023-11-24T08:08:16.809 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111349.log.gz 2023-11-24T08:08:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128095.log 2023-11-24T08:08:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111993.log 2023-11-24T08:08:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128095.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128095.log.gz 2023-11-24T08:08:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111993.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111993.log.gz 2023-11-24T08:08:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113562.log 2023-11-24T08:08:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114299.log 2023-11-24T08:08:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.113562.log: /var/log/ceph/ceph-client.admin.114299.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113562.log.gz 2023-11-24T08:08:16.811 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114299.log.gz 2023-11-24T08:08:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109810.log 2023-11-24T08:08:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109994.log 2023-11-24T08:08:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109810.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109810.log.gz 2023-11-24T08:08:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109994.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109994.log.gz 2023-11-24T08:08:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120675.log 2023-11-24T08:08:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128003.log 2023-11-24T08:08:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120675.log: /var/log/ceph/ceph-client.admin.128003.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120675.log.gz 2023-11-24T08:08:16.812 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128003.log.gz 2023-11-24T08:08:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125728.log 2023-11-24T08:08:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115738.log 2023-11-24T08:08:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125728.log: /var/log/ceph/ceph-client.admin.115738.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.125728.log.gz 2023-11-24T08:08:16.812 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115738.log.gz 2023-11-24T08:08:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122610.log 2023-11-24T08:08:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124874.log 2023-11-24T08:08:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122610.log: /var/log/ceph/ceph-client.admin.124874.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122610.log.gz 2023-11-24T08:08:16.813 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.124874.log.gz 2023-11-24T08:08:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124112.log 2023-11-24T08:08:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113792.log 2023-11-24T08:08:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124112.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124112.log.gz 2023-11-24T08:08:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.113792.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113792.log.gz 2023-11-24T08:08:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109624.log 2023-11-24T08:08:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117674.log 2023-11-24T08:08:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109624.log: /var/log/ceph/ceph-client.admin.117674.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109624.log.gz 2023-11-24T08:08:16.814 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117674.log.gz 2023-11-24T08:08:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-24T08:08:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117444.log 2023-11-24T08:08:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.117444.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117444.log.gz 2023-11-24T08:08:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109856.log 2023-11-24T08:08:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116290.log 2023-11-24T08:08:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109856.log: /var/log/ceph/ceph-client.admin.116290.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109856.log.gz 2023-11-24T08:08:16.815 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116290.log.gz 2023-11-24T08:08:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124020.log 2023-11-24T08:08:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114483.log 2023-11-24T08:08:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124020.log: /var/log/ceph/ceph-client.admin.114483.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124020.log.gz 2023-11-24T08:08:16.815 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114483.log.gz 2023-11-24T08:08:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113930.log 2023-11-24T08:08:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123828.log 2023-11-24T08:08:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.113930.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113930.log.gz 2023-11-24T08:08:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123828.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123828.log.gz 2023-11-24T08:08:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124269.log 2023-11-24T08:08:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121058.log 2023-11-24T08:08:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124269.log: /var/log/ceph/ceph-client.admin.121058.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124269.log.gz 2023-11-24T08:08:16.816 INFO:teuthology.orchestra.run.smithi153.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121058.log.gz 2023-11-24T08:08:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122356.log 2023-11-24T08:08:16.817 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-24T08:08:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128714.log 2023-11-24T08:08:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122356.log: /var/log/ceph/ceph-client.admin.128714.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122356.log.gz 2023-11-24T08:08:16.819 INFO:teuthology.orchestra.run.smithi153.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128714.log.gz 2023-11-24T08:08:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111579.log 2023-11-24T08:08:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110771.log 2023-11-24T08:08:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111579.log: /var/log/ceph/ceph-client.admin.110771.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111579.log.gz 2023-11-24T08:08:16.820 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110771.log.gz 2023-11-24T08:08:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118689.log 2023-11-24T08:08:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111533.log 2023-11-24T08:08:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.118689.log: /var/log/ceph/ceph-client.admin.111533.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118689.log.gz 2023-11-24T08:08:16.820 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111533.log.gz 2023-11-24T08:08:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-24T08:08:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127322.log 2023-11-24T08:08:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.127322.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127322.log.gz 2023-11-24T08:08:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120964.log 2023-11-24T08:08:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120964.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.120964.log.gz 2023-11-24T08:08:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117812.log 2023-11-24T08:08:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117812.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117812.log.gz 2023-11-24T08:08:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127368.log 2023-11-24T08:08:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127368.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.127368.log.gz 2023-11-24T08:08:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122540.log 2023-11-24T08:08:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122540.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.122540.log.gz 2023-11-24T08:08:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115646.log 2023-11-24T08:08:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.115646.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115646.log.gz 2023-11-24T08:08:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117858.log 2023-11-24T08:08:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117858.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.117858.log.gz 2023-11-24T08:08:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.96972.log 2023-11-24T08:08:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.tmp-client.admin.96972.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.96972.log.gz 2023-11-24T08:08:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114886.log 2023-11-24T08:08:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114886.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114886.log.gz 2023-11-24T08:08:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128279.log 2023-11-24T08:08:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128279.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.128279.log.gz 2023-11-24T08:08:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127957.log 2023-11-24T08:08:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127957.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127957.log.gz 2023-11-24T08:08:16.853 INFO:teuthology.orchestra.run.smithi153.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-24T08:08:16.867 INFO:teuthology.orchestra.run.smithi164.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-24T08:08:16.890 INFO:teuthology.orchestra.run.smithi164.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-24T08:08:16.903 INFO:teuthology.orchestra.run.smithi153.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-24T08:08:16.907 INFO:teuthology.orchestra.run.smithi164.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-24T08:08:16.919 INFO:teuthology.orchestra.run.smithi153.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-24T08:08:16.926 INFO:teuthology.orchestra.run.smithi153.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-24T08:08:16.943 INFO:teuthology.orchestra.run.smithi164.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-24T08:08:16.944 INFO:teuthology.orchestra.run.smithi164.stderr: 2023-11-24T08:08:16.945 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m0.301s 2023-11-24T08:08:16.945 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m1.405s 2023-11-24T08:08:16.945 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.067s 2023-11-24T08:08:16.961 INFO:teuthology.orchestra.run.smithi153.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-24T08:08:17.069 INFO:teuthology.orchestra.run.smithi153.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-24T08:08:17.071 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-24T08:08:17.071 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m0.455s 2023-11-24T08:08:17.071 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m1.499s 2023-11-24T08:08:17.072 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m0.259s 2023-11-24T08:08:17.072 INFO:tasks.ceph:Archiving logs... 2023-11-24T08:08:17.072 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584/remote/smithi153/log 2023-11-24T08:08:17.073 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T08:08:17.639 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584/remote/smithi164/log 2023-11-24T08:08:17.640 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T08:08:17.862 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-24T08:08:17.881 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-24T08:08:17.882 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T08:08:17.884 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T08:08:17.971 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-24T08:08:17.986 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-24T08:08:17.987 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:08:17.989 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:08:18.003 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2023-11-24T08:08:18.005 INFO:teuthology.orchestra.run.smithi164.stderr:bash: ntpq: command not found 2023-11-24T08:08:18.008 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T08:08:18.008 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-11-24T08:08:18.008 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 42 +2450us[+2450us] +/- 78ms 2023-11-24T08:08:18.009 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 6 377 44 -856us[ -872us] +/- 55ms 2023-11-24T08:08:18.009 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -1324us[-1324us] +/- 83ms 2023-11-24T08:08:18.009 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:08:18.010 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T08:08:18.010 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2023-11-24T08:08:18.011 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 43 +2472us[+2470us] +/- 78ms 2023-11-24T08:08:18.011 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv02.front.sepia.ceph.com 3 6 377 43 -830us[ -832us] +/- 55ms 2023-11-24T08:08:18.011 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 -1321us[-1321us] +/- 83ms 2023-11-24T08:08:18.011 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:08:18.011 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-24T08:08:18.024 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-24T08:08:18.024 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-24T08:08:18.040 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T08:08:18.151 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T08:08:18.245 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T08:08:18.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:08:18.278 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T08:08:18.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:08:18.310 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-24T08:08:18.323 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-24T08:08:18.339 INFO:teuthology.task.internal:Duration was 973.704801 seconds 2023-11-24T08:08:18.339 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-24T08:08:18.354 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-24T08:08:18.355 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T08:08:18.357 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T08:08:18.401 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T08:08:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T08:08:18.627 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-24T08:08:18.627 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2023-11-24T08:08:18.627 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T08:08:18.648 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2023-11-24T08:08:18.648 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T08:08:18.670 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-24T08:08:18.671 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T08:08:18.691 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T08:08:18.751 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-24T08:08:18.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T08:08:18.776 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T08:08:18.875 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-24T08:08:18.888 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-24T08:08:18.889 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T08:08:18.915 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T08:08:18.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-24T08:08:18.955 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:08:18.958 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:08:18.981 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2023-11-24T08:08:18.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-24T08:08:18.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-24T08:08:18.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-24T08:08:18.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-24T08:08:18.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-11-24T08:08:18.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-24T08:08:18.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-24T08:08:18.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-11-24T08:08:18.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-11-24T08:08:18.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-11-24T08:08:19.008 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2023-11-24T08:08:19.022 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:08:19.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:08:19.052 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:08:19.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:08:19.079 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-24T08:08:19.094 INFO:teuthology.task.internal:Transferring archived files... 2023-11-24T08:08:19.095 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584/remote/smithi153 2023-11-24T08:08:19.095 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T08:08:19.139 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584/remote/smithi164 2023-11-24T08:08:19.139 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T08:08:19.177 INFO:teuthology.task.internal:Removing archive directory... 2023-11-24T08:08:19.177 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T08:08:19.180 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T08:08:19.228 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-24T08:08:19.241 INFO:teuthology.task.internal:Not uploading archives. 2023-11-24T08:08:19.241 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-24T08:08:19.260 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-24T08:08:19.260 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T08:08:19.263 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T08:08:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 08:08 /home/ubuntu/cephtest 2023-11-24T08:08:19.285 INFO:teuthology.orchestra.run.smithi164.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 08:08 /home/ubuntu/cephtest 2023-11-24T08:08:19.286 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-24T08:08:19.307 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-24T08:08:19.341 INFO:teuthology.nuke:Checking targets against current locks 2023-11-24T08:08:19.368 DEBUG:teuthology.nuke:shortname: smithi153 2023-11-24T08:08:19.368 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T08:08:19.394 DEBUG:teuthology.nuke:shortname: smithi164 2023-11-24T08:08:19.394 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T08:08:19.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:46:28.729235', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-24T08:08:19.422 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:46:28.727264', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-24T08:08:19.444 INFO:teuthology.orchestra.console.smithi153:Power off 2023-11-24T08:08:19.445 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T08:08:19.469 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-11-24T08:08:19.469 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:19.484 INFO:teuthology.orchestra.console.smithi164:Power off 2023-11-24T08:08:19.484 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T08:08:19.495 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-11-24T08:08:19.507 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-11-24T08:08:19.508 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:19.531 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-11-24T08:08:23.495 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:23.533 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:23.606 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-11-24T08:08:23.643 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-11-24T08:08:27.610 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:27.645 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:27.722 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-11-24T08:08:27.755 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-11-24T08:08:31.726 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:31.756 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:31.836 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-11-24T08:08:31.866 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-11-24T08:08:31.938 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-11-24T08:08:31.967 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-11-24T08:08:32.072 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} duration: 973.7048010826111 failure_reason: 'Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5720a0285baf47d9bb6cf0d4bdb57aa4 status: fail success: false 2023-11-24T08:08:32.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T08:08:32.155 INFO:teuthology.run:FAIL